babel/old/babel-test: scripts/import

annotate scripts/import_cldr.py @ 239:4afe02d81083

Again, properly implement week-in-year (#46).

author	cmlenz
date	Tue, 07 Aug 2007 17:17:28 +0000
parents	bc22f5aef216
children	64d340f76701

rev	line source
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	1 #!/usr/bin/env python
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	2 # -- coding: utf-8 --
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	3 #
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	4 # Copyright (C) 2007 Edgewall Software
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	5 # All rights reserved.
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	6 #
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	7 # This software is licensed as described in the file COPYING, which
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	8 # you should have received as part of this distribution. The terms
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	9 # are also available at http://babel.edgewall.org/wiki/License.
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	10 #
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	11 # This software consists of voluntary contributions made by many
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	12 # individuals. For the exact contribution history, see the revision
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	13 # history and logs, available at http://babel.edgewall.org/log/.
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	14
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	15 import copy
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	16 from optparse import OptionParser
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	17 import os
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	18 import pickle
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	19 import sys
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	20 try:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	21 from xml.etree.ElementTree import parse
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	22 except ImportError:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	23 from elementtree.ElementTree import parse
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	24
65 7478d663561f Add Babel soruce path to CLDR import script automatically for asmodai ;-). cmlenz parents: 34 diff changeset	25 # Make sure we're using Babel source, and not some previously installed version
7478d663561f Add Babel soruce path to CLDR import script automatically for asmodai ;-). cmlenz parents: 34 diff changeset	26 sys.path.insert(0, os.path.join(os.path.dirname(sys.argv[0]), '..'))
7478d663561f Add Babel soruce path to CLDR import script automatically for asmodai ;-). cmlenz parents: 34 diff changeset	27
9 3be73c6f01f1 Add basic support for number format patterns. jonas parents: 8 diff changeset	28 from babel import dates, numbers
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	29
15 76985c08a339 Minor date formatting improvements. cmlenz parents: 13 diff changeset	30 weekdays = {'mon': 0, 'tue': 1, 'wed': 2, 'thu': 3, 'fri': 4, 'sat': 5,
76985c08a339 Minor date formatting improvements. cmlenz parents: 13 diff changeset	31 'sun': 6}
8 9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	32
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	33 try:
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	34 any
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	35 except NameError:
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	36 def any(iterable):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	37 return filter(None, list(iterable))
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	38
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	39 def _text(elem):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	40 buf = [elem.text or '']
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	41 for child in elem:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	42 buf.append(_text(child))
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	43 buf.append(elem.tail or '')
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	44 return u''.join(filter(None, buf)).strip()
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	45
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	46 def main():
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	47 parser = OptionParser(usage='%prog path/to/cldr')
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	48 options, args = parser.parse_args()
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	49 if len(args) != 1:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	50 parser.error('incorrect number of arguments')
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	51
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	52 srcdir = args[0]
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	53 destdir = os.path.join(os.path.dirname(os.path.abspath(sys.argv[0])),
233 bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	54 '..', 'babel')
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	55
8 9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	56 sup = parse(os.path.join(srcdir, 'supplemental', 'supplementalData.xml'))
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	57
233 bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	58 # import global data from the supplemental files
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	59 global_data = {}
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	60
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	61 territory_zones = global_data.setdefault('territory_zones', {})
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	62 zone_aliases = global_data.setdefault('zone_aliases', {})
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	63 zone_territories = global_data.setdefault('zone_territories', {})
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	64 for elem in sup.findall('//timezoneData/zoneFormatting/zoneItem'):
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	65 tzid = elem.attrib['type']
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	66 territory_zones.setdefault(elem.attrib['territory'], []).append(tzid)
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	67 zone_territories[tzid] = elem.attrib['territory']
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	68 if 'aliases' in elem.attrib:
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	69 for alias in elem.attrib['aliases'].split():
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	70 zone_aliases[alias] = tzid
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	71
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	72 outfile = open(os.path.join(destdir, 'global.dat'), 'wb')
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	73 try:
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	74 pickle.dump(global_data, outfile, 2)
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	75 finally:
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	76 outfile.close()
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	77
8 9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	78 # build a territory containment mapping for inheritance
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	79 regions = {}
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	80 for elem in sup.findall('//territoryContainment/group'):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	81 regions[elem.attrib['type']] = elem.attrib['contains'].split()
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	82
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	83 # Resolve territory containment
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	84 territory_containment = {}
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	85 region_items = regions.items()
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	86 region_items.sort()
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	87 for group, territory_list in region_items:
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	88 for territory in territory_list:
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	89 containers = territory_containment.setdefault(territory, set([]))
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	90 if group in territory_containment:
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	91 containers \|= territory_containment[group]
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	92 containers.add(group)
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	93
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	94 filenames = os.listdir(os.path.join(srcdir, 'main'))
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	95 filenames.remove('root.xml')
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	96 filenames.sort(lambda a,b: len(a)-len(b))
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	97 filenames.insert(0, 'root.xml')
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	98
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	99 for filename in filenames:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	100 print>>sys.stderr, 'Processing input file %r' % filename
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	101 stem, ext = os.path.splitext(filename)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	102 if ext != '.xml':
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	103 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	104
26 710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	105 tree = parse(os.path.join(srcdir, 'main', filename))
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	106 data = {}
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	107
8 9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	108 language = None
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	109 elem = tree.find('//identity/language')
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	110 if elem is not None:
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	111 language = elem.attrib['type']
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	112 print>>sys.stderr, ' Language: %r' % language
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	113
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	114 territory = None
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	115 elem = tree.find('//identity/territory')
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	116 if elem is not None:
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	117 territory = elem.attrib['type']
13 b6c0de43fa40 Extended and documented `LazyProxy`. cmlenz parents: 9 diff changeset	118 else:
b6c0de43fa40 Extended and documented `LazyProxy`. cmlenz parents: 9 diff changeset	119 territory = '001' # world
8 9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	120 print>>sys.stderr, ' Territory: %r' % territory
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	121 regions = territory_containment.get(territory, [])
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	122 print>>sys.stderr, ' Regions: %r' % regions
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	123
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	124 # <localeDisplayNames>
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	125
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	126 territories = data.setdefault('territories', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	127 for elem in tree.findall('//territories/territory'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	128 if 'draft' in elem.attrib and elem.attrib['type'] in territories:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	129 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	130 territories[elem.attrib['type']] = _text(elem)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	131
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	132 languages = data.setdefault('languages', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	133 for elem in tree.findall('//languages/language'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	134 if 'draft' in elem.attrib and elem.attrib['type'] in languages:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	135 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	136 languages[elem.attrib['type']] = _text(elem)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	137
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	138 variants = data.setdefault('variants', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	139 for elem in tree.findall('//variants/variant'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	140 if 'draft' in elem.attrib and elem.attrib['type'] in variants:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	141 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	142 variants[elem.attrib['type']] = _text(elem)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	143
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	144 scripts = data.setdefault('scripts', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	145 for elem in tree.findall('//scripts/script'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	146 if 'draft' in elem.attrib and elem.attrib['type'] in scripts:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	147 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	148 scripts[elem.attrib['type']] = _text(elem)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	149
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	150 # <dates>
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	151
8 9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	152 week_data = data.setdefault('week_data', {})
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	153 supelem = sup.find('//weekData')
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	154
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	155 for elem in supelem.findall('minDays'):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	156 territories = elem.attrib['territories'].split()
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	157 if territory in territories or any([r in territories for r in regions]):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	158 week_data['min_days'] = int(elem.attrib['count'])
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	159
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	160 for elem in supelem.findall('firstDay'):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	161 territories = elem.attrib['territories'].split()
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	162 if territory in territories or any([r in territories for r in regions]):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	163 week_data['first_day'] = weekdays[elem.attrib['day']]
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	164
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	165 for elem in supelem.findall('weekendStart'):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	166 territories = elem.attrib['territories'].split()
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	167 if territory in territories or any([r in territories for r in regions]):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	168 week_data['weekend_start'] = weekdays[elem.attrib['day']]
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	169
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	170 for elem in supelem.findall('weekendEnd'):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	171 territories = elem.attrib['territories'].split()
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	172 if territory in territories or any([r in territories for r in regions]):
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	173 week_data['weekend_end'] = weekdays[elem.attrib['day']]
9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	174
233 bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	175 zone_formats = data.setdefault('zone_formats', {})
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	176 for elem in tree.findall('//timeZoneNames/gmtFormat'):
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	177 if 'draft' not in elem.attrib:
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	178 zone_formats['gmt'] = unicode(elem.text).replace('{0}', '%s')
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	179 break
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	180 for elem in tree.findall('//timeZoneNames/regionFormat'):
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	181 if 'draft' not in elem.attrib:
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	182 zone_formats['region'] = unicode(elem.text).replace('{0}', '%s')
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	183 break
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	184 for elem in tree.findall('//timeZoneNames/fallbackFormat'):
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	185 if 'draft' not in elem.attrib:
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	186 zone_formats['fallback'] = unicode(elem.text) \
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	187 .replace('{0}', '%(0)s').replace('{1}', '%(1)s')
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	188 break
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	189
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	190 time_zones = data.setdefault('time_zones', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	191 for elem in tree.findall('//timeZoneNames/zone'):
28 11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	192 info = {}
11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	193 city = elem.findtext('exemplarCity')
11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	194 if city:
11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	195 info['city'] = unicode(city)
11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	196 for child in elem.findall('long/*'):
11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	197 info.setdefault('long', {})[child.tag] = unicode(child.text)
11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	198 for child in elem.findall('short/*'):
11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	199 info.setdefault('short', {})[child.tag] = unicode(child.text)
233 bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	200 for child in elem.findall('usesMetazone'):
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	201 if 'to' not in child.attrib: # FIXME: support old mappings
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	202 info['use_metazone'] = child.attrib['mzone']
28 11278622ede9 Import basic timezone info from CLDR (see #3). Still missing a couple other pieces in the puzzle. cmlenz parents: 26 diff changeset	203 time_zones[elem.attrib['type']] = info
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	204
233 bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	205 meta_zones = data.setdefault('meta_zones', {})
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	206 for elem in tree.findall('//timeZoneNames/metazone'):
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	207 info = {}
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	208 city = elem.findtext('exemplarCity')
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	209 if city:
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	210 info['city'] = unicode(city)
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	211 for child in elem.findall('long/*'):
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	212 info.setdefault('long', {})[child.tag] = unicode(child.text)
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	213 for child in elem.findall('short/*'):
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	214 info.setdefault('short', {})[child.tag] = unicode(child.text)
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	215 info['common'] = elem.findtext('commonlyUsed') == 'true'
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	216 meta_zones[elem.attrib['type']] = info
34 3666f3d3df15 Extended time-zone support. cmlenz parents: 33 diff changeset	217
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	218 for calendar in tree.findall('//calendars/calendar'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	219 if calendar.attrib['type'] != 'gregorian':
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	220 # TODO: support other calendar types
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	221 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	222
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	223 months = data.setdefault('months', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	224 for ctxt in calendar.findall('months/monthContext'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	225 ctxts = months.setdefault(ctxt.attrib['type'], {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	226 for width in ctxt.findall('monthWidth'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	227 widths = ctxts.setdefault(width.attrib['type'], {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	228 for elem in width.findall('month'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	229 if 'draft' in elem.attrib and int(elem.attrib['type']) in widths:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	230 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	231 widths[int(elem.attrib.get('type'))] = unicode(elem.text)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	232
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	233 days = data.setdefault('days', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	234 for ctxt in calendar.findall('days/dayContext'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	235 ctxts = days.setdefault(ctxt.attrib['type'], {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	236 for width in ctxt.findall('dayWidth'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	237 widths = ctxts.setdefault(width.attrib['type'], {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	238 for elem in width.findall('day'):
8 9132c9218745 Pull in some supplemental data from the CLDR, for things like the first day of the week. cmlenz parents: 1 diff changeset	239 dtype = weekdays[elem.attrib['type']]
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	240 if 'draft' in elem.attrib and dtype in widths:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	241 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	242 widths[dtype] = unicode(elem.text)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	243
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	244 quarters = data.setdefault('quarters', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	245 for ctxt in calendar.findall('quarters/quarterContext'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	246 ctxts = quarters.setdefault(ctxt.attrib['type'], {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	247 for width in ctxt.findall('quarterWidth'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	248 widths = ctxts.setdefault(width.attrib['type'], {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	249 for elem in width.findall('quarter'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	250 if 'draft' in elem.attrib and int(elem.attrib['type']) in widths:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	251 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	252 widths[int(elem.attrib.get('type'))] = unicode(elem.text)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	253
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	254 eras = data.setdefault('eras', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	255 for width in calendar.findall('eras/*'):
233 bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	256 ewidth = {
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	257 'eraAbbr': 'abbreviated',
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	258 'eraNames': 'wide',
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	259 'eraNarrow': 'narrow',
bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	260 }[width.tag]
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	261 widths = eras.setdefault(ewidth, {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	262 for elem in width.findall('era'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	263 if 'draft' in elem.attrib and int(elem.attrib['type']) in widths:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	264 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	265 widths[int(elem.attrib.get('type'))] = unicode(elem.text)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	266
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	267 # AM/PM
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	268 periods = data.setdefault('periods', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	269 for elem in calendar.findall('am'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	270 if 'draft' in elem.attrib and elem.tag in periods:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	271 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	272 periods[elem.tag] = unicode(elem.text)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	273 for elem in calendar.findall('pm'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	274 if 'draft' in elem.attrib and elem.tag in periods:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	275 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	276 periods[elem.tag] = unicode(elem.text)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	277
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	278 date_formats = data.setdefault('date_formats', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	279 for elem in calendar.findall('dateFormats/dateFormatLength'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	280 if 'draft' in elem.attrib and elem.attrib.get('type') in date_formats:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	281 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	282 try:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	283 date_formats[elem.attrib.get('type')] = \
9 3be73c6f01f1 Add basic support for number format patterns. jonas parents: 8 diff changeset	284 dates.parse_pattern(unicode(elem.findtext('dateFormat/pattern')))
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	285 except ValueError, e:
26 710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	286 print>>sys.stderr, 'ERROR: %s' % e
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	287
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	288 time_formats = data.setdefault('time_formats', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	289 for elem in calendar.findall('timeFormats/timeFormatLength'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	290 if 'draft' in elem.attrib and elem.attrib.get('type') in time_formats:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	291 continue
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	292 try:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	293 time_formats[elem.attrib.get('type')] = \
9 3be73c6f01f1 Add basic support for number format patterns. jonas parents: 8 diff changeset	294 dates.parse_pattern(unicode(elem.findtext('timeFormat/pattern')))
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	295 except ValueError, e:
26 710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	296 print>>sys.stderr, 'ERROR: %s' % e
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	297
33 0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	298 datetime_formats = data.setdefault('datetime_formats', {})
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	299 for elem in calendar.findall('dateTimeFormats/dateTimeFormatLength'):
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	300 if 'draft' in elem.attrib and elem.attrib.get('type') in datetime_formats:
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	301 continue
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	302 try:
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	303 datetime_formats[elem.attrib.get('type')] = \
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	304 unicode(elem.findtext('dateTimeFormat/pattern'))
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	305 except ValueError, e:
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	306 print>>sys.stderr, 'ERROR: %s' % e
0740b6d31799 * Import datetime patterns from CLDR. cmlenz parents: 28 diff changeset	307
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	308 # <numbers>
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	309
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	310 number_symbols = data.setdefault('number_symbols', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	311 for elem in tree.findall('//numbers/symbols/*'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	312 number_symbols[elem.tag] = unicode(elem.text)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	313
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	314 decimal_formats = data.setdefault('decimal_formats', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	315 for elem in tree.findall('//decimalFormats/decimalFormatLength'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	316 if 'draft' in elem.attrib and elem.attrib.get('type') in decimal_formats:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	317 continue
26 710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	318 pattern = unicode(elem.findtext('decimalFormat/pattern'))
710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	319 decimal_formats[elem.attrib.get('type')] = numbers.parse_pattern(pattern)
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	320
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	321 scientific_formats = data.setdefault('scientific_formats', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	322 for elem in tree.findall('//scientificFormats/scientificFormatLength'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	323 if 'draft' in elem.attrib and elem.attrib.get('type') in scientific_formats:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	324 continue
125 b75ae5def3b1 Add currency formatting. cmlenz parents: 65 diff changeset	325 pattern = unicode(elem.findtext('scientificFormat/pattern'))
b75ae5def3b1 Add currency formatting. cmlenz parents: 65 diff changeset	326 scientific_formats[elem.attrib.get('type')] = numbers.parse_pattern(pattern)
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	327
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	328 currency_formats = data.setdefault('currency_formats', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	329 for elem in tree.findall('//currencyFormats/currencyFormatLength'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	330 if 'draft' in elem.attrib and elem.attrib.get('type') in currency_formats:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	331 continue
125 b75ae5def3b1 Add currency formatting. cmlenz parents: 65 diff changeset	332 pattern = unicode(elem.findtext('currencyFormat/pattern'))
b75ae5def3b1 Add currency formatting. cmlenz parents: 65 diff changeset	333 currency_formats[elem.attrib.get('type')] = numbers.parse_pattern(pattern)
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	334
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	335 percent_formats = data.setdefault('percent_formats', {})
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	336 for elem in tree.findall('//percentFormats/percentFormatLength'):
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	337 if 'draft' in elem.attrib and elem.attrib.get('type') in percent_formats:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	338 continue
26 710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	339 pattern = unicode(elem.findtext('percentFormat/pattern'))
710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	340 percent_formats[elem.attrib.get('type')] = numbers.parse_pattern(pattern)
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	341
26 710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	342 currency_names = data.setdefault('currency_names', {})
710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	343 currency_symbols = data.setdefault('currency_symbols', {})
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	344 for elem in tree.findall('//currencies/currency'):
26 710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	345 name = elem.findtext('displayName')
710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	346 if name:
710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	347 currency_names[elem.attrib['type']] = unicode(name)
710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	348 symbol = elem.findtext('symbol')
710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	349 if symbol:
710090104678 * Reduce size of locale data pickles by only storing the data provided by each locale itself, and merging inherited data at runtime. cmlenz parents: 22 diff changeset	350 currency_symbols[elem.attrib['type']] = unicode(symbol)
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	351
233 bc22f5aef216 Upgraded to CLDR 1.5 and improved timezone formatting. cmlenz parents: 125 diff changeset	352 outfile = open(os.path.join(destdir, 'localedata', stem + '.dat'), 'wb')
1 f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	353 try:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	354 pickle.dump(data, outfile, 2)
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	355 finally:
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	356 outfile.close()
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	357
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	358 if __name__ == '__main__':
f71ca60f2a4a Import of initial code base. cmlenz parents: diff changeset	359 main()

Mercurial > babel > old > babel-test

annotate scripts/import_cldr.py @ 239:4afe02d81083