Mercurial > babel > old > babel-test
annotate babel/messages/catalog.py @ 225:3703ded648ab
Applied patch by Ramiro Morales for more extensive detection of Python string formatting specifiers. Closes #57.
author | cmlenz |
---|---|
date | Fri, 20 Jul 2007 12:52:40 +0000 |
parents | 677147547e2d |
children | 236a640d02a6 |
rev | line source |
---|---|
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
1 # -*- coding: utf-8 -*- |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
2 # |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
3 # Copyright (C) 2007 Edgewall Software |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
4 # All rights reserved. |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
5 # |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
6 # This software is licensed as described in the file COPYING, which |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
7 # you should have received as part of this distribution. The terms |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
8 # are also available at http://babel.edgewall.org/wiki/License. |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
9 # |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
10 # This software consists of voluntary contributions made by many |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
11 # individuals. For the exact contribution history, see the revision |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
12 # history and logs, available at http://babel.edgewall.org/log/. |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
13 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
14 """Data structures for message catalogs.""" |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
15 |
149
ba5150e9544e
Respect charset specified in PO headers in `read_po()`. Fixes #17.
cmlenz
parents:
131
diff
changeset
|
16 from cgi import parse_header |
67 | 17 from datetime import datetime |
165
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
18 from difflib import get_close_matches |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
19 from email import message_from_string |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
20 import re |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
21 try: |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
22 set |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
23 except NameError: |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
24 from sets import Set as set |
67 | 25 import time |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
26 |
67 | 27 from babel import __version__ as VERSION |
64 | 28 from babel.core import Locale |
131
a63812008056
Use `dates.format_datetime` for dates in PO(T) header, as `datetime.strftime` produces wrong results on windows.
cmlenz
parents:
121
diff
changeset
|
29 from babel.dates import format_datetime |
67 | 30 from babel.messages.plurals import PLURALS |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
31 from babel.util import odict, LOCALTZ, UTC, FixedOffsetTimezone |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
32 |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
33 __all__ = ['Message', 'Catalog', 'TranslationError'] |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
34 __docformat__ = 'restructuredtext en' |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
35 |
225
3703ded648ab
Applied patch by Ramiro Morales for more extensive detection of Python string formatting specifiers. Closes #57.
cmlenz
parents:
220
diff
changeset
|
36 PYTHON_FORMAT = re.compile(r'\%(\([\w]+\))?([-#0\ +])?(\*|[\d]+)?(\.(\*|[\d]+))?([hlL])?[diouxXeEfFgGcrs]') |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
37 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
38 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
39 class Message(object): |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
40 """Representation of a single message in a catalog.""" |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
41 |
149
ba5150e9544e
Respect charset specified in PO headers in `read_po()`. Fixes #17.
cmlenz
parents:
131
diff
changeset
|
42 def __init__(self, id, string=u'', locations=(), flags=(), auto_comments=(), |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
43 user_comments=(), previous_id=(), lineno=None): |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
44 """Create the message object. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
45 |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
46 :param id: the message ID, or a ``(singular, plural)`` tuple for |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
47 pluralizable messages |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
48 :param string: the translated message string, or a |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
49 ``(singular, plural)`` tuple for pluralizable messages |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
50 :param locations: a sequence of ``(filenname, lineno)`` tuples |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
51 :param flags: a set or sequence of flags |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
52 :param auto_comments: a sequence of automatic comments for the message |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
53 :param user_comments: a sequence of user comments for the message |
203 | 54 :param previous_id: the previous message ID, or a ``(singular, plural)`` |
55 tuple for pluralizable messages | |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
56 :param lineno: the line number on which the msgid line was found in the |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
57 PO file, if any |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
58 """ |
107 | 59 self.id = id #: The message ID |
68 | 60 if not string and self.pluralizable: |
61 string = (u'', u'') | |
107 | 62 self.string = string #: The message translation |
70
2b0e18a04856
Fix for mixed singular/plural messages, follow-up to [70].
cmlenz
parents:
69
diff
changeset
|
63 self.locations = list(locations) |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
64 self.flags = set(flags) |
67 | 65 if id and self.python_format: |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
66 self.flags.add('python-format') |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
67 else: |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
68 self.flags.discard('python-format') |
105
f744dd56573d
`Message`, `read_po` and `write_po` now all handle user/auto comments correctly.
palgarvio
parents:
104
diff
changeset
|
69 self.auto_comments = list(auto_comments) |
f744dd56573d
`Message`, `read_po` and `write_po` now all handle user/auto comments correctly.
palgarvio
parents:
104
diff
changeset
|
70 self.user_comments = list(user_comments) |
203 | 71 if isinstance(previous_id, basestring): |
72 self.previous_id = [previous_id] | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
73 else: |
203 | 74 self.previous_id = list(previous_id) |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
75 self.lineno = lineno |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
76 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
77 def __repr__(self): |
196
93a922d31eca
Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit.
cmlenz
parents:
188
diff
changeset
|
78 return '<%s %r (flags: %r)>' % (type(self).__name__, self.id, |
93a922d31eca
Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit.
cmlenz
parents:
188
diff
changeset
|
79 list(self.flags)) |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
80 |
67 | 81 def fuzzy(self): |
82 return 'fuzzy' in self.flags | |
83 fuzzy = property(fuzzy, doc="""\ | |
84 Whether the translation is fuzzy. | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
85 |
67 | 86 >>> Message('foo').fuzzy |
87 False | |
175
3c4718fb7435
Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing).
palgarvio
parents:
165
diff
changeset
|
88 >>> msg = Message('foo', 'foo', flags=['fuzzy']) |
3c4718fb7435
Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing).
palgarvio
parents:
165
diff
changeset
|
89 >>> msg.fuzzy |
67 | 90 True |
175
3c4718fb7435
Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing).
palgarvio
parents:
165
diff
changeset
|
91 >>> msg |
196
93a922d31eca
Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit.
cmlenz
parents:
188
diff
changeset
|
92 <Message 'foo' (flags: ['fuzzy'])> |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
93 |
67 | 94 :type: `bool` |
95 """) | |
96 | |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
97 def pluralizable(self): |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
98 return isinstance(self.id, (list, tuple)) |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
99 pluralizable = property(pluralizable, doc="""\ |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
100 Whether the message is plurizable. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
101 |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
102 >>> Message('foo').pluralizable |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
103 False |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
104 >>> Message(('foo', 'bar')).pluralizable |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
105 True |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
106 |
61
da7efa40a9e2
Move `Translations` and `LazyProxy` to new `babel.support` module, which should contain any convenience code that is useful for applications using Babel/I18n, but not used by Babel itself.
cmlenz
parents:
56
diff
changeset
|
107 :type: `bool` |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
108 """) |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
109 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
110 def python_format(self): |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
111 ids = self.id |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
112 if not isinstance(ids, (list, tuple)): |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
113 ids = [ids] |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
114 return bool(filter(None, [PYTHON_FORMAT.search(id) for id in ids])) |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
115 python_format = property(python_format, doc="""\ |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
116 Whether the message contains Python-style parameters. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
117 |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
118 >>> Message('foo %(name)s bar').python_format |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
119 True |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
120 >>> Message(('foo %(name)s', 'foo %(name)s')).python_format |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
121 True |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
122 |
61
da7efa40a9e2
Move `Translations` and `LazyProxy` to new `babel.support` module, which should contain any convenience code that is useful for applications using Babel/I18n, but not used by Babel itself.
cmlenz
parents:
56
diff
changeset
|
123 :type: `bool` |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
124 """) |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
125 |
105
f744dd56573d
`Message`, `read_po` and `write_po` now all handle user/auto comments correctly.
palgarvio
parents:
104
diff
changeset
|
126 |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
127 class TranslationError(Exception): |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
128 """Exception thrown by translation checkers when invalid message |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
129 translations are encountered.""" |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
130 |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
131 |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
132 DEFAULT_HEADER = u"""\ |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
133 # Translations template for PROJECT. |
120 | 134 # Copyright (C) YEAR ORGANIZATION |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
135 # This file is distributed under the same license as the PROJECT project. |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
136 # FIRST AUTHOR <EMAIL@ADDRESS>, YEAR. |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
137 #""" |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
138 |
196
93a922d31eca
Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit.
cmlenz
parents:
188
diff
changeset
|
139 |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
140 class Catalog(object): |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
141 """Representation of a message catalog.""" |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
142 |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
143 def __init__(self, locale=None, domain=None, header_comment=DEFAULT_HEADER, |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
144 project=None, version=None, copyright_holder=None, |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
145 msgid_bugs_address=None, creation_date=None, |
206
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
146 revision_date=None, last_translator=None, language_team=None, |
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
147 charset='utf-8', fuzzy=True): |
64 | 148 """Initialize the catalog object. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
149 |
64 | 150 :param locale: the locale identifier or `Locale` object, or `None` |
151 if the catalog is not bound to a locale (which basically | |
152 means it's a template) | |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
153 :param domain: the message domain |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
154 :param header_comment: the header comment as string, or `None` for the |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
155 default header |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
156 :param project: the project's name |
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
157 :param version: the project's version |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
158 :param copyright_holder: the copyright holder of the catalog |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
159 :param msgid_bugs_address: the email address or URL to submit bug |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
160 reports to |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
161 :param creation_date: the date the catalog was created |
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
162 :param revision_date: the date the catalog was revised |
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
163 :param last_translator: the name and email of the last translator |
206
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
164 :param language_team: the name and email of the language team |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
165 :param charset: the encoding to use in the output |
175
3c4718fb7435
Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing).
palgarvio
parents:
165
diff
changeset
|
166 :param fuzzy: the fuzzy bit on the catalog header |
64 | 167 """ |
107 | 168 self.domain = domain #: The message domain |
64 | 169 if locale: |
170 locale = Locale.parse(locale) | |
107 | 171 self.locale = locale #: The locale or `None` |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
172 self._header_comment = header_comment |
67 | 173 self._messages = odict() |
174 | |
107 | 175 self.project = project or 'PROJECT' #: The project name |
176 self.version = version or 'VERSION' #: The project version | |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
177 self.copyright_holder = copyright_holder or 'ORGANIZATION' |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
178 self.msgid_bugs_address = msgid_bugs_address or 'EMAIL@ADDRESS' |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
179 |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
180 self.last_translator = last_translator or 'FULL NAME <EMAIL@ADDRESS>' |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
181 """Name and email address of the last translator.""" |
206
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
182 self.language_team = language_team or 'LANGUAGE <LL@li.org>' |
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
183 """Name and email address of the language team.""" |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
184 |
95
008cd3f7d485
Fix for #11 (use local timezone in timestamps of generated POT).
cmlenz
parents:
87
diff
changeset
|
185 self.charset = charset or 'utf-8' |
84
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
186 |
67 | 187 if creation_date is None: |
97 | 188 creation_date = datetime.now(LOCALTZ) |
95
008cd3f7d485
Fix for #11 (use local timezone in timestamps of generated POT).
cmlenz
parents:
87
diff
changeset
|
189 elif isinstance(creation_date, datetime) and not creation_date.tzinfo: |
97 | 190 creation_date = creation_date.replace(tzinfo=LOCALTZ) |
107 | 191 self.creation_date = creation_date #: Creation date of the template |
67 | 192 if revision_date is None: |
97 | 193 revision_date = datetime.now(LOCALTZ) |
95
008cd3f7d485
Fix for #11 (use local timezone in timestamps of generated POT).
cmlenz
parents:
87
diff
changeset
|
194 elif isinstance(revision_date, datetime) and not revision_date.tzinfo: |
97 | 195 revision_date = revision_date.replace(tzinfo=LOCALTZ) |
107 | 196 self.revision_date = revision_date #: Last revision date of the catalog |
181
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
197 self.fuzzy = fuzzy #: Catalog header fuzzy bit (`True` or `False`) |
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
198 |
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
199 self.obsolete = odict() #: Dictionary of obsolete messages |
67 | 200 |
107 | 201 def _get_header_comment(self): |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
202 comment = self._header_comment |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
203 comment = comment.replace('PROJECT', self.project) \ |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
204 .replace('VERSION', self.version) \ |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
205 .replace('YEAR', self.revision_date.strftime('%Y')) \ |
120 | 206 .replace('ORGANIZATION', self.copyright_holder) |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
207 if self.locale: |
107 | 208 comment = comment.replace('Translations template', '%s translations' |
209 % self.locale.english_name) | |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
210 return comment |
120 | 211 |
107 | 212 def _set_header_comment(self, string): |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
213 self._header_comment = string |
107 | 214 |
215 header_comment = property(_get_header_comment, _set_header_comment, doc="""\ | |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
216 The header comment for the catalog. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
217 |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
218 >>> catalog = Catalog(project='Foobar', version='1.0', |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
219 ... copyright_holder='Foo Company') |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
220 >>> print catalog.header_comment |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
221 # Translations template for Foobar. |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
222 # Copyright (C) 2007 Foo Company |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
223 # This file is distributed under the same license as the Foobar project. |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
224 # FIRST AUTHOR <EMAIL@ADDRESS>, 2007. |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
225 # |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
226 |
120 | 227 The header can also be set from a string. Any known upper-case variables |
228 will be replaced when the header is retrieved again: | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
229 |
120 | 230 >>> catalog = Catalog(project='Foobar', version='1.0', |
231 ... copyright_holder='Foo Company') | |
232 >>> catalog.header_comment = '''\\ | |
233 ... # The POT for my really cool PROJECT project. | |
234 ... # Copyright (C) 1990-2003 ORGANIZATION | |
235 ... # This file is distributed under the same license as the PROJECT | |
236 ... # project. | |
237 ... #''' | |
238 >>> print catalog.header_comment | |
239 # The POT for my really cool Foobar project. | |
240 # Copyright (C) 1990-2003 Foo Company | |
241 # This file is distributed under the same license as the Foobar | |
242 # project. | |
243 # | |
244 | |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
245 :type: `unicode` |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
246 """) |
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
247 |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
248 def _get_mime_headers(self): |
67 | 249 headers = [] |
250 headers.append(('Project-Id-Version', | |
251 '%s %s' % (self.project, self.version))) | |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
252 headers.append(('Report-Msgid-Bugs-To', self.msgid_bugs_address)) |
67 | 253 headers.append(('POT-Creation-Date', |
131
a63812008056
Use `dates.format_datetime` for dates in PO(T) header, as `datetime.strftime` produces wrong results on windows.
cmlenz
parents:
121
diff
changeset
|
254 format_datetime(self.creation_date, 'yyyy-MM-dd HH:mmZ', |
a63812008056
Use `dates.format_datetime` for dates in PO(T) header, as `datetime.strftime` produces wrong results on windows.
cmlenz
parents:
121
diff
changeset
|
255 locale='en'))) |
67 | 256 if self.locale is None: |
257 headers.append(('PO-Revision-Date', 'YEAR-MO-DA HO:MI+ZONE')) | |
258 headers.append(('Last-Translator', 'FULL NAME <EMAIL@ADDRESS>')) | |
259 headers.append(('Language-Team', 'LANGUAGE <LL@li.org>')) | |
260 else: | |
261 headers.append(('PO-Revision-Date', | |
131
a63812008056
Use `dates.format_datetime` for dates in PO(T) header, as `datetime.strftime` produces wrong results on windows.
cmlenz
parents:
121
diff
changeset
|
262 format_datetime(self.revision_date, |
a63812008056
Use `dates.format_datetime` for dates in PO(T) header, as `datetime.strftime` produces wrong results on windows.
cmlenz
parents:
121
diff
changeset
|
263 'yyyy-MM-dd HH:mmZ', locale='en'))) |
67 | 264 headers.append(('Last-Translator', self.last_translator)) |
206
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
265 headers.append(('Language-Team', |
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
266 self.language_team.replace('LANGUAGE', |
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
267 str(self.locale)))) |
84
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
268 headers.append(('Plural-Forms', self.plural_forms)) |
67 | 269 headers.append(('MIME-Version', '1.0')) |
68 | 270 headers.append(('Content-Type', |
271 'text/plain; charset=%s' % self.charset)) | |
67 | 272 headers.append(('Content-Transfer-Encoding', '8bit')) |
105
f744dd56573d
`Message`, `read_po` and `write_po` now all handle user/auto comments correctly.
palgarvio
parents:
104
diff
changeset
|
273 headers.append(('Generated-By', 'Babel %s\n' % VERSION)) |
67 | 274 return headers |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
275 |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
276 def _set_mime_headers(self, headers): |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
277 for name, value in headers: |
210
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
278 if name == 'content-type': |
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
279 mimetype, params = parse_header(value) |
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
280 if 'charset' in params: |
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
281 self.charset = params['charset'].lower() |
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
282 break |
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
283 for name, value in headers: |
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
284 name = name.lower().decode(self.charset) |
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
285 value = value.decode(self.charset) |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
286 if name == 'project-id-version': |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
287 parts = value.split(' ') |
210
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
288 self.project = u' '.join(parts[:-1]) |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
289 self.version = parts[-1] |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
290 elif name == 'report-msgid-bugs-to': |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
291 self.msgid_bugs_address = value |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
292 elif name == 'last-translator': |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
293 self.last_translator = value |
206
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
294 elif name == 'language-team': |
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
295 self.language_team = value |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
296 elif name == 'pot-creation-date': |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
297 # FIXME: this should use dates.parse_datetime as soon as that |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
298 # is ready |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
299 value, tzoffset, _ = re.split('[+-](\d{4})$', value, 1) |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
300 tt = time.strptime(value, '%Y-%m-%d %H:%M') |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
301 ts = time.mktime(tt) |
120 | 302 tzoffset = FixedOffsetTimezone(int(tzoffset[:2]) * 60 + |
303 int(tzoffset[2:])) | |
121 | 304 dt = datetime.fromtimestamp(ts) |
305 self.creation_date = dt.replace(tzinfo=tzoffset) | |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
306 |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
307 mime_headers = property(_get_mime_headers, _set_mime_headers, doc="""\ |
67 | 308 The MIME headers of the catalog, used for the special ``msgid ""`` entry. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
309 |
67 | 310 The behavior of this property changes slightly depending on whether a locale |
311 is set or not, the latter indicating that the catalog is actually a template | |
312 for actual translations. | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
313 |
67 | 314 Here's an example of the output for such a catalog template: |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
315 |
95
008cd3f7d485
Fix for #11 (use local timezone in timestamps of generated POT).
cmlenz
parents:
87
diff
changeset
|
316 >>> created = datetime(1990, 4, 1, 15, 30, tzinfo=UTC) |
67 | 317 >>> catalog = Catalog(project='Foobar', version='1.0', |
95
008cd3f7d485
Fix for #11 (use local timezone in timestamps of generated POT).
cmlenz
parents:
87
diff
changeset
|
318 ... creation_date=created) |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
319 >>> for name, value in catalog.mime_headers: |
67 | 320 ... print '%s: %s' % (name, value) |
321 Project-Id-Version: Foobar 1.0 | |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
322 Report-Msgid-Bugs-To: EMAIL@ADDRESS |
67 | 323 POT-Creation-Date: 1990-04-01 15:30+0000 |
324 PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE | |
325 Last-Translator: FULL NAME <EMAIL@ADDRESS> | |
326 Language-Team: LANGUAGE <LL@li.org> | |
327 MIME-Version: 1.0 | |
328 Content-Type: text/plain; charset=utf-8 | |
329 Content-Transfer-Encoding: 8bit | |
330 Generated-By: Babel ... | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
331 |
67 | 332 And here's an example of the output when the locale is set: |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
333 |
95
008cd3f7d485
Fix for #11 (use local timezone in timestamps of generated POT).
cmlenz
parents:
87
diff
changeset
|
334 >>> revised = datetime(1990, 8, 3, 12, 0, tzinfo=UTC) |
67 | 335 >>> catalog = Catalog(locale='de_DE', project='Foobar', version='1.0', |
95
008cd3f7d485
Fix for #11 (use local timezone in timestamps of generated POT).
cmlenz
parents:
87
diff
changeset
|
336 ... creation_date=created, revision_date=revised, |
206
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
337 ... last_translator='John Doe <jd@example.com>', |
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
338 ... language_team='de_DE <de@example.com>') |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
339 >>> for name, value in catalog.mime_headers: |
67 | 340 ... print '%s: %s' % (name, value) |
341 Project-Id-Version: Foobar 1.0 | |
78
ee043bb666f0
Fixed the plurals header on `Catalog` which should only be written if it's not a catalog template.
palgarvio
parents:
70
diff
changeset
|
342 Report-Msgid-Bugs-To: EMAIL@ADDRESS |
67 | 343 POT-Creation-Date: 1990-04-01 15:30+0000 |
344 PO-Revision-Date: 1990-08-03 12:00+0000 | |
345 Last-Translator: John Doe <jd@example.com> | |
206
2fe580515695
Preserve language-team header in catalogs on update. Closes #35 again.
cmlenz
parents:
203
diff
changeset
|
346 Language-Team: de_DE <de@example.com> |
84
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
347 Plural-Forms: nplurals=2; plural=(n != 1) |
67 | 348 MIME-Version: 1.0 |
349 Content-Type: text/plain; charset=utf-8 | |
350 Content-Transfer-Encoding: 8bit | |
351 Generated-By: Babel ... | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
352 |
67 | 353 :type: `list` |
354 """) | |
355 | |
68 | 356 def num_plurals(self): |
357 num = 2 | |
358 if self.locale: | |
359 if str(self.locale) in PLURALS: | |
360 num = PLURALS[str(self.locale)][0] | |
361 elif self.locale.language in PLURALS: | |
362 num = PLURALS[self.locale.language][0] | |
363 return num | |
84
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
364 num_plurals = property(num_plurals, doc="""\ |
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
365 The number of plurals used by the locale. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
366 |
103
7cdf89eb9007
Implement wrapping of header comments in PO(T) output. Related to #14.
cmlenz
parents:
97
diff
changeset
|
367 >>> Catalog(locale='en').num_plurals |
7cdf89eb9007
Implement wrapping of header comments in PO(T) output. Related to #14.
cmlenz
parents:
97
diff
changeset
|
368 2 |
7cdf89eb9007
Implement wrapping of header comments in PO(T) output. Related to #14.
cmlenz
parents:
97
diff
changeset
|
369 >>> Catalog(locale='cs_CZ').num_plurals |
7cdf89eb9007
Implement wrapping of header comments in PO(T) output. Related to #14.
cmlenz
parents:
97
diff
changeset
|
370 3 |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
371 |
103
7cdf89eb9007
Implement wrapping of header comments in PO(T) output. Related to #14.
cmlenz
parents:
97
diff
changeset
|
372 :type: `int` |
84
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
373 """) |
68 | 374 |
67 | 375 def plural_forms(self): |
376 num, expr = ('INTEGER', 'EXPRESSION') | |
377 if self.locale: | |
378 if str(self.locale) in PLURALS: | |
379 num, expr = PLURALS[str(self.locale)] | |
380 elif self.locale.language in PLURALS: | |
381 num, expr = PLURALS[self.locale.language] | |
382 return 'nplurals=%s; plural=%s' % (num, expr) | |
383 plural_forms = property(plural_forms, doc="""\ | |
384 Return the plural forms declaration for the locale. | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
385 |
103
7cdf89eb9007
Implement wrapping of header comments in PO(T) output. Related to #14.
cmlenz
parents:
97
diff
changeset
|
386 >>> Catalog(locale='en').plural_forms |
67 | 387 'nplurals=2; plural=(n != 1)' |
388 >>> Catalog(locale='pt_BR').plural_forms | |
389 'nplurals=2; plural=(n > 1)' | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
390 |
67 | 391 :type: `str` |
392 """) | |
393 | |
394 def __contains__(self, id): | |
395 """Return whether the catalog has a message with the specified ID.""" | |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
396 return self._key_for(id) in self._messages |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
397 |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
398 def __len__(self): |
84
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
399 """The number of messages in the catalog. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
400 |
84
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
401 This does not include the special ``msgid ""`` entry. |
4ff9cc26c11b
Some cosmetic changes for the new translator comments support.
cmlenz
parents:
80
diff
changeset
|
402 """ |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
403 return len(self._messages) |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
404 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
405 def __iter__(self): |
64 | 406 """Iterates through all the entries in the catalog, in the order they |
407 were added, yielding a `Message` object for every entry. | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
408 |
64 | 409 :rtype: ``iterator`` |
410 """ | |
67 | 411 buf = [] |
104
22f222e23b86
Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction.
cmlenz
parents:
103
diff
changeset
|
412 for name, value in self.mime_headers: |
67 | 413 buf.append('%s: %s' % (name, value)) |
198
74a346c7846d
Correctly handle non-ASCII chars in the catalog MIME headers.
cmlenz
parents:
196
diff
changeset
|
414 flags = set() |
175
3c4718fb7435
Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing).
palgarvio
parents:
165
diff
changeset
|
415 if self.fuzzy: |
198
74a346c7846d
Correctly handle non-ASCII chars in the catalog MIME headers.
cmlenz
parents:
196
diff
changeset
|
416 flags |= set(['fuzzy']) |
210
6c8b69e150a9
When parsing catalog headers, look for the content-type first, to be able to use a specified encoding on all other headers.
cmlenz
parents:
206
diff
changeset
|
417 yield Message(u'', '\n'.join(buf), flags=flags) |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
418 for key in self._messages: |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
419 yield self._messages[key] |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
420 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
421 def __repr__(self): |
64 | 422 locale = '' |
423 if self.locale: | |
424 locale = ' %s' % self.locale | |
425 return '<%s %r%s>' % (type(self).__name__, self.domain, locale) | |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
426 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
427 def __delitem__(self, id): |
64 | 428 """Delete the message with the specified ID.""" |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
429 key = self._key_for(id) |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
430 if key in self._messages: |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
431 del self._messages[key] |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
432 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
433 def __getitem__(self, id): |
64 | 434 """Return the message with the specified ID. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
435 |
64 | 436 :param id: the message ID |
437 :return: the message with the specified ID, or `None` if no such message | |
438 is in the catalog | |
67 | 439 :rtype: `Message` |
64 | 440 """ |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
441 return self._messages.get(self._key_for(id)) |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
442 |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
443 def __setitem__(self, id, message): |
64 | 444 """Add or update the message with the specified ID. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
445 |
64 | 446 >>> catalog = Catalog() |
447 >>> catalog[u'foo'] = Message(u'foo') | |
448 >>> catalog[u'foo'] | |
196
93a922d31eca
Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit.
cmlenz
parents:
188
diff
changeset
|
449 <Message u'foo' (flags: [])> |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
450 |
64 | 451 If a message with that ID is already in the catalog, it is updated |
452 to include the locations and flags of the new message. | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
453 |
64 | 454 >>> catalog = Catalog() |
455 >>> catalog[u'foo'] = Message(u'foo', locations=[('main.py', 1)]) | |
456 >>> catalog[u'foo'].locations | |
457 [('main.py', 1)] | |
458 >>> catalog[u'foo'] = Message(u'foo', locations=[('utils.py', 5)]) | |
459 >>> catalog[u'foo'].locations | |
460 [('main.py', 1), ('utils.py', 5)] | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
461 |
64 | 462 :param id: the message ID |
463 :param message: the `Message` object | |
464 """ | |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
465 assert isinstance(message, Message), 'expected a Message object' |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
466 key = self._key_for(id) |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
467 current = self._messages.get(key) |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
468 if current: |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
469 if message.pluralizable and not current.pluralizable: |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
470 # The new message adds pluralization |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
471 current.id = message.id |
70
2b0e18a04856
Fix for mixed singular/plural messages, follow-up to [70].
cmlenz
parents:
69
diff
changeset
|
472 current.string = message.string |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
473 current.locations.extend(message.locations) |
105
f744dd56573d
`Message`, `read_po` and `write_po` now all handle user/auto comments correctly.
palgarvio
parents:
104
diff
changeset
|
474 current.auto_comments.extend(message.auto_comments) |
f744dd56573d
`Message`, `read_po` and `write_po` now all handle user/auto comments correctly.
palgarvio
parents:
104
diff
changeset
|
475 current.user_comments.extend(message.user_comments) |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
476 current.flags |= message.flags |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
477 message = current |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
478 elif id == '': |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
479 # special treatment for the header message |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
480 headers = message_from_string(message.string.encode(self.charset)) |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
481 self.mime_headers = headers.items() |
120 | 482 self.header_comment = '\n'.join(['# %s' % comment for comment |
483 in message.user_comments]) | |
196
93a922d31eca
Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit.
cmlenz
parents:
188
diff
changeset
|
484 self.fuzzy = message.fuzzy |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
485 else: |
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
486 if isinstance(id, (list, tuple)): |
68 | 487 assert isinstance(message.string, (list, tuple)) |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
488 self._messages[key] = message |
56
27fba894d3ca
Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends.
cmlenz
parents:
diff
changeset
|
489 |
105
f744dd56573d
`Message`, `read_po` and `write_po` now all handle user/auto comments correctly.
palgarvio
parents:
104
diff
changeset
|
490 def add(self, id, string=None, locations=(), flags=(), auto_comments=(), |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
491 user_comments=(), previous_id=(), lineno=None): |
64 | 492 """Add or update the message with the specified ID. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
493 |
64 | 494 >>> catalog = Catalog() |
495 >>> catalog.add(u'foo') | |
496 >>> catalog[u'foo'] | |
196
93a922d31eca
Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit.
cmlenz
parents:
188
diff
changeset
|
497 <Message u'foo' (flags: [])> |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
498 |
64 | 499 This method simply constructs a `Message` object with the given |
500 arguments and invokes `__setitem__` with that object. | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
501 |
64 | 502 :param id: the message ID, or a ``(singular, plural)`` tuple for |
503 pluralizable messages | |
504 :param string: the translated message string, or a | |
505 ``(singular, plural)`` tuple for pluralizable messages | |
506 :param locations: a sequence of ``(filenname, lineno)`` tuples | |
507 :param flags: a set or sequence of flags | |
106
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
508 :param auto_comments: a sequence of automatic comments |
9b22b36066f6
Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`.
cmlenz
parents:
105
diff
changeset
|
509 :param user_comments: a sequence of user comments |
203 | 510 :param previous_id: the previous message ID, or a ``(singular, plural)`` |
511 tuple for pluralizable messages | |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
512 :param lineno: the line number on which the msgid line was found in the |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
513 PO file, if any |
64 | 514 """ |
105
f744dd56573d
`Message`, `read_po` and `write_po` now all handle user/auto comments correctly.
palgarvio
parents:
104
diff
changeset
|
515 self[id] = Message(id, string, list(locations), flags, auto_comments, |
220
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
516 user_comments, previous_id, lineno=lineno) |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
517 |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
518 def check(self): |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
519 """Run various validation checks on the translations in the catalog. |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
520 |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
521 For every message which fails validation, this method yield a |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
522 ``(message, errors)`` tuple, where ``message`` is the `Message` object |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
523 and ``errors`` is a sequence of `TranslationError` objects. |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
524 |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
525 :rtype: ``iterator`` |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
526 """ |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
527 checkers = [] |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
528 from pkg_resources import working_set |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
529 for entry_point in working_set.iter_entry_points('babel.checkers'): |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
530 checkers.append(entry_point.load()) |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
531 |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
532 for message in self._messages.values(): |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
533 errors = [] |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
534 for checker in checkers: |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
535 try: |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
536 checker(self, message) |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
537 except TranslationError, e: |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
538 errors.append(e) |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
539 if errors: |
677147547e2d
Added infrastructure for adding catalog checkers, and implement a checker that validations Python format parameters in translations, closing #19.
cmlenz
parents:
210
diff
changeset
|
540 yield message, errors |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
541 |
203 | 542 def update(self, template, no_fuzzy_matching=False): |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
543 """Update the catalog based on the given template catalog. |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
544 |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
545 >>> from babel.messages import Catalog |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
546 >>> template = Catalog() |
188 | 547 >>> template.add('green', locations=[('main.py', 99)]) |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
548 >>> template.add('blue', locations=[('main.py', 100)]) |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
549 >>> template.add(('salad', 'salads'), locations=[('util.py', 42)]) |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
550 >>> catalog = Catalog(locale='de_DE') |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
551 >>> catalog.add('blue', u'blau', locations=[('main.py', 98)]) |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
552 >>> catalog.add('head', u'Kopf', locations=[('util.py', 33)]) |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
553 >>> catalog.add(('salad', 'salads'), (u'Salat', u'Salate'), |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
554 ... locations=[('util.py', 38)]) |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
555 |
181
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
556 >>> catalog.update(template) |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
557 >>> len(catalog) |
188 | 558 3 |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
559 |
188 | 560 >>> msg1 = catalog['green'] |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
561 >>> msg1.string |
188 | 562 >>> msg1.locations |
563 [('main.py', 99)] | |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
564 |
188 | 565 >>> msg2 = catalog['blue'] |
566 >>> msg2.string | |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
567 u'blau' |
188 | 568 >>> msg2.locations |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
569 [('main.py', 100)] |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
570 |
188 | 571 >>> msg3 = catalog['salad'] |
572 >>> msg3.string | |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
573 (u'Salat', u'Salate') |
188 | 574 >>> msg3.locations |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
575 [('util.py', 42)] |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
576 |
181
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
577 Messages that are in the catalog but not in the template are removed |
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
578 from the main collection, but can still be accessed via the `obsolete` |
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
579 member: |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
580 |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
581 >>> 'head' in catalog |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
582 False |
181
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
583 >>> catalog.obsolete.values() |
196
93a922d31eca
Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit.
cmlenz
parents:
188
diff
changeset
|
584 [<Message 'head' (flags: [])>] |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
585 |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
586 :param template: the reference catalog, usually read from a POT file |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
587 :param no_fuzzy_matching: whether to use fuzzy matching of message IDs |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
588 """ |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
589 messages = self._messages |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
590 self._messages = odict() |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
591 |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
592 for message in template: |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
593 if message.id: |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
594 key = self._key_for(message.id) |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
595 if key in messages: |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
596 oldmsg = messages.pop(key) |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
597 message.string = oldmsg.string |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
598 message.flags |= oldmsg.flags |
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
599 self[message.id] = message |
165
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
600 |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
601 else: |
200
2983c718f6e2
Added `--no-fuzzy-matching` to the frontends and also `--previous` which adds the old msgid's as comments. The latest closes #31.
palgarvio
parents:
198
diff
changeset
|
602 if no_fuzzy_matching is False: |
165
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
603 # do some fuzzy matching with difflib |
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
604 matches = get_close_matches(key.lower().strip(), |
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
605 [self._key_for(msgid) for msgid in messages], 1) |
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
606 if matches: |
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
607 oldmsg = messages.pop(matches[0]) |
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
608 message.string = oldmsg.string |
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
609 message.flags |= oldmsg.flags | set([u'fuzzy']) |
203 | 610 if isinstance(oldmsg.id, basestring): |
611 message.previous_id = [oldmsg.id] | |
612 else: | |
613 message.previous_id = list(oldmsg.id) | |
165
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
614 self[message.id] = message |
188 | 615 continue |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
616 |
165
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
617 self[message.id] = message |
650a6e996ede
Implement fuzzy matching to catalog updates. No frontend yet.
cmlenz
parents:
163
diff
changeset
|
618 |
181
9a1acb41e7dd
The frontends now provide ways to update existing translations catalogs from a template. Closes #22.
cmlenz
parents:
175
diff
changeset
|
619 self.obsolete = messages |
163
f2c78a271159
Added preliminary catalog updating/merging functionality.
cmlenz
parents:
149
diff
changeset
|
620 |
69
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
621 def _key_for(self, id): |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
622 """The key for a message is just the singular ID even for pluralizable |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
623 messages. |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
624 """ |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
625 key = id |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
626 if isinstance(key, (list, tuple)): |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
627 key = id[0] |
9b8079807245
Message catalogs can have multiple messages with the same ID, where some of them have plural strings, and others don't. Still the same message.
cmlenz
parents:
68
diff
changeset
|
628 return key |