babel/mirror: babel/messages/tests/pofile.py annotate

annotate babel/messages/tests/pofile.py @ 582:3fd7fb953633 trunk

fix handling of messages containing '\\n' (#171)

author	fschwarz
date	Fri, 03 Aug 2012 22:41:49 +0000
parents	e8155a73ac2e
children	5c9dba5dd311

rev	line source
1 7870274479f5 Import of initial code base. cmlenz parents: diff changeset	1 # -- coding: utf-8 --
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	2 #
530 ca203b2af83c Update the copyright line. jruigrok parents: 447 diff changeset	3 # Copyright (C) 2007-2011 Edgewall Software
1 7870274479f5 Import of initial code base. cmlenz parents: diff changeset	4 # All rights reserved.
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	5 #
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	6 # This software is licensed as described in the file COPYING, which
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	7 # you should have received as part of this distribution. The terms
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	8 # are also available at http://babel.edgewall.org/wiki/License.
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	9 #
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	10 # This software consists of voluntary contributions made by many
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	11 # individuals. For the exact contribution history, see the revision
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	12 # history and logs, available at http://babel.edgewall.org/log/.
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	13
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	14 from datetime import datetime
1 7870274479f5 Import of initial code base. cmlenz parents: diff changeset	15 import doctest
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	16 from StringIO import StringIO
1 7870274479f5 Import of initial code base. cmlenz parents: diff changeset	17 import unittest
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	18
181 8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	19 from babel.messages.catalog import Catalog, Message
54 7dbcbc3f07e0 Rename the `babel.catalog` package to `babel.messages` for consistency with the other package names. cmlenz parents: 51 diff changeset	20 from babel.messages import pofile
531 ce7f70238aec cleanup: remove unused imports fschwarz parents: 530 diff changeset	21 from babel.util import FixedOffsetTimezone
1 7870274479f5 Import of initial code base. cmlenz parents: diff changeset	22
17 55e22bc56f0c Recognize python-format messages also for unnamed parameters. cmlenz parents: 12 diff changeset	23
106 2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	24 class ReadPoTestCase(unittest.TestCase):
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	25
196 b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	26 def test_preserve_locale(self):
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	27 buf = StringIO(r'''msgid "foo"
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	28 msgstr "Voh"''')
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	29 catalog = pofile.read_po(buf, locale='en_US')
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	30 self.assertEqual('en_US', catalog.locale)
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	31
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	32 def test_preserve_domain(self):
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	33 buf = StringIO(r'''msgid "foo"
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	34 msgstr "Voh"''')
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	35 catalog = pofile.read_po(buf, domain='mydomain')
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	36 self.assertEqual('mydomain', catalog.domain)
b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	37
545 e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	38 def test_applies_specified_encoding_during_read(self):
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	39 buf = StringIO(u'''
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	40 msgid ""
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	41 msgstr ""
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	42 "Project-Id-Version: 3.15\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	43 "Report-Msgid-Bugs-To: Fliegender Zirkus <fliegender@zirkus.de>\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	44 "POT-Creation-Date: 2007-09-27 11:19+0700\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	45 "PO-Revision-Date: 2007-09-27 21:42-0700\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	46 "Last-Translator: John <cleese@bavaria.de>\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	47 "Language-Team: German Lang <de@babel.org>\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	48 "Plural-Forms: nplurals=2; plural=(n != 1)\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	49 "MIME-Version: 1.0\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	50 "Content-Type: text/plain; charset=iso-8859-1\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	51 "Content-Transfer-Encoding: 8bit\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	52 "Generated-By: Babel 1.0dev-r313\\n"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	53
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	54 msgid "foo"
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	55 msgstr "bär"'''.encode('iso-8859-1'))
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	56 catalog = pofile.read_po(buf, locale='de_DE')
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	57 self.assertEqual(u'bär', catalog.get('foo').string)
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	58
106 2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	59 def test_read_multiline(self):
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	60 buf = StringIO(r'''msgid ""
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	61 "Here's some text that\n"
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	62 "includesareallylongwordthatmightbutshouldnt"
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	63 " throw us into an infinite "
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	64 "loop\n"
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	65 msgstr ""''')
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	66 catalog = pofile.read_po(buf)
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	67 self.assertEqual(1, len(catalog))
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	68 message = list(catalog)[1]
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	69 self.assertEqual("Here's some text that\nincludesareallylongwordthat"
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	70 "mightbutshouldnt throw us into an infinite loop\n",
2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	71 message.id)
196 b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	72
175 5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	73 def test_fuzzy_header(self):
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	74 buf = StringIO(r'''\
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	75 # Translations template for AReallyReallyLongNameForAProject.
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	76 # Copyright (C) 2007 ORGANIZATION
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	77 # This file is distributed under the same license as the
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	78 # AReallyReallyLongNameForAProject project.
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	79 # FIRST AUTHOR <EMAIL@ADDRESS>, 2007.
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	80 #
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	81 #, fuzzy
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	82 ''')
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	83 catalog = pofile.read_po(buf)
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	84 self.assertEqual(1, len(list(catalog)))
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	85 self.assertEqual(True, list(catalog)[0].fuzzy)
196 b38a6b220ea2 Fix for #35, and a minor improvement to how we parse the catalog fuzzy bit. cmlenz parents: 191 diff changeset	86
175 5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	87 def test_not_fuzzy_header(self):
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	88 buf = StringIO(r'''\
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	89 # Translations template for AReallyReallyLongNameForAProject.
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	90 # Copyright (C) 2007 ORGANIZATION
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	91 # This file is distributed under the same license as the
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	92 # AReallyReallyLongNameForAProject project.
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	93 # FIRST AUTHOR <EMAIL@ADDRESS>, 2007.
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	94 #
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	95 ''')
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	96 catalog = pofile.read_po(buf)
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	97 self.assertEqual(1, len(list(catalog)))
5d32098d8352 Changed the `__repr__` output to include the flags(it can be changed back, but it was usefull to implement the fuzzy header parsing). palgarvio parents: 106 diff changeset	98 self.assertEqual(False, list(catalog)[0].fuzzy)
106 2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	99
291 2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	100 def test_header_entry(self):
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	101 buf = StringIO(r'''\
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	102 # SOME DESCRIPTIVE TITLE.
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	103 # Copyright (C) 2007 THE PACKAGE'S COPYRIGHT HOLDER
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	104 # This file is distributed under the same license as the PACKAGE package.
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	105 # FIRST AUTHOR <EMAIL@ADDRESS>, 2007.
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	106 #
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	107 #, fuzzy
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	108 msgid ""
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	109 msgstr ""
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	110 "Project-Id-Version: 3.15\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	111 "Report-Msgid-Bugs-To: Fliegender Zirkus <fliegender@zirkus.de>\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	112 "POT-Creation-Date: 2007-09-27 11:19+0700\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	113 "PO-Revision-Date: 2007-09-27 21:42-0700\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	114 "Last-Translator: John <cleese@bavaria.de>\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	115 "Language-Team: German Lang <de@babel.org>\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	116 "Plural-Forms: nplurals=2; plural=(n != 1)\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	117 "MIME-Version: 1.0\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	118 "Content-Type: text/plain; charset=iso-8859-2\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	119 "Content-Transfer-Encoding: 8bit\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	120 "Generated-By: Babel 1.0dev-r313\n"
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	121 ''')
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	122 catalog = pofile.read_po(buf)
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	123 self.assertEqual(1, len(list(catalog)))
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	124 self.assertEqual(u'3.15', catalog.version)
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	125 self.assertEqual(u'Fliegender Zirkus <fliegender@zirkus.de>',
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	126 catalog.msgid_bugs_address)
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	127 self.assertEqual(datetime(2007, 9, 27, 11, 19,
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	128 tzinfo=FixedOffsetTimezone(7 * 60)),
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	129 catalog.creation_date)
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	130 self.assertEqual(u'John <cleese@bavaria.de>', catalog.last_translator)
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	131 self.assertEqual(u'German Lang <de@babel.org>', catalog.language_team)
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	132 self.assertEqual(u'iso-8859-2', catalog.charset)
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	133 self.assertEqual(True, list(catalog)[0].fuzzy)
2f6b2b06a428 fix catalogs' charset values not being recognized pjenvey parents: 249 diff changeset	134
199 a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	135 def test_obsolete_message(self):
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	136 buf = StringIO(r'''# This is an obsolete message
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	137 #~ msgid "foo"
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	138 #~ msgstr "Voh"
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	139
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	140 # This message is not obsolete
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	141 #: main.py:1
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	142 msgid "bar"
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	143 msgstr "Bahr"
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	144 ''')
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	145 catalog = pofile.read_po(buf)
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	146 self.assertEqual(1, len(catalog))
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	147 self.assertEqual(1, len(catalog.obsolete))
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	148 message = catalog.obsolete[u'foo']
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	149 self.assertEqual(u'foo', message.id)
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	150 self.assertEqual(u'Voh', message.string)
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	151 self.assertEqual(['This is an obsolete message'], message.user_comments)
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	152
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	153 def test_obsolete_message_ignored(self):
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	154 buf = StringIO(r'''# This is an obsolete message
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	155 #~ msgid "foo"
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	156 #~ msgstr "Voh"
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	157
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	158 # This message is not obsolete
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	159 #: main.py:1
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	160 msgid "bar"
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	161 msgstr "Bahr"
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	162 ''')
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	163 catalog = pofile.read_po(buf, ignore_obsolete=True)
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	164 self.assertEqual(1, len(catalog))
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	165 self.assertEqual(0, len(catalog.obsolete))
a0d22f2f2df0 Handle obsolete messages when parsing catalogs. Closes #32. cmlenz parents: 196 diff changeset	166
335 4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	167 def test_with_context(self):
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	168 buf = StringIO(r'''# Some string in the menu
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	169 #: main.py:1
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	170 msgctxt "Menu"
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	171 msgid "foo"
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	172 msgstr "Voh"
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	173
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	174 # Another string in the menu
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	175 #: main.py:2
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	176 msgctxt "Menu"
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	177 msgid "bar"
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	178 msgstr "Bahr"
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	179 ''')
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	180 catalog = pofile.read_po(buf, ignore_obsolete=True)
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	181 self.assertEqual(2, len(catalog))
350 9166eab61e29 More work on msgctxt support (#54). cmlenz parents: 335 diff changeset	182 message = catalog.get('foo', context='Menu')
335 4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	183 self.assertEqual('Menu', message.context)
350 9166eab61e29 More work on msgctxt support (#54). cmlenz parents: 335 diff changeset	184 message = catalog.get('bar', context='Menu')
335 4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	185 self.assertEqual('Menu', message.context)
4db404d0c19b More preparation for msgctxt support (#54). cmlenz parents: 315 diff changeset	186
421 fcde0f2ff278 Include patch from Asheesh Laroia. Fixes #45. palgarvio parents: 377 diff changeset	187 # And verify it pass through write_po
fcde0f2ff278 Include patch from Asheesh Laroia. Fixes #45. palgarvio parents: 377 diff changeset	188 out_buf = StringIO()
fcde0f2ff278 Include patch from Asheesh Laroia. Fixes #45. palgarvio parents: 377 diff changeset	189 pofile.write_po(out_buf, catalog, omit_header=True)
fcde0f2ff278 Include patch from Asheesh Laroia. Fixes #45. palgarvio parents: 377 diff changeset	190 assert out_buf.getvalue().strip() == buf.getvalue().strip(), \
fcde0f2ff278 Include patch from Asheesh Laroia. Fixes #45. palgarvio parents: 377 diff changeset	191 out_buf.getvalue()
fcde0f2ff278 Include patch from Asheesh Laroia. Fixes #45. palgarvio parents: 377 diff changeset	192
428 a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	193 def test_with_context_two(self):
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	194 buf = StringIO(r'''msgctxt "Menu"
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	195 msgid "foo"
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	196 msgstr "Voh"
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	197
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	198 msgctxt "Mannu"
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	199 msgid "bar"
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	200 msgstr "Bahr"
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	201 ''')
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	202 catalog = pofile.read_po(buf, ignore_obsolete=True)
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	203 self.assertEqual(2, len(catalog))
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	204 message = catalog.get('foo', context='Menu')
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	205 self.assertEqual('Menu', message.context)
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	206 message = catalog.get('bar', context='Mannu')
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	207 self.assertEqual('Mannu', message.context)
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	208
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	209 # And verify it pass through write_po
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	210 out_buf = StringIO()
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	211 pofile.write_po(out_buf, catalog, omit_header=True)
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	212 assert out_buf.getvalue().strip() == buf.getvalue().strip(), out_buf.getvalue()
a974d298400f Fix for msgctxt parsing in PO files. Thanks to Asheesh Laroia for the patch. Closes #159. cmlenz parents: 423 diff changeset	213
443 53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	214 def test_single_plural_form(self):
53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	215 buf = StringIO(r'''msgid "foo"
446 458384f70395 Actually make the msgid_plural be a plural as per typical use case. jruigrok parents: 445 diff changeset	216 msgid_plural "foos"
443 53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	217 msgstr[0] "Voh"''')
53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	218 catalog = pofile.read_po(buf, locale='ja_JP')
53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	219 self.assertEqual(1, len(catalog))
53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	220 self.assertEqual(1, catalog.num_plurals)
53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	221 message = catalog['foo']
53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	222 self.assertEqual(1, len(message.string))
53fe6880791a Add a test for a locale with one plural form. jruigrok parents: 442 diff changeset	223
442 af7b13202b11 Fix testcase name typo. jruigrok parents: 441 diff changeset	224 def test_singular_plural_form(self):
370 bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	225 buf = StringIO(r'''msgid "foo"
446 458384f70395 Actually make the msgid_plural be a plural as per typical use case. jruigrok parents: 445 diff changeset	226 msgid_plural "foos"
370 bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	227 msgstr[0] "Voh"
442 af7b13202b11 Fix testcase name typo. jruigrok parents: 441 diff changeset	228 msgstr[1] "Vohs"''')
af7b13202b11 Fix testcase name typo. jruigrok parents: 441 diff changeset	229 catalog = pofile.read_po(buf, locale='nl_NL')
370 bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	230 self.assertEqual(1, len(catalog))
442 af7b13202b11 Fix testcase name typo. jruigrok parents: 441 diff changeset	231 self.assertEqual(2, catalog.num_plurals)
377 d0ee047cd3ae Use item access to catalog messages in tests, so that they can be easily ported back to the 0.9.x branch. cmlenz parents: 370 diff changeset	232 message = catalog['foo']
442 af7b13202b11 Fix testcase name typo. jruigrok parents: 441 diff changeset	233 self.assertEqual(2, len(message.string))
441 942afedbb3d7 Make sure to only strip on the first occurence of ]. jruigrok parents: 428 diff changeset	234
370 bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	235 def test_more_than_two_plural_forms(self):
bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	236 buf = StringIO(r'''msgid "foo"
446 458384f70395 Actually make the msgid_plural be a plural as per typical use case. jruigrok parents: 445 diff changeset	237 msgid_plural "foos"
370 bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	238 msgstr[0] "Voh"
445 766ddd5161c8 More than two plural forms work nowadays. Adjust the test. jruigrok parents: 444 diff changeset	239 msgstr[1] "Vohs"
766ddd5161c8 More than two plural forms work nowadays. Adjust the test. jruigrok parents: 444 diff changeset	240 msgstr[2] "Vohss"''')
370 bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	241 catalog = pofile.read_po(buf, locale='lv_LV')
bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	242 self.assertEqual(1, len(catalog))
bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	243 self.assertEqual(3, catalog.num_plurals)
377 d0ee047cd3ae Use item access to catalog messages in tests, so that they can be easily ported back to the 0.9.x branch. cmlenz parents: 370 diff changeset	244 message = catalog['foo']
370 bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	245 self.assertEqual(3, len(message.string))
445 766ddd5161c8 More than two plural forms work nowadays. Adjust the test. jruigrok parents: 444 diff changeset	246 self.assertEqual(u'Vohss', message.string[2])
370 bc18179832b7 We no longer neglect `catalog.plurals`. Added tests for it. Fixes #120. palgarvio parents: 356 diff changeset	247
444 a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	248 def test_plural_with_square_brackets(self):
a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	249 buf = StringIO(r'''msgid "foo"
446 458384f70395 Actually make the msgid_plural be a plural as per typical use case. jruigrok parents: 445 diff changeset	250 msgid_plural "foos"
444 a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	251 msgstr[0] "Voh [text]"
a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	252 msgstr[1] "Vohs [text]"''')
a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	253 catalog = pofile.read_po(buf, locale='nb_NO')
a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	254 self.assertEqual(1, len(catalog))
a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	255 self.assertEqual(2, catalog.num_plurals)
a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	256 message = catalog['foo']
a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	257 self.assertEqual(2, len(message.string))
a4eb4ea8d6f9 Put the square brackets test after all the normal plural tests. It's more jruigrok parents: 443 diff changeset	258
106 2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	259
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	260 class WritePoTestCase(unittest.TestCase):
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	261
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	262 def test_join_locations(self):
56 f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	263 catalog = Catalog()
f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	264 catalog.add(u'foo', locations=[('main.py', 1)])
f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	265 catalog.add(u'foo', locations=[('utils.py', 3)])
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	266 buf = StringIO()
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	267 pofile.write_po(buf, catalog, omit_header=True)
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	268 self.assertEqual('''#: main.py:1 utils.py:3
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	269 msgid "foo"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	270 msgstr ""''', buf.getvalue().strip())
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	271
545 e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	272 def test_write_po_file_with_specified_charset(self):
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	273 catalog = Catalog(charset='iso-8859-1')
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	274 catalog.add('foo', u'äöü', locations=[('main.py', 1)])
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	275 buf = StringIO()
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	276 pofile.write_po(buf, catalog, omit_header=False)
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	277 po_file = buf.getvalue().strip()
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	278 assert r'"Content-Type: text/plain; charset=iso-8859-1\n"' in po_file
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	279 assert u'msgstr "äöü"'.encode('iso-8859-1') in po_file
e8155a73ac2e Catalog class should not do decoding of input strings (fixes #256) fschwarz parents: 544 diff changeset	280
228 6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	281 def test_duplicate_comments(self):
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	282 catalog = Catalog()
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	283 catalog.add(u'foo', auto_comments=['A comment'])
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	284 catalog.add(u'foo', auto_comments=['A comment'])
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	285 buf = StringIO()
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	286 pofile.write_po(buf, catalog, omit_header=True)
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	287 self.assertEqual('''#. A comment
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	288 msgid "foo"
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	289 msgstr ""''', buf.getvalue().strip())
6582494abc36 Follow-up to [239]: also combine duplicate comments when writing PO files. cmlenz parents: 203 diff changeset	290
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	291 def test_wrap_long_lines(self):
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	292 text = """Here's some text where
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	293 white space and line breaks matter, and should
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	294
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	295 not be removed
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	296
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	297 """
56 f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	298 catalog = Catalog()
f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	299 catalog.add(text, locations=[('main.py', 1)])
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	300 buf = StringIO()
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	301 pofile.write_po(buf, catalog, no_location=True, omit_header=True,
56 f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	302 width=42)
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	303 self.assertEqual(r'''msgid ""
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	304 "Here's some text where \n"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	305 "white space and line breaks matter, and"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	306 " should\n"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	307 "\n"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	308 "not be removed\n"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	309 "\n"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	310 msgstr ""''', buf.getvalue().strip())
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	311
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	312 def test_wrap_long_lines_with_long_word(self):
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	313 text = """Here's some text that
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	314 includesareallylongwordthatmightbutshouldnt throw us into an infinite loop
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	315 """
56 f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	316 catalog = Catalog()
f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	317 catalog.add(text, locations=[('main.py', 1)])
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	318 buf = StringIO()
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	319 pofile.write_po(buf, catalog, no_location=True, omit_header=True,
56 f40fc143439c Add actual data structures for handling message catalogs, so that more code can be reused here between the frontends. cmlenz parents: 54 diff changeset	320 width=32)
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	321 self.assertEqual(r'''msgid ""
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	322 "Here's some text that\n"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	323 "includesareallylongwordthatmightbutshouldnt"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	324 " throw us into an infinite "
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	325 "loop\n"
b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	326 msgstr ""''', buf.getvalue().strip())
80 116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	327
103 dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	328 def test_wrap_long_lines_in_header(self):
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	329 """
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	330 Verify that long lines in the header comment are wrapped correctly.
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	331 """
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	332 catalog = Catalog(project='AReallyReallyLongNameForAProject',
395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	333 revision_date=datetime(2007, 4, 1))
103 dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	334 buf = StringIO()
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	335 pofile.write_po(buf, catalog)
103 dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	336 self.assertEqual('''\
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	337 # Translations template for AReallyReallyLongNameForAProject.
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	338 # Copyright (C) 2007 ORGANIZATION
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	339 # This file is distributed under the same license as the
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	340 # AReallyReallyLongNameForAProject project.
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	341 # FIRST AUTHOR <EMAIL@ADDRESS>, 2007.
103 dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	342 #
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	343 #, fuzzy''', '\n'.join(buf.getvalue().splitlines()[:7]))
dacfbaf0d1e0 Implement wrapping of header comments in PO(T) output. Related to #14. cmlenz parents: 80 diff changeset	344
315 59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	345 def test_wrap_locations_with_hyphens(self):
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	346 catalog = Catalog()
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	347 catalog.add(u'foo', locations=[
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	348 ('doupy/templates/base/navmenu.inc.html.py', 60)
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	349 ])
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	350 catalog.add(u'foo', locations=[
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	351 ('doupy/templates/job-offers/helpers.html', 22)
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	352 ])
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	353 buf = StringIO()
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	354 pofile.write_po(buf, catalog, omit_header=True)
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	355 self.assertEqual('''#: doupy/templates/base/navmenu.inc.html.py:60
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	356 #: doupy/templates/job-offers/helpers.html:22
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	357 msgid "foo"
59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	358 msgstr ""''', buf.getvalue().strip())
423 fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	359
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	360 def test_no_wrap_and_width_behaviour_on_comments(self):
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	361 catalog = Catalog()
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	362 catalog.add("Pretty dam long message id, which must really be big "
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	363 "to test this wrap behaviour, if not it won't work.",
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	364 locations=[("fake.py", n) for n in range(1, 30)])
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	365 buf = StringIO()
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	366 pofile.write_po(buf, catalog, width=None, omit_header=True)
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	367 self.assertEqual("""\
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	368 #: fake.py:1 fake.py:2 fake.py:3 fake.py:4 fake.py:5 fake.py:6 fake.py:7
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	369 #: fake.py:8 fake.py:9 fake.py:10 fake.py:11 fake.py:12 fake.py:13 fake.py:14
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	370 #: fake.py:15 fake.py:16 fake.py:17 fake.py:18 fake.py:19 fake.py:20 fake.py:21
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	371 #: fake.py:22 fake.py:23 fake.py:24 fake.py:25 fake.py:26 fake.py:27 fake.py:28
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	372 #: fake.py:29
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	373 msgid "pretty dam long message id, which must really be big to test this wrap behaviour, if not it won't work."
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	374 msgstr ""
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	375
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	376 """, buf.getvalue().lower())
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	377 buf = StringIO()
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	378 pofile.write_po(buf, catalog, width=100, omit_header=True)
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	379 self.assertEqual("""\
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	380 #: fake.py:1 fake.py:2 fake.py:3 fake.py:4 fake.py:5 fake.py:6 fake.py:7 fake.py:8 fake.py:9 fake.py:10
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	381 #: fake.py:11 fake.py:12 fake.py:13 fake.py:14 fake.py:15 fake.py:16 fake.py:17 fake.py:18 fake.py:19
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	382 #: fake.py:20 fake.py:21 fake.py:22 fake.py:23 fake.py:24 fake.py:25 fake.py:26 fake.py:27 fake.py:28
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	383 #: fake.py:29
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	384 msgid ""
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	385 "pretty dam long message id, which must really be big to test this wrap behaviour, if not it won't"
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	386 " work."
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	387 msgstr ""
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	388
fb926f48efba Now, the `--width` option, although with a default value of 76, it's not set to any value initially so that the `--no-wrap` option can be passed without throwing an error. Fixes #145. palgarvio parents: 421 diff changeset	389 """, buf.getvalue().lower())
315 59c7849d8b32 Fix for #79 (location lines wrapping at hyphens). cmlenz parents: 291 diff changeset	390
80 116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	391 def test_pot_with_translator_comments(self):
116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	392 catalog = Catalog()
116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	393 catalog.add(u'foo', locations=[('main.py', 1)],
105 c62b68a0b65e `Message`, `read_po` and `write_po` now all handle user/auto comments correctly. palgarvio parents: 104 diff changeset	394 auto_comments=['Comment About `foo`'])
80 116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	395 catalog.add(u'bar', locations=[('utils.py', 3)],
105 c62b68a0b65e `Message`, `read_po` and `write_po` now all handle user/auto comments correctly. palgarvio parents: 104 diff changeset	396 user_comments=['Comment About `bar` with',
c62b68a0b65e `Message`, `read_po` and `write_po` now all handle user/auto comments correctly. palgarvio parents: 104 diff changeset	397 'multiple lines.'])
80 116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	398 buf = StringIO()
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	399 pofile.write_po(buf, catalog, omit_header=True)
80 116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	400 self.assertEqual('''#. Comment About `foo`
116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	401 #: main.py:1
116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	402 msgid "foo"
116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	403 msgstr ""
116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	404
105 c62b68a0b65e `Message`, `read_po` and `write_po` now all handle user/auto comments correctly. palgarvio parents: 104 diff changeset	405 # Comment About `bar` with
c62b68a0b65e `Message`, `read_po` and `write_po` now all handle user/auto comments correctly. palgarvio parents: 104 diff changeset	406 # multiple lines.
80 116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	407 #: utils.py:3
116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	408 msgid "bar"
116e34b8cefa Added support for translator comments at the API and frontends levels.(See #12, item 1). Updated docs and tests accordingly. palgarvio parents: 56 diff changeset	409 msgstr ""''', buf.getvalue().strip())
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	410
190 5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	411 def test_po_with_obsolete_message(self):
181 8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	412 catalog = Catalog()
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	413 catalog.add(u'foo', u'Voh', locations=[('main.py', 1)])
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	414 catalog.obsolete['bar'] = Message(u'bar', u'Bahr',
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	415 locations=[('utils.py', 3)],
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	416 user_comments=['User comment'])
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	417 buf = StringIO()
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	418 pofile.write_po(buf, catalog, omit_header=True)
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	419 self.assertEqual('''#: main.py:1
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	420 msgid "foo"
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	421 msgstr "Voh"
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	422
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	423 # User comment
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	424 #~ msgid "bar"
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	425 #~ msgstr "Bahr"''', buf.getvalue().strip())
8a762ce37bf7 The frontends now provide ways to update existing translations catalogs from a template. Closes #22. cmlenz parents: 175 diff changeset	426
190 5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	427 def test_po_with_multiline_obsolete_message(self):
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	428 catalog = Catalog()
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	429 catalog.add(u'foo', u'Voh', locations=[('main.py', 1)])
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	430 msgid = r"""Here's a message that covers
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	431 multiple lines, and should still be handled
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	432 correctly.
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	433 """
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	434 msgstr = r"""Here's a message that covers
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	435 multiple lines, and should still be handled
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	436 correctly.
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	437 """
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	438 catalog.obsolete[msgid] = Message(msgid, msgstr,
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	439 locations=[('utils.py', 3)])
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	440 buf = StringIO()
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	441 pofile.write_po(buf, catalog, omit_header=True)
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	442 self.assertEqual(r'''#: main.py:1
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	443 msgid "foo"
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	444 msgstr "Voh"
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	445
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	446 #~ msgid ""
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	447 #~ "Here's a message that covers\n"
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	448 #~ "multiple lines, and should still be handled\n"
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	449 #~ "correctly.\n"
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	450 #~ msgstr ""
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	451 #~ "Here's a message that covers\n"
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	452 #~ "multiple lines, and should still be handled\n"
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	453 #~ "correctly.\n"''', buf.getvalue().strip())
5041d90edf0c Correctly write out obsolete messages spanning multiple lines. Fixes #33. cmlenz parents: 181 diff changeset	454
191 c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	455 def test_po_with_obsolete_message_ignored(self):
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	456 catalog = Catalog()
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	457 catalog.add(u'foo', u'Voh', locations=[('main.py', 1)])
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	458 catalog.obsolete['bar'] = Message(u'bar', u'Bahr',
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	459 locations=[('utils.py', 3)],
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	460 user_comments=['User comment'])
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	461 buf = StringIO()
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	462 pofile.write_po(buf, catalog, omit_header=True, ignore_obsolete=True)
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	463 self.assertEqual('''#: main.py:1
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	464 msgid "foo"
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	465 msgstr "Voh"''', buf.getvalue().strip())
c171a0041ad2 Add an option to the frontend commands for catalog updating that removes completely any obsolete messages, instead of putting them comments. cmlenz parents: 190 diff changeset	466
203 fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	467 def test_po_with_previous_msgid(self):
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	468 catalog = Catalog()
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	469 catalog.add(u'foo', u'Voh', locations=[('main.py', 1)],
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	470 previous_id=u'fo')
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	471 buf = StringIO()
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	472 pofile.write_po(buf, catalog, omit_header=True, include_previous=True)
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	473 self.assertEqual('''#: main.py:1
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	474 #\| msgid "fo"
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	475 msgid "foo"
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	476 msgstr "Voh"''', buf.getvalue().strip())
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	477
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	478 def test_po_with_previous_msgid_plural(self):
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	479 catalog = Catalog()
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	480 catalog.add((u'foo', u'foos'), (u'Voh', u'Voeh'),
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	481 locations=[('main.py', 1)], previous_id=(u'fo', u'fos'))
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	482 buf = StringIO()
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	483 pofile.write_po(buf, catalog, omit_header=True, include_previous=True)
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	484 self.assertEqual('''#: main.py:1
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	485 #\| msgid "fo"
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	486 #\| msgid_plural "fos"
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	487 msgid "foo"
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	488 msgid_plural "foos"
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	489 msgstr[0] "Voh"
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	490 msgstr[1] "Voeh"''', buf.getvalue().strip())
fc1f8cd448fc Minor changes to how previous msgids are processed. cmlenz parents: 199 diff changeset	491
249 51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	492 def test_sorted_po(self):
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	493 catalog = Catalog()
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	494 catalog.add(u'bar', locations=[('utils.py', 3)],
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	495 user_comments=['Comment About `bar` with',
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	496 'multiple lines.'])
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	497 catalog.add((u'foo', u'foos'), (u'Voh', u'Voeh'),
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	498 locations=[('main.py', 1)])
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	499 buf = StringIO()
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	500 pofile.write_po(buf, catalog, sort_output=True)
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	501 value = buf.getvalue().strip()
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	502 assert '''\
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	503 # Comment About `bar` with
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	504 # multiple lines.
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	505 #: utils.py:3
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	506 msgid "bar"
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	507 msgstr ""
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	508
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	509 #: main.py:1
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	510 msgid "foo"
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	511 msgid_plural "foos"
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	512 msgstr[0] "Voh"
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	513 msgstr[1] "Voeh"''' in value
51a1f6101fa6 added test cases for correct po/mofile sorting, following up r264 pjenvey parents: 228 diff changeset	514 assert value.find('msgid ""') < value.find('msgid "bar"') < value.find('msgid "foo"')
24 b09e90803d1b Reimplement line wrapping for PO writing (as the `textwrap` module is too destructive with white space) and move it to the `normalize` function (which was already doing some handling of line breaks). cmlenz parents: 17 diff changeset	515
356 4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	516 def test_silent_location_fallback(self):
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	517 buf = StringIO('''\
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	518 #: broken_file.py
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	519 msgid "missing line number"
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	520 msgstr ""
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	521
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	522 #: broken_file.py:broken_line_number
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	523 msgid "broken line number"
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	524 msgstr ""''')
4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	525 catalog = pofile.read_po(buf)
377 d0ee047cd3ae Use item access to catalog messages in tests, so that they can be easily ported back to the 0.9.x branch. cmlenz parents: 370 diff changeset	526 self.assertEqual(catalog['missing line number'].locations, [])
d0ee047cd3ae Use item access to catalog messages in tests, so that they can be easily ported back to the 0.9.x branch. cmlenz parents: 370 diff changeset	527 self.assertEqual(catalog['broken line number'].locations, [])
356 4cdca48fc832 Fixed #59 by falling back silently on invalid location comments. aronacher parents: 350 diff changeset	528
582 3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	529
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	530 class PofileFunctionsTestCase(unittest.TestCase):
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	531
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	532 def test_unescape(self):
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	533 escaped = u'"Say:\\n \\"hello, world!\\"\\n"'
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	534 unescaped = u'Say:\n "hello, world!"\n'
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	535 self.assertNotEqual(unescaped, escaped)
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	536 self.assertEqual(unescaped, pofile.unescape(escaped))
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	537
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	538 def test_unescape_of_quoted_newline(self):
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	539 # regression test for #198
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	540 self.assertEqual(r'\n', pofile.unescape(r'"\\n"'))
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	541
3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	542
1 7870274479f5 Import of initial code base. cmlenz parents: diff changeset	543 def suite():
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	544 suite = unittest.TestSuite()
544 ea0254950175 catalog.add() now returns the message instance (closes #245) fschwarz parents: 531 diff changeset	545 suite.addTest(doctest.DocTestSuite(pofile, optionflags=doctest.ELLIPSIS))
106 2cd83f77cc98 Fix for #16: the header message (`msgid = ""`) is now treated specially by `read_po` and `Catalog`. cmlenz parents: 105 diff changeset	546 suite.addTest(unittest.makeSuite(ReadPoTestCase))
104 395704fda00b Merged `write_pot` and `write_po` functions by moving more functionality to the `Catalog` class. This is certainly not perfect yet, but moves us in the right direction. cmlenz parents: 103 diff changeset	547 suite.addTest(unittest.makeSuite(WritePoTestCase))
582 3fd7fb953633 fix handling of messages containing '\\n' (#171) fschwarz parents: 545 diff changeset	548 suite.addTest(unittest.makeSuite(PofileFunctionsTestCase))
1 7870274479f5 Import of initial code base. cmlenz parents: diff changeset	549 return suite
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	550
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	551 if __name__ == '__main__':
7870274479f5 Import of initial code base. cmlenz parents: diff changeset	552 unittest.main(defaultTest='suite')

Mercurial > babel > mirror

annotate babel/messages/tests/pofile.py @ 582:3fd7fb953633 trunk