Mercurial Mercurial > pub > hg > cubicweb / annotate
summary | shortlog | changelog | graph | tags | bookmarks | branches | files | changeset | file | latest | revisions | annotate | diff | comparison | raw | help
Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
test/unittest_dataimport.py
author Julien Cristau <julien.cristau@logilab.fr>
Wed, 26 Mar 2014 11:08:09 +0100
branchstable
changeset 9589 7e4897901c64
parent 9181 2eac0aa1d3f6
child 9695 aa982b7c3f2a
permissions -rw-r--r--
[migration] Improve update of in-memory schema during 3.18 CWAttribute.defaultval change We weren't updating the schema properly so a bunch of structures still had the old rdef with 'String' as object. That caused failures to add new attributes later in the migration as their default value would be a Binary object but the schema would expect a String. Closes #3683640
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
9181
2eac0aa1d3f6 [dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset 
     1
 
from StringIO import StringIO
2eac0aa1d3f6 [dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset 
     2
 
from logilab.common.testlib import TestCase, unittest_main
2eac0aa1d3f6 [dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset 
     3
 
from cubicweb import dataimport
2eac0aa1d3f6 [dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset 
     4
 
class UcsvreaderTC(TestCase):
2eac0aa1d3f6 [dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset 
     5
 












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




     6


    def test_empty_lines_skipped(self):












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




     7


        stream = StringIO('''a,b,c,d,












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




     8


1,2,3,4,












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




     9


,,,,












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    10


,,,,












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    11


''')












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    12


        self.assertEqual([[u'a', u'b', u'c', u'd', u''],












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    13


                          [u'1', u'2', u'3', u'4', u''],












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    14


                          ],












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    15


                         list(dataimport.ucsvreader(stream)))












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    16


        stream.seek(0)












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    17


        self.assertEqual([[u'a', u'b', u'c', u'd', u''],












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    18


                          [u'1', u'2', u'3', u'4', u''],












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    19


                          [u'', u'', u'', u'', u''],












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    20


                          [u'', u'', u'', u'', u'']












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    21


                          ],












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    22


                         list(dataimport.ucsvreader(stream, skip_empty=False)))












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    23














2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    24














2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    25


if __name__ == '__main__':












2eac0aa1d3f6
[dataimport] ucsvreader should skip empty lines unless specified otherwise. Closes #3035944



Sylvain Thénault <sylvain.thenault@logilab.fr>


parents: 

diff
changeset




    26


    unittest_main()














cubicweb