misc/migration/3.14.4_Any.py
author Vladimir Popescu <vladimir.popescu@logilab.fr>
Tue, 12 Mar 2013 18:31:15 +0100
changeset 8836 8a57802d40d3
parent 8375 7d8979176bc0
child 9450 af4b93bc38a5
permissions -rw-r--r--
[cubicweb/doc] Add tutorial on data import in CubicWeb. This involves creating the "tutorials/dataimport" directory structure under "cubicweb/doc" and, inside the "dataimport" directory, putting several files: - a ResT file containing the tutorial *per se*; this tutorial addresses the following issues: * creating a CubicWeb schema for representing a given data set (here, the Diseasome RDF data, for illustration purposes); * parsing the data; * importing the data, by using several stores: + the ``RQLObjectStore``, ``NoHookRQLObjectStore`` and ``SQLGenObjectStore`` from the ``dataimport`` module in CubicWeb; + the ``MassiveObjectStore`` from the ``dataimport`` module in the ``dataio`` cube. The tutorial also provides timing benchmarks of the various stores. - a set of Python files illustrating the data import, in the context of Diseasome RDF data parsing: * a Diseasome RDF data parse module, * a Diseasome data import module, * a CubicWeb schema for representing Diseasome data.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
8205
14c52c5ee706 [entities system table] change asource and source column size (closes #1951819)
Alexandre Richardson <alexandre.richardson@logilab.fr>
parents:
diff changeset
     1
from yams import schema2sql as y2sql
14c52c5ee706 [entities system table] change asource and source column size (closes #1951819)
Alexandre Richardson <alexandre.richardson@logilab.fr>
parents:
diff changeset
     2
14c52c5ee706 [entities system table] change asource and source column size (closes #1951819)
Alexandre Richardson <alexandre.richardson@logilab.fr>
parents:
diff changeset
     3
dbhelper = repo.system_source.dbhelper
14c52c5ee706 [entities system table] change asource and source column size (closes #1951819)
Alexandre Richardson <alexandre.richardson@logilab.fr>
parents:
diff changeset
     4
rdefdef = schema['CWSource'].rdef('name')
14c52c5ee706 [entities system table] change asource and source column size (closes #1951819)
Alexandre Richardson <alexandre.richardson@logilab.fr>
parents:
diff changeset
     5
attrtype = y2sql.type_from_constraints(dbhelper, rdefdef.object, rdefdef.constraints).split()[0]
14c52c5ee706 [entities system table] change asource and source column size (closes #1951819)
Alexandre Richardson <alexandre.richardson@logilab.fr>
parents:
diff changeset
     6
8263
a73ad255ff63 [migration/3.14.4] use the right API else we break sqlserver instances (closes #2211248)
Aurelien Campeas <aurelien.campeas@logilab.fr>
parents: 8205
diff changeset
     7
cursor = session.cnxset['system']
8375
7d8979176bc0 fix an horrible typo
Aurelien Campeas <aurelien.campeas@logilab.fr>
parents: 8374
diff changeset
     8
sql('UPDATE entities SET asource = source WHERE asource is NULL')
8263
a73ad255ff63 [migration/3.14.4] use the right API else we break sqlserver instances (closes #2211248)
Aurelien Campeas <aurelien.campeas@logilab.fr>
parents: 8205
diff changeset
     9
dbhelper.change_col_type(cursor, 'entities', 'asource', attrtype, False)
a73ad255ff63 [migration/3.14.4] use the right API else we break sqlserver instances (closes #2211248)
Aurelien Campeas <aurelien.campeas@logilab.fr>
parents: 8205
diff changeset
    10
dbhelper.change_col_type(cursor, 'entities', 'source', attrtype, False)
a73ad255ff63 [migration/3.14.4] use the right API else we break sqlserver instances (closes #2211248)
Aurelien Campeas <aurelien.campeas@logilab.fr>
parents: 8205
diff changeset
    11
dbhelper.change_col_type(cursor, 'deleted_entities', 'source', attrtype, False)