misc/migration/3.10.5_Any.py
author Vladimir Popescu <vladimir.popescu@logilab.fr>
Tue, 12 Mar 2013 18:31:15 +0100
changeset 8836 8a57802d40d3
parent 6622 27402fe6a94a
permissions -rw-r--r--
[cubicweb/doc] Add tutorial on data import in CubicWeb. This involves creating the "tutorials/dataimport" directory structure under "cubicweb/doc" and, inside the "dataimport" directory, putting several files: - a ResT file containing the tutorial *per se*; this tutorial addresses the following issues: * creating a CubicWeb schema for representing a given data set (here, the Diseasome RDF data, for illustration purposes); * parsing the data; * importing the data, by using several stores: + the ``RQLObjectStore``, ``NoHookRQLObjectStore`` and ``SQLGenObjectStore`` from the ``dataimport`` module in CubicWeb; + the ``MassiveObjectStore`` from the ``dataimport`` module in the ``dataio`` cube. The tutorial also provides timing benchmarks of the various stores. - a set of Python files illustrating the data import, in the context of Diseasome RDF data parsing: * a Diseasome RDF data parse module, * a Diseasome data import module, * a CubicWeb schema for representing Diseasome data.
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
6622
27402fe6a94a [core schema] CWSourceHostConfig.match_host only unique per source
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents: 6621
diff changeset
     1
sync_schema_props_perms('CWSourceHostConfig', syncperms=False)
6621
11c09415078b [migration] stupid typo, cw_source still not properly set
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset
     2
11c09415078b [migration] stupid typo, cw_source still not properly set
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset
     3
sql('INSERT INTO cw_source_relation(eid_from, eid_to) '
11c09415078b [migration] stupid typo, cw_source still not properly set
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset
     4
    'SELECT e.eid,s.cw_eid FROM entities as e, cw_CWSource as s '
11c09415078b [migration] stupid typo, cw_source still not properly set
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset
     5
    'WHERE s.cw_name=e.source AND NOT EXISTS(SELECT 1 FROM cw_source_relation WHERE eid_from=e.eid AND eid_to=s.cw_eid)')
11c09415078b [migration] stupid typo, cw_source still not properly set
Sylvain Thénault <sylvain.thenault@logilab.fr>
parents:
diff changeset
     6
commit()