Vladimir Popescu <vladimir.popescu@logilab.fr> [Tue, 12 Mar 2013 18:31:15 +0100] rev 8836
[cubicweb/doc] Add tutorial on data import in CubicWeb.
This involves creating the "tutorials/dataimport" directory
structure under "cubicweb/doc" and, inside the "dataimport" directory,
putting several files:
- a ResT file containing the tutorial *per se*; this tutorial addresses
the following issues:
* creating a CubicWeb schema for representing a given data set (here,
the Diseasome RDF data, for illustration purposes);
* parsing the data;
* importing the data, by using several stores:
+ the ``RQLObjectStore``, ``NoHookRQLObjectStore`` and
``SQLGenObjectStore`` from the ``dataimport`` module in CubicWeb;
+ the ``MassiveObjectStore`` from the ``dataimport`` module
in the ``dataio`` cube.
The tutorial also provides timing benchmarks of the various stores.
- a set of Python files illustrating the data import, in the context
of Diseasome RDF data parsing:
* a Diseasome RDF data parse module,
* a Diseasome data import module,
* a CubicWeb schema for representing Diseasome data.
Vladimir Popescu <vladimir.popescu@logilab.fr> [Tue, 02 Apr 2013 12:05:51 +0200] rev 8835
[dataimport] Slight message modification in exception handling code.
Vladimir Popescu <vladimir.popescu@logilab.fr> [Tue, 02 Apr 2013 12:04:22 +0200] rev 8834
[dataimport] Handle various data formats when creating buffers from data.
:note: On the long run, this should be addressed before, when these data are
created.
Vladimir Popescu <vladimir.popescu@logilab.fr> [Tue, 02 Apr 2013 12:12:41 +0200] rev 8833
[dataimport] Add a ``flush`` method for all stores.
For ``ObjectStore``, ``RQLObjectStore`` and ``NoHookRQLObjectStore``
the method tries to call the ``commit`` method.
For ``SQLGenObjectStore``, the ``flush`` method is basically
unchanged with respect to previous changesets.