David Douard <david.douard@logilab.fr> [Thu, 11 Jun 2015 10:17:41 +0200] rev 10515
[cwxml parser] refactor url handling code to use urlparse and urlencode (related to #5456849)
Sylvain Thénault <sylvain.thenault@logilab.fr> [Fri, 26 Jun 2015 15:00:07 +0200] rev 10514
add use_extid_as_cwuri ext entity transform, that will be often necessary and not so easy to write at once
Sylvain Thénault <sylvain.thenault@logilab.fr> [Fri, 26 Jun 2015 11:15:25 +0200] rev 10513
[dataimport] dispatch and deprecate old code
previously, the whole dataimport.py content has been copied in
dataimport/__init__.py, then dataimport/importer.py API has been introduced.
Following these changes, this cset:
* dispatch __init__ code into sub-modules
* dispatch unittest_dataimport accordingly
* deprecates functions and classes that are deprecated by the new API
Related to #5414753.
Denis Laxalde <denis.laxalde@logilab.fr> [Tue, 30 Jun 2015 23:17:45 +0200] rev 10512
Add tox.ini file
* Factor out `commands` for most environments using {envname} substitution to
build pytest commande.
* Positional arguments are passed on to `pytest` (others may also be passed
after a `--`).
* Set PATH env variable for tests requiring PostgreSQL.
* Also added a `doc` target to build the book.
Also update .hgignore exclude .tox directory (where virtualenvs will be
created and cubicweb.egg-info created by sdist command).
Closes #5447161.
Denis Laxalde <denis.laxalde@logilab.fr> [Mon, 29 Jun 2015 22:34:58 +0200] rev 10511
Add requirements.txt files in test directories
These files, located in each test directory (when needed), list test
dependencies supplementary to install requirements.
Some requirements.txt files include psycopg2 because it won't get installed by
logilab-database apparently.
Related to #5447161.
Rémi Cardona <remi.cardona@logilab.fr> [Mon, 09 Mar 2015 10:49:03 +0100] rev 10510
Spelling fixes in comments and docstrings
Rémi Cardona <remi.cardona@logilab.fr> [Wed, 08 Apr 2015 11:29:24 +0200] rev 10509
[web/views] Clean up confusing backwards compatibility code
Dead code since fbb370195199, related to #4943392.
Julien Cristau <julien.cristau@logilab.fr> [Thu, 02 Jul 2015 09:25:45 +0200] rev 10508
[server/test] avoid lgdb warnings from str to unicode conversion
Rémi Cardona <remi.cardona@logilab.fr> [Fri, 03 Jul 2015 15:18:24 +0200] rev 10507
[web/test] Modernize unittest_propertysheet.py
- remove call to os.makedirs in global scope
- fold CACHEDIR as an instance attribute
- bonus: use unittest directly instead of lgc.testlib
Rémi Cardona <remi.cardona@logilab.fr> [Fri, 03 Jul 2015 12:20:48 +0200] rev 10506
[web/webconfig] Drop pre-3.9 backward compatibility method "has_resource"
Rémi Cardona <remi.cardona@logilab.fr> [Fri, 03 Jul 2015 12:07:44 +0200] rev 10505
[web] Stop using negative indices with os.stat results
The python doc says:
More items may be added at the end by some implementations.
.st_mtime is also more readable than [-2].
David Douard <david.douard@logilab.fr> [Fri, 03 Jul 2015 13:43:40 +0200] rev 10504
[doc] small rst fixes and cleanups in changelog files
Related to #4832808
David Douard <david.douard@logilab.fr> [Fri, 03 Jul 2015 13:44:01 +0200] rev 10503
[doc] make the changelog chapter a one html page
Related to #4832808
David Douard <david.douard@logilab.fr> [Fri, 03 Jul 2015 12:18:56 +0200] rev 10502
[doc] reformat changes files headers
to remove the "what's new" phrasing and add the publication date instead.
Related to #4832808
David Douard <david.douard@logilab.fr> [Fri, 03 Jul 2015 12:07:29 +0200] rev 10501
[doc] remove mentions of pyro and reposity instance type
from the concepts chapter
Related to #4832808
David Douard <david.douard@logilab.fr> [Fri, 03 Jul 2015 11:37:58 +0200] rev 10500
[doc] put the tutorials between the intro and the `Repository development` toc of the book
Related to #4832808
David Douard <david.douard@logilab.fr> [Fri, 03 Jul 2015 14:07:53 +0200] rev 10499
[doc] move the documentations from docstring directly to the book.
and improve a bit API documentations.
Related to #4832808
David Douard <david.douard@logilab.fr> [Fri, 03 Jul 2015 15:23:14 +0200] rev 10498
[predicates] remove deprecated sentences in docstrings
David Douard <david.douard@logilab.fr> [Fri, 03 Jul 2015 14:06:57 +0200] rev 10497
[predicates] objectify the anonymous_user predicate
for the sake of consistency.
David Douard <david.douard@logilab.fr> [Thu, 02 Jul 2015 19:54:25 +0200] rev 10496
[doc] more fixes of warnings/errors in doc build
- move 3.21.rst changelog description at it's proper place
- include changelogs in the main index
- few typos
- add :noindex: for autoxxx directives not in api/
Related to #4832808
Julien Cristau <julien.cristau@logilab.fr> [Tue, 23 Jun 2015 17:04:40 +0200] rev 10495
[doc] fix warnings/errors in doc build
- fix links to images
- fix a couple of typos
- re-add IDownloadableOneLineView doc
- rename documenting.rst back to .txt, it's intended as a doc of how to
write rst, not part of the rst doc
Related to #4832808
Christophe de Vienne <christophe@unlish.com> [Thu, 08 Jan 2015 23:00:56 +0100] rev 10494
[doc] Start documenting the API
Related to #4832808
Christophe de Vienne <christophe@unlish.com> [Thu, 08 Jan 2015 23:00:33 +0100] rev 10493
[doc] Remove useless indexes
Related to #4832808
Christophe de Vienne <christophe@unlish.com> [Thu, 08 Jan 2015 23:06:12 +0100] rev 10492
[doc] Insert the dev docs in the toc
Related to #4832808
Christophe de Vienne <christophe@unlish.com> [Thu, 08 Jan 2015 22:11:06 +0100] rev 10491
[doc] Restructure the documentation
* Create a new index file
* Move the sphinx configuration files do the documentation root
* Move book/README to dev/documenting.rst
* Move book/mode_plan.py to tools/
* Move book/en/images to images
* Move book/en/* to book/
* Move changelogs to changes/*
* Adapt the Makefile
* Add a title to the javascript api index
Related to #4832808
Julien Cristau <julien.cristau@logilab.fr> [Mon, 06 Jul 2015 17:39:35 +0200] rev 10490
[migration/3.21.0] performance and reliability fixes
- use EXCEPT instead of NOT IN, seems to improve performance
dramatically on postgresql
- delete rows from cw_<etype> tables whose eid is unknown
- deal with missing/dangling required inline relations (by deleting the
subject entities) instead of asserting
- fix/improve print statements
- don't ask for confirmation before running pure select queries
Julien Cristau <julien.cristau@logilab.fr> [Mon, 06 Jul 2015 17:15:24 +0200] rev 10489
[serverctl] fix source-sync command
Closes #5491700
Julien Cristau <julien.cristau@logilab.fr> [Tue, 07 Jul 2015 10:41:34 +0200] rev 10488
[server] missing import
Fixes NameError in an unlikely error case.
Julien Cristau <julien.cristau@logilab.fr> [Thu, 02 Jul 2015 10:15:47 +0200] rev 10487
[server/test] stop using email cube
- make unittest_migractions use a separate datadir, and add a fake email
cube there (we use it to test {add,drop}_cube, so need something that
looks like a cube)
- for the other test modules, just copy what we need from cubicweb-email's
schema to our test schema
Rémi Cardona <remi.cardona@logilab.fr> [Thu, 02 Jul 2015 16:13:05 +0200] rev 10486
[web/views] Remove unused variable
Rémi Cardona <remi.cardona@logilab.fr> [Thu, 02 Jul 2015 15:33:03 +0200] rev 10485
[server/session] bring anonymous_connection back
Fixes cubicweb-comment.
Rémi Cardona <remi.cardona@logilab.fr> [Thu, 02 Jul 2015 15:31:48 +0200] rev 10484
[migration/3.21] idempotency fixes
Drop constraints before (re)creating them
This is postgresql-specific syntax, sqlserver needs work.
Rémi Cardona <remi.cardona@logilab.fr> [Thu, 02 Jul 2015 12:19:49 +0200] rev 10483
[migration/3.21] Make index and table creation idempotent
Julien Cristau <julien.cristau@logilab.fr> [Thu, 02 Jul 2015 15:44:49 +0200] rev 10482
[migration/3.21] Add missing foreign keys when upgrading
Try to delete dangling relations, since there's no point in keeping
them.
Related to #4846892.
Sylvain Thénault <sylvain.thenault@logilab.fr> [Wed, 01 Jul 2015 12:03:00 +0200] rev 10481
[schema2sql] properly consider skip_relations parameters.
This is the same bug as yams #286912. Also, introducing a unique function
telling if the relation should have a table or not unhide some other problems
related to computed relation, or missing skipped relations information.
Julien Cristau <julien.cristau@logilab.fr> [Thu, 02 Jul 2015 09:20:02 +0200] rev 10480
[hooks/test] don't rely on RelationDefinition implicitly
Its presence in globals is deprecated and going away.
Laura Médioni <laura.medioni@logilab.fr> [Thu, 11 Jun 2015 16:51:51 +0200] rev 10479
[web] write css_class to attrs on rendering and not on button creation
Because css_class attribute may be overriden by bootstrap after button creation and this
modification has to be taken into account.
closes #5457548
Julien Cristau <julien.cristau@logilab.fr> [Fri, 26 Jun 2015 14:30:24 +0200] rev 10478
[statsd_logger] handle ipv6 addresses
David Douard <david.douard@logilab.fr> [Mon, 04 May 2015 17:37:43 +0200] rev 10477
implement a simple statsd logger (closes #5488711)
and add a few timing probes on:
- etwist.server.CubicWebRootResource.render_request()
- server.querier.QuerierHelper.execute()
- server.sources.native.NativeSQLSource:
- sqlexec()
- compile_rql()
- authenticate()
- doexec()
- doexecmany()
as well as a pair of counters on server.querier.QuerierHelper cache (hit/miss).
Adrien Di Mascio <Adrien.DiMascio@logilab.fr> [Wed, 01 Jul 2015 21:00:13 +0200] rev 10476
[predicates] ExpectedValuePredicate now accepts a dict parameter
``match_form_params`` and ``match_kwargs`` benefit from that.
For instance, the following statements are valid::
__select__ = match_form_params('vid', 'subvid')
__select__ = match_form_params(vid='list', subvid='incontext')
__select__ = match_form_params(vid=('list', 'tsearch'))
In the latter cases, not only the parameters (``vid``/``subvid``)
must be in the request form but their corresponding value must also match
the expected values (or one of possible choices if `values` is a sequence).
closes #5484070
Christophe de Vienne <christophe@unlish.com> [Thu, 18 Jun 2015 18:26:02 +0200] rev 10475
[rql2sql] Fix iter_exists_sols() excessive cleaning of _state.tables
Closes #5503548
David Douard <david.douard@logilab.fr> [Thu, 25 Jun 2015 22:12:49 +0200] rev 10474
[cwctl] allow overriding config settings from the command line (closes #5557656)
eg.
cubicweb-ctl start -p port:8082 myapp
to overload the port parameter defined in the all-in-one.conf file.
Sylvain Thénault <sylvain.thenault@logilab.fr> [Fri, 26 Jun 2015 13:04:25 +0200] rev 10473
avoid sanitizing warnings
Julien Cristau <julien.cristau@logilab.fr> [Fri, 26 Jun 2015 14:04:16 +0200] rev 10472
[devtools] avoid warning about source['global-db-name']
sqlite and postgres db handlers store the db template name there.
Julien Cristau <julien.cristau@logilab.fr> [Fri, 26 Jun 2015 10:52:03 +0200] rev 10471
[skeleton] remove no-break space from skeleton setup.py
Julien Cristau <julien.cristau@logilab.fr> [Fri, 26 Jun 2015 10:51:16 +0200] rev 10470
[server/test] drop unused import
Julien Cristau <julien.cristau@logilab.fr> [Fri, 26 Jun 2015 10:50:59 +0200] rev 10469
[doc] update 3.21 release notes
Rémi Cardona <remi.cardona@logilab.fr> [Fri, 26 Jun 2015 16:28:56 +0200] rev 10468
[devtools] Sort _cw_fields in fake_form
Try to generate a predictable string, to help testing with PYTHONHASHSEED=random.
Rémi Cardona <remi.cardona@logilab.fr> [Fri, 26 Jun 2015 16:29:28 +0200] rev 10467
[entity] sort fetchattrs when generating rql
Try to generate a predictable rql query, to help testing with
PYTHONHASHSEED=random.
Rémi Cardona <remi.cardona@logilab.fr> [Fri, 26 Jun 2015 16:27:37 +0200] rev 10466
Update hgignore for temporary test databases
Samuel Trégouët <samuel.tregouet@logilab.fr> [Fri, 03 Apr 2015 17:59:10 +0200] rev 10465
[js] removed unused and broken SuggestForm Widget (closes #5213487)
Rémi Cardona <remi.cardona@logilab.fr> [Tue, 30 Jun 2015 15:06:36 +0200] rev 10464
[test] Fix unittest_i18n to run properly with "pytest -t" (closes #5576169)
When running "pytest -t", many tests modules will be imported and run
within a single python process. unittest_i18n fails when run after tests
such as unittest_webtest.py or unittest_httptest.py.
The main reason is that unittest_i18n does various tricks to add a test
cube to the search path, which badly fails when a previous test module
has already loaded "stuff" (for lack of a better word).
Instead, let's just call the 'i18ncube' command with subprocess.
The change from logilab.common.testlib to unittest is not directly
needed, but comes as a free cleanup with the above changes.
Julien Cristau <julien.cristau@logilab.fr> [Mon, 29 Jun 2015 16:58:43 +0200] rev 10463
[server/test] fix random error in unittest_security
When entering a new Connection, we cache the user and its 'login'
attribute (with no permissions checking).
This test makes 'CWUser.login' unreadable by guests, and then proceeds
to make sure the 'anon' user can actually not read any 'login'
attribute. However, due to the above cnx initialization, anon's login
is actually cached, hence readable. This happens to make the test fail
sometimes depending on the order in which CWUser entities are returned,
because one of them has .complete() called, which as a side effect sets
the attribute cache to None for unreadable attributes.
Call .complete() on both entities to reset the login cache. While this
is still highly debatable, at least it's consistent.
Julien Cristau <julien.cristau@logilab.fr> [Mon, 29 Jun 2015 16:41:36 +0200] rev 10462
[entity] fix typo in comment
Denis Laxalde <denis.laxalde@logilab.fr> [Fri, 26 Jun 2015 16:10:33 +0200] rev 10461
[doc] Add a tutorial and extend documentation for ExtEntityImporter
Related to #5414753.
Yann Voté <yann.vote@logilab.fr> [Fri, 26 Jun 2015 16:09:27 +0200] rev 10460
[dataimport] introduce the importer and extentity classes
This introduces the ``ExtEntity`` class which is a transitional state between
data at external source and the actual CubicWeb entities.
``ExtEntitiesImporter`` is then in charge to turn a bunch of ext entities into
CW entities in repository, using a given store.
This changeset also introduces ``SimpleImportLog`` and ``HTMLImportLog`` which
implement the CW DataImportLog interface in order to show log messages in UI
using simple text and HTML formats respectively, instead of storing these
messages in database.
Both have mostly been backported from cubes.skos.dataimport.
Closes #5414753.
Denis Laxalde <denis.laxalde@logilab.fr> [Fri, 26 Jun 2015 17:01:03 +0200] rev 10459
[test] Use store.prepare_insert_relation instead of deprecated relate method
Follow-up for 1f5026e7d848.
Related to #5040344.
Sylvain Thénault <sylvain.thenault@logilab.fr> [Wed, 24 Jun 2015 23:30:47 +0200] rev 10458
[dataimport] since we have foreign key constraints in the database, 'entities' table should be updated first
Yann Voté <yann.vote@logilab.fr> [Wed, 24 Jun 2015 23:23:57 +0200] rev 10457
[dataimport] Move stores to new API.
Here is the final store API:
* ``prepare_insert_entity(<entity type>, **kwargs) -> eid``: given an entity
type, attributes and inlined relations, return the eid of the entity to be
inserted, *with no guarantee that anything has been inserted in database*,
* ``prepare_update_entity(<entity type>, eid, **kwargs) -> None``: given an
entity type and eid, promise for update given attributes and inlined
relations *with no guarantee that anything has been inserted in database*,
* ``prepare_insert_relation(eid_from, rtype, eid_to) -> None``: indicate that a
relation ``rtype`` should be added between entities with eids ``eid_from``
and ``eid_to``. Similarly to ``prepare_insert_entity()``, *there is no
guarantee that the relation will be inserted in database*,
* ``flush() -> None``: flush any temporary data to database. May be called
several times during an import,
* ``finish() -> None``: additional stuff to do after import is terminated.
**Warning:** ``prepare_update_entity()`` still needs to be implemented for
NoHookRQLObjectStore.
Related to #5040344
Rabah Meradi <rabah.meradi@logilab.fr> [Tue, 23 Jun 2015 13:08:48 +0200] rev 10456
[js] Using appropriate http method when calling a remote function to respect REST principles.
closes #5355952