[migration] fix bug in `CWAttributeAddOp.revertprecommit_event` The `rdefdef` attribute is set during the operation execution. In some the operation crash before this assignment. In such case `revertprecommit` raise an attribute error crashing the whole process and shadowing the original error. This changeset detect and Avoid this situation.

[session] security context directly use transaction object when applicable Most of the security logic have been moved on Transaction anyway.

[session] move context manager logic in the security context manager The `init_security` and `reset_security` method have no other user that the context manager itself. Having dedicated public function is not useful.

[session] hook control context directly use transaction object when applicable Most of the hooks control logic have been moved on Transaction anyway.

[session] move context manager logic in the hook controls context manager The `init_hooks_mode_categories` and `reset_hooks_mode_categories` have no other user that the context manager itself. Having dedicated public function is not useful.

[session] drop the useless set_hooks_mode method It has not external user and trivial code

[session/transaction] move most undo support into transaction A small part that need repo access has not been moved into transaction yet.

[session] simplify mode property We can delegate very thing to transaction utility

[session/transaction] pass the session object to the Transaction __init__ This simplify access to variables. As we are moving more and more logic and states in the Transaction it will greatly helps in future commit.

[session] use a dedicated class to track cnxset We introduce a new CnxSetTracker to track `cnxset` used by Transaction and allows to wait for them. This new class does not use Thread ID not thread joining to work. This allows to use multiple transaction per thread and a transaction in multiple thread. The class itself is totally threadsafe by the Transaction is still not thread safe. The old _threads_in_transaction attribute is dropped in favor of a new logic based on this object. The registration of cnxset used is not done by the Transaction itself. tx.cnset is a property handling the Consistency of its value with the CnxSetTracker instance. Note: The CnxSetTracker instance only track transaction id, not transaction itself, So not reference cycle are created.

[session] cleanup Transaction.cnxset The attribute should always be there. It is None when not cnxset exists.

[session] drop useless getter and setter for security Those function have very few user and does not anything fancy. Internal user now access tx.read/write_security directly. External user have been blessed with a writable property. They are only interested in the write part of they did not used the return of the removed function. They access it through the session since I prefer the external world to not be aware of Transaction yet.

[session/transaction] move read_security subtlety in transaction This is transaction data, itshould be handled by the transaction itself.

[transaction] initialize dbapi_request in __init__ There is not reason to have it implicitly declared. The attribute is renamed to match its public name.

[whatsnew] notify drop of deprecated code

[web/views] extract cube embed (closes #1916015)

[skeleton] Update debian packaging to support only python 2.6 and up

Drop iprogress code (closes #2777628)

[web/views] extract cube sioc (closes #1916018)

[doc] Add 3.17 release notes

[migration] mark all version prior 3.7 as non-migrable API possible used by such old migration script are not supported in recent Cubiweb. Closes #2772958

[dataimport] drop checkpoint backward compat API Deprecated since 3.7. See #2772958 for details.

[dataimport] drop index support deprecated since 3.7 Dropping of pre-3.7 API decided in #2772958

[utils] drop pre-3.7 compat in util Dropping of API deprecated since 3.7 decided in #2772958

[migration] drop pre-3.7 utility Dropping of API deprecated since 3.7 decided in #2772958

[entity] drop pre-3.7 api on session Dropping of API deprecated since 3.7 decided in #2772958

drop dubious comment

[req] drop pre-3.7 api on request Dropping of API deprecated since 3.7 decided in #2772958

[session] drop pre-3.7 api on session Dropping of API deprecated since 3.7 decided in #2772958

[transaction] use set operation in the hook control code We use direct operator on set instead of looping by hand, This simplify the codes.

[session/transaction] move hook management in transaction itself This is transaction level code.

[session] allow writable tx_attr and use it for commit_state This keep clarifying the code.

[session/transaction] move add operation in session code

[session/transaction] move entity life utility on transaction This access transaction related data and therefor should live in transaction.

[transaction] small simplification in ecache code A single assignation is simpler.

[session/transaction] move entity cache management on session A new utility method is added for that. It is similar to the one used for attribute access. code is copy pasted as his. Function documentation is added.

[session] have a nice helper function to forward access to session This allows a lighter and clearer code. This will also ease the addition of deprecation warning in the future.

[session] drop dead code session._tx is never None. New transaction are created if necessary.

[session] use tx.data directly in session code.

[transaction] rename transaction_data to data Transaction.transaction_data is redundant. A transaction_data property is left for backward compatibility. Deprecation mechanism will come in later changeset

[session] document Session._tx

[session] split session creation from default session assignation This is the first step for more independence for Transaction.

[session] make session lock reentrant We are going to use it for other session related business. It is renamed from _closed_lock to _lock in the same move.

[session] document set_tx

[session] rename txstore variable to tx This is a more accurate name

[session] rename `_threaddata` to `_tx` The returned object is a Transaction object.

[session] rename self.__threaddata.txdata to self.__threaddata.tx This is Transaction object now.

[session] rename _tx_data into _txs The object inside are now Transaction object. Not TransactionData object.

[transaction] relocate method building transaction context manager It is in the middle of methods going to be refactored.

[transaction] move RQLRewriter in Transaction This remove the last ``AttributeError`` magic. The ``RQLRewriter`` needs a Session. Its reset is handled in ``Session`` code to handle that

[transaction] initialize security control attribute in Transaction There is no reason to not initialize them in __init__ time. This simplify the Session code.

[session] move security constant out of the class There is no reason for it to not be global. This will ease it use by ``Transaction object``.

[transaction] initialize hook control attribute in Transaction There is no reason to not initialize them in __init__ time. this simplify the transaction code.

[session] Move hook control constants out of the class There is no reason for them to not be global. This will ease they use by Transaction object.

[transaction] initialize transaction data and state related attribute. There is not reason to not explicitly declare and initialize attribute in Transaction.__init__. This change requires the introduction of a Transaction.clear() method to get ride of some wicked ``AttributeError`` based logic.

[transaction] handle ``mode`` default value in Transaction The transaction mode is now explicitly passed at creation time and always read from the Transaction object. Note that there is a slight behavior change. The transaction mode is now set at the creation of the transaction. Changes made to the default value have no longer any effect on existing transaction.

[transaction] explicit Transaction cnxset attribute The Transaction object have a lot more attribute that those previously declared in __init__. They are just dynamically assigned in Session code. This changeset explicit the ``cnxset`` and ``mode`` attribute declaration.

[server] rename TransactionData to Transaction Transaction will become a full featured object.

[doc] update Session documentation A major refactoring of Session/Transaction handling is commit. This is a good occasion to improves the documention.

merge 3.16 fix in default

[devtools] fix a couple issues with xvfb-run xvfb-run didn't quite clean up correctly after itself, because: - dash doesn't run EXIT traps on signals - if we don't run the command in the background, a TERM handler doesn't run until the command exits

[devtools/qunit] don't open-code subprocess.Popen.terminate

[devtools/qunit] get rid of unused variable

[server] *init_repository* lookup the database instead of the schema to drop tables (closes #810743) So, tables are dropped even if the schema was changed. :note: if mssql, drop views before tables. :note: because of table dependencies we try a second drop sequence

[book] remove XXX to an old discussion about appengine

[web publish] in case of error, ensure proper http status is set and Content-disposition header is reseted. Closes #2553066

Add CubicWebRequestBase.content (closes #2742453) This is the body of the HTTP request (stream)

add the match_http_method predicate (closes #2559932) This aim at creating views which are selected on other HTTP methods (PUT, DELETE, ...)

[pkg] the previous commit requires new feature in yams.

add a command to compare db schema and file system schema (closes #464991)

drop typed_eid() in favour of int() (closes #2742462) typed_eid was introduced to abstract the eid type when running on Google AppEngine. It is not used anymore and can be removed. Let's use int() instead.

merge with stable

3.15 is the new old stable

[web] don't link to None in author box (when author has been deleted) (closes #2409855)

dbapi: try to restore compatibility of the connect api with 3.15 A few issues here: - urlparse('foo').scheme is '', not None - cnxprops is an optional argument Regression from 62213a34726e ("[db-api/configuration] simplify db-api and configuration so that all the connection information is in the repository url, closes #2521848") Closes #2754322

3.16 is the new stable After discussion with David Douard I'm merging 3.16.x branches in stable and starting 3.17 feature on default.

Added tag cubicweb-debian-version-3.15.10-1 for changeset feca12e4a618

Added tag cubicweb-version-3.15.10 for changeset 89bdb5444cd2

prepare 3.15.10

Added tag cubicweb-debian-version-3.16.1-1 for changeset 84fbcdc8021c

Added tag cubicweb-version-3.16.1 for changeset d95cbb7349f0

prepare 3.16.1

[views/primary] some inner sections should use the `limit` by default to avoid a denial of service (closes #2719110) Today, it is possible to call .related and get a huge unlimited database-dos-inducing resultset that will be nevertheless limited a bit further in pure python in the `autolimited` view. While we cannot completely avoid potential denial of services such as these we mitigate the problem with the default ui settings: if the inner vid is `autolimited`, then the relation result sets is computed using the user-defined limit. This change respects the semantics of the `autolimited` view and shouldn't break anything.

[entity] ensure the .related(entities=False) parameter is honored all the way down (closes #2755994) As of today, such a call will always fill the relation cache by calling .entities() on every single related rset entry. As a consequence, the `limit` parameter handling also had to be fixed. It was bogus in the following ways: * not used in the related_rql, hence potentially huge database requests, but also actually * foolishly used in the .entities()-calling cache routine we now bypass (this changeset ticket's main topic) Now: * we set a limit on the rql expression, and * forbid caching if given a non-None limit (as we don't want to make the cache handling code more complicated than it is already) With this, entity.unrelated gets a better limit implementation (so the code in related/unrelated is nice and symmetric) Risk: * _cw_relation_cache disappears completely, which is good, but this is Python, so you never know ...

[test/web] fix invisibly bogus test (prepares #2755994) The test was wrong but that was cancelled out by a cache effect and fuzzy naming. Wiping the entity caches restores sanity: the choices list are the same before and after the SET. Also field.choices uses entity.unrelated but always returns related + unrelated elements. Hence `choice` replaces `unrelated` where it makes sense. AssertIn is used in place of AssertTrue.

[cwconfig] Fix exception handling when building the cube dependency graph UnorderableGraph exceptions do not have a 'cycles' property. A simple cast to str does the job.

[merge] backport stable fixes

[test/sobject] fix test regression Was complaining: - * updated comment #EID (#EID) ? ^^^^ + * updated comment #EID (duh?) ? ^^^^ in sobjects/test/unittest_supervising.

[web/request] Prune extraneous 'pageid' from generated ajax URL parameters (closes #2758130) If 'pageid' is given through extraparams, it is sent twice to the browser. On the JS side, the final URL loadxhtml() will end up using will have 'pageid' set twice which CubicWeb will readily accept as a list. Pruning this parameter makes sure it is exactly once.

[web/component] Use global variable to point to ajax controller (part of #2758254)

[web] Use the new '/ajax' URL path to access the AjaxController (closes #2758254) 5a81fa526b30 took care of all the JS code, this patch cleans up the remaining python bits.

[devtools/httptest] fix syntax error introduced by ce5ae7b80d2c

[component] Fix URL generation for navigation component (closes #2464832)

merge with another default heads

Merge stable into default (NON-TRIVIAL) - dropping __future__ statement added by d2472948da9c - added migration from 407acc41beb5 to migration file for 3.16.1

maintain python2.5 compatibility

[schema/workflow] one more typo fix Also add proper migration.

[devtools] add http_publish to CubicWebTC (closes #2565882) Fakes a http request, without overriding the normal error handling. Returns the request object so the caller can check for errors.

[testlib] url_publish should give url to the request and the rset returned by the path evaluator to ctrl_publish. Closes #2557468 Also, url_publish now accepts a `data` argument to simulate POST of values.

[towards py3k] import reduce() from functools (part of #2711624)

merge stable fix into default

[doc] document dbapi.Connection

[c-c shell] fix command description (-P option is gone long ago)

[hooks/syncschema] do not crash when adding a new entity type (closes #2741643) The previous version assumed META_RTYPES provide relation definitions for all entity types.

[views/debug] Do not show all web sessions without CNX, just count them (closes #2602161)

[facets js] use $ instead of jQuery and other small cleanups

[devtools/httptest] allow sending other types of requests besides GET

merge with stable

[ext/rest] fix docstring of rql_role()

[web application] Fix missing self. in error_handler

[ldapfeed] all options of a source should be in the same group, else you get AssertionError on c-c add-source. Closes #2538398

[sources] fix classes that inherit from AbstractSource (closes #2718669)

[login] don't redirect to http url if we allow anonymous on https Closes #2583913

Correct typo in example

[testlib] make test_view load the json data Closes #2721472

[etwist] Properly escape traceback output (closes #2712042) Stop using StringIO in the process as well.

[dbapi] Stop shadowing exceptions in get_repository() (closes #2710515) Exceptions are already handled higher up in the stack so there's no reason to handle them here. Furthermore, non-ConnectionError exceptions would get hidden, making debugging harder.

[cwvreg] complete cw.web.uicfg cleanup callback (closes #2718217) 1dd655788ece introduced insufficient backward compat support When cubes directly import uicfg from cubicweb.web (or uihelper) this also creates a reference in the parent cubicweb.web namespace. This must be cleaned up as reloaded cubes will take back this reference and the old versions of its appobjects.

[book] fix typo. remove spurious `i`

[towards py3k] fix bug introduced by 0bb18407c053

[doc] Book entry for the undo functionnality.

[toward py3k] rewrite has_key() (part of #2711624) The `has_key` method is not in Python3K but dict supports __contains__ check for ages.

[toward py3k] rewrite dict.keys() and dict.values() (part of #2711624) Python 3K will only expose iterators. http://docs.python.org/3.0/whatsnew/3.0.html#views-and-iterators-instead-of-lists

[toward-py3k] rewrite to "except AnException as exc:" (part of #2711624) The older form is not necessary since we dropped python 2.5 compability. This will help Python 3.3 experimentation.

[toward-py3k] remove import with_statement (part of #2711624) They are unneeded since we dropped python 2.5 compatibility. This will help Python 3.3 experimentation.

pkg: drop python 2.5 compatibility (closes #2711624) 2.5 is not common anymore. Dropping compatibility will help moving to a code base compatible with Python 3.3

devtools: improve qunit timeout message Make the message clearer, shorter and properly wrapped.

merge default into stable

[devtools] fix broken windmill test case

Added tag cubicweb-debian-version-3.15.9-1 for changeset 29fbc632a696

Added tag cubicweb-version-3.15.9 for changeset 8bfc0753f1da

Added tag cubicweb-debian-version-3.16.0-1 for changeset 853237d1daf6

Added tag cubicweb-version-3.16.0 for changeset 6c7c2a02c9a0

3.15.9

[ldap test] fix bad merge

[merge] backport stable fixes

[cwctl] fix cubicweb-ctl shell command (closes #2583919) * add an uri parsing utility that documents a bit the uri cubicweb supports out of the box * cwctl: use this utility and refactor a bit for clarity (the novelty here being real support for old style 'myapp', or: * 'inmemory://myapp' * 'pyro://pyro-ns-host:pyro-ns-port/myapp' (pyro access through a pyro concentrator) * 'pyroloc://host:port/pyro-instance-id' (direct access to a pyro repository) * 'zmqpickle-tcp://host:port' * dbapi: refactor to sort out some of the complexity and restore functionality lost in 62213a34726e

[ldap test] move the slapd database directory to a tempdir (closes #2583993) This is required to be sure we are not hurt by NFS or such...

[ldap auth] make sure imported passwords from LDAP are encrypted (closes #2583994) When a user is imported from an LDAP source (in ldapfeed or when converting a user from an ldapsource to system one), we may import a clear-text password, which we do not want to do in our system database.

[ldapfeed] don't crash if one specify an unexisting group in the configuration. Closes #2538399

[doc/ldap] update the ldap chapter wrt the ldapfeed source type (closes #2551863)

prepare 3.16

[doc/3.16] complete description of what changed

[rql sources] uses an URL as remote host address for pyro/zmq rql sources, instead of extra configuration parameters. Follows modification of dbapi.connect api. Closes #2539822

[repo sources] move handling of source's url into abstract source as this becomes shared by most sources prepare #2539822

[db-api] rename repo_connect into _repo_connect to mark it private. Closes #2521848

[repository sources] copy source configuration: source's __init__ modify it while config.sources() return a cached dictionary which shouldn't be modified This causes pb since f8aa87a773b2 (though it's unclear why it hasn't been a problem before). Closes #2521848

cleanup repository connect doc: cnxtype is now deprecated / base_url has never been given that way. Follow #2521848

prefix "tcp://" zmq uris with "zmqpickle" (closes #2574114) * it turns "tcp://" into "zmqpickle-tcp://" * will leave room for future non-pickling communications using zmq

[db-api/configuration] simplify db-api and configuration so that all the connection information is in the repository url, closes #2521848 eg no more specific option of pyro ns host, group, etc. This also fixes broken ZMQ sources. Changes: * dropped pyro-ns-host, pyro-instance-id, pyro-ns-group from client side config, in favor of repository-uri. No migration done, supposing there is **no web-only config** in the wild. Also stop discovering the connection method through the repo_method class attribute of the configuration, varying according to the configuration class. This is a first step on the way to a simpler configuration handling. Notice those pyro options are still available for repository only / all-in-one configurations as they are needed to configure the pyro server. * stop telling connection method using ConnectionProperties, this is so boring. Also, drop _cnxtype from Connection and cnxtype from Session. The former is replaced by a is_repo_in_memory property and the later is totaly useless. * deprecate in_memory_cnx which becomes useless, use _repo_connect instead

[ldap test] ensure slapdd launch went fine and move ldapfeed setUp to parent class, as all ldap sources deal with url

[web/uihelper,uicfg] transform uihelper functions into uicfg objects methods (closes #2543949)

make ui configurations selectable (closes #2406609) * introduce a new 'uicfg' registry (storing instances) * use the relevant new APIs from lgc.registry to manage the new registrable uicfg objects * cw event manager useage is gone; instead thze standard registry reloading mechanism is used * ensure i18n commands still work (devctl) * introduce dynamic uicfgs use whenever possible (various views), even though sometimes the classic 'static' usage remains

[uicfg] uicfg.py moves from web/ to web/views/ (prepares #2406609) We are about to make uicfg selectable. Registrable / selectable views and helpers live in web/views. Hence the move. Backward compat is put in place. However CubicWeb imports of uicfg are updated to the new location.

[appobject] introduce RegistrableObject base class (prepares #2406609)

[cwvreg] introduce lgc version 0.59 and remove unneeded method redefinition (prepares #2406609) The new logilab.common.registry makes this moot.

[BFSS] mark fs_imported value as uncachable This will finally fix the `test_bfss_fs_importing_transparency` pass again. Regression was introduced by 4ba11607d84a

[entity] add a "repo_side" parameter to `_cw_dont_cache_attribute` This parameter (defaulting to `False`) is used to inform cubicweb that we really really do not want to cache a value during creation or update. This will be used by a storage that may do very specific processing on attribute values that result in a stored value different than the provided one (e.g. BFSS `fs_importing` mode).

[merge] backport stable fixes

[entities] fix test failures introduced by fixes in workflow related message strings (completes 9bb93efa1952)

[doc/book/] Corrected typo in en/tutorials/base/customizing-the-application.rst, for the add_cubes function call

[entity,views/json] backout 353bbd17a8b6 (reopens #2559931) Calling .complete() unconditionnally from the json encoder is unsafe since on entity creation validation: * an eid may have been drawn (hence even .has_eid() would not help) while processing form data in the edit controller * a ValidationError may have been raised and the entity-creating transaction rollbacked This leads to a crash on the return path from the validation to the browser, where the json_dumps((status, args, entity)) call will stumble upon the .complete() call which will fail because the entity does not (any more) exist in the database.

[schemas] fix typo

merge with stable

[appobject] cleanup module (prepares #2406609) * remove unused imports * break long lines

[uicfg] remove pre 3.6 bw compat structure (prepares #2406609) This should have been done in a673d1d9a738.

[testlib] test_view now parse json data, closes #2557467

Improve entity json export (closes #2559931) Make output from __json_encode__ predictable; use it in the ejsonexport view.

[web/application/test] drop useless code This is already done in CubicWebTC

[test] precheck initial condition

[packaging] Fix search in squeeze cubicweb-documentation package (closes #2558496) Work around broken combination of jquery 1.4 and sphinx 0.6 in squeeze by patching up doctools.js.

[packaging] don't compress txt files (closes #2558496)

[wf/test] fix tests broken by changes from another patch which have slipped there

[merge] backport stable

[web/test] fix stale reference to the changelog view (closes #2423532)

Added tag cubicweb-debian-version-3.15.8-1 for changeset 4ef457479337

Added tag cubicweb-version-3.15.8 for changeset 459d0c48dfaf

[test] fix possible views test (closes #2544358)

prepare 3.15.8

[ldapfeed] if a deactivated user becomes available again in its source, reactivate it (closes #2542776) * cwusers that see their ldap source counterpart disappear are deactivated * until now they were not activated again on reappearance * note this behaviour in the doc

[ldaputils,ldapparser] correctly compute "deleted" users (closes #2542083) * in ldaputils.py, removal of an unneeded method (checking existence of an object in the ldap, but not using the configuration filters) * in the ldapparser, memoize the (filtered) search so as to serve both .process and .is_deleted * add a non regression test for the 'user-filter' source config entry + deletion

[dataimport] new ignore_errors argument to ucsvreader, default to False. Closes #2547200

[ldapsource] keep python 2.5 compatibility (closes #2541602)

[ldapuser2ldapfeed] .values -> .iteritems (closes #2542872)

[ldap tests] cleanup in preparation of #2542083

[ldapparser] demote warning level (actually important user info can leak there) (prepares #2542083)

Remove changelog view (closes #2423532)

[dataimport] Allow to replace escape char in the create_copyfrom_buffer

[doc] fix function name FTIRANK

[json] enable jsonexport selection on empty rsets (closes #2544358)

[test] fix req default value handling in CubicWebTC.view (closes #2544376) It's no more than the standard ``if rset`` vs. ``if rset is None`` error.

[ajax] fix attribute lookup (closes #2491038)

[server] add debugging for Hooks & Operations (closes #2470048)

[dataimport] Add SQL Store for faster import - works ONLY with Postgres for now, as it requires "copy from" command - closes #2410822 This store will use: - copy from for massive insertions. - execute from for update. The API of this store is similar to the other stores.

[test] swap order in assert of `test_users_and_groups_non_readable_by_guests` unittest2 order is (expected, got), not the opposite. This help test report readbility.

[test] fix server/querier/build_descr1 test. There is no self.transaction of TestCase. I assumed the test writer meant a session. This seems to make the test pass.

[server] make `test_bfss_fs_importing_transparency` less verbose on failure Dumping the whole content of a file on failure is a bit annoying. We only print the bad version here (it's usually the file path).

[entity] drop redundant cache update This ``cw_attr_cache`` update is redundant, ``_cw_update_attr_cache`` already do this step.

[cw-ctl] silence msgcat and msgfmt (closes #2527594)

Added tag cubicweb-debian-version-3.15.7-1 for changeset c5400558f370

Added tag cubicweb-version-3.15.7 for changeset d8916cee7b70

prepare 3.15.7

[migration] fix crash when adding a new meta relation type. Closes #2532483

[ldapfeed] fix connection leak (closes #2532528)

[zmq] add an introductive docstring on ZMQComm

[server config] on quick start, system source is still activated. Closes #2535714

[web] use `inline` `Content-Disposition` by default (closes #2535734) since known time we have been serving static file with a `filename` parameter on the `Content-Disposition` header. But since d74addac92bb we explicitly serve file as attachment if a filename is provided. However this is valid to have `inline` disposition and `filename` parameter. This changeset revert this part of d74addac92bb, going back to `inlined` by default. `IDownloadable` code explicitly request `attachment` content to preserve expected behavior.

[web] allow configuration of the Content-disposition value The `set_content_type` function now takes and optional `disposition` parameter to control the value of this HTTP header. Use of `Content-disposition: inline` with a filename parameter are valid, so the presence of filename does not allows to choose between `attachment` and `inline`

[downloadable] fix filename HTTP header for simple name with space (closes #2535715) Since d74addac92bb, we export simple ascii filename without any encoding in the `filename` parameter of the `Content-Disposition` header. If this name contains space this will fails, the parameter value will be truncated at the space position. (eg. `filename=jungle babar.txt` read as `jungle`) We need to quote the filename to prevent this (eg. `filename="jungle babar.txt"`). Then literal quote and backslash needs to be escaped too. The new escaping is correct according this extensive test case data base: http://greenbytes.de/tech/tc2231/

merge fixes from stable

Added tag cubicweb-debian-version-3.15.6-1 for changeset b05e156b8fe7

Added tag cubicweb-version-3.15.6 for changeset 0163bd9f4880

prepare 3.15.6

[web] add a digital signature to error form (closes #2522526) Simple (and quite weak) implementation of a digital signature of the content to be submited by email in the error report view generated by ErrorView. The signature is a simple hmac hash computed using a secret key (generated at repository startup) and the "secret" form content to be included in the notification email. The controller can then check this content has not been modified or forged by a malicious user.

[web/views] bugfix: the mime type is text/plain, not text/txt (closes #2526345)

[doc] fix of personnal etc directory in book

[web] add a Forbidden exception This is similar to the Unauthorized exception, but generates a 403 error instead of a 401 (Unauthorized)

[web] add a ``anonymize-jsonp-queries`` option in file configuration (closes #2465388) This option controls connection anonymizing before executing any query for CSRF / safety reason.

[downloadable] fix filename in HTTP header (closes #2522325, #2522324) Before this changeset we use the `filename` header with utf8 encoded filename all the time. However RFC6266 says: The parameters "filename" and "filename*" differ only in that "filename*" uses the encoding defined in [RFC5987], allowing the use of characters not present in the ISO-8859-1 character set ([ISO-8859-1]). Therefore, we alter the code to: 1. Use `filename` and `ascii` encoding whenever possible, 2. use `filename*` with `utf8` encoding otherwise (with a filename fallback for old browser) We also switch the `content-disposition` value to attachement if filename is specified, this will result as a mandatory download according to RFC6266. This mandatory download is the expected behavior. We changes the filename encoding to RFC5987 which is simpler, supported by all and modern browser (including IE from version 6) and does not suffer from the continuation issue. (see ticket #2522324 for details)

docstring typo

[facet] make BitFieldFacet allow special 0 value. Closes #2522697

[doc] ubuntu LTS is now Precise Pangolin

backport stable

[server] implement base_url with secure=True (closes #2508638)

[validation api] properly use yams 0.36 validation error api and update message catalog. Follows bbe0d6985e59 the creation of the `translate` method in the 23a10f049447 yams commit.

[wsgi] saner use of `self.config` instead of `config`

[server] fix repository initialisation Changeset d753d6a6798f was breaking database creation. Dropping the `config.creating` clause lead to trying to load the schema from database even in creation mode. Conditional are a bit altered and reordered to prevent this to happen.

[web test] make unittest_viewselectors work if rdflib isn't available

[js/ajax] documentation of 'reload' is missing an argument

[ldapfeed] move docstring to the class instead of the module

[hook] fix hook base class so access to __registries__ doesn't call check_event, only call it in registered callback. Closes #2517748

[startup hook/looping tasks] separated hook for each looping task to ease modification from cubes. Closes #2517096

[ldaputils] should use entity.eid instead of entity on raising ValidationError. closes #2517095

[dbapi] provide get_option_value over DBAPIRequest (closes #2515522)

Added tag cubicweb-debian-version-3.15.5-1 for changeset 19e115ae5442

Added tag cubicweb-version-3.15.5 for changeset b0e086f451b7

prepare 3.15.5

[entity attr cache] mark attribute as uncacheable in the underlying function else we may miss some changes. Also rewrite a storage test currently failing because cache of the entity created by the test transaction, distinct from the entity created internally and given to hooks and all, has its attributes cache not updated. As this doesn't seems a proper usage, rewrite it as expected. Much probably closes #2423719 definitly.

[repository] move modification of appobject_path to repository initialization code so we can restore it later to avoid side effect on the config. Fix regression introduced in d32ab8570e5d

[req / session] drop is_internal_session (buggy) compat on base request by implementing necessary methods on internal manager

[check integrity] use session consistently

[test] use session commit/rollback to be consistent with the test

[merge] reintegrate that black sheep

[ldapparser] utf-8 uri + unicode emailaddr will crash if the later is not properly encoded (closes #2508515)

backporting

backport stable

fix no more running zmq repository test (closes #2500153)

[dbapi] load_appobjects must attempt to load available cubicweb configurations to avoid error when some object use a persistent propery (CWProperty) defined there. Closes #2497697

dummy merge

[ajax] reload function should set 'processing' cursor. Closes #2503899

[misc/scripts] a slightly experimental script to help repair LDAPUser cwusers suffering from split-brainite (closes #2497108)

[views/boxes] re-establish the proper selector (closes #2496294)

[ldapparser] raise specific error if the configuration is wrong (closes #2498164)

[skeleton] add pypi classifiers in __pkginfo__ and setup.py (closes #2502156)

[c-c shell -H] add verbosity=0 so we are not asked to confirm everything, as when not using -H

mock ``CWUser.prefered_language()`` on InternalManager objects. The recent split of patches for session refactoring broke this.

[session] fix arguments default value and promote usage of security_enabled as session method. Closes #2481820 One should use session method rather than direct usage of the context manager of the same name. Fix default argument values for consistency with the context manager: when one omit an argument, meaning is "keep the current value", not "disable security".

[session] promote usage of [deny|all]_all_hooks_but session methods rather than hooks_control context manager directly

[web app] move set of status_out into validation_error_handler to ease readability

[workflow test] don't use session.user, subject to internal changes

[db creation test] more testing of db initialization: call build_db_cache and ensure admin user exists

[source synchronization hooks] Fix/enhance system source hooks They are broken if launched during repository initialization (this was not the case yet, but will be soon...). Add additional checks to ensure one doesn't try to store system source config in the database, as it will be ignored in favor of the "sources" file.

[validation error] refactor validation error handling so translation is done on the web side Users should now use cubicweb.validation_error helper function that will activate the feature with other handy behaviours. Also test testing for message in errors should call exception.tr(unicode) before comparing. Using bare ValidationError keep backward compat.

[repo cleanup] drop code moved to querier by 7e264ce34cd4

[repo cleanup] drop code moved to querier by 7e264ce34cd4

Added tag cubicweb-debian-version-3.15.4-1 for changeset 70cb36c826df

Added tag cubicweb-version-3.15.4 for changeset 63260486de89

[facets] add link 'focus on selection' (closes #525277)

[server/utils] catch ValueError from password verification passlib can raise ValueError when it can't recognized a hash. Treat that as a wrong password.

[test] reindent and use request() rather than bare session this avoid error due to implementation details of session

[repo] fix debug code in DBG_REPO mode (closes #2469942)

[datafeed] properly call hooks for inlined relations on entity creation. Closes #2481156

[sources/native] automatically update passwords using deprecated hashes on login Closes #2465904

[repo pyro] fix previous commit: should not import Pyro in remoterql module/base class, it may be missing

massive copyright update to avoid clutering later patches

minor cleanups/typos

[session / querier] reorganize code to building result set descriptions

[web] search state doesn't need cnx, remove useless test

[schema] rename schema permissions function: session may also be a request, use _cw

[repo initialisation] during repo creation, load all hooks and entities code this simplify code and make it more consistent

[request/session] refactor language handling: don't attempt to sync web/repo languages This decouple thing and make code easier to understand. Previous behaviour was fine w/ validation error that were translated on the server side, but isn't satisfying for notification and all. Now: * translations should be done on the ui side (see previous validation error refactoring) * consistent behaviour: each side (web/repo) is responsible to deal with its request/session of language, no weird interaction between them on this topic * drop on the way the 'session properties' api, used only for that matter. -> much simpler/cleaner/saner api The thing missing being a way for user to tell "My favorite language is xxx but I also want cw to consider my http language header)

[config] turn internal configuration methods building appobjects search path into normal method rather than class method as this is useless and make path filters difficult to override (we had to override the class attribute, as instance attributes were not seen). Also rename related methods for consistency with current vocabulary

fix missing import

backport stable

[hooks/syncshema] fix logging level and nicer message (wrong changeset published previously)

[hooks/syncschema] do not crash on DROP of an already dropped index/... (closes #2465393)

[cwctl] show a better diagnostic message on version violation (closes #2464800)

[tabs] fix pb with non-lazy tabs: style isn't properly set due to missing jquery.ui activation. Closes #2465657 also do a small cleanup on the way, and properly implements render_entity rather than cell_call, as one would expect regarding default PrimaryView code.

[migration] fix backward compat for rename_relation

[datafeed] make cnxset handling of datafeed source more robust currently we may run in some cases where the session has no more cnxset depending on errors and parser's handling of the cnxset. Also, free the cnxset and reacquire it later, letting a chance to other threads to run.

don't use rset.rowcount in predicates, this makes them usable with other types such as lists

[c-c db-check] don't skip is/is_instance_of mandatory relation to avoid telling two opposite messages when the relation is missing. Closes #2465659

[ui tabs] avoid duplicate rset argument if already specified in tab kwargs. Closes #2464786

[entity edition] don't remove values from attribute cache on the repository side This follows changesets 552de9f0c46d, 1527b012802f, 25da1e5c7c50 and 4ba11607d84a. closes #2423719 ?

fix ldapuser test

Prepare 3.15.4

migration: replace empty passwords with random ones on upgrade

ldapuser2ldapfeed: create CWUsers with random passwords, not empty ones

[source/native] only system source users should be authenticated by the native source (closes #2465883)

[web test] fix test broken by 199fefe396ab

[fti] add some documentation

[form] add assertion to ensure field has a name when `role_name` is called

Added tag cubicweb-debian-version-3.15.3-1 for changeset 7ad423a5b6a8

Added tag cubicweb-version-3.15.3 for changeset 0e012eb80990

[pkg] prepare 3.15.3 release

[entity edition] stop comparing values as it may trigger exceptions (e.g. timeseries cube tests) Rely on a changes in yams instead where we have guarantee to have only comparable objects. This follows changesets 1527b012802f, 25da1e5c7c50 and 4ba11607d84a, and should definitly closes #2423719

[tabbed view] make tabs optionaly lazy: lazy=False on the tabbed view trigger synchronous tabs. Closes #2443038 This is useful for tabs holding a self-posted form for instance.

[web form] refactor Form.__init__ so that extra kwargs are set earlier in the process. Closes #2443040 (eg if you want to use them in .session_key)

[test rql completion] dont limit number of completion, else we've impredicable results. Also should tell rql.parse to not print error on stdout This repairs test introduced by dcd9bc1d1bca which closes #2439846

[entity] fix deprecation warnings (closes #2423719)

merge oldstable in stable

Added tag cubicweb-debian-version-3.14.9-1 for changeset 68c762adf2d5

Added tag cubicweb-version-3.14.9 for changeset 9337812cef6b

[ui] provide an autocomplete RQL bar (closes #2439846)

[ajax] improve backward compatibility for redefined ajax functions (closes #2447189) If an ajax function from stdlib (e.g. js_reledit_form) was redefined in a cube, the cube version should still takes the precedence< => check for existing ajax function on deprecated controller _before_ checking ajax function availability on the new one.

prepare version 3.14.9

[composite] apply composite on new enty too (closes #2450679) Before this changesets, automatic deletion did not applied to entity created in the same transaction. This patch remove this filtering in the dedicated operation. The original filtering where introduced by 5d889b4928bb but no rational where found for this changes. The former behavior is seen as inconsistent and creates bug in some cubes.

[storage] relies on event=='deleted' to detect "delete" event (closes #2450680) When we delete a previously edited entity, it *will* have a cw_edited attribute even if the goal is to delete it. The function get an argument that explicitly contains the "delete" event. The code now uses that instead.

[composite] apply composite on new enty too Before this changesets, automatic deletion did not applied to entity created in the same transaction. This patch remove this filtering in the dedicated operation. The original filtering where introduced by 5d889b4928bb but no rational where found for this changes. The former behavior is seen as inconsistent and creates bug in some cubes.

[storage] relies on event=='deleted' to detect "delete" event When we delete a previously edited entity, it *will* have a cw_edited attribute even if the goal is to delete it. The function get an argument that explicitly contains the "delete" event. The code now uses that instead.

[web navigation] previous / next icons are missing mandatory alt attribute

[testlib] consider rset for template / view selection (closes #2447183) The original code did something like: kwargs['rset'] = rset viewfunc = lambda **k: viewsreg.main_template(req, template, **kwargs) kwargs.pop('rset') return self._test_view(viewfunc, view, template, kwargs) meaning that by the time ``viewfunc`` (i.e. the lambda function) is called, ``rset`` was popped from ``kwargs`` and had no chance to be passed to ``main_template``.

[documentation] fix some ReST compilation problems

[test] remove no more necessary attribute cache manipulation to repair test

[entity] more tweaks for entity attribute cache handling on cw_set/cw_create to fix test regression * when an attribute is listed in dont-cache-attrs, purge any previous value * test value is actually modified in EditedEntity.__setitem__ before adding attribute to dont-cache-attrs

[entity/hooks] fix regression introduced by 4ba11607d84a on create_entity, attributes weren't cached, but they are since 4ba11607d84a and this triggered a bug: used values may be transformed by hooks (e.g. TidyHtmlFields), ending in invalid value in the cache. This is the regression. Now, set_attributes used to update the attributes cache while suffering from the very same pb. This is the now fixed old bug. Transformed attributes are now recorded in a transaction shared variable, and those are omitted from the client cache.

[doc] use :meth: and remove doc to deprecated methods

[doc] add passlib to list of dependencies

Added tag cubicweb-debian-version-3.15.2-1 for changeset 9aa5553b2652

Added tag cubicweb-version-3.15.2 for changeset 2afc157ea9b2

[test] missing future import

[web test] fix tests broken by 8de41063d629

3.15.2

[web login] fix after login redirection: redirect expect an url not a relative path. Breaks on cases like '?vid=aview'. Closes #2423575

[config] load_configuration should not crash because of fs errors. Closes #2286215

[entity api] unify set_attributes / set_relations into a cw_set method. Closes #2423719 Allowing similar usage as create_entity/cw_instantiate. Update cw code base to remove deprecated calls.

[workflow ui] fix state/transition edition form on existing entity. Closes #2423531 It should not return unrelated entities only in case where the entity exists. Also fix a deprecation warning, vocabulary values should be an unicode string.

[predicates] fix predicates that erroneously evaluate the entity passed as a parameter as a boolean, instead of testing its existence in the keyword arguments -using the kwargs.get('entity') idiom instead of 'entity' in kwargs or similar- ; closes #2424288

[book] fix build warnings/errors. Closes #2430042

[ldap feed] add missing future import

[ldap feed] fix error since with read security activated, password value is not selecteable (closes #2406597). Also add a note in the book about packages required to connect to an ldap server

[config] Set CWDEV, aka dev mode, according to presence of the i18n directory, not .hg

[book] Some tweaks to fix cubicweb-documentation package generation - Fix up PYTHONPATH setting to make sure sphinx can find cubicweb modules - Add a few missing build-dependencies

[webconfig] debug mode should not be special wrt data_url handling (closes #2405487)

[test] missing future import

[ldap] allow working connection to some ADs (closes #2408829)

[entity] fix unrelated_rql for creation form vocabulary for relation with specific permissions (closes #2423854)

[form widgets] fix JQueryDatePicker and JQueryTimePicker so they consider widget custom attributes. Closes #2423720

[web app] handle Redirect raised during session establishment, as this may be used by eg openid authentication. Closes #2430018

backport stable

[ldapuser2ldapfeed] fix confusing script structure and decode the extid to avoid an UnicodeDecodeError (closes #2413437)

[migraction] rename rename_relation method to rename_relation_type for consistency

[web app] only log tb when explicitly asked

typo

[views/tables|css] show actions in small tabs instead of menu indirection (closes #2004109)

stable is now 3.15

oldstable is now 3.14

[test] update server security test using login and new temporary_permissions context managers

[testlib] introduce temporary_permissions context manager Fix a test failure due to cached method on the way as usage of the context manager enforce proper interaction with schema objects

[rql2sql] remove debug print and fix bug introduced in 8469:69ad9a509bc3

[html form] use __linkto url parameter value as a default value of the corresponding field in a creation form (closes #2407770)

[rql2sql] fix generated SQL when an attribute relation with a variable is ored with another attribute relation. Closes #2410405

[repository] drop unused argument

[ui] actions box should be displayed if there are some actions, not if context is an entity. Closes #2419040

backport stable

[packaging] bump rql dependency to 0.29 (closes #2410042) Needed for add_eid_restriction with 4 args, usage of which was introduced in changeset aed065b97f12 (refactor entity fetch_rql method to use a RQL syntax tree instead of RQL strings)

[rql security] fix rql bug when using yams inheritance and read permissions (closes #2410156) problems occurings when querying using is_instance_of while a subtype has some permissions not shared by the parent type

[c-c schema] devtools: the output file for cw-ctl schema is not supposed to exist When using the 'file' type, logilab-common errors out if the file doesn't exist. Which, if the option refers to an output file, is not so useful. Use 'string' instead.

[fti] allow usage of custom RQL to fetch entities to index (closes #2410509)

[fti] make db-rebuild-fti accept etypes on command line (closes #2410508)

backport stable

[fti] drop entity cache once an etype is indexed (closes #2410507)

[server/utils] add_looping_task can be used any time (closes #2408814)

[formrenderers] if a tag object gets there, it blows (closes #2410462) - cwtags monkeypatches cubicweb's UStringIO's .write and .getvalue methods - but it cannot monkeypatch list.append ...

[login] redirect to real instance root if no postlogin_path is provided When not postlogin_path is provided, the login form issue a redirect to "/". The instance root may not be at "/" on the server. Then issuing a redirect to "/" send the user to the wrong location. We now redirect to "." which works fine because the "login" controller a direct children of instance root (http://babar.com/instance/login). All other redirection of the login controller use relative path too and then rely on this relative path from the login controleur to the instance root. This mechanism may be considered fragile and may deserve a proper fix. but this is to be discussed and implemented in another changeset.

[web/application] declare default 'content' value sooner (closes #2406560) It may be used while processing AuthenticationError. Such error may be raised before the former declaration.

[views/tabs] fix rql/eid param conflict when either one is already in the request form (closes #2405249)

Added tag cubicweb-debian-version-3.15.1-1 for changeset fe5e60862b64

Added tag cubicweb-version-3.15.1 for changeset 783a5df54dc7

[debian] prepare 3.15.1-1

[server/tests] fix tests

[registry|ajaxcontroller] the @ajaxcontroller decorator ought to return a compatible object (closes #2385155)

[cwconfig] shutup on absent i18n/ mo files when in operating in tests

[datafeed] correctly distinguish checked/updated

[ldapfeed] do not crash on ldap user deletion + pull + already deactivated users, cleanups (closes #2392933)

[server/session,repo] turn InternalSession, hence repo.internal_session, into a context manager (closes #2393651)

[ldapparser] missing return

[ldapparser] remove spurious print

fix ldap removal handling in ldapfeed (closes #2376625 and #2385133)

[ldapfeed] fix crash on sql cursor usage (closes #2380246)

[sources/ldapfeed] do not user cwuri as url (closes #2380324)

[web/views/staticcontroller] safety belt for unguessed mimetypes (closes #2380304)

[server/hook] fix identation

backport stable

Added tag cubicweb-debian-version-3.14.8-1 for changeset 81394043ad22

Added tag cubicweb-version-3.14.8 for changeset 15fe07ff6872

[css] do not use display:block for all images, but only for rest generated

3.14.8

[css] make ReST align statement works for images (closes #1280176)

[doc] cubicweb.view documentation (closes: #2099962)

[docstrings] typos corrected

[views] enable paginate toggle on RsetTableView (closes #2200675)

[ui] display author name in box instead of login (closes #1529147)

[doc] remove deprecated doc (wrong link) (closes #2329206)

Fixes for compatibility with passlib 1.6 (closes #2356393) Somebody missed the memo about API backwards compatibility: - calc_checksum is renamed _calc_checksum - passlib.utils.handlers.GenericHandler strict keyword removed - bytes vs str vs unicode issues

[formrenderers] Factor-out render_title to ease customisation in derived classes

[IE] use document.createStyleSheet to add CSS dynamically (closes #2356261)

[pkginfo] the before_shutdown event was not in 3.15.0

[migration] do not crash if the conf file is already migrated (closes #2361061)

[datafeed] fix/finish cleanup started by auc in 8393:c25b96ae4f8a: parser.process prototytpe is (url, raise_on_error=False). Drop partialcommit argument which were never specified

backport stable

[logs table view] properly translate level buy using the correct msgid. Closes #2356329

[data import] don't crash if value isn't in the file, simply no key/value in the output dict. Closes #2356328

[logs table view] only put values starting with http in <a> tag

[db-api] fix typo leading to crash on client connection (config has no translations). Closes #2357044

[data import] allow a request to be given as argument, ease use from web ui

[datafeed] allow the xml datafeed parser to work with client-side connections

small doc updates

[ldapfeed] properly mark email address as encountered during import to avoid deleting them

[merge] backport stable

[server/utils] passlib 1.6 is now less tolerant wrt handler names (closes #2349330)

backport stable

[web] remove some unused imports

[selectors] make multi_columns_rset work with a simple list of lists

[server/hook] a tiny bit of doc about before_server_shutdown

[events] add a new before_shutdown event (closes #2345728)

[ldapparser] cleanup

[ldapparser] reapply dropped fix

[app] turn these info into debug logs (this being too chatty for .info)

fix static file serving when url has parameters (like cache busters do)

[repo test] Avoid hangs in zmq repo unit test - interaction through the zmq event loop from a different thread is only allowed through add_callback - notify the background thread when the client dies with an exception so it doesn't spin forever

[ldap] we may actually get back password from ldap

[ldapfeed, test] use default source config

[ldapfeed, test] use a safe internal session, as in real life

[datafeed] give a dictionary as sourceparams to avoid crash if attempt to import the user is done

[yams] Binary instance passwords should not be given to str()

[ldapfeed] don't crash if entity is None. Closes (superficialy) #2341266

[merge] backport stable fixes

[bin/clonedeps] fix NameError (closes #2334080)

[sources/native] do not let a log message crash on us

[merge] backport stable

[cwconfig] impose an order on appobject paths processing: entities first (closes #2330799)

[serverctl] avoid a crash if zmq-address is not defined/empty (config.get is a false friend wrt dict behaviour)

fix an horrible typo

[migration/3.14.4] prevent migration crash when there are NULLs in asource

Added tag cubicweb-debian-version-3.15.0-1 for changeset 925db25a3250

Added tag cubicweb-version-3.15.0 for changeset 0642b2d03aca

typo

3.15.0

[static web] fix fckeditor static files delivery: remove leading subpath and url parameters from computed file path

[doc] 3.15 services api description

[service-api] Add unified service API on `_cw` attribute This will allow writting generic entity code that could run on both client and repo side. This addition have been discussed with Sylvain Sylvain Thenault.

fix ``call_service`` API and add test service API ``call_service`` was taking a session argument. But Service is an AppoObject and already has the same session accessible as ``self._cw``.

[skel] update newcube skeleton (closes #2312509)

[doc] improved 3.15 blog using developpers'contributions

[devtool-testlib] add deprecated entry point for publish method 6c2119509fac renamed ``publish`` to ``handle_request``. And removed the older testlib function (because the semantic of handle_request is quite different from the publish one). However it seems to do more harm that good and I'm adding proxy with deprecation warning for those.

[doc] improve 3.15 release blog

[web/views/staticcontrollers] restore windows compat

Added tag cubicweb-debian-version-3.14.7-1 for changeset 20ee573bd237

Added tag cubicweb-version-3.14.7 for changeset 3ba3ee5b3a89

3.14.7

[3.15 migration] repo-uri is a c-c command option and does not need migration since it doesn't exist in the configuration file

[remote rql source] fix super call

[zmq] Add a new ZMQ-based RQL source (closes #2290203)

[pyro] Refactor the pyrorql source Extract most of the code that is not related to Pyro from PyroRQLSource in a new RemoteSource abstract class.

[zmq] add unit tests for ZMQ-based repository (server and dbapi)

[dbapi] add possibility to connect to a remote ZMQRepository (closes #2290126)

[repository] fire 'server_shutdown' hooks before waiting for theads This is required for threaded tasks that use the 'server_shutdown' hook to die properly, as for example the ZMQ server in an all-in-one configuration

[zmq] Implement a ZMQ-based Repository (closes #2290125) This Repository server behave mainly like the Pyro-based repository.

backport stable

[test] update create_user call

[test] use setUpClass rather than setUpModule to avoid inter-dependency pb with CubicWebTC sub-classes

[test] with yams#stable, ordernum is different than with yams#default

[bin] Force clone_deps.py to use mercurial command-line interface - closes #2296057

[table view] EntityTableView should accept **kwargs as RsetTableView

Fix a Python 2.5 regression introduced by previous commit

[rql annotation] fix has_text_query detection (if coming from sub-query and if has_text on a column aliases. Closes #2275322

[etwist] fix static directory serving; closes #2174797

[form renderer] refactor inline form renderer to ease overriding. Closes #2282662

[devtools] fix bashism in xvfb-run.sh bash's trap builtin accepts SIGUSR1, whereas dash complains. So use USR1 instead.

[devtools] fix xvfb-run.sh permissions (exec bit)

[form] add a new property telling if the form is being generated or posted. Closes #2262340

[workflow] set default test/plain option for workflow default comment (closes #993083)

[js] get rid of `partial` function (closes #1972794)

[css] change `h3` and `h4` styles(closes #893244)

querier: Improve error message when ERQLExpression fails on some entity (closes #2267081) When an RQL variable is indeed "constant" (we know it's eid) ERQL expression are not inserted but checked prior query execution. If the session have no read access to the entity an `Unauthorized` exception is raised. This changeset add a meaningfull message to this exception:: No read acces on "X" with eid 42.

[js] fix error in loadRemote docstring

[doc] add missing section titles

[doc] fix bad indentation

[server/ldaputils] do not allow ldap.server_down to crash on us

Add missing with_statement import for python2.5 compat

[devtools] make xvfb-run not wait 3s each time (closes #2265710) Ask Xvfb to tell us when it's ready instead of unconditionally waiting 3 seconds. Sync from http://anonscm.debian.org/gitweb/?p=pkg-xorg/xserver/xorg-server.git;a=blob_plain;f=debian/local/xvfb-run;hb=HEAD

[view] breadcrumbs layout broken with long elements (closes #1347486)

[static-file] return Unauthorized on blocked directory listing This is more appropriate than 404 NOT FOUND

[login redirect] only add postlogin_path argument when meaningful

static-file: properly set/use cache header for static file (closes #2255013) This changesets enables the standard http cache mechanism where the static controller may reply "304 Not modified" based on `last-modified` in HTTP response and `if-modified-since` in HTTP query. The last modified time is computed using the file-system information. The pre-existing logic using an `Expires` header to prevent client from sending request stay in place. The new logic just prevents sending the file again if not necessary.

[repository] move task manager instantiation outside repository. Repository callers are in charge of providing a task manager. The task manager is optional when the repository is not a server. This part is not really expected to work well yet. But we aim to remove all task management responsibilities from the Repository object.

[repository] split repo initialization from starting looping task (closes #2204047) This separation highlights that two distinct operations are done. This is a step towards a full distinction between repo, server and looping tasks

[repo looping task] move looping task logic in a dedicated object (progress #2204047)

[manage / default index views] discard login/logout templates

devtools-request: transmit the headers keyword argument to the request class Otherwise the headers kwargs end up in the form. This is very useful for testing publish logic related to http header (as cache).

[security] use a stronger encryption algorythm for password, keeping bw compat Administrator should ask their users to reenter new password so they benefit from the new encryption. Also, new encryption is cross-platform compatible, eg you may now move an instance from windows to linux painlessly

[cache] factorize _validate_cache() logic implemented in wsgi and twisted handlers

[fake-request] support `http_method()`

[Web-Request] Use rich header (closes #2204164) Unify header management. All web request use the Headers class now (imported from twisted). Code dedicated to header management have been merged into the base WebRequest class.

http-header: support __contains__ in Headers You can now use:: >>> 'expires" in headers True

[web] Move request handling logic into cubicweb application. (closes #2200684) We improve http status handling in the process: ``application.publish`` have been renamed to ``application.handle`` to better reflect it's roles. The request object gain a status_out attribute to convey the HTTP status of the response. WSGI and etwist code have been updated. Exception gain status attribute

[login] split authentication logic from post authentication logic (closes #2200755) * The Session manager is now only in charge of providing a valid session. * LoginControllers are now used in all case but wrong credential. * The LoginControllers are in charge of redirecting the user to the page wanted to see in the first place, expected to see. * The login form is now always submitted to the login controller with an extra argument pointing to the url we should redirect too after successful authentication. The ``"log out first logic"`` logic on login controller is removed because: 1. Other web actor do not do that. 2. Removed code do not need to be reimplemented. 3. We can only get it to work again in a single case: use do a GET request on http://www.my-cw-stuff.io/login 4. I do not see it's purpose.

[LoginForm] refactor to ease other implementation An Abstract BaseLoginForm is created. It is intended to be used by cubes who want to implement new login form. It gather common login form elements in particular the form action. This will ease redefinition of this form action in later commit.

[request] gather all base_url logic in a single place (closes #2200756) * Handle ``https base-url`` in the core code: ``./req.py`` and ``web/request.py`` * Remove custom ``base_url`` handling if web request

[http] drop use-request-subdomain feature (closes #2251986) This feature do not have any user nowaday and lays in the path to WSGI.

backport stable

[config, undo] Fix undo-support option migration

Added tag cubicweb-debian-version-3.14.6-1 for changeset 75364c099490

Added tag cubicweb-version-3.14.6 for changeset db021578232b

3.14.6

[debian] add a watch file Allows tools like uscan to find the tarball for new debian revisions.

[uilib] don't print timedeltas between 0 and 23h as negative (closes #2236352)

[storage/bfss] ensure bfss never remove a cw_edited item (closes #2236287) When the <old value> == <new value> (not really and update but can happen), the value was popped but never restored. The cw_edited attribut had wrong content for a small time lapse.

[datafeed xml parser] fix typo

[twisted] move out url logic from twisted (closes #2200593) Data, fck and static file are now served by cubicweb controller by default. Some hackish url rewriting is necessary to have them selected. This is necessary because cubicweb does not selection controller on multi level path. - 'Expires' header seems to conflict with Cache-Control set by HTTPCacheManger (don't know yet why HTTPCacheManager is involved here) mod_wsgi is now usable in simple cases (e.g. still requires persisten sessions).

[cwconfig] improve assert error message. Single tuple element are processed in a non trivial way.

rqlrewrite: remove element in rewritten when we remove them from the select (closes #2236985) update _cleanup_inserted to avoid leaving rewritten variable behind when removing a snipset. insert_varmap_snippets was impacted too for unclear reason --- Before A KeyError was raised when: * multiple snipset is to be inserted on a statement * some *supported* snipset adds ambiguity (increase the number of solution) * some *unsupported* snipset adds new variable * The new variable require rewritting :: File "/home/pyves/src/fcw/cubicweb/rqlrewrite.py", line 185, in rewrite newsolutions = self.remove_ambiguities(snippets, newsolutions) File "/home/pyves/src/fcw/cubicweb/rqlrewrite.py", line 436, in remove_ambiguities variantes = self.build_variantes(newsolutions) File "/home/pyves/src/fcw/cubicweb/devtools/repotest.py", line 340, in _build_variantes variantes = _orig_build_variantes(self, newsolutions) File "/home/pyves/src/fcw/cubicweb/rqlrewrite.py", line 470, in build_variantes variante.append( (key, sol[newvar]) ) KeyError: u'D' This happen because the mechanism removing unsupported snipset does not remove entry in ``self.rewritten`` when it removes entry from ``self.select.defined_vars``. Iteration on ``self.rewritten`` then crash because values of ``rewritten`` are expected to be found in solution.

[js] fix $.fullCalendar.regional call (closes #2232028)

Added tag cubicweb-debian-version-3.14.5-1 for changeset 55fc796ed5d5

Added tag cubicweb-version-3.14.5 for changeset f559ab9602e7

[undo, test] fix undohistory selector et related tests

prepare version 3.14.5

fix events display in calendar (closes #2167866)

[repo test] fix test regression introduced by 8286:8b0146e31baa

[css] in old css, more space around the text, and try to make it centered

[js] translate calendar in french (closes #2167866)

[entity url] rest path fallback should be the url used as cwuri. Closes #2186039

[migration] fix add_relation_type in case it already exists, broken by 67660d5f1916

backport 3.14.4-2

Added tag cubicweb-debian-version-3.14.4-2 for changeset 4c8cb2e9d0ee

[debian] prepare 3.14.4-2

[debian] add missing build-deps to generate the documentation (closes #2223062)

[repo services] set cnxset before calling the service then ensure it's freed

[migration] fix migration jumping from pre 3.12 to post 3.13

[migration] add schema obj into assertion failure message so we get a chance to understand the pb

{repository] add documentation explaining ``fix_user_classes`` hook

[devtools/fake] add some https related properties to FakeRequest

[typo] "lod" --> "load"

[dbapi] some documentation

[undo view] fix wrong set operator

[web application] move default path logic inside url publisher Previously, this logic was handle by: * etwist server * wsgi handler * web application

[req, doc] add some documentation of CubicWebRequestBase attributes

[test] more standalone test add a __main__ section to `etwist/test/unittest_server.py`

[web templates] fix invalid html in main-no-top template; closes #2174806

[repository] implement a generic way to call repo-side services; closes #2203418

[web] Exposes the undo feature to user through a undo-history view (closes #893940)

[undo, transactions] Adds a property in the transaction API. (closes #2202953) Required by forthcoming changes in undo_web.diff

[repo, undo] Finish repository-side implementation of the undo feature (closes #893940) 1) Changes API for undo_transaction in order to raise an exception: the previous API returned a sequence of error, the user of the API needed to be careful to check explicitly. We change this for it to raise an UndoException with the list of errors as an attribute. 2) The server-side support for undoing update actions is finished 3) The configuration for `undo-support` is now a simple boolean Beware of the costs, both in DB space and in number of requests on the RDBMS backend, once this feture is activated. 4) Adds a txuuid param/attribute to the existing NoSuchTransaction exception.

[rql rewrite] when a subquery has to be introduced, properly return the snippet expression so that further expressions are properly ored. Closes #2207180

[migration/3.14.4] use the right API else we break sqlserver instances (closes #2211248)

backport stable

[devtools] make a copy of the xvfb-run script so we can kill it properly Since changeset a3d3bdd46463 we don't run firefox directly but through a wrapper script. This meant that on stopping the test, we would kill that wrapper script but leave the Xvfb server and firefox processes running. So make a local copy of xvfb-run, and make it kill Xvfb when it goes down, not just when its client exits.

[ajax] use AJAX_BASE_URL instead of JSON_BASE_URL JSON_BASE_URL / 'json' should be replaced by AJAX_BASE_URL / 'ajax'

[web/config] refactor initialization of the data url Common logic have been moved in a dedicated `data_relpath` function.

backport stable

[test] create temporary directory with meaningfull prefix It will help cleanup temporary directory when cubicweb test failed to cleanup themself.

[schema] make cubicweb 3.14 compatible with yams 0.35

[test] fix ReST extensions tests

[web/controller] fix some cases where _cwmsgid may appears twice the Way the URL was build led to double _cwmsgid parameter in the URL query, which led in turn to a crash. We use _cw.rebuild_url to update new params instead of append_url_params which merely does a textual concatenation.

[reledit, autoform] move reledit_form definition in reledit.py No deprecation handling needed, reledit_form is new in CW 3.15

[hg] ignore ldap database

[ldap migration] use unicode strings

[ldapfeed] fix synchronisation crash: ldap attributes are given while we want cw attributes and name errors in method checking if a dn still exists in ldap

backport stable

Fix bug about missing Interval field (closes #1463996). Implement Field and Widget dedicated to the yams entity 'Interval': - TimeIntervalField - IntervalTimeWidget Allow to set an integer with a character as a period of time '20s', '48h' or '3d' for instance (turn into seconds).

[cubicweb-ctl] i18ncube return 2 (failed command) on failure (closes #2192336) i18ncube command previously returned 0 even on failure. Bisect i18n breakage was hard.

[book] document the WEEKDAY rql function Added in 3.14.

[rql2sql] correctly handle modulo operator (closes #2192457) rql has % as a modulo operator. The string we output gets passed to a substitution function so the % needs to be escaped.

[web-repo] use transaction data, not session data to inform ui about sources error. Closes #2192577

Added tag cubicweb-debian-version-3.14.4-1 for changeset bc40991b7f13

Added tag cubicweb-version-3.14.4 for changeset 508645a54287

prepare version 3.14.4

[vreg] restore bw compat, eg container expect to find Selector in appobject module

backport stable

[spelling] fix dictionnary -> dictionary typo

[tabs] use eid parameter instead of rql when an eid is given. Closes #2186288

backport stable

[system source] fix authentication: don't allow login whatever the given password if user password is NULL in database. Closes #2186099

[binary] use seek(0) in `from_file` Binary creation method (closes #2189183)

[c-c] use subprocess instead of os.system to start repository

backport oldstable

[bfss, migration] fix storage migration (closes #2189206) The storage migration intend to clean the attributes cache but in practice it was trying to discard attribut edition. As no attribut were edited this lead to a crash.

[datafeed] fix dumb name error introduced by recent deletion handling refactoring

[ldapfeed] make authentication actually working

[sources] include source's class in its repr

[email notifications] send notification at post-commit time (closes #2119248)

[devtools] Use Xvfb to run firefox in js tests on posix platforms This way we don't require running tests under X.

[i18n] fix pb with non-ascii chars in cwd. closes #2149063

[repository] add a ``gc_stats`` method and 2 more cache size for ``stats`` (closes #2179735) This method returns memory informations in a dictionnary (same informations as the content displayed by the GCView).

[test] fix test broken by RichString handling changes in yams #default

[test] fix test broken by EmailAddress read permissions change

[test] fix test broken by renaming of module containing the cwxml parser and handling of vid in urls

[test] fix test broken by selectors/predicates changes coming with the move of registry to lgc

[repo test] fix test broken by recent changes on EmailAddress read permissions

backport stable

[server test] fix test broken by recent changes in lgdb

backport stable

[schema sync hooks] fix format string

[event bus] event has been renamed to publish

[schema view] properly display inheritance (closes #870073).

[workflow view] Display a non-localized version of state/transition names (closes #1912537).

[repo] Add a publish/subscribe mechanism for inter-instance communication using zmq Each repo can have a publishing and any number of subscribing sockets whose addresses are specified in the instance's configuration. An application or cube can subscribe to some 'topics', and give a callback that gets called when a message matching that topic is received. As a proof of concept, this introduces a hook to clean up the caches associated with the repository when an entity is deleted. A subscription is added using Repository::zmq::add_subscription; the callback receives a list representing the received multi-part message as argument (the first element of the message is its topic).

[migration] fire hooks in postcreate by default (closes #1417110) also turn usage of hooks_control to relevent session's method

[migration] `add_relation_type` warns and add missing definitions on already existing rtypes (closes #2121979)

[i18n] fix translations of login actions in french (closes #1546397)

([config] add file encoding information to python files (closes #1942655)

[primary view] delete PrimaryView.skip_none attribute (closes #2093250) it was already broken anyway, since introduction of reledit (a while ago)

[entities system table] change asource and source column size (closes #1951819)

[view] fix error messages of NotImplementedError

kill dead code in Workflow view This looks like it's been missed in r5224:34e669b6fd95.

[bw compat] add compatibility for import of former VRegistry

[views/attribute] role parameter must default to "subject" (closes #2175427)

[windows service] Copied the 3 lines from etwist/twctl into etwist/service in order to also clean the cache in Windows service mode. Could be factorised with etwist/server.run

[entity] fix crash when using cw_instantiate with empty related entity list; closes #2094462

[pylint] correctly detect uiprops module when it's not in a package

backport https-deny-anonymous option type fix done in default

Added tag cubicweb-debian-version-3.14.3-1 for changeset 4d0f5d18e8a0

Added tag cubicweb-version-3.14.3 for changeset 60efdbb45520

3.14.3

[web/formwidgets] make default_size a tunable, fix code layout (closes #2165936)

[hooks/syncschema] do not crash if the schema did not learn (yet) some new META rtype (closes #2171313)

[js] better support for no js in tabs (closes #2162092)

[vreg] move base registry implementation to logilab.common. Closes #1916014 A new logilab.common.registry module has been created with content from * cw.vreg (the whole things that was in there) * cw.appobject (base selectors and all). In the process, we've done some renaming: * former selector functions are now known as "predicate", though you still use predicates to build an object'selector * hence `objectify_selector` decorator is now `objectify_predicate` * the top level registry is now `RegistryStore` (was `VRegistry`) Also there is no more need for the @lltrace decorator. On the CubicWeb side, the `selectors` module has been renamed to `predicates`. There should be full backward compat with proper deprecation warnings.

[datafeed] when checking for deletion using cwentity xml parser, use vid=xml to limit resources consumption

[repository] ldap-feed source. Closes #2086984 datafeed based source which copy a subtree of the ldap directory into the system database. Authentication still go through ldap though. Pros: * don't need temporary tables and such for multi-sources RQL queries execution * much more flexible to enhance / configure behaviour (you simply have to replace the parser) * run better when ldap isn't reachable Cons: * no more 'on the fly' discovery of users (though a user authenticating itself will be automatically added if it doesn't exist in the db yet) * synchronization may be heavy if there are a lot of users A new cw.server.ldaputils containing code in common between former ldapuser and new ldapfeed sources has been introduced. Also ldapuser source now uses url instead of custom host/protocol option so it looks like a datafeed source (could be improved).

[datafeed] set delete-entities=yes is now safer, by checking each entity actually seems deleted. Closes #2165381 Parsers now have to implement the `is_deleted(extid, etype, eid)` method that should return a boolean telling if the given entity exists in the external source or not.

[config, migration] fix https-deny-anonymous option type

[js, i18n] translated strings should use " not ' else they are discarded by xgettext. Closes #1892489

[book] Fix typos in rql datetime functions documentation

[search box] allow to specify domid in select arguments. Closes #2162166 needed when one want to display search box twice in a page (eg logilabfr)

[config] fix rql-cache-size initial values (closes #2162160)

[migractions] fix comment to avoid ambiguity. Closes #2015260

[storage] BFSS now create read only file (closes #2151672) In the process binary.to_file now takes a file instead of a file-path. As storage was currently the only user it should not impact anyone.

backport stable

[schema synchronization] don't use sql for TODAY/NOW in keyword arg. Closes #2154815 Also consider TZDatetime on the way

backport oldstable

[req cookie] fix remove_cookie expires which was leading to expires computed to 0 in set_cookie and the Cookie class interpret that has no expires. Closes #2154654

[testlib, postgres] take care, _repo is None when backuping postgres test db, crashing database generation

[base views] make it easier to override EntityStartupView behaviour when the rset is empty; closes #2126364

[excanvas js] missing comma

backport stable

[datafeed] Don't pretend all columns are sortable in datafeed sources import log view. Closes #2146387

[facets] Make hiding facet body optional (closes #2105862)

[manage/index view] fix sources management view appearing in index view although it should not; closes #2126335

[book] add doc about request, session and connection management you need to know when writing tests

[test] test/demonstrate relation permissions overriding

[datafeed] Don't pretend all columns are sortable in datafeed sources import log view. Closes #2146387

[facets] Make hiding facet body optional (closes #2105862)

gmap: fix regression from 151058945234 Send zoomlevel as an int, and move closing brace to the right place.

gmap: fix regression from 151058945234 Send zoomlevel as an int, and move closing brace to the right place.

[deprecation] add cw version number to deprecation warning

[test] fix test broken by 8158:2ee254e74382 and add a test for that change

[doc] Add a small docstring to RQLExpression constructor

backport stable

[schema] restrictive email address read permission. Closes #2148141 You may have to update your application schema if you were based on previous settings!

[tableview] drop useless code: cellvid systematically given by RsetTableView, according to its .[non]finalview attribute

[tableviews] use ``select_or_none`` instead of ``try: select() except:`` select_or_none is here to avoid multiplying try: except: context in the code.

[bw compat] json_request setter is necessary for some cubes which has json_request (eg preview)

gmap: set center and zoomlevel automatically (closes #2144255) Instead of hardcoding the default zoomlevel and setting the center to the average of all markers, let gmap compute them so all markers fit in the map.

[views] calendar id in CalendarView must be unique (closes #2143864)

[debian] cubicweb works with python 2.7 (which become the standard on some distros). Closes #2142050

[multi-sources] call doexec rather than sqlexec since we do not want to call process_result (as there aren't any and this breaks with lgdb default)

[sources] hide some attributes from source edition form. Closes #2144160

[https] Allow configuration of anonymous access on https (closes #1971992) For now any anonymous access in denied on secured connection (https-url). This patch introduce a configuration option to control this behaviour. New instance will allow it. Old instance should stay as is during migration.

[bfss] convert root BFSS directory to str in constructor (closes #2137793) otherwise you can get crashed with AssertionError: Binary objects must use raw strings, not <type 'unicode'>

[rql, security] fix buggy rqlstr cleanup when some introduced snippet create an unresolvable query. Closes #2142041

[ldap test] test actual ldap authentication instead of monkey-patching also drop usage of not-anymore-necessary constants.

[book] Add some details about usage of EXISTS

backport stable

Added tag cubicweb-debian-version-3.14.2-1 for changeset 17ebd836cee3

Added tag cubicweb-version-3.14.2 for changeset 049a3819f03d

3.14.2

[i18n] fix french for 'action menu'

[server] use lgd.process_cursor to optimize processing of large resultsets update lgdb dependency to ensure we've a fix necessary for proper behaviour of the previous changeset

[css] fix typo in uiprops/css

backport stable

[sources management] fix crash mapping tab because chain() is not indexable. Closes #2124077

[css] use listingHeaderBgColor in old css this also fix inconsistency between background image / bg color

add instance to not implemented error

[repo cache] fix cache clearing for an eid: keys are now always a tuple

missing import statement

fix potential problems when BFSS uses a Windows SMB share (closes #2131435) files on windows network share must be read / written by chunks of reasonable size or you get some unusual os level errors.

[views] (in/outof)context views now use directly dc_(long)_title() (closes #2110235)

[table] use cell text content when cubicweb:sortvalue is not defined (closes #2093183)