3.12.9

[repo, ms] fix planning of some queries where variable 'non-invarianess' should be considered, leading for instance to junk in entities table on source deletion

[repo] closes #1821172: fix source deletion

[ajax, IE] rewrite some code to avoid duplicated evaluation with IE

[repo, hooks] small task optimization: don't start cleanup_old_transactions when undo support is not activated, and retrieve a session to update a source only when some source to update is found

[http] closes #1816411, restore expires_header on static files in non-debug mode

[native source] fix bug introduced in 7645:cb2459aaa7d7: fetchone() may return None

[source] closes #1816412: try to reconnect to dbms if connection is reset in eid_type_source()

[twisted] add an option to configure twisted's threadpool size Twisted's threadpool size defaults to 10, which means we virtually try to serve up to 10 simulateneous requests but connection-pool size defaults to 4 on CW-server side. That means that under heavy load, chances are high that some HTTP queries end up with a 500 error code / connection-pool exhausted.

[book, form] include complete example of self-posted form with custom field/widget + minor other changes

backport stable

[datafeed] don't raise bad config error on source initialization

[schema] closes #1816439: RQLConstraint does not take variable U into account

[web form] avoid mis-formated warning for _cw_fields

[doc, hook] more backport of syt mbox documentation

[book, ldap] backport some doc from my mailbox

[book] fix some urls

[book, forms] talk about cnx.use_web_compatible_request instead of custom monkey-patching

[book] drop gae from the book

[book, admin] include some fixes done by auc in an email to me

[book] fix some rest/sphinx errors

[repo test] fix broken tests

closes #1784285: [rql2sql] crash when using a relation for inner and outer join

[range facet] closes #1806937: simply retrieve min/max values when computing vocabulary/possible_values, this is enough

[facet] fix facet values update, broken by 7626:56300bec75f8

[facet slider] quote attribute value, else may break with earlier jquery

[facets] use unique dom id

[facet] with rql path facet rel may be None, handle it

[facet] closes #1806932: test and fix facet bug w/ having query (need rql update)

[ajax js loading] when everything is already loaded, don't do anything

backport stable

[IE, plot] ship with jqplot'excanvas version (include http://code.google.com/p/explorercanvas/issues/detail?id=82 for instance)

[etwist, modconcat] closes #1806935: directly write data, don't put the whole concatenated thing in memory

[etwist] clear ui cache at server startup time. Closes #1806933 this avoid pb when cubicweb/cubes provide new version of some js/css and also accumulating junk in the cache directories

[facet] closes #1806931: new facet type, based on arbitrary rql path

[selectors, test] remove duplicated test and add some for relation_possible selector w/ rqlst

[repository] catch Exception instead of everything

[facet] fix argument inversion in date range facet

[facetbox] put the facet box in a box

[doc] fix broken links

backport stable

[test] fix test, code from 3.13 gone in 3.12 accidentaly

[selectors, facet] make is_instance and other EClassSelector subclass gather entity classes from 'select' and 'filtered_variable' context information. Closes #1796732 This allow for instance to use the filter form on rqlst where the filtered variable is not selected

[facets] DontUpdateConstraint mecanism introduced a few commit ago isn't needed: we already have the 'needs_update' property controlling this

[facet] more api cleanup: support_and should be a property, so it's easier to deactivate.

[range facet] refactor to ease overriding, possible_values raise DontUpdateFacet (not handled by js actually)

[facets] allow to specify on which rqlst's variable facets should be applied. Closes #1795915

[facets] refactor / cleanup facet api: more consistent variable naming and easier to reuse function. Closes #1796804

backport stable

[schema / rql] fix mainvars of RRQLExpression with parens

[facets js] better cubicweb:facetargs handling and avoid initializing a same form twice (that may occurs)

[facets] should remove groupby from base rqlst. Closes #1796196 as we search for values for a variable, there seems to be no case where we would be interested in groups, though there are clearly some were leaving groups cause errors.

[facets] factorize table filter form / facets box generation, moving out filter form from the table view so it's usable from other views. Closes #1794009

backport stable

[worklow forms] rewrite remaining pre 3.10 form code using uicfg

[doc] SQL Server isolation level settings

new rql2sql unit tests for ORDERBY and LIMIT checks in SQLServer

backport stable

[cwc shell] add ``--password`` option to ``reset-admin-pwd`` (close #1794866) This will help batch. The help warn it's not very secure.

[c-c instance commands] keyboard interrupt should stop the command, not jump to the next instance. Closes #1794850

[rset] syntax_tree impl. consistency: don't return an annotated syntax tree

[cw-ctl] add command versions to list versions of cubes used by an instance (closes #508052)

closes #1793991: [datafeed] error handling: log unexpected exceptions / don't stop on first validation error

[web session] fix bad cleanup of session without a connection set. Closes #1772125

[i18n] fix undetected conflict

[rql2sql tests] fix erroneous case (tested with psql)

add missing future import

drop unittest deprecation warning

[form, controller] closes #1787233: form should provide a method to process posted content

[forms] fix import, gone into the wrong patch

[form, renderer] closes #1787234: [form] onsubmit interpolated by the form renderer, it shouldn't

[form renderers] closes #1787232: new 'onerowtable' form renderer so it's easy to retrieve a dictionary of {field name : typed value} for a custom, no entity related, form

backport stable branch

[rql2sql] more cases fixed where something is wrongly added to GROUPBY, causing unexpected results for the query

[book] rewrite / complete the RQL language chapter

[all] remove pattern "try: function() except AttributeError: pass" (closes #1787966)

[cw-ctl] command list should not break when cube depends on version None (closes #1787209)

[uilib] new js_dumps function allowing usage of bare js string (wrapped into JSString) modify magic 'js' object to consider them as well

backport stable

[repo, looping task] raise a custom exception when repository is shuting down, avoid looping task to be restarted in such case. Closes #1021276

[formfields] use support_args instead of catching type error avoid hiding other issues and making debugging difficult

[cw.ajax] fix loadxhtml documentation and warn when called on an empty elements list

[etwist] log missing file even in debug mode

backport stable

[test] run and fix utils and uilib doctests

Display proper date in plot/flot (closes #1725589)

[doc] fix NameError in bfss tutorial

[js/css concat] do not return 404 when resources of a concatenated data URL does not exist, unless in debugmode; closes #1745644

[server] "overrule" case insensitivity of database name (closes: #611294) The only instances where you are required to use quotes are either when a database object's identifier is identical to a keyword, or when the identifier has at least one capitalized letter in its name. In either of these circumstances, you must remember to quote the identifier both when creating the object, as well as in any subsequent references to that object

[tests] update repository tests with new `use_cwuri_as_url` attribute This attribute was intriduced by changeset 92fd4b777016

backport stable

Added tag cubicweb-debian-version-3.12.8-1 for changeset cf49ed55685a

Added tag cubicweb-version-3.12.8 for changeset 50122a47ce4f

3.12.8

[migration] litle enhancements and a fix to patch accidentally pushed two revisions ago

[controller] UndoController: fix output method (closes: #1776091) Fix buggy direct output in `UndoController.publish()`. Raise now a ValidationError instead of malformed string Changes: * raise ValidationError when an error occured in undo * use the new message mechanism based on _cwmsgid If errors are not fatal, you have to change publish() method.

[migration] closes #1777411: schema modification commands shouldn't crash if already exists

[rqlrewrite] closes #1772135: 1. don't try to reuse a relation from another statement (eg because a subquery has been introduced) 2. _use_orig_term should consider the current statement

test fixes

[datafeed cw parser] refactor: split logic that was in the parser into: * an "item builder" component, turning an etree xml node into a specific python dictionnary representing an entity * "action" components, selected given an entity, a relation and its role in the relation, and responsible to link the entity to given related items (eg dictionnary) This changes make it easy to add new action or to override existing one's behaviour according to the entity, the relation, etc... Also refactor the xml view so one can also override what's included in the tag used to mark the entity as used by a relation, hopefully allowing to reduce the number of http requests needed for a full datafeed import.

[datafeed, entities] url for entities from a datafeed source should be on their origin site. Closes #1769391

cleanup

[3.10] fix typo and error for pre 3.10 migration w/ postgres: we *must* call init_creating else the fti isn't correctly initialized, which may lead to silently rollbacked transaction

[migration] don't add CWUniqueConstraint if already there (may occurs when running a migration in multiple times

[datafeed] catch all exception, we should continue to process other urls

fix 3.13.1 migration

Added tag cubicweb-debian-version-3.12.7-1 for changeset a07517985136

Added tag cubicweb-version-3.12.7 for changeset 628fe57ce746

3.12.7

[ms, entity metas] add 'actual source' to entities table / base entity metadata cache. Closes #1767090 this is needed since for entities from 'copy based sources' such as datafeed, we want entity.cw_metainformation() to return as 'source' the datafeed source, not the system source (ie the source where the entity is actually stored). For both performance and bootstraping reasons, we should store this information in the `entities` table and in the _type_source cache.

fix 3.13.0 migration script (closes #1766202)

backport stable

fix 3.12.0 migration script (closes: #1766202)

[test] update to 3.13 api

[migration] when there are no data migration needed, we still want to rewrite the configuration and to restart the server. Closes #1760927

[migration] bugfix: c-c list was not displaying the name of a cube requiring another cube without constraining the version.

backport stable

[rqlrewrite] test and fix rql snippets insertion when several snippets match an optional variable

[datafeed, cw.xml] xml now carry entity's source information, interpreted at the other end so that for instance when an entity from elo is seen when importing cwo, it's properly marked as coming from elo source if one exists

[datafeed] actually raise on error

[python 2.5] compat fix

[datafeed, cwxml] parser now try to complete source's urls so one can add url such as <myinstance>/project. Closes #1759908

[server] fix unicode conversion capability in UndoException By overriding the __unicode__ method, we ensure unicode builtin will return Unicode object even for python versions that don't have a __unicode__ method by default (python < 2.6) In previous versions, when this method is not defined, string conversion is attempted, and the result of string conversion is converted to Unicode using the system default encoding which is ascii the most of the time.

[book] add autoload section from code and fix sphinx warnings * drop misleading faq entry since clear explanation can be found in internationalization chapter * use autodata sphinx directive instead of raw text * fill empty chapter with autodoc: - devweb/httpcaching.rst - devweb/resource.rst - devweb/views/idownloadable.rst - devweb/views/wdoc.rst * use shebang in excerpt to denote shell code * fix some bad indented docstrings in javascript files

[controller] fix wrong view name when error occurs in UndoController

[datafeed] renaming parser attribute to parser_id makes things clearer

cleanup and assert we don't import unexpected stuff

[source config] fix synchronization on configuration entity changes

[ui, sources] configure source form: hide synchronizing and mapping entities, use simple text input for parser

[rql annotation] fix bad invariant variable w/ has_text relation: this is only true when has_text will be used as principal (though we don't know that yet)

[test] update to new db handler api

[querier] turn remove_clauses/restore_clauses into a context manager

[devtools pg handler] some fixes so we get proper error when pg host is not reachable

[rdf] add method so one can call entity.view('rdf')

[web test] fix unittest_web

[ajax edition] freeze form button when calling validateForm, so it freeze nicely for e.g. comment submitting form

[web page tracking] fix bug introduced by parent revision

closes #1484510: ajax_replace_url should propagate page id (until an underlying api does it automatically

backport stable

[repo integrity] test and fix glob add relation where several entities are added at once for a relation of 1? cardinality

[packaging] Build the cubicweb-documentation package

[breadcrumbs] closes #1717489: Double escaping in breadcrumbs

[donc] Fix building the cubicweb js documentation Avoids errors such as: Exception: Bad file id cubicweb.lazy referenced in INDEX_IN_ORDER in ../../../doc/tools/pyjsrest.py, fix this please

add an XXX

fix 3.10 cwproperties migration

fix failures introduced by recent refactoring * * * [testlib, realdb] we should close connections prior to create a new db using current db as template

[testlib, realdb] we should close connections prior to create a new db using current db as template

[migration] this is needed to avoid pb with yams 0.33 / cw < 3.13

[sync schema hooks] consider etype name map before trying to update in-memory schema

[repository] refactor and optimize '?1' relation handling * only skip auto remove if activeintegrity is explicitly disabled * do it even for inlined relation, so hooks are properly called * on entity creation, only cleanup what's needed

[session] deprecates schema_rproperty in favor of more optimized rtype_eids_rdef which return the rdef (so reusable to gather other data)

[repository] refactor/cleanup entity deletion methods * kill unused Repository.delete_info_multi (no leading _) * kill unnecessary system_source.delete_info (almost no benefit over delete_info_multi) * stop giving entities list *and* extid list, gather them from the entity when needed * move pending eids handling into glob_delete_entities, so one can call it directly without worrying about that

[repository] new hook selector according to configuration's repairing flag

[pyrorql] don't display traceback on connection error

[data hook] new .union operation on DataOperationMixIn, only when container is a set, not a list

[rql2sql] add test case for 7493:3c46b9390871

backport stable

[hooks] use local variable

[integrity hooks] remove dead code

[rql2sql] fix for some queries where eid variable used and entities picked as variable's table

[js] add missing jquery.qtip.min.js

Added tag cubicweb-debian-version-3.13.0-1 for changeset a96137858f57

Added tag cubicweb-version-3.13.0 for changeset b661ef475260

3.13

backport stable

Added tag cubicweb-debian-version-3.12.6-1 for changeset 105767487c70

Added tag cubicweb-version-3.12.6 for changeset a18dac758150

3.12.6

[repo test] fixes

[doc, apache] add ProxyPreserveHost hint + note about https /w http configuration

[doc] Small addition to apache configuration in book

merge changes from stable branch

[parsers] format read by web/views/xmlrss is relation=%s-%s not %s_%s

[sql] implement #1631319: ask user before creating postgresql languages

[parsers] improve url construction by using stdlib's urllib instead of str concatenation fix a s/_/-/ bug on the way.

[bfss] Catch EnvironmentError instead of OSError when trying to read attributes bffstored This will also catch IOError (as file not found) that might be encountered expectable too.

merge changes from stable branch

[views/iprogress] rename to make things easier to read and understand

[datafeed cwxml parser] cache processed urls/entities to avoid unnecessary http requests and processing

backport stable

[rql2sql] fix missing sql restriction w/ attribute restriction where value comes from a subquery

[dataimport] fix #1732685: cached entity and shared cw_edited data with NoHookRQLObjectStore

[parsers] fix python2.5 compat problem introduced by 7466:395c966a1cb3

[test] update cubicweb/test/unittest_schema.py (to follow yams#.....)

[server] fix NameError (missing VIRTUAL_RTYPES import) in checkintegrity.py

[schema] fix computing of has_text relation: when a fulltext_container relation is added, we need to recompute has_text for the target entity type as well. Also, avoid computation when not needed

[parsers] remove build_search_rql() that duplicates find_entities()

[vreg] help understanding assertion error

[datetime] by default display 'UTC' string when displaying TZDatetime

[test] update test to avoid failure

[web] fix typo

[datafeed] fix stupid error introduced by 'just before qfinish' refactoring...

[schema] support for BigInt type. Closes #1720995

[test,i18n] update test and i18n catalog to follow addition of 'synchronizing' attribute on sources

[i18n] update yams error messages (requires yams#67668)

[datafeed] provide a source-sync command to launch source synchronization through the command line. Closes #1725692

[datafeed] use a boolean flag on CWSource to ensure we don't have concurrent synchronizations. Closes #1725690

[views] add columns parser and latest_retrieval to cwsource admin view

backport stable

Fix name error introduced in c21d845836e4 c21d845836e4 use a ``vocab`` variable but doesn't define it. I assumed ``vocab`` is ``field.vocabulary(form)``.

Fix conditionnal logic broken in 195b24fe3a03 195b24fe3a03 replace: if not req.cnx: by if getattr(req, 'cnx', True): The "not" diseapeared in the process.

[session] provide a simple transaction context manager for session. Closes #1725640

[formwidgets] make the select size a class attribute (more easily tuned)

[bfss] Make ``current_fs_path`` return None when an attribute has no value current_fs_path was returning the future fspath when no value was defined. * This does not make any sense * This tricks the storage into believing that updating the attribute content is not necessary. The file was written but the attributes was not updated. as a result the assignement was not made. (close #1725446)

[selectors] take care, Session has no cnx

don't crash if we can't fetch data or if xml is malformed

[datafeed] extract some methods from pull_data to ease writing custom datafeed sources

drop useless code

backport stable

[datafeed] we should use utc timestamp to avoid pb with local times

[test] fix failure introduced by yams'changeset 644:f9c79356b758

[testlib] add convenience assertion method to check __message

[test] fix failure introduced by 1719eab69551: the regexp should be fixed, not the error message

[web test] fix test failures introduced by 7431:cab99ccdb774

backport stable changes

[ui message] fix regression introduced by 7429:ef5165fa99e0, leading to 'None' message displayed in the ui

backport stable changes

[json controller] fix .exception call msg format string (missing one slot)

[test] fix tests broken by 7427:5338d895b891

merge default heads

[ui messages, xss] Start migration towards use of _msgid instead of __message (prone to XSS injection) closes #1698245

backport stable

[ui messages] make application message component works when request has no cnx set and support for explicit message given through render argument

backport stable

[web session] fix session handling so we get a chance to have for instance the 'forgotpwd' feature working on a site where anonymous are not allowed fix several pbs: * we need a session id and a session cookie anyway, else subsequent http queries are unrelated * this imply some changes in the session attribution workflow for session without a cnx * some views/selectors must be fixed for cases where session has no cnx On the way, avoid unnecessary Redirect on successful login. closes #750543

[ajax js/css] modconcat fix: load code exactly once (auc, fcayre) * introduces cw.ajax namespace (currently hosts only recent modconcat functionality) * handle load-one/load-many-at-once edge case * properly handle already-loaded js resource * avoid .appendTo to trigger script evaluation since from jquery 1.5 this results in uncached ajax calls

[test] update test broken by previous commit

[entity fetch_attrs] remove ambiguous relations on different etypes from fetched attrs or it may produce wrong related results; closes #1700896

typo : s/undoed/undone/

[cwvreg] inline function dump_class() Grepping the entire code base (cubicweb+all the known cubes) shows that inlining this function is harmless: no one is using it.

[js/ajax] undeprecate (async)remoteExec. closes #1381205

[rql2sql] closes #1697862: ORDERBY SUM(C) cancel GROUPBY by wrongly adding C to grouped variables

backport stable

Added tag cubicweb-debian-version-3.12.5-1 for changeset 6dfe78a0797c

Added tag cubicweb-version-3.12.5 for changeset ae33197db1f0

3.12.5

i18nupdate

[views/table (facetform)] introduced in facetbox, was missing in tableview form filter

[web.facet] self.w -> w

[web/facet|views/table] bump a bit some heights, split table view methods for easier subclassing

backport stable

cleanup and update some copyright

[migractions] fix change_attribute_type

[migractions] dropped_constraints should accept only droprequired without cstrtype

[form rendering] some refactoring to ease FormRenderer overriding

[deprecation] drop remaining warnings

backport stable

[session] new methods on session to ease access to security/hooks control context managers

[workflow] new 'fire_transition_if_possible' method on IWorkflowable to fire a transition if it's possible

[workflow] new 'incontext-state' view for IWorkflowable entities

[facets/table] vertically group facets by two when possible in order to have a more compact horizontal layout in table filter form

[workflow] add method on IWorkflowable to set initial state of an entity (closes #1686357)

[web test] fix test broken by making cw_source editable by managers

[multi-sources] support for moving an entity from an external source (closes #343818) Original need is to move a user from a ldap source to the system source so we can delete it from ldap without loosing information into the cubicweb instance. We can't wait for the user to be deleted from the ldap since it will be too late then to get back user attributes, so it has to be a manual operation to operate before actual deletion. This makes sense for other sources as well. So the idea is to make the "Any cw_source CWSource" relation editable by managers, and to watch changes of it. We then check the move is possible (ie from an external source to the system source) and do necessary stuff (essentially changing source information and copying data into the system source). Remaining pb is that we don't want the moved entity to be reimported later. To distinguish this state, the trick is to change the associated record in the 'entities' system table with eid=-eid while leaving other fields unchanged, and to add a new record with eid=eid, source='system'. External source will then have consider case where `extid2eid` return a negative eid as 'this entity was known but has been moved, ignore it'. Notice no ui is provided yet, it has currently to be done in a c-c shell.

[repository api] definitly kill usage of word 'pool' to refer to connections set used by a session Also document session's data storage and some other internals. Hopefuly things will get clearer. Closes #1684860: vocabulary confusion in repository code: notion of 'pool'

backport stable

[rql2sql] fix in 7394:d11d88bd08e8 was actually not needed

[rset] close #1683703: rset.get_entity crash on rql query with subquery and aggregat

[rql2sql] fix generated sql for eid comparison. closes #1638695

fix some deprecation warnings

[querier test] test groupby function call / column number

backport stable

[plot views] don't paginate

backport oldstable

[url rewriting] fix nasty bug in build_rset inner function: the same dictionary is used by all queries, hence triggering potentially important bugs on concurrent requests (this dictionary goes back and forth the repository)

[hooks selection optimization] prune hooks when multiple entities are concerned by a hm.call_hooks() (closes: #1672022) the idea is to make a first pass over all the hooks in the registry and to mark put some of them in a disabled list. The disabled hooks are the one which: * are disabled at the session level * have a match_rtype or an is_instance selector which does not match the rtype / etype of the relations / entities for which we are calling the hooks. This works because the repository calls the hooks grouped by rtype or by etype when using the entities or eids_to_from keyword arguments Only hooks with a simple selector or an AndSelector of simple selectors (is_instance and match_rtype) are considered for disabling.

[repo test] datafeed parser's process method should now take raise_on_error argument

[datafeed] propagate raise_on_error to parser's process method

[http] Make a better __repr__ for Status responce exception. This help debug.

[schema] fix imprecise error message

fix name error introduced in previous changeset

[server test] restore logging level after test end

[web data] fix datadir handling to avoid web test failure introduced somewhere in default branch

remove debug print

[datafeed] extract a generic DataFeedXMLParser from CWEntityXMLParser

backport stable

[entity] fix cw_instantiate w/ reverse_ relation crash when either multiple entities are given or an eid instead of an entity

[cw source ui] fix mapping checking for datafeed source (avoid false positive error, but doesn't check that much things)

[web request] don't define pageid js variable when one is found in form parameters (eg, page ajax call)

[repo cache] there are some relations we don't want to cache, they may cause memory leak

[c-c shell] we should commit the migration handler, cnx is not None unless connected through pyro

[cwpermission, cwgroup] convenience method on CWGroup to grant a local permission (ie CWPermission) on an entity

[cleanup] kill some remaining traces of goa

[c-c shell] closes #1669147: autocommit in maintenance scripts

backport stable

Added tag cubicweb-debian-version-3.12.4-1 for changeset 7c4d34a5ec57

Added tag cubicweb-version-3.12.4 for changeset 5cd0dbc26882

3.12.4

missing future import

don't let windmill/qunit test break apycot warning for all web/test

[selectors] enhance rql_condition to make it usable as a condition on request's user

[repo test] fix test broken by c2452cd57026 by using proper fake session

[testlib] fake session can be given a vreg

backport stable

fix some test failures introduced by 7350:c2452cd57026

[rql2sql] fix bug avoiding outer join relation to be used as a variable principal. Closes #1659395

resurrect code lost by too much patch manipulation

backport stable

[parsers] various refactorings - inline method process_one - rename value to others in action methods - turn _complete_url into _complete_item - turn _related_link callbacks into a boolean parameter create_when_not_found - fix spelling

backport oldstable

backport stable

fix _set_relation when no target eids, update datafeed source pull_data arguments to raise on error during tests

[session] enhance session's transaction storage handling to fix cases where commit/rollback is done while in the context of hooks_control/security_enabled managers. Closes #1412648: commit or rollback during postcreate reset hooks control state

[session] nicer local variable names

[web server] #1642893 issue a 403 instead of a 500 on Unauthorized exception To do so, we allow an arbitrary code to be passed to ``error_handler``. Default error code is still 500.

[css] repair selected slice distinctiveness (with a nice, discrete bg color)

[view] ability to define a column header through custom label_column_<colindex> method, useful for table view to customize a specific column without specifying others

[selectors] test/fix rql_condition to make it works when entity is specified via 'entity' keyword argument instead of rset, row and col

[etwist] fix bug w/ new resources concantenation and https-url enabled sites

oops

adds support for a portable db import/export format (closes: #1521112) the db-dump and db-restore cwctl commands are enhanced with a --format option (defaults to 'native'). If the format is 'portable', then the system database dump / restore is performed using pure SQL queries and the storage uses picked Python objects in a zip archive.

add a new method iter_process_result which does the same as proces_result but is a generator (closes #1625374) process_result is reimplemented using the new method, and the two helper methods are turned into generators. These generators use cursor.fetchmany instead of cursor.fetchall after setting cursor.arraysize to 100. This means that the whole result set should never loaded in memory when using the iter_process_result method. This is used in the "portable" database dump implementation when we typically to 'SELECT * FROM table', but could probably be used too in other parts of cubicweb.

[session] lock self._closed and session.close to avoid race conditions

[server test] use a lock instead of sleep to have higher green probability :/

backport stable

[testlib] create_user may now create user's email address

enhanced comment

[i18n] en translation fixes

[users management] use an existing msgid...

[cwgroup views] uicfg rules cleanup

backport stable

[testlib] grant_permission now accept either an entity or en eid

[session selector] missing not

[session] new selectors according to session type (eg user or internal

[ajax] reload method should return underlying deferred

[user mgmt] should show user login in first column in any case (e.g. application specific override)

[component|i18n] give imgs an alt attribute, refresh i18n po files

[i18n/es] repair es.po

[testlib] fix deprecation warning stack level

[nav component/cosmetics] have nice looking arrows insteads of << / >>

backport stable

Added tag cubicweb-debian-version-3.12.3-1 for changeset ba8fe4f2e408

Added tag cubicweb-version-3.12.3 for changeset e712bc6f1f71

3.12.3

backport oldstable

Added tag cubicweb-debian-version-3.11.3-1 for changeset b3c6702761a1

Added tag cubicweb-version-3.11.3 for changeset b7a124f9aed2

3.11.3 hopefuly closing the 3.11 serie

backport stable

[testlib] fix assertAuthFailure to consider both None and dbapi._NeedAuthAccessMock as meaning 'no connection has been set'

[i18n] update spanish translation, thanks to Celso from CreaLibre

[i18n] fix french translation

[primary, metadata] reuse existing msgids

fix ajax loading of concatenated js/ css + prefix concat cache files to ease cache clearing

[entity] make set_relations() accept entities and eids (closes #1631391)

[CubicWebTC] fix create_user bw compat

[msplanner] fix regression and test failure introduced in 7292:258c92805066

[repository quick start] should modify class attribute to get this actually working (used by a classmethod)

backport stable

[js] use minified jquery

[entity] fix entity fetch_rql when fetch_attrs contains a rtype with multiple destination etypes which do not have the same fetched attributes themselves (closes #1631282)

[configuration] exit with proper message when sources file is unreadable (you usually started cw while logged with a wrong user). Closes #1631238

[js] remove facet-loading.png, use plain-text / i18n

backport stable

[selectors] fix on_fire_transition for cases where change_state is called (eg no transition specified)

[workflow selectors] introduced new on_fire_transition hook selector, deprecated on_transition + minor docstring cleanup

backport stable

[migration] new command to get default workflow for an entity type * * * typo

[workflow hooks] reuse metadata/integrity categories instead of a new 'workflow' category and drop useless hook

[entity 3.13 api] rename clear_all_caches into cw_clear_all_cache

[ms planner] ignore neged source relation when trying to restrict query sources

[users management] show email as text avoid specific primary email rendering (and we don't bother getting a clickable link)

[primary view] display entity source in 'metadata' view if it's not the system source

[users management] enhance users table: show state, primary email and data source; show filter form

merge changes from oldstable

[entity] improve error message

[doc] fix doc and tutorials about hooks and operations

[optim] cache rset column structures When iterating over large resultsets (lot of colcumns, lot of lines) to build entities, caching column structure (which attribute or relation is stored in each column) can improve performance noticeably.

[js] make _loadAjaxHtmlHead aware of mod_concat-like urls _loadAjaxHtmlHead keeps track of already imported resources (js / css) to make sure they're not included twice, but with mod_concat-like urls, things get a bit more complicated : if BASE_URL/data??foo.js,bar.js is already imported, then loading : BASE_URL/data??bar.js,spam.js should only load spam.js

[etwist] in debug-mode, concat-file is rebuilt if one of the concatenated file is more recent

[facets] display splash image while facets are reloading content (closes #1624851)

[facets] mark titles of active facets with red dot (closes #1624857)

[facet] add missing selector to HasRelationFacet

[facets] proper fix for #1625112: we should rather call unicode() as we always manipulate string as unicode internally

merge

[etwist] Generates apache's mod_concat-like urls for js and css Uses the lists of js, css and ie_css included in order to generate urls compatible with Apache mod_concat (ie: http://test.fr/??file1.js,file2.js). Css files may use `media` option or may be for IE only ; this patch does not concatenate css filenames for different media types or different IE specs. It concatenates only files served under cubicweb's `data` urls and keeps original include order. The generated urls are added to the HTML header as usual. HOW-TO: - calling HTMLHead(datadir_url) will enable the url concatenation - calling HTMLHead() will not benefit of url concatenation IMPORTANT NOTE: - fckeditor can no more be served under `/data/` segment

handle js/ css file concatenation with twisted

put data version md5 into a new url segment to ease static serving

add cwctl command to generate a consolidated data directory with all cubes/ cubicweb data directories content to be delivered statically

[etwist] refactor child resources management

[vreg] vregistry._select_best was needlessly instanciating NoSelectableObject (closes #1626708) in large selections, this incurred a non negligible cost (add_relations with 2000 inlined relations runs 7% faster with this patch)

backport stable

merge stable

merge oldstable

backport oldstable

[page data] don't call unload_page_data too many time (closes #1518398)

[request] don't init tabindex unnecessarily, since it's added to page data which will makes an ajax call to unload_page_data necessary

[deprecation] kill a remaining 3.6 warning

[web config] fix md5 version to ensure cubes order and to include cubicweb version

merged stable bugfix

merged oldstable bugfix

place the disable hooks context manager at the right place (closes: #1626694) hooks control is reset at each commit so we need to have a smaller scope for the CM in the 3.10.9 migration script

backport stable into default

backport oldstable into stable

[js] fix inArray usage in reorderTabIndex() : inArray returns -1 if element is not found, not 'false'

[rql] basic support for regexp-based pattern matching

[rql] support CAST() Function

stable is now 3.12

oldstable is now 3.11

[js] delete empty js files (incluced in cw.ajax.js)

[sql generation] fix crash on outer join + ambiguous inlined relation + attribute selection

[rql rewrite] backout 7177:f2a976cf7dac : since EXISTS is the variable scope, we want to insert snippets here anyway (other solution would be to NOT insert snippets at all in such case). Closes #1625464

[book] fix documentation + add chpasswd.py script

[facets] fix unicode encode error; closes #1625112

[facets] fix RangeFacet get_widget: do no return a widget unless there are at least 2 values; closes #1625203

merge

Backed out changeset 7a58581d842c This changeset breaks a number of CW tests, which depends on pre add hooks. I'm backing it out, so that we can start the need-for-speed sprint with green tests (and possibly rework this changeset)

small reformatting (but test still fails)

fix tests broken by fcb8932082a5 (continued)

fix bad handling of inlined relations when entities of different etypes are passed as subject to add_relations

fix failing test_migration test caused by schema change

fix tests broken by fcb8932082a5

merge back stable

fix server/test/unittest_checkintegrity (failing since 70538ea2532d)

fix implementation of repository.glob_add_relations (closes ##1625257) the internal data structure had changed during implementation and the code had not been updated...

[server] improve the speed of setting relations between entities (closes #1625257) The main idea is to add methods equivalent to session.add_relation and repository.glob_add_relation which handle several relations in one call. Speed gain results from: * using cursor.executemany to run SQL statements * factorizing some code which otherwise has to be performed for each relation, such as context manager creation before calling hooks or to enable security, creation of the EditedEntity instance (when several inlined relations are set on a single entity, and consequently when refreshing the cached entity) benchmark runs 1.1x faster for non inlined entities and 125x faster for inlined entities :-)

added test case to monitor speed improvements in the repository code. To use it, add a test in a patch, then hack CW to speed it up in another patch, updating the test if needed. By running the test with and without the second patch applied you can easily see the speed improvements

backport stable changes to default

[js] update jquery.corner.js to the latest version (uses native css support for browser that provide it); closes #1625065

[js/css] remove old versions of ui.tabs/slider etc.; closes #1625085

[devtools] make return value of get_response_header(raw=True) consistent wrt get_header(raw=True) i.e. get_response_header(raw=True) now returns the first element of the list rather than the list itself.

[widgets] handle no value label for tristate radios, put default separator on class for easier redefinition - closes #1624839

[doc] update of the update

[tz postgres support] we've to commit the connection once time-zone is set, else we may loose the setting

[tz support] more tests

[dataimport] actually commit every desired number...

[doc] major update of the install documentation

[facets] make rangefacet comply with start_unfolded (closes #1615869)

[testlib] make a clear distinction between input / output HTTP headers The get_header() / set_header() API is the same as for CubicWebRequestBase : - get_header() returns the **request** header - set_header() / add_header() works on the **response** header FakeRequest adds two additional methods : - get_response_header() returns the **reponse** header - set_request_header() adds a **request** header FakeRequest now uses the `headers_out` ineherited from CubicWebRequestBase. It also uses a `_headers_in` attribute

[entity] create_entity/cw_instantiate should initialize entity's cache to avoid later queries

[testlib] refactor create_user and grant_permission to make them usable from pre_setup_database

[3.12 regression] don't access to __class__ directly, it may raise AttributeError

[testlib] fix typos / NameErrors in devtools/__init__.py

[schema serialization] add warning on missing group

backport stable

[testlib] fix bug in backup file name generation: it may erroneously replace '-' by '_' in database **parent directories**. This should fix random error when test are run under apycot.

backport stable

[schema diagram] proper url generation (closes #1621276)

[testlib] fix readlb config handling, avoid systematic recreation of db with postgres (closes #1618089)

[entities] fix cw_instantiate typo

[entities/test] add failing test for cw_instantiate

[timezone] ensure tzinfo is None

[entity] use a list comprehension

Added tag cubicweb-debian-version-3.12.2-1 for changeset 6d418fb3ffed

Added tag cubicweb-version-3.12.2 for changeset 5a9b6bc56538

[packaging] prepare the release of version 3.12.2

merge changes from stable branch

[facet] ignore range extremas to avoid filtering out rows where value is NULL (closes #1251192)