add a new method iter_process_result which does the same as proces_result but is a generator (closes #1625374) process_result is reimplemented using the new method, and the two helper methods are turned into generators. These generators use cursor.fetchmany instead of cursor.fetchall after setting cursor.arraysize to 100. This means that the whole result set should never loaded in memory when using the iter_process_result method. This is used in the "portable" database dump implementation when we typically to 'SELECT * FROM table', but could probably be used too in other parts of cubicweb.

[session] lock self._closed and session.close to avoid race conditions

[server test] use a lock instead of sleep to have higher green probability :/

backport stable

[testlib] create_user may now create user's email address

enhanced comment

[i18n] en translation fixes

[users management] use an existing msgid...

[cwgroup views] uicfg rules cleanup

backport stable

[testlib] grant_permission now accept either an entity or en eid

[session selector] missing not

[session] new selectors according to session type (eg user or internal

[ajax] reload method should return underlying deferred

[user mgmt] should show user login in first column in any case (e.g. application specific override)

[component|i18n] give imgs an alt attribute, refresh i18n po files

[i18n/es] repair es.po

[testlib] fix deprecation warning stack level

[nav component/cosmetics] have nice looking arrows insteads of << / >>

backport stable

Added tag cubicweb-debian-version-3.12.3-1 for changeset ba8fe4f2e408

Added tag cubicweb-version-3.12.3 for changeset e712bc6f1f71

3.12.3

backport oldstable

Added tag cubicweb-debian-version-3.11.3-1 for changeset b3c6702761a1

Added tag cubicweb-version-3.11.3 for changeset b7a124f9aed2

3.11.3 hopefuly closing the 3.11 serie

backport stable

[testlib] fix assertAuthFailure to consider both None and dbapi._NeedAuthAccessMock as meaning 'no connection has been set'

[i18n] update spanish translation, thanks to Celso from CreaLibre

[i18n] fix french translation

[primary, metadata] reuse existing msgids

fix ajax loading of concatenated js/ css + prefix concat cache files to ease cache clearing

[entity] make set_relations() accept entities and eids (closes #1631391)

[CubicWebTC] fix create_user bw compat

[msplanner] fix regression and test failure introduced in 7292:258c92805066

[repository quick start] should modify class attribute to get this actually working (used by a classmethod)

backport stable

[js] use minified jquery

[entity] fix entity fetch_rql when fetch_attrs contains a rtype with multiple destination etypes which do not have the same fetched attributes themselves (closes #1631282)

[configuration] exit with proper message when sources file is unreadable (you usually started cw while logged with a wrong user). Closes #1631238

[js] remove facet-loading.png, use plain-text / i18n

backport stable

[selectors] fix on_fire_transition for cases where change_state is called (eg no transition specified)

[workflow selectors] introduced new on_fire_transition hook selector, deprecated on_transition + minor docstring cleanup

backport stable

[migration] new command to get default workflow for an entity type * * * typo

[workflow hooks] reuse metadata/integrity categories instead of a new 'workflow' category and drop useless hook

[entity 3.13 api] rename clear_all_caches into cw_clear_all_cache

[ms planner] ignore neged source relation when trying to restrict query sources

[users management] show email as text avoid specific primary email rendering (and we don't bother getting a clickable link)

[primary view] display entity source in 'metadata' view if it's not the system source

[users management] enhance users table: show state, primary email and data source; show filter form

merge changes from oldstable

[entity] improve error message

[doc] fix doc and tutorials about hooks and operations

[optim] cache rset column structures When iterating over large resultsets (lot of colcumns, lot of lines) to build entities, caching column structure (which attribute or relation is stored in each column) can improve performance noticeably.

[js] make _loadAjaxHtmlHead aware of mod_concat-like urls _loadAjaxHtmlHead keeps track of already imported resources (js / css) to make sure they're not included twice, but with mod_concat-like urls, things get a bit more complicated : if BASE_URL/data??foo.js,bar.js is already imported, then loading : BASE_URL/data??bar.js,spam.js should only load spam.js

[etwist] in debug-mode, concat-file is rebuilt if one of the concatenated file is more recent

[facets] display splash image while facets are reloading content (closes #1624851)

[facets] mark titles of active facets with red dot (closes #1624857)

[facet] add missing selector to HasRelationFacet

[facets] proper fix for #1625112: we should rather call unicode() as we always manipulate string as unicode internally

merge

[etwist] Generates apache's mod_concat-like urls for js and css Uses the lists of js, css and ie_css included in order to generate urls compatible with Apache mod_concat (ie: http://test.fr/??file1.js,file2.js). Css files may use `media` option or may be for IE only ; this patch does not concatenate css filenames for different media types or different IE specs. It concatenates only files served under cubicweb's `data` urls and keeps original include order. The generated urls are added to the HTML header as usual. HOW-TO: - calling HTMLHead(datadir_url) will enable the url concatenation - calling HTMLHead() will not benefit of url concatenation IMPORTANT NOTE: - fckeditor can no more be served under `/data/` segment

handle js/ css file concatenation with twisted

put data version md5 into a new url segment to ease static serving

add cwctl command to generate a consolidated data directory with all cubes/ cubicweb data directories content to be delivered statically

[etwist] refactor child resources management

[vreg] vregistry._select_best was needlessly instanciating NoSelectableObject (closes #1626708) in large selections, this incurred a non negligible cost (add_relations with 2000 inlined relations runs 7% faster with this patch)

backport stable

merge stable

merge oldstable

backport oldstable

[page data] don't call unload_page_data too many time (closes #1518398)

[request] don't init tabindex unnecessarily, since it's added to page data which will makes an ajax call to unload_page_data necessary

[deprecation] kill a remaining 3.6 warning

[web config] fix md5 version to ensure cubes order and to include cubicweb version

merged stable bugfix

merged oldstable bugfix

place the disable hooks context manager at the right place (closes: #1626694) hooks control is reset at each commit so we need to have a smaller scope for the CM in the 3.10.9 migration script

backport stable into default

backport oldstable into stable

[js] fix inArray usage in reorderTabIndex() : inArray returns -1 if element is not found, not 'false'

[rql] basic support for regexp-based pattern matching

[rql] support CAST() Function

stable is now 3.12

oldstable is now 3.11

[js] delete empty js files (incluced in cw.ajax.js)

[sql generation] fix crash on outer join + ambiguous inlined relation + attribute selection

[rql rewrite] backout 7177:f2a976cf7dac : since EXISTS is the variable scope, we want to insert snippets here anyway (other solution would be to NOT insert snippets at all in such case). Closes #1625464

[book] fix documentation + add chpasswd.py script

[facets] fix unicode encode error; closes #1625112

[facets] fix RangeFacet get_widget: do no return a widget unless there are at least 2 values; closes #1625203

merge

Backed out changeset 7a58581d842c This changeset breaks a number of CW tests, which depends on pre add hooks. I'm backing it out, so that we can start the need-for-speed sprint with green tests (and possibly rework this changeset)

small reformatting (but test still fails)

fix tests broken by fcb8932082a5 (continued)

fix bad handling of inlined relations when entities of different etypes are passed as subject to add_relations

fix failing test_migration test caused by schema change

fix tests broken by fcb8932082a5

merge back stable

fix server/test/unittest_checkintegrity (failing since 70538ea2532d)

fix implementation of repository.glob_add_relations (closes ##1625257) the internal data structure had changed during implementation and the code had not been updated...

[server] improve the speed of setting relations between entities (closes #1625257) The main idea is to add methods equivalent to session.add_relation and repository.glob_add_relation which handle several relations in one call. Speed gain results from: * using cursor.executemany to run SQL statements * factorizing some code which otherwise has to be performed for each relation, such as context manager creation before calling hooks or to enable security, creation of the EditedEntity instance (when several inlined relations are set on a single entity, and consequently when refreshing the cached entity) benchmark runs 1.1x faster for non inlined entities and 125x faster for inlined entities :-)

added test case to monitor speed improvements in the repository code. To use it, add a test in a patch, then hack CW to speed it up in another patch, updating the test if needed. By running the test with and without the second patch applied you can easily see the speed improvements

backport stable changes to default

[js] update jquery.corner.js to the latest version (uses native css support for browser that provide it); closes #1625065

[js/css] remove old versions of ui.tabs/slider etc.; closes #1625085

[devtools] make return value of get_response_header(raw=True) consistent wrt get_header(raw=True) i.e. get_response_header(raw=True) now returns the first element of the list rather than the list itself.

[widgets] handle no value label for tristate radios, put default separator on class for easier redefinition - closes #1624839

[doc] update of the update

[tz postgres support] we've to commit the connection once time-zone is set, else we may loose the setting

[tz support] more tests

[dataimport] actually commit every desired number...

[doc] major update of the install documentation

[facets] make rangefacet comply with start_unfolded (closes #1615869)

[testlib] make a clear distinction between input / output HTTP headers The get_header() / set_header() API is the same as for CubicWebRequestBase : - get_header() returns the **request** header - set_header() / add_header() works on the **response** header FakeRequest adds two additional methods : - get_response_header() returns the **reponse** header - set_request_header() adds a **request** header FakeRequest now uses the `headers_out` ineherited from CubicWebRequestBase. It also uses a `_headers_in` attribute

[entity] create_entity/cw_instantiate should initialize entity's cache to avoid later queries

[testlib] refactor create_user and grant_permission to make them usable from pre_setup_database

[3.12 regression] don't access to __class__ directly, it may raise AttributeError

[testlib] fix typos / NameErrors in devtools/__init__.py

[schema serialization] add warning on missing group

backport stable

[testlib] fix bug in backup file name generation: it may erroneously replace '-' by '_' in database **parent directories**. This should fix random error when test are run under apycot.

backport stable

[schema diagram] proper url generation (closes #1621276)

[testlib] fix readlb config handling, avoid systematic recreation of db with postgres (closes #1618089)

[entities] fix cw_instantiate typo

[entities/test] add failing test for cw_instantiate

[timezone] ensure tzinfo is None

[entity] use a list comprehension

Added tag cubicweb-debian-version-3.12.2-1 for changeset 6d418fb3ffed

Added tag cubicweb-version-3.12.2 for changeset 5a9b6bc56538

[packaging] prepare the release of version 3.12.2

merge changes from stable branch

[facet] ignore range extremas to avoid filtering out rows where value is NULL (closes #1251192)

Backed out changeset e0e802afa8e1, widgets are actually defined below

[facet] refactor: a simple class attribute is enough

[native source] eid_creation_lock actually lock the eid connection creation and usage

[dataimport] allow to specify columns on which result should be sorted in lazydbtable

[entity creation] ensure this is a relation and not an attribute before moving things into pending_relations because value is a list Using a list for attributes may be used for later type specific casting (e.g. timeseries)

[fckeditor] fix fckeditor relative url: use baseuri()

Added tag cubicweb-debian-version-3.12.1-1 for changeset 07e2c9c7df26

Added tag cubicweb-version-3.12.1 for changeset 59701627adba

3.12.1

i18n update

backport stable

[sql generation] fix missing join with outer joins w/ rhs invariant variable... ... where the principal where not the processed relation. This led to major refactoring in outer join handling, which is now much clearer and powerful. Closes #1579228

[test, cw props] ensure we can't add user specific / system-wide properties we had this pb on an historical instance in our intranet (eg. running for about 8 years).

[ms planner] fix buggy temp table name generation, may generate duplicated unique id with subqueries/union

[system source] drop now useless bw compat

[test] silent warning

[ms planner] use an index to avoid doing the same step twice

[views] extend HTMLStream API to be able to change doctype / xmldecl When generating RDFa (for instance), the doctype must be : <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML+RDFa 1.0//EN" "http://www.w3.org/MarkUp/DTD/xhtml-rdfa-1.dtd"> This changeset adds a ``set_doctype()`` method on request objects to allow such changes during page generation.

[test] drop some warnings introduced by new test dabase handling

rephrase

backport stable

[web] fix CalendarView : both icalendarable.start and icalendarable.stop dates can be None

[edit controller] fix subform formid in EditController (would need further improvement)

[schema synchronization] get back eid when adding a final entity type, else it may cause pb on later schema synchronization during the migration where the type is added

backport fix from oldstable

backport fix from oldstable

fileConfig is in logging.config

[entity vocab] fix bug introduced in 3.12 vs/ entity vocabulary, leading to some unexpected empty vocabulary. Fix test accordingly.

[rql rewriter] take care not to introduce snippets into a neged scope

[old css] use aColor property

[uipros] drop unused properties

[selectors] abstract ExpectedValueSelector now accept a set as single argument

[igeocodable] import adapter description

[dataimport] tell more and nicely about transaction status

[dataimport] propagate stack

Added tag cubicweb-debian-version-3.12.0-1 for changeset 92b56939b7c7

Added tag cubicweb-version-3.12.0 for changeset fd502219eb76

prepare 3.12.0

[time zone] support for TZDatetime and TZTime data type Should be usable and cause no crash, though some stuff may still be refined (test value generation, display in views/forms...) Proprify some data structures dealing with yams base types along the way and adding warning when some were missing (eg Interval usually).

merged test fix from stable

[http] implement 1587305: provide better implementation of Accept header parsing + tests

[web test] extract a set_auth_mode method from init_authentication and use it in test_fb_login_concept to avoid bad test interaction

merge stable to default

fix failing tests before 3.12 release added a skip in unittest_reledit, I'd like acampeas to give it a look.

[dataimport] new 'lazydbtable' generator function to feed data from a database table

[dataimport] ObjectStore.create_entity should return something that looks like an entity (eg no more using dict protocol to access to attributes)

[dataimport] cleanups, update docstring to up-to-date usage

[doc] improve dostring of server.hook

merge back stable to default

[cwctl] refactor ui messages aiming for consistency and simplicity

[entity vocabulary] refactor unrelated rql to allow usage of RQLRewriter to insert schema constraints. Closes #1561806

[entity vocabulary] fix unrelated rql generation to skip rql constraints that don't make sense

[schema, refactoring] use RQLExpression as base class for RQL constraint classes

[reledit] fix crash due to wrong attributes usage

merge

make it easier to inherit from EditionFormView

more TZDatetime/TZTime test fixes

fix test_knownValues_load_schema

backport stable to default

[doc] fix typo

[doc] fix typo

[AnyEntity] rename __linkto attribute as cw_linkto to avoid name mangling which make overriding/monkey-patching unnecessarily harder

[sql generation test] avoid lgdb warnings when a db module is faked

backport stable

[c-c create] unification of c-c create and its subcommands handling * create/db-create/db-init uniformly accept --automatic and --config-level options, properly passed along the way * --automatic option fixed so it doesn't need yes or no argument * closes ##1537265 on the way

[rql rewriter] to properly handle 'relation' rql expressions, rql rewriter must support multiple variables (eg S and O) at once to be given as varmap

[rql rewriter] drop unused argument

[rql rewriter] don't add unnecessary (potentially buggy) exists

update lgc dependency also in pkginfo

updated lgc dependency

allow CW to act as a Pyro Server without registering the server to a Pyro Nameserver (closes #1528533) This is achieved by configuring the pyro-ns-host to __NO_PYRONS__ (which is an illegal value for a host name) The Pyro URI for the server can be retrieved by reading the pyro_uri attribute of the Repository

[date picker] apply Carlos patch fixing spanish date picker translation file. Closes #1558893

cleanup

[c-c create] we should also skip option with no type, else we may generate title for section without any option to fill

[config] do not set base-url during instance creation, we don't want generated value to ends up in the configuration file

[config] generalise config.creating, allowing to drop set_language class attribute

[web test] fix broken url in reledit. tests BROKEN ANYWAY (crash due to missing attribute)

merge

Added tag cubicweb-debian-version-3.11.2-1 for changeset 954b5b51cd92

Added tag cubicweb-version-3.11.2 for changeset 56ae3cd5f855

[packaging] prepare 3.11.2

try to reconstruct the file forgotten by syt in changeset e094b3d4eb95

[javascript] fix loadRemote test for JSON_BASE_URL / baseuri matching put both url and baseuri() to lowercase since baseuri() might have uppercase characters. Thanks to Florent for spotting this.

cleanups

[cwuser, persistent properties] fix recent set_property implementation on CWUser: for_user is automatically handled for non-managers users (this is seriously debatable though)

[repository] fix crash in optimized [add|remove]_relation w/ inlined relation (broken by cw 3.10 refactoring)

[server] move EditedEntity class to its own module, to avoid cyclic dependency when needed from e.g. session.py

[facets] closes #1569459 (date-range facet with year < 1900) use lgc.date.ustrftime() and lgc.date.ticks2datetime to convert js date ticks and have a chance to handle dates with year < 1900.

[session] add find_entities and find_one_entity to session/request API (closes #1550045)

[web formwidgets] add missing tabindex to jquery date and time widgets (closes #1568475)

[c-c create] db-create doesn't not take a verbose option any longer

[css] we should use padding instead of margin here, else the element as size greater than <body>, forcing an horizontal scrollbar to appear

[db connection] fix db connections method: verbose should be named interactive, it's not a question of verbosity but wether question should be asked or not

[cwprops, migration] fix [set_]property to ensure we don't retrieve a user specific value. Add some docstring along the way

[cwprops] add set_property method on CWUser instances, to ease setting of user specific properties

[merge] backport stable fixes into default

Abstract the support for ORDER BY and LIMIT/OFFSET SQL generation all DB engines do not support the same syntax for these features, MS SQLServer being the bad boy we try to support in CW. * Use two new methods of dbhelper to add LIMIT/OFFSET clauses and ORDER BY clauses * added unit tests for sqlserver backend * changed unittest_rql2sql to lauch the backend tests even if the driver module is not installed on the machine, so that we can run the sqlserver tests on linux (and the mysql tests too) * adapt msstep.py to the new interface closes #1154756

backport oldstable

[migration] Lesser memory consumption of cwuri fix + actually commit every 100 processed entities Don't use the ORM as added value is poor while all intentiated object are keept by rset cache.

[migration] improve fix cwuri progress bar * Use the progress context manager, * Adds a title * Informs that operation have been partially committed.

[migration] explicit first step of 3.10.9 migration. Previously there was on a "commit now" confirmation. The reason of the request are now explained and both request must be confirmed.

cleanups

[uiprops, css] make header background actually modifiable through uiprops

[components] add **kwargs to render method of header components to make them usable as regular components (eg in other places than the header

[schema views] don't propose 'view all' action for final entity types (closes #1560549)

[doc] fix urls pointing to repositories and download sites

backported tag to stable

Added tag cubicweb-version-3.9.x for changeset 48f468f33704

merge

[devtools] missing py2.5 compat import

merge oldstable into default

fix stupid typo

merge

merge: [testlib] require explicite overwriting of TestDataBaseHandler. A new overwrite (default to False) parametters is added.

[testlib] require explicite overwriting of TestDataBaseHandler. A new overwrite (default to False) parametters is added.

remove conflict marker

merge old stable into stable

fix pylint helper methods: need a classmathod in cwconfig.py

fix pylint helper methods: need a classmathod in cwconfig.py