[book, rql] update rql langage chapter with new operators and outer join capabilities

[web] closes #1892494: emailaddress and anonymity notice though mangle-address is weak since address won't be mangled when fetched through rql

[3.13 migration] closes #1896724: some db backend (eg sqlserver) doesn't support ADD COLUMN

[source] update system table and internal structures on source renaming. Closes #1896721

[rql2sql] closes #1892473: enhance handling of optional inlined relation * some outer join aren't supported while they could * consider newly available 'optcomparisons' st information on variables (rql 0.30)

[schema] use definition for `use_email` relation instead of type declaration (closes: #1894929) This will be more adaptable for other existent `use_relastion` as the one in the cube Person.

[web] rql directive breaks if explicit vid and empty rset (closes #1893433)

[datafeed] properly encode/decode external uri

[querier] we should not insert None but skip the line when some unknown eid is detected (closes #1892491)

[rql2sql] closes #1892471: support for unary expression introduced in rql 0.30

[deprecation] __message hidden generate deprecation warning

[server] host mapping is better named url mapping (closes #1892461)

[packaging] should depend on yams 0.33

[packaging] should depend on yams 0.33

[rql2sql test] sqlserver use 0/1 for booleans, not FALSE/TRUE

[repo] Stop setting hashmode on schema At best it was a no-op, at worst it created race conditions.

[devtool] Make the sqlite database used for test execution process specific (closes #1230401) * Database cache are not impacted. * This allow multiple process to run test with the same template at the same time The db-name property return an unaltered value to for database cache mechanism.

backport stable

Added tag cubicweb-debian-version-3.13.3-1 for changeset fb48c55cb802

Added tag cubicweb-version-3.13.3 for changeset 0e82e7e5a34f

[rql2sql] take care to boolean_value returning an int (eg sqlite/mysql)

[repo test] remove debug

[repo ms] commit/rollback session if it has been created in the method

3.13.3

i18nupdate

[sql] more test and fix boolean handling

backport oldstable

[repo test] Fix test broken by BFSSTestable changeset bd56a29acaa8 broke several fragile test.

[sql] fix querying of boolean value w/ sqlite

backport oldstable

[datafeed] for datafeed source, we don't want commit in extid2eid but explicitly handled by the source. Also, we should use 'safe' internal session

[sql gen] handle optional on comparison node (eg HAVING expression) and on rhs of final relation. Closes #1859609

[session] safe internal sessions don't deactivate integrity hooks

[sql test] lgdb > 1.6 use int for bool with sqlite backend

[rql2sql] don't introduce substitution for Int and Boolean constants. This is needed for COUNT(DISTINCT) support

[css] syntax fix in cubicweb.css

[entities] skip_copy_for should be considered for object relations too (closes #1857474)

[datafeed] case insensitive etype. Closes #1877014

[datafeed] closes #1875322: empty tag means None value

[datafeed] properly take care to cwsource=system in imported xml. Closes #1877017

[datafeed / fti] rather control a 'complete' parameter than setting empty attribute values

[repo api] deprecates source.extid2eid, only the system source should implement it, and one should directly use the repo api instead of this confusing and error-prone short-cut. Deprecates eid2ext as well for consistency.

backport stable

backport oldstable

[bfss] Fix update of BFSS attribute to None (close #1875289) The current code assume attr value is alway a valide Binary value. But when the attr is optional, the value might be None. The change handle this case.

[skeleton/pytestconf] provide an acceptable solution for windows, closes #1875488

[facets] make sure has_text facet data is posted correctly (closes #1857405) Posted data was associated to facet id (e.g. has-text-123098dasdf898adssdd) rather than facet name (i.e. has-text).

[rql] fix min/max args definition of [TEXT_]LIMIT_SIZE registered procedures (long outstanding bug discovered after recent fix in lgdb)

[schema] rephrase relation definition since constraint doesn't apply to CWRelation

[datafeed] closes #1873616 (user's url corruption when etype is not recognized

[schema] restrict source mapping 'cw_schema' relation to non final relation, we currently have no use for attributes

[c-c db-check] add some sql queries to fix cw_source/is/is_instance relations according to data in the entities table

[c-c db-check] missing comma ending print statement to get expected output

[c-c db-check] disable write security as well so we can delete stuff when needed (e.g. orphan TrInfo)

[c-c db-check] having no owner is allowed, don't try to fix that

[metadata, ldap] make backport of ldap user actually working

[c-c db-check] drop some deprecation warning

[index page] use 'New xxx' generated labels, 'add a xxx' labels are only generated according to inlined form configuration and with an associated context

[doc packaging] prune _sources containing generated text file, include js else search doesn't work

[boxes] 3.13.2 regression: should specify dom id else we may generate bad xhtml

[facets] fix missing 'warnings' import and missing self reference on 'filtered_variable'

stable is now 3.13

oldstable is now 3.12

Added tag cubicweb-debian-version-3.13.2-1 for changeset 9ad5411199e0

Added tag cubicweb-version-3.13.2 for changeset f9227b9d6183

3.13.2

[rql2sql] closes #1832859: fake HAVING terms w/ EXISTS terms there are cases where we want to use the HAVING trick on terms that should belong to an EXISTS subquery. Currently , this causes bad sql. We should fix that until we've a proper rql grammar avoiding the need for this trick. Notice at some point, we may want **actuall** HAVING clauses and GROUPBY used in EXISTS subquery, but that's another story.

backport stable

[boxes] closes #1832844: translate views category in possible views boxes

[cwctl] set min/max args for reset admin password command. Closes #1832986

[web] Image optimisation using trimage (pngcrush inside)

[preferences js] jquery 1.6 needs quote when querying attribute value

fix test broken by previous commit

[session] add session id to closed connection errors

unsaved change...

[facets] closes #1827464: facet box always appear by implementing proper selectors

[uilib] fix bad argument order, introduced by previous commit

[uilib] reimplement printable_value function using a dictionary so one can easily change how to base type is displayed everywhere in the application. Closes #1827465

closes #1826543: error on some ajax_replace_url call

Added tag cubicweb-debian-version-3.13.1-1 for changeset cc0578049cbe

Added tag cubicweb-version-3.13.1 for changeset 7d84317ef185

3.13.1

i18nupdate

backport stable

Added tag cubicweb-debian-version-3.12.9-1 for changeset 92464e39134c

Added tag cubicweb-version-3.12.9 for changeset cb2990aaa63c

3.12.9

[repo, ms] fix planning of some queries where variable 'non-invarianess' should be considered, leading for instance to junk in entities table on source deletion

[repo] closes #1821172: fix source deletion

[ajax, IE] rewrite some code to avoid duplicated evaluation with IE

[repo, hooks] small task optimization: don't start cleanup_old_transactions when undo support is not activated, and retrieve a session to update a source only when some source to update is found

[http] closes #1816411, restore expires_header on static files in non-debug mode

[native source] fix bug introduced in 7645:cb2459aaa7d7: fetchone() may return None

[source] closes #1816412: try to reconnect to dbms if connection is reset in eid_type_source()

[twisted] add an option to configure twisted's threadpool size Twisted's threadpool size defaults to 10, which means we virtually try to serve up to 10 simulateneous requests but connection-pool size defaults to 4 on CW-server side. That means that under heavy load, chances are high that some HTTP queries end up with a 500 error code / connection-pool exhausted.

[book, form] include complete example of self-posted form with custom field/widget + minor other changes

backport stable

[datafeed] don't raise bad config error on source initialization

[schema] closes #1816439: RQLConstraint does not take variable U into account

[web form] avoid mis-formated warning for _cw_fields

[doc, hook] more backport of syt mbox documentation

[book, ldap] backport some doc from my mailbox

[book] fix some urls

[book, forms] talk about cnx.use_web_compatible_request instead of custom monkey-patching

[book] drop gae from the book

[book, admin] include some fixes done by auc in an email to me

[book] fix some rest/sphinx errors

[repo test] fix broken tests

closes #1784285: [rql2sql] crash when using a relation for inner and outer join

[range facet] closes #1806937: simply retrieve min/max values when computing vocabulary/possible_values, this is enough

[facet] fix facet values update, broken by 7626:56300bec75f8

[facet slider] quote attribute value, else may break with earlier jquery

[facets] use unique dom id

[facet] with rql path facet rel may be None, handle it

[facet] closes #1806932: test and fix facet bug w/ having query (need rql update)

[ajax js loading] when everything is already loaded, don't do anything

backport stable

[IE, plot] ship with jqplot'excanvas version (include http://code.google.com/p/explorercanvas/issues/detail?id=82 for instance)

[etwist, modconcat] closes #1806935: directly write data, don't put the whole concatenated thing in memory

[etwist] clear ui cache at server startup time. Closes #1806933 this avoid pb when cubicweb/cubes provide new version of some js/css and also accumulating junk in the cache directories

[facet] closes #1806931: new facet type, based on arbitrary rql path

[selectors, test] remove duplicated test and add some for relation_possible selector w/ rqlst

[repository] catch Exception instead of everything

[facet] fix argument inversion in date range facet

[facetbox] put the facet box in a box

[doc] fix broken links

backport stable

[test] fix test, code from 3.13 gone in 3.12 accidentaly

[selectors, facet] make is_instance and other EClassSelector subclass gather entity classes from 'select' and 'filtered_variable' context information. Closes #1796732 This allow for instance to use the filter form on rqlst where the filtered variable is not selected

[facets] DontUpdateConstraint mecanism introduced a few commit ago isn't needed: we already have the 'needs_update' property controlling this

[facet] more api cleanup: support_and should be a property, so it's easier to deactivate.

[range facet] refactor to ease overriding, possible_values raise DontUpdateFacet (not handled by js actually)

[facets] allow to specify on which rqlst's variable facets should be applied. Closes #1795915

[facets] refactor / cleanup facet api: more consistent variable naming and easier to reuse function. Closes #1796804

backport stable

[schema / rql] fix mainvars of RRQLExpression with parens

[facets js] better cubicweb:facetargs handling and avoid initializing a same form twice (that may occurs)

[facets] should remove groupby from base rqlst. Closes #1796196 as we search for values for a variable, there seems to be no case where we would be interested in groups, though there are clearly some were leaving groups cause errors.

[facets] factorize table filter form / facets box generation, moving out filter form from the table view so it's usable from other views. Closes #1794009

backport stable

[worklow forms] rewrite remaining pre 3.10 form code using uicfg

[doc] SQL Server isolation level settings

new rql2sql unit tests for ORDERBY and LIMIT checks in SQLServer

backport stable

[cwc shell] add ``--password`` option to ``reset-admin-pwd`` (close #1794866) This will help batch. The help warn it's not very secure.

[c-c instance commands] keyboard interrupt should stop the command, not jump to the next instance. Closes #1794850

[rset] syntax_tree impl. consistency: don't return an annotated syntax tree

[cw-ctl] add command versions to list versions of cubes used by an instance (closes #508052)

closes #1793991: [datafeed] error handling: log unexpected exceptions / don't stop on first validation error

[web session] fix bad cleanup of session without a connection set. Closes #1772125

[i18n] fix undetected conflict

[rql2sql tests] fix erroneous case (tested with psql)

add missing future import

drop unittest deprecation warning

[form, controller] closes #1787233: form should provide a method to process posted content

[forms] fix import, gone into the wrong patch

[form, renderer] closes #1787234: [form] onsubmit interpolated by the form renderer, it shouldn't

[form renderers] closes #1787232: new 'onerowtable' form renderer so it's easy to retrieve a dictionary of {field name : typed value} for a custom, no entity related, form

backport stable branch

[rql2sql] more cases fixed where something is wrongly added to GROUPBY, causing unexpected results for the query

[book] rewrite / complete the RQL language chapter

[all] remove pattern "try: function() except AttributeError: pass" (closes #1787966)

[cw-ctl] command list should not break when cube depends on version None (closes #1787209)

[uilib] new js_dumps function allowing usage of bare js string (wrapped into JSString) modify magic 'js' object to consider them as well

backport stable

[repo, looping task] raise a custom exception when repository is shuting down, avoid looping task to be restarted in such case. Closes #1021276

[formfields] use support_args instead of catching type error avoid hiding other issues and making debugging difficult

[cw.ajax] fix loadxhtml documentation and warn when called on an empty elements list

[etwist] log missing file even in debug mode

backport stable

[test] run and fix utils and uilib doctests

Display proper date in plot/flot (closes #1725589)

[doc] fix NameError in bfss tutorial

[js/css concat] do not return 404 when resources of a concatenated data URL does not exist, unless in debugmode; closes #1745644

[server] "overrule" case insensitivity of database name (closes: #611294) The only instances where you are required to use quotes are either when a database object's identifier is identical to a keyword, or when the identifier has at least one capitalized letter in its name. In either of these circumstances, you must remember to quote the identifier both when creating the object, as well as in any subsequent references to that object

[tests] update repository tests with new `use_cwuri_as_url` attribute This attribute was intriduced by changeset 92fd4b777016

backport stable

Added tag cubicweb-debian-version-3.12.8-1 for changeset cf49ed55685a

Added tag cubicweb-version-3.12.8 for changeset 50122a47ce4f

3.12.8

[migration] litle enhancements and a fix to patch accidentally pushed two revisions ago

[controller] UndoController: fix output method (closes: #1776091) Fix buggy direct output in `UndoController.publish()`. Raise now a ValidationError instead of malformed string Changes: * raise ValidationError when an error occured in undo * use the new message mechanism based on _cwmsgid If errors are not fatal, you have to change publish() method.

[migration] closes #1777411: schema modification commands shouldn't crash if already exists

[rqlrewrite] closes #1772135: 1. don't try to reuse a relation from another statement (eg because a subquery has been introduced) 2. _use_orig_term should consider the current statement

test fixes

[datafeed cw parser] refactor: split logic that was in the parser into: * an "item builder" component, turning an etree xml node into a specific python dictionnary representing an entity * "action" components, selected given an entity, a relation and its role in the relation, and responsible to link the entity to given related items (eg dictionnary) This changes make it easy to add new action or to override existing one's behaviour according to the entity, the relation, etc... Also refactor the xml view so one can also override what's included in the tag used to mark the entity as used by a relation, hopefully allowing to reduce the number of http requests needed for a full datafeed import.

[datafeed, entities] url for entities from a datafeed source should be on their origin site. Closes #1769391

cleanup

[3.10] fix typo and error for pre 3.10 migration w/ postgres: we *must* call init_creating else the fti isn't correctly initialized, which may lead to silently rollbacked transaction

[migration] don't add CWUniqueConstraint if already there (may occurs when running a migration in multiple times

[datafeed] catch all exception, we should continue to process other urls

fix 3.13.1 migration

Added tag cubicweb-debian-version-3.12.7-1 for changeset a07517985136

Added tag cubicweb-version-3.12.7 for changeset 628fe57ce746

3.12.7

[ms, entity metas] add 'actual source' to entities table / base entity metadata cache. Closes #1767090 this is needed since for entities from 'copy based sources' such as datafeed, we want entity.cw_metainformation() to return as 'source' the datafeed source, not the system source (ie the source where the entity is actually stored). For both performance and bootstraping reasons, we should store this information in the `entities` table and in the _type_source cache.

fix 3.13.0 migration script (closes #1766202)

backport stable

fix 3.12.0 migration script (closes: #1766202)

[test] update to 3.13 api

[migration] when there are no data migration needed, we still want to rewrite the configuration and to restart the server. Closes #1760927

[migration] bugfix: c-c list was not displaying the name of a cube requiring another cube without constraining the version.

backport stable

[rqlrewrite] test and fix rql snippets insertion when several snippets match an optional variable

[datafeed, cw.xml] xml now carry entity's source information, interpreted at the other end so that for instance when an entity from elo is seen when importing cwo, it's properly marked as coming from elo source if one exists

[datafeed] actually raise on error

[python 2.5] compat fix

[datafeed, cwxml] parser now try to complete source's urls so one can add url such as <myinstance>/project. Closes #1759908

[server] fix unicode conversion capability in UndoException By overriding the __unicode__ method, we ensure unicode builtin will return Unicode object even for python versions that don't have a __unicode__ method by default (python < 2.6) In previous versions, when this method is not defined, string conversion is attempted, and the result of string conversion is converted to Unicode using the system default encoding which is ascii the most of the time.

[book] add autoload section from code and fix sphinx warnings * drop misleading faq entry since clear explanation can be found in internationalization chapter * use autodata sphinx directive instead of raw text * fill empty chapter with autodoc: - devweb/httpcaching.rst - devweb/resource.rst - devweb/views/idownloadable.rst - devweb/views/wdoc.rst * use shebang in excerpt to denote shell code * fix some bad indented docstrings in javascript files

[controller] fix wrong view name when error occurs in UndoController

[datafeed] renaming parser attribute to parser_id makes things clearer

cleanup and assert we don't import unexpected stuff

[source config] fix synchronization on configuration entity changes

[ui, sources] configure source form: hide synchronizing and mapping entities, use simple text input for parser

[rql annotation] fix bad invariant variable w/ has_text relation: this is only true when has_text will be used as principal (though we don't know that yet)

[test] update to new db handler api

[querier] turn remove_clauses/restore_clauses into a context manager

[devtools pg handler] some fixes so we get proper error when pg host is not reachable

[rdf] add method so one can call entity.view('rdf')

[web test] fix unittest_web

[ajax edition] freeze form button when calling validateForm, so it freeze nicely for e.g. comment submitting form

[web page tracking] fix bug introduced by parent revision

closes #1484510: ajax_replace_url should propagate page id (until an underlying api does it automatically

backport stable

[repo integrity] test and fix glob add relation where several entities are added at once for a relation of 1? cardinality

[packaging] Build the cubicweb-documentation package

[breadcrumbs] closes #1717489: Double escaping in breadcrumbs

[donc] Fix building the cubicweb js documentation Avoids errors such as: Exception: Bad file id cubicweb.lazy referenced in INDEX_IN_ORDER in ../../../doc/tools/pyjsrest.py, fix this please

add an XXX

fix 3.10 cwproperties migration

fix failures introduced by recent refactoring * * * [testlib, realdb] we should close connections prior to create a new db using current db as template

[testlib, realdb] we should close connections prior to create a new db using current db as template

[migration] this is needed to avoid pb with yams 0.33 / cw < 3.13

[sync schema hooks] consider etype name map before trying to update in-memory schema

[repository] refactor and optimize '?1' relation handling * only skip auto remove if activeintegrity is explicitly disabled * do it even for inlined relation, so hooks are properly called * on entity creation, only cleanup what's needed

[session] deprecates schema_rproperty in favor of more optimized rtype_eids_rdef which return the rdef (so reusable to gather other data)

[repository] refactor/cleanup entity deletion methods * kill unused Repository.delete_info_multi (no leading _) * kill unnecessary system_source.delete_info (almost no benefit over delete_info_multi) * stop giving entities list *and* extid list, gather them from the entity when needed * move pending eids handling into glob_delete_entities, so one can call it directly without worrying about that

[repository] new hook selector according to configuration's repairing flag

[pyrorql] don't display traceback on connection error