merged test fix from stable

[http] implement 1587305: provide better implementation of Accept header parsing + tests

[web test] extract a set_auth_mode method from init_authentication and use it in test_fb_login_concept to avoid bad test interaction

merge stable to default

fix failing tests before 3.12 release added a skip in unittest_reledit, I'd like acampeas to give it a look.

[dataimport] new 'lazydbtable' generator function to feed data from a database table

[dataimport] ObjectStore.create_entity should return something that looks like an entity (eg no more using dict protocol to access to attributes)

[dataimport] cleanups, update docstring to up-to-date usage

[doc] improve dostring of server.hook

merge back stable to default

[cwctl] refactor ui messages aiming for consistency and simplicity

[entity vocabulary] refactor unrelated rql to allow usage of RQLRewriter to insert schema constraints. Closes #1561806

[entity vocabulary] fix unrelated rql generation to skip rql constraints that don't make sense

[schema, refactoring] use RQLExpression as base class for RQL constraint classes

[reledit] fix crash due to wrong attributes usage

merge

make it easier to inherit from EditionFormView

more TZDatetime/TZTime test fixes

fix test_knownValues_load_schema

backport stable to default

[doc] fix typo

[doc] fix typo

[AnyEntity] rename __linkto attribute as cw_linkto to avoid name mangling which make overriding/monkey-patching unnecessarily harder

[sql generation test] avoid lgdb warnings when a db module is faked

backport stable

[c-c create] unification of c-c create and its subcommands handling * create/db-create/db-init uniformly accept --automatic and --config-level options, properly passed along the way * --automatic option fixed so it doesn't need yes or no argument * closes ##1537265 on the way

[rql rewriter] to properly handle 'relation' rql expressions, rql rewriter must support multiple variables (eg S and O) at once to be given as varmap

[rql rewriter] drop unused argument

[rql rewriter] don't add unnecessary (potentially buggy) exists

update lgc dependency also in pkginfo

updated lgc dependency

allow CW to act as a Pyro Server without registering the server to a Pyro Nameserver (closes #1528533) This is achieved by configuring the pyro-ns-host to __NO_PYRONS__ (which is an illegal value for a host name) The Pyro URI for the server can be retrieved by reading the pyro_uri attribute of the Repository

[date picker] apply Carlos patch fixing spanish date picker translation file. Closes #1558893

cleanup

[c-c create] we should also skip option with no type, else we may generate title for section without any option to fill

[config] do not set base-url during instance creation, we don't want generated value to ends up in the configuration file

[config] generalise config.creating, allowing to drop set_language class attribute

[web test] fix broken url in reledit. tests BROKEN ANYWAY (crash due to missing attribute)

merge

Added tag cubicweb-debian-version-3.11.2-1 for changeset 954b5b51cd92

Added tag cubicweb-version-3.11.2 for changeset 56ae3cd5f855

[packaging] prepare 3.11.2

try to reconstruct the file forgotten by syt in changeset e094b3d4eb95

[javascript] fix loadRemote test for JSON_BASE_URL / baseuri matching put both url and baseuri() to lowercase since baseuri() might have uppercase characters. Thanks to Florent for spotting this.

cleanups

[cwuser, persistent properties] fix recent set_property implementation on CWUser: for_user is automatically handled for non-managers users (this is seriously debatable though)

[repository] fix crash in optimized [add|remove]_relation w/ inlined relation (broken by cw 3.10 refactoring)

[server] move EditedEntity class to its own module, to avoid cyclic dependency when needed from e.g. session.py

[facets] closes #1569459 (date-range facet with year < 1900) use lgc.date.ustrftime() and lgc.date.ticks2datetime to convert js date ticks and have a chance to handle dates with year < 1900.

[session] add find_entities and find_one_entity to session/request API (closes #1550045)

[web formwidgets] add missing tabindex to jquery date and time widgets (closes #1568475)

[c-c create] db-create doesn't not take a verbose option any longer

[css] we should use padding instead of margin here, else the element as size greater than <body>, forcing an horizontal scrollbar to appear

[db connection] fix db connections method: verbose should be named interactive, it's not a question of verbosity but wether question should be asked or not

[cwprops, migration] fix [set_]property to ensure we don't retrieve a user specific value. Add some docstring along the way

[cwprops] add set_property method on CWUser instances, to ease setting of user specific properties

[merge] backport stable fixes into default

Abstract the support for ORDER BY and LIMIT/OFFSET SQL generation all DB engines do not support the same syntax for these features, MS SQLServer being the bad boy we try to support in CW. * Use two new methods of dbhelper to add LIMIT/OFFSET clauses and ORDER BY clauses * added unit tests for sqlserver backend * changed unittest_rql2sql to lauch the backend tests even if the driver module is not installed on the machine, so that we can run the sqlserver tests on linux (and the mysql tests too) * adapt msstep.py to the new interface closes #1154756

backport oldstable

[migration] Lesser memory consumption of cwuri fix + actually commit every 100 processed entities Don't use the ORM as added value is poor while all intentiated object are keept by rset cache.

[migration] improve fix cwuri progress bar * Use the progress context manager, * Adds a title * Informs that operation have been partially committed.

[migration] explicit first step of 3.10.9 migration. Previously there was on a "commit now" confirmation. The reason of the request are now explained and both request must be confirmed.

cleanups

[uiprops, css] make header background actually modifiable through uiprops

[components] add **kwargs to render method of header components to make them usable as regular components (eg in other places than the header

[schema views] don't propose 'view all' action for final entity types (closes #1560549)

[doc] fix urls pointing to repositories and download sites

backported tag to stable

Added tag cubicweb-version-3.9.x for changeset 48f468f33704

merge

[devtools] missing py2.5 compat import

merge oldstable into default

fix stupid typo

merge

merge: [testlib] require explicite overwriting of TestDataBaseHandler. A new overwrite (default to False) parametters is added.

[testlib] require explicite overwriting of TestDataBaseHandler. A new overwrite (default to False) parametters is added.

remove conflict marker

merge old stable into stable

fix pylint helper methods: need a classmathod in cwconfig.py

fix pylint helper methods: need a classmathod in cwconfig.py

merged back pylint help changes to stable

merge

help pylint by explicitely defining some attributes * the logging functions automatically set by set_log_methods * the attributes of Hook classes (eidfrom, entity...):

[doc] fix indentation spelling and grammar of tutorials/advanced/part03_bfss

[doc] complete description of EXISTS in rql/language.rst

[doc] fix rql/debugging.rst and server.__init__ docstrings

[doc] fix rql/debugging.rst and server.__init__ docstrings

[test] New Handling of database for test. This patch adds a new TestDataBaseHandler class. TestDataBaseHandler are in charge of Setup, backup, restore, connection, repository caching and cleanup for database used during the test. TestDataBaseHandler reuse code and logic previously found in cubicweb.devtools functions and devtools.testlib.CubicwebTC. TestDataBaseHandler is an abstract class and must be subclassed to implement functionalities specific to each driver. TestDataBaseHandler can store and restore various database setups. devtools.testlib.CubicwebTC gains a test_db_id class attribute to specify that its TestCase uses a specific database that should be cached. The pre_setup_database class method is used to setup the database that will be cached. The setup_database method is kept uncached. The same TestDataBaseHandler are reused for every test using the same config object. TestDataBaseHandler try to reuse Repository objects as much as possible. All cubicweb test have been updated.

[reledit] repair some brokennes

[reledit] kill the reledit/doreledit duality * * * [reledit] use action to determine form content * * * [reledit] use self.entity instead of passing entity everywhere

default (3.11.X) is now stable

stable (3.10.X) is now oldstable

[test] add some tags

[test] properly close connections

[devtools] fix anonymous user handling in test classes

[web] provide a data_url() method on req and get_rid of explicit datadir_url usage (#1438736)

[views] #1499661 get rid of base tag

backport stable

[tabs] forward url parameters to lazy tabs views If http://www.cubicweb.org/project/foo?x=12&y=13 dislays a LazyTabView, this patch forwards {x: 12, y: 13} to subsequent lazy tabs (i.e. called through ajax queries).

[testlib] fix regression introduced in 7065:6a6ea9966931

[testlib] simplify code by using a class attribute

[repo] fix multi-threads bug with get_option_value: pyro proxy can't be used from a thread to another without caution (closes #1535206)

fix editable_attributes bug (closes #1534802)

[http test] fix typo in super call

backport stable

[testlib] New assertion method assertSentEmail() to test presence of emails in system mailbox

[tests] Fix web test for windmill and forms - new component 'inout' needed to be clicked (windmill) - renamed id will fail html tests (windmill and unittest_forms.py)

[uilib] fix eid_param implementation

[test] fix bad super call

[dbapi] split in_memory_cnx functions

Remove trailing white space

Add a "closed" property on session This will simplify check and allow nicer error thatn the current "no _tx_data" attribute error.

[test] Improve tagging and error message of TwistedCWIdentTC

[test/windmill] Gracefully skip windmill test if windmill can't be imported. If windmill import fails the windmill module is set to None and a dummy CubicWebWindmillUseCase test class is create. This class contains a test that skip itself with a proper warning message.

[devtools/qunit] had "qunit" test for tag.

[3.10.9 migration] don't display progress bar if stdout is not a tty

[source host alias] match_host is the attribute, match is the method

Added tag cubicweb-debian-version-3.11.1-1 for changeset 77318f1ec4aa

Added tag cubicweb-version-3.11.1 for changeset d0410eb4d8bb

3.11.1

i18nupdate

backport stable

some copyrigh updates

[sql generation] fix exists table scope pb: when iterating other solutions inner to an EXISTS subquery, we should reset variables which have this exists node as scope

[sql generation] fix table scope pb: when an inlined relation is used as principal for the rhs variable, we should adjust lhs variable'scope

merge stable changes into default

[testlib] backport some useful testing utilities from tracker's testutils module

[testlib] fix rql generation bug w/ groups given as unicode string

[multi-sources] add missing close method on ConnectionWrapper

[c-c db-check] new checks for entities missing a mandatory relation/attribute

[c-c db-check] factorize code by introducing notify_fixed dumb function

[migration] cleanup corrupted database, pb noticed on several instances

[dataimport] remove eid_key deprecation warning and prints

[config] fix option group clash causing anonymous user configuration to end in the MAIN section instead of the WEB section if cubicweb-dev is installed

[config refactoring] rename eproperty_definition method to cwproperty_definition

allow configuring the level of the configuration settings for cw-ctl add-source and db-init (which may call add-source)

add some tips for users who want to bind to an AD server adjust the level of the different configuration parameters so that the condfiguration becomes usable outside Logilab

[c-c upgrade] rename force-componant-version option to force-cube-version and cleanup code

[repo querier] fix rqlst cache no limit issue, comment the code

[migration] missing future import

backport stable

[source hooks] filter out case where source configuration doesn't have to be reloaded

Added tag cubicweb-debian-version-3.11.0-1 for changeset 8daabda9f571

Added tag cubicweb-version-3.11.0 for changeset 37432cede4fe

[schema sync] we don't want to react on after_update_entity, it may only causes bug. CWUniqueConstraint should be deleted then a fresh one readded on change (as we do in sync_schema_props_perms)

i18n update

[source ui] uicfg tweaks

3.11

[web test] fix some tests broken by recent (and various) changesets notice test_jscript and test_windmill are still broken, a pain to maintain and so breaks apycot test since we can't see state change from green to red (they are always red due to those two tests)

[web/views] add a generic rdf view

backport stable

[testlib pageinfo] extract matching_node method from has_tag to ease looking for a node with a given set of attributes

backport stable

[schema serialization] for relation type, ertidx contains the relation type as string, for relation def, the RelationDefinitionSchema instance

[schema deserialization] enhance fix done in 7010:fa707848a88a to properly deal with cw 3.9 database

[schema deserialization] _unique_together should hold string, not schema instance (may lead to crash during sync_schema_props_perms for instance)

backport stable

cleanup

[web test] ensure we're using proper instance home

backport stable

[config] we should load available configuration before search for an instance configuration

[dbapi] fix for cases where one want to use 'connect' for an in-memory connection

[skel] avoid pylint warning for newly generated cube

[sobjects/parsers] compatibility with xml view of cw <= 3.10

[sobjects/parsers] on validationerror, skip entity and continue processing feed

[web test] fix test name conflict

merge default heads

merge default heads

[tabs] use datadir_url to build image url instead of hardcoding data/

[wdoc] fallback to english title when no translation found

[datafeed] don't crash if python-kerberos isn't installed

[sobjects/parsers] add gssapi auth handler to urllib2 opener applied patch gssapiauth.diff

[data operation] add new remove_data method

[migtration] fix migration script for 'dont cross' relations

backport stable

[dataimport] implement create_entity() on ObjectStore to provide a consistent interface (+fix typo s/attribute_edited/edited_attributed/)

[dataimport] make it possible to insert 'empty' (i.e. no-attrs) entities In such cases (e.g. ternary relations), generated RQL must be 'INSERT MyEntityType' instead of 'INSERT MyEntityType:'

[hooks] do not break if no entity created or updated during feed update

[ajax box] fix ajaxBoxShowSelector w/ mono-valued fields + minor cleanups

[ldap test] use get_available_port from cw.devtools.httptest

[test] generate slapd.conf to be cwd independant

[ldap test] use get_available_port from cw.devtools.httptest

[test] generate slapd.conf to be cwd independant

backport stable

[test] missing future import

backport stable

[testlib] take care, validator may be None

[testlib] extract get_validator method from _check_html, move assertDocTestFile

[testlib] new method on page info object to ensure some tag with arbitrary attributes is found

[packaging, test] include ldap test files in sdist

[test] python 2.5 specifix

add a note

[manage view] get etypes first to avoid xhtml validation error if no one found

[datafeed] return empty dict when source is fresh avoid crash in the looping task because None returned

[manage view] fix skipping of startup views

[parser host mapping] take care to cases where apphome is None (c-c i18ncube command for instance)

backport stable

[test] update cwxml tests: computed cwuri have changed, and parser.parse isn't anymore a static method

[testlib] by default skip new 'manage' action's category

[manage view] filter before displaying anything avoid xhtml errors

[test] update cwuri test

[test] test extracted from unittest_hooks + new test for unique constraint check

[datafeed] introduce a host mapping so dev instance may transparently redirect request to another host than the actual's one

[management ui] add views to manage sources similarly to users

[manage view] cleanup manage view and user menu * drop code that shouldn't be there (e.g. folders handling) * add a section displaying site management actions, some of them were initially in the user's drop down menu, which now only have a 'manage' link with regards to management actions * stop displaying 'system' and 'schema' entities by default, only 'application' entities * put 'gc', 'registry' and 'info' views as tabs of a generic 'server information' view

[datafeed] add parser to import cubicweb xml this parser is configurable through a mapping, which basically tells which entity's relation should be copied. Multiple actions to control backport of data are available: * 'copy': copy the external entities locally (though marked as coming from the data feed source) * 'link': find similar entity internaly (e.g. for states) * 'link-or-create': try to find a similar entity internaly, and create it if necessary (won't be marked as coming from the data feed source, e.g. for tags)

[xml] enhance default entity xml view * format attributes according to their type in a predictable way * move eid/cwuri as top level tag attributes * control which relations should be in using 'relation' form param

[pyro source] benefit from addition of latest_retrieval on CWSource to avoid using a CWProperty to store pyrorql source latest synchronization.

[repository] #1460066: backport datafeed cube as cubicweb source * add some attributes to CWSource to handle this kind of source (not natural to put everything in 'config' string). Adding a CWSource subclass has been attempted then rollbacked because it adds pain to handle multi-sources planning and it introduce an ambiguity on a generic relation (cw_source), which may be a penalty in multiple case * data feed sources are a new kind of source, namely 'copy based', which have no effect on the query planner * a data feed source is associated to a list of url and a parser (appobjects in the 'parsers' registry * entities imported by a data feed have cwuri set to their url on the distant site, their cw_source relation point to the data feed source, though their source stored in the entities table (returned by cw_metainformation) is their physical source, hence 'system'

backport stable

[entity, metadata] huuum, use resolvable url as cwuri... And fix existing ones.

[doc] update some copyrights

[repo, ms] fix pb introduced in 6941:9ed02daa7dbb resulting in missing relation deletes when an entity is deleted

[tabs js] merge tabs and lazy js files into cw.ajax.js and use camel case names to satisfy js coding standards

[schema, ui] fix is_subobject to skip cw_source relation (else everything is considered as a subobject, since this relation is now composite)

[admin ui] nicer views for users/groups management

[test, ui] mark CWSourceSchemaConfig as an internal type

backport stable

[js] using the actual registry fixes spurious warnings

[pyrorql source] using 'time' option type is more convenient

[sources] refactor source creation and options handling * options validation * ease proper update of source's config on configuration change

[sources] rewrite the way pyrorql mapping are stored in the database so it can be reused for other sources (eg datafeed+cwxml)

[sources] reorganize abstract source code, drop no more used cleanup_entities_info and _cleanup_system_relations methods

[source schema] fix permission pb on cw_host_config_of relation + add composite on cw_source, so entities from a source are properly removed when the source is removed

[repo, ms] optimise external source deletion by using source's eid instead of name

[rql2sql] should not select a neged relation as principal + simplify code for sql generation for attribute relation

[c-c] fix crash on delete instance + potential others when user don't specify db user's password

add a rql directive to restructuredtext

[pkg] bump dependency on logilab.database

Added tag cubicweb-debian-version-3.10.8-1 for changeset 132b525de25b

Added tag cubicweb-version-3.10.8 for changeset e581a86a68f0

3.10.8

i18nupdate

undo part of #6911

backport stable

[test] add test for != operator

[rql2sql] fix bug with NOT in "fake" having terms

[doc/book] simplify & fix the overview chapter

ooops :D

cleanups

[ctxcomponents vreg] allow to specify 'no cache' using __cache argument

[js utils] backport some generic code from comments cube to handle inline ajax form as you get to add comment to entities. Following stuff has been generalized and backported to ease such things: * lazy_view_holder() method on EntityCtxComponent class, to build place holder where the form will be inserted * ajax_composite_form() function in cw.web.views.ajaxedit, to build the form itself * reload() and reloadCtxComponentsSection() javascript function in cubicweb.ajax.js for the javascript processing side

[doc] update photo web site tutorial: we're starting from cw 3.10/file 1.9+

[view] fix/enhance view.render * give view init args when selecting row view * optimize by avoiding re-selection on rset of size 1

[js lib] new string.rstrip method

[ibreadcrumb] fix breadcrumb adapter backward compat

[selectors] modify workflow selectors: is_in_state, on_transition - factorize `is_on_state` selector - add new `on_transition` selector Especially useful to match pending transitions to enable notifications when your workflow allows several transition to the same states. Note that if workflow `change_state` adapter method is used, this selector will not be triggered. In debug mode: These both selectors will check against the entity current workflow if expected values given in selector argument are valid. ValueError exception will be raised for unmatching state/transition names against the current workflow (generic etype workflow). (check against custom workflow is not implemented)

[cw-ctl] use default `mkdtemp()` behaviour to store backup file internally When using `mkdtemp(dir=instbkdir)`, a dedicated system user which hasn't the permissions to write in /var/lib/cubicweb/instances/$INSTANCE/backup will not be able to run the db-dump command.

[debian] fix lintian errors

[devtools] fix understanding of boundary constraint on db automatic population

[rset] fix entity building for some result set with UNION and subqueries

[c-c] lgc 0.54 check for duplicated commands, this may occurs with cw where plugins are automaticall (re)loaded

[utils] support_args now support classes, searching if __init__ supports the arguments

[schema sync] fix crash when bad inlinment detected, inlined is not in the locals

cleanup, docstring update

fix test broken by addition of new entity in test schema