[datafeed] add parser to import cubicweb xml this parser is configurable through a mapping, which basically tells which entity's relation should be copied. Multiple actions to control backport of data are available: * 'copy': copy the external entities locally (though marked as coming from the data feed source) * 'link': find similar entity internaly (e.g. for states) * 'link-or-create': try to find a similar entity internaly, and create it if necessary (won't be marked as coming from the data feed source, e.g. for tags)

[xml] enhance default entity xml view * format attributes according to their type in a predictable way * move eid/cwuri as top level tag attributes * control which relations should be in using 'relation' form param

[pyro source] benefit from addition of latest_retrieval on CWSource to avoid using a CWProperty to store pyrorql source latest synchronization.

[repository] #1460066: backport datafeed cube as cubicweb source * add some attributes to CWSource to handle this kind of source (not natural to put everything in 'config' string). Adding a CWSource subclass has been attempted then rollbacked because it adds pain to handle multi-sources planning and it introduce an ambiguity on a generic relation (cw_source), which may be a penalty in multiple case * data feed sources are a new kind of source, namely 'copy based', which have no effect on the query planner * a data feed source is associated to a list of url and a parser (appobjects in the 'parsers' registry * entities imported by a data feed have cwuri set to their url on the distant site, their cw_source relation point to the data feed source, though their source stored in the entities table (returned by cw_metainformation) is their physical source, hence 'system'

backport stable

[entity, metadata] huuum, use resolvable url as cwuri... And fix existing ones.

[doc] update some copyrights

[repo, ms] fix pb introduced in 6941:9ed02daa7dbb resulting in missing relation deletes when an entity is deleted

[tabs js] merge tabs and lazy js files into cw.ajax.js and use camel case names to satisfy js coding standards

[schema, ui] fix is_subobject to skip cw_source relation (else everything is considered as a subobject, since this relation is now composite)

[admin ui] nicer views for users/groups management

[test, ui] mark CWSourceSchemaConfig as an internal type

backport stable

[js] using the actual registry fixes spurious warnings

[pyrorql source] using 'time' option type is more convenient

[sources] refactor source creation and options handling * options validation * ease proper update of source's config on configuration change

[sources] rewrite the way pyrorql mapping are stored in the database so it can be reused for other sources (eg datafeed+cwxml)

[sources] reorganize abstract source code, drop no more used cleanup_entities_info and _cleanup_system_relations methods

[source schema] fix permission pb on cw_host_config_of relation + add composite on cw_source, so entities from a source are properly removed when the source is removed

[repo, ms] optimise external source deletion by using source's eid instead of name

[rql2sql] should not select a neged relation as principal + simplify code for sql generation for attribute relation

[c-c] fix crash on delete instance + potential others when user don't specify db user's password

add a rql directive to restructuredtext

[pkg] bump dependency on logilab.database

Added tag cubicweb-debian-version-3.10.8-1 for changeset 132b525de25b

Added tag cubicweb-version-3.10.8 for changeset e581a86a68f0

3.10.8

i18nupdate

undo part of #6911

backport stable

[test] add test for != operator

[rql2sql] fix bug with NOT in "fake" having terms

[doc/book] simplify & fix the overview chapter

ooops :D

cleanups

[ctxcomponents vreg] allow to specify 'no cache' using __cache argument

[js utils] backport some generic code from comments cube to handle inline ajax form as you get to add comment to entities. Following stuff has been generalized and backported to ease such things: * lazy_view_holder() method on EntityCtxComponent class, to build place holder where the form will be inserted * ajax_composite_form() function in cw.web.views.ajaxedit, to build the form itself * reload() and reloadCtxComponentsSection() javascript function in cubicweb.ajax.js for the javascript processing side

[doc] update photo web site tutorial: we're starting from cw 3.10/file 1.9+

[view] fix/enhance view.render * give view init args when selecting row view * optimize by avoiding re-selection on rset of size 1

[js lib] new string.rstrip method

[ibreadcrumb] fix breadcrumb adapter backward compat

[selectors] modify workflow selectors: is_in_state, on_transition - factorize `is_on_state` selector - add new `on_transition` selector Especially useful to match pending transitions to enable notifications when your workflow allows several transition to the same states. Note that if workflow `change_state` adapter method is used, this selector will not be triggered. In debug mode: These both selectors will check against the entity current workflow if expected values given in selector argument are valid. ValueError exception will be raised for unmatching state/transition names against the current workflow (generic etype workflow). (check against custom workflow is not implemented)

[cw-ctl] use default `mkdtemp()` behaviour to store backup file internally When using `mkdtemp(dir=instbkdir)`, a dedicated system user which hasn't the permissions to write in /var/lib/cubicweb/instances/$INSTANCE/backup will not be able to run the db-dump command.

[debian] fix lintian errors

[devtools] fix understanding of boundary constraint on db automatic population

[rset] fix entity building for some result set with UNION and subqueries

[c-c] lgc 0.54 check for duplicated commands, this may occurs with cw where plugins are automaticall (re)loaded

[utils] support_args now support classes, searching if __init__ supports the arguments

[schema sync] fix crash when bad inlinment detected, inlined is not in the locals

cleanup, docstring update

fix test broken by addition of new entity in test schema

[view] missing class on label span

fix #1452413 : is_in_state selector does not match initial state of an entity

[component] refactor layout retrieval to handle case where we've an entity without rset properly

[forms] EntityFieldsForm now take extra mainentity argument, for usage with composite form (the main form) where one of the subform edits the main entity

[selectors] one_line_rset selector should also work when rset is None but an entity is specified

[workflow] fix warning: we want to see the adapted entity, not the adapter

[js] fix deprecated call

[uicfg] fix reledit rtag initialization for final relations

[uicfg] use INTERNAL_TYPES and WORKFLOW_TYPES to initialize indexview_etype_section dict

[rtags] fix NoTargetRelationTagsDict to ensure relation are tagged using '*' during initialization

[rtags] speepup initialization by avoiding to get file entity types relations (useless)

[skel] try to generate warning free stub...

[deprecation] kill remaining 3.6 warning

[migration] cwunique constraint schema fix must be done in bootstrap migration

[i18n] missing some english translation

we must check constraint for all concerned entities and not stop at the first deleted one

avoid creating a new instance of CleanupDeletedEidsCacheOp if nothing was deleted

[css] fix popup css (login box) for IE7

[user form] use InOutWidget to edit CWUser in_group relation

[widgets, js] add a InOutWidget for multiple select

improve massive deletion performance change hooks.integrity._DelayedDeleteOp implementation to give it a chance of processing the entities by chunks of reasonnable size (500 entities at a time) adapt ssplanner.DeleteEntitiesStep to call a variant of glob_delete_entity with several entities. That variant calls all the before_delete_entities hooks in one go, then performs the deletion, and then calls all the after_delete_entities hooks. The deletion is performed by grouping together entities by etype and by source. adapt the HooksManager to call the hooks on a list of entities instead of on a single entity. adapt the sources to be able to delete several entities of the same etype at once. changed the source fti_(un)index_entity methods to fti_(un)index_entities taking a collection of entities.

[ldap] remove useless hack in unittest_ldapuser.py

[tests] make ldap source test run its own local (Open)LDAP server

[ldap] small code cleanups

[test] fix score_entity test

[testlib] missing method on value generator to generate the Interval type

[cleanup]

backport stable

[selector] update `match_transition` selector to match form & as well as form view.

[book] fixes some references and other doc construction pbs * predefine order of js files in index generation, skip some files * fix some references to the base tutorial (recently changed) * other ReST fixes

[book] advanced tutorial part 5 improvments: add some roles, talk about cube's layout, strip image

update code sample to 3.10 api

blog proofreading

[doc] backport part 3 & 4 of the sytweb's tutorial + to be published part 5

[test] missing future imports

[test] fix typo

[schema test] fix tests broken by 6861:9d4e11d6e783 (missing data files and not removed deprecated/broken test)

[vreg] check for identical app objects when replacing Prevent from weird behaviour when you badly wrote vreg callback

[docstring] minor: add warning about entity cache for rql_condition selector

[selectors] minor: use similar __repr__ implementation for selector instances

[tests] new unit tests about score_entity selector (inscore machinery)

[tests] use migration api to create workflow Prefer high-level migration api thru admin session instead of raw rql in helper method

[c-c delete] closes #1433117 and other flavours where we don't want to crash on error

[after edition ui] closes #1381425: Wrong message : 'entity edited (click here to see created entity)'

[i18n] cleanup catalogs

[adapters] fix #1424467 caused by precedence of bw compat method while the adapter is concret for a given class

[c-c delete] add quote on db drop statement to be more robust to exotic database names

[ajax] apply Ronan Dunklau patch closing #1433305: loadRemote js function failure on Firefox 4 with upper cased base domain name

[schema] ease understanding of schema naming error

[db-create] we should always ask db user that should be used when special privileges are required

[entity] fix some docstrings

[js] always lowercase baseuri #1433305

[rset] add utility method to get entities and attributes from any rset

[url publishing] evaluate url rewrite rules before rest path so one may easily override schema based urls

[ui, index page] drop useless 'schema entities' table

[views] delete ``permission`` tab in ``SchemaView``

[schema] fix CWSource permissions

[migration] fix migration of old cw instances which do not have yet the CWUniqueTogetherConstraint entity type

[repo] kill no more needed 'recreate' feature

[repo] move cursor creation into the try/except, it may raises an InterfaceError if the connection is closed

[repository auth] cleanup email login by turning it into a proper repo-side authentication plugin

[web session] cleanup session/authentication api: we don't have anymore to store authentication information on web session since the auto-reconnection feature has been dropped (eg in 3.10)

[primary view] support for entity_call on primary view

[doc] fix typo

[c-c list] don't crash if there are no 'version' attribute in pkginfo

[config] stop using a metaclass for registration of "public" configuration, simply do it explicitly

[devtools] set configuration name to all-in-one so test/data/all-in-one.conf file will be loaded as one may expected

backport stable

[sparql] fix an url generation bug breaking sparqlxml results view + remove a deprecation warning

[skel] setup.py patched to get easy_install to work

[tutorial] make things clearer

[hook] drop now deprecated comment (pop handled by get_data)

tutorial proof reading

[pkg] fix small bug appearing on Windows

[doc] major rework of the simple blog tutorial

[doc] fix match_rtype_sets docstring

[doc] some ReST syntax fixes

[doc] update cw api (XXX: similar changes have to be done in book probably)

added note about the effect of commit/rollback on the hooks_control context manager

[doc] fix security bug in photo web site tutorial

[c-c create] don't ask for web server interface at level 0

[skeleton] nicer pkginfo organization

[ui tweaks] fix default ui

[i18n] missing english translation

[doc] update unittest api

backport stable branch

[views] fix typo (invalid format character) in deprecation warning

backport stable

merge stable heads

Added tag cubicweb-debian-version-3.10.7-1 for changeset bf5d9a1415e3

Added tag cubicweb-version-3.10.7 for changeset 1959d97ebf2e

[server test] can't use skipTest method as a class method, raise appropriate exception instead

[etwist] add an 'interface' config option (passed to reactor.listenTCP)

[wf migration] allow to deactivate assertion on wfable entity to quick-fix tests

[schema] fix pb with ambiguous relation used within UniqueTogetherConstraint by having CWUniqueTogetherConstraint.relation targeting CWRType instead of CWAttribute/CWRelation. This fixes 3.10.7 migration.

[idownloadable] deprecate download_box function

[idownloadable] restore backward compat

typo in deprecation warning

[doc] stop trying to compile useless files with logilab's internal tools

update version number of dependancy to rql

prepare 3.10.7

i18nupdate

[cleanup] pylint detected error (among a ton of false positives due to the dynamic nature of cubicweb's code...)

[testlib] extract validation logic into a ``assertWellFormed`` method. This allow validation of document generated without a view.

[migration] add_workflow now ensure the entity type is actually workflowable, and a new make_workflowable migration function is available to make an entity type workflowable (closes #1382720)

unittest2 fix: can't skip test in setUp, but it's fine in setUpClass

[c-c] #1193302: Only show Deprecation warnings when using cubicweb-ctl (not /etc/init.d/cubicweb)

[pyviews] document the fact that content is not xml-escaped (closes #1382038)

[repository, pyro] ensure we're still properly registered into pyro name server in a looping task (closes #1336002)

[web action] refactor box menu handling, fixing #1401943 on the way

[config] use %r instead of %s for cube name makes things clearer

missing future import

[web test] fix authentication test: session cookie should now be computed by the session handler (changed in cw 3.10.6)

[unittest2] update to unittest2 assertRaises api

[server test] fix test inter-dependancy issue

[multi-sources] fix planning of crossed relation w/ some complex queries see ticket #59168 on our extranet for an example symptom.

[idownloadable] oneline view display entity's default title instead of file name, while download box display file name

[deprecation] fix bad warning on entity.querier_pending_relations

[web session] refactor to finally closes #343036: allow _postlogin behaviour overloading

[schema migration] add a test to ensure default value are considered

[schema hook] don't depends on lgc.testlib, hence unittest2 for a dumb mock

[bfss storage] Improve fspath() error message. This changeset improve the error message of fspath when the argument is not managed by a BytesFileSystem storage.

[json controler] extraargs in js_component contains unicode keys which may not be given as argument names

[footer template] refactor to ease addition of some content into the footer

[boxes] add id of the rset to generated dom id of RsetBox to lower chance of id conflict (object id may be reused later)

[doc] fix bad class ref

oops, forgotten to save buffer...

backport stable

[unittest2] use unittest2 module fixture api

[server/test] raise SkipTest from setUpModule instead of setUp( unittest2 behaviour) + kill some deprecation warnings

[daemon] make process umask configurable

properly tell we've started an instance (close #1391262)

[ctxcomponents] RQLCtxComponent: refactor init_rendering/render_body to ease overriding init_rendering now simply execute the query to get result set to be displayed, and store it in .cw_rset attribute. Links to be displayed by default are now computed in render_body. So you may now simply customise what to be displayed by overriding render_body.

[tests] use TextTestRunner from unittest, no more need to use SkipAwareTextRunner from lgc.testlib (which doesn't exist anymore in recent releases

[i18n/fr] minor change in etypenavigation component

d-t-w

merge stable heads

[test, html validation] make validator selection somewhat smarter (at least it works properly when content is demoted from xhtml to html, making the XMLDemotingValidator class useless

minor code cleanup

merge

Backed out changeset 84b67ae41a0d: with this fix, some extra ]> appears in the browser. We need to fix the validator instead.

fix unittest broken by TrInfo schema change

check the validity of kwargs passed to match_rtype

merge stable heads

fix ticket #1382716 (problem was actually more subtle than I originally thought) * log errors happening in looping tasks and repo threads * do not swallow RegistryNotFound exceptions which occur during hook execution (only those happening during hook registry selection)

[web/views/basetemplates] nbsp breaks tests, use #160 instead

[web/views/workflow] hide tr_count attribute in wf transition form

backport stable

[html generation] even when doctype without extension are asked, we should define the xmlns:cubicweb attribute to avoid html validation error during tests (break tests with new calendar view in default branch since it demote to html)

handle the fact that there might be no views registered in some configurations (#1382716)

[ms] fix ms planner crash on some ambiguous queries, as demonstrated in a comment on http://www.cubicweb.org/ticket/1382452

[ms] #1382452: incorrect results with multi-sources when some relation is crossed among sources with non-invariant variables, we've to introduce an intermediary steps to fetch all relations from all sources, then make the join with intermediary tables containing possible variables values.

#1382705 forbid with sql level locking the simultaneous fireing of a transition on a given entity

[doc/book] add missing mixin

[views/reledit] funky API made this fatal (it was previously only eating the second argument)

[views/reledit] ajax.js not there by default #1382713

[doc/book] fix/update a bit the hooks chapter

fix error message for unique together constraint

backport stable

backport oldstable

[config, i18n] Create default translation mechanism for all supported languages. Mostly usefull in test where language are never initialised from .po files. This is a reapplication of changeset 1a423eaee782 backouted by b9ffecd0316a with an additional fix not to break i18nxxx commands

[config] Use newstyle call to parent classe method.

[security] fix access control problem

[js/edition] remove trailing coma

[doc/book] move ctl tool in Admin chapter (from Appendages)

[doc/book] mention that the shell is a python shell

[web/components] fix typo in warning

[registry] backout 120c7ea6e1fa: errors should not pass silently Catching ImportError silently while loading files has too many side effects. (e.g. if system hooks / entities can't be registered).

[config] revert change that breaks i18nxxx commands

remove "metadata" class from MetaDataView as it is now set by SectionLayout (view.cssclass)

[js] fix initial value for autocomplete

[pkginfo|debian/control] adjust ldb version

add localization files for jquery datepicker

[#615712] replace calendar views with views using fullcalendar jquery plugin (remove old_calendar)

brown paperbag fix

make rename_table work with MS SQL (needs updated logilab.database)

[ldap] fix user-filter handling

[migration] improve doctest report format

[book] Notes about literate testing

[hook] update DataOperationMixIn docstring

[config, i18n] Create default translation mechanism for all supported languages. Mostly usefull in test where language are never initialised from .po files.

allow additional filtering to be performed on the LDAP source (#1382380)

[edition js] update docstring and remove a 3.9 deprecation warning

[autoform] fix call to remove pending generic relation: reference bad function name

[autoform] fix restoration of pending generic relation: inconsistent id was generated (eg different from the one generated by javascript

[pyro source] store pyro source mapping file into the database also, remove former c-c command to check that file and do the job in the source's view.

backport stable

[repo source] rename attribute so it's much easier to grasp its role

backport oldstable