merge changes from oldstable

[entity] improve error message

[doc] fix doc and tutorials about hooks and operations

[optim] cache rset column structures When iterating over large resultsets (lot of colcumns, lot of lines) to build entities, caching column structure (which attribute or relation is stored in each column) can improve performance noticeably.

[js] make _loadAjaxHtmlHead aware of mod_concat-like urls _loadAjaxHtmlHead keeps track of already imported resources (js / css) to make sure they're not included twice, but with mod_concat-like urls, things get a bit more complicated : if BASE_URL/data??foo.js,bar.js is already imported, then loading : BASE_URL/data??bar.js,spam.js should only load spam.js

[etwist] in debug-mode, concat-file is rebuilt if one of the concatenated file is more recent

[facets] display splash image while facets are reloading content (closes #1624851)

[facets] mark titles of active facets with red dot (closes #1624857)

[facet] add missing selector to HasRelationFacet

[facets] proper fix for #1625112: we should rather call unicode() as we always manipulate string as unicode internally

merge

[etwist] Generates apache's mod_concat-like urls for js and css Uses the lists of js, css and ie_css included in order to generate urls compatible with Apache mod_concat (ie: http://test.fr/??file1.js,file2.js). Css files may use `media` option or may be for IE only ; this patch does not concatenate css filenames for different media types or different IE specs. It concatenates only files served under cubicweb's `data` urls and keeps original include order. The generated urls are added to the HTML header as usual. HOW-TO: - calling HTMLHead(datadir_url) will enable the url concatenation - calling HTMLHead() will not benefit of url concatenation IMPORTANT NOTE: - fckeditor can no more be served under `/data/` segment

handle js/ css file concatenation with twisted

put data version md5 into a new url segment to ease static serving

add cwctl command to generate a consolidated data directory with all cubes/ cubicweb data directories content to be delivered statically

[etwist] refactor child resources management

[vreg] vregistry._select_best was needlessly instanciating NoSelectableObject (closes #1626708) in large selections, this incurred a non negligible cost (add_relations with 2000 inlined relations runs 7% faster with this patch)

backport stable

merge stable

merge oldstable

backport oldstable

[page data] don't call unload_page_data too many time (closes #1518398)

[request] don't init tabindex unnecessarily, since it's added to page data which will makes an ajax call to unload_page_data necessary

[deprecation] kill a remaining 3.6 warning

[web config] fix md5 version to ensure cubes order and to include cubicweb version

merged stable bugfix

merged oldstable bugfix

place the disable hooks context manager at the right place (closes: #1626694) hooks control is reset at each commit so we need to have a smaller scope for the CM in the 3.10.9 migration script

backport stable into default

backport oldstable into stable

[js] fix inArray usage in reorderTabIndex() : inArray returns -1 if element is not found, not 'false'

[rql] basic support for regexp-based pattern matching

[rql] support CAST() Function

stable is now 3.12

oldstable is now 3.11

[js] delete empty js files (incluced in cw.ajax.js)

[sql generation] fix crash on outer join + ambiguous inlined relation + attribute selection

[rql rewrite] backout 7177:f2a976cf7dac : since EXISTS is the variable scope, we want to insert snippets here anyway (other solution would be to NOT insert snippets at all in such case). Closes #1625464

[book] fix documentation + add chpasswd.py script

[facets] fix unicode encode error; closes #1625112

[facets] fix RangeFacet get_widget: do no return a widget unless there are at least 2 values; closes #1625203

merge

Backed out changeset 7a58581d842c This changeset breaks a number of CW tests, which depends on pre add hooks. I'm backing it out, so that we can start the need-for-speed sprint with green tests (and possibly rework this changeset)

small reformatting (but test still fails)

fix tests broken by fcb8932082a5 (continued)

fix bad handling of inlined relations when entities of different etypes are passed as subject to add_relations

fix failing test_migration test caused by schema change

fix tests broken by fcb8932082a5

merge back stable

fix server/test/unittest_checkintegrity (failing since 70538ea2532d)

fix implementation of repository.glob_add_relations (closes ##1625257) the internal data structure had changed during implementation and the code had not been updated...

[server] improve the speed of setting relations between entities (closes #1625257) The main idea is to add methods equivalent to session.add_relation and repository.glob_add_relation which handle several relations in one call. Speed gain results from: * using cursor.executemany to run SQL statements * factorizing some code which otherwise has to be performed for each relation, such as context manager creation before calling hooks or to enable security, creation of the EditedEntity instance (when several inlined relations are set on a single entity, and consequently when refreshing the cached entity) benchmark runs 1.1x faster for non inlined entities and 125x faster for inlined entities :-)

added test case to monitor speed improvements in the repository code. To use it, add a test in a patch, then hack CW to speed it up in another patch, updating the test if needed. By running the test with and without the second patch applied you can easily see the speed improvements

backport stable changes to default

[js] update jquery.corner.js to the latest version (uses native css support for browser that provide it); closes #1625065

[js/css] remove old versions of ui.tabs/slider etc.; closes #1625085

[devtools] make return value of get_response_header(raw=True) consistent wrt get_header(raw=True) i.e. get_response_header(raw=True) now returns the first element of the list rather than the list itself.

[widgets] handle no value label for tristate radios, put default separator on class for easier redefinition - closes #1624839

[doc] update of the update

[tz postgres support] we've to commit the connection once time-zone is set, else we may loose the setting

[tz support] more tests

[dataimport] actually commit every desired number...

[doc] major update of the install documentation

[facets] make rangefacet comply with start_unfolded (closes #1615869)

[testlib] make a clear distinction between input / output HTTP headers The get_header() / set_header() API is the same as for CubicWebRequestBase : - get_header() returns the **request** header - set_header() / add_header() works on the **response** header FakeRequest adds two additional methods : - get_response_header() returns the **reponse** header - set_request_header() adds a **request** header FakeRequest now uses the `headers_out` ineherited from CubicWebRequestBase. It also uses a `_headers_in` attribute

[entity] create_entity/cw_instantiate should initialize entity's cache to avoid later queries

[testlib] refactor create_user and grant_permission to make them usable from pre_setup_database

[3.12 regression] don't access to __class__ directly, it may raise AttributeError

[testlib] fix typos / NameErrors in devtools/__init__.py

[schema serialization] add warning on missing group

backport stable

[testlib] fix bug in backup file name generation: it may erroneously replace '-' by '_' in database **parent directories**. This should fix random error when test are run under apycot.

backport stable

[schema diagram] proper url generation (closes #1621276)

[testlib] fix readlb config handling, avoid systematic recreation of db with postgres (closes #1618089)

[entities] fix cw_instantiate typo

[entities/test] add failing test for cw_instantiate

[timezone] ensure tzinfo is None

[entity] use a list comprehension

Added tag cubicweb-debian-version-3.12.2-1 for changeset 6d418fb3ffed

Added tag cubicweb-version-3.12.2 for changeset 5a9b6bc56538

[packaging] prepare the release of version 3.12.2

merge changes from stable branch

[facet] ignore range extremas to avoid filtering out rows where value is NULL (closes #1251192)

Backed out changeset e0e802afa8e1, widgets are actually defined below

[facet] refactor: a simple class attribute is enough

[native source] eid_creation_lock actually lock the eid connection creation and usage

[dataimport] allow to specify columns on which result should be sorted in lazydbtable

[entity creation] ensure this is a relation and not an attribute before moving things into pending_relations because value is a list Using a list for attributes may be used for later type specific casting (e.g. timeseries)

[fckeditor] fix fckeditor relative url: use baseuri()

Added tag cubicweb-debian-version-3.12.1-1 for changeset 07e2c9c7df26

Added tag cubicweb-version-3.12.1 for changeset 59701627adba

3.12.1

i18n update

backport stable

[sql generation] fix missing join with outer joins w/ rhs invariant variable... ... where the principal where not the processed relation. This led to major refactoring in outer join handling, which is now much clearer and powerful. Closes #1579228

[test, cw props] ensure we can't add user specific / system-wide properties we had this pb on an historical instance in our intranet (eg. running for about 8 years).

[ms planner] fix buggy temp table name generation, may generate duplicated unique id with subqueries/union

[system source] drop now useless bw compat

[test] silent warning

[ms planner] use an index to avoid doing the same step twice

[views] extend HTMLStream API to be able to change doctype / xmldecl When generating RDFa (for instance), the doctype must be : <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML+RDFa 1.0//EN" "http://www.w3.org/MarkUp/DTD/xhtml-rdfa-1.dtd"> This changeset adds a ``set_doctype()`` method on request objects to allow such changes during page generation.

[test] drop some warnings introduced by new test dabase handling

rephrase

backport stable

[web] fix CalendarView : both icalendarable.start and icalendarable.stop dates can be None

[edit controller] fix subform formid in EditController (would need further improvement)

[schema synchronization] get back eid when adding a final entity type, else it may cause pb on later schema synchronization during the migration where the type is added

backport fix from oldstable

backport fix from oldstable

fileConfig is in logging.config

[entity vocab] fix bug introduced in 3.12 vs/ entity vocabulary, leading to some unexpected empty vocabulary. Fix test accordingly.

[rql rewriter] take care not to introduce snippets into a neged scope

[old css] use aColor property

[uipros] drop unused properties

[selectors] abstract ExpectedValueSelector now accept a set as single argument

[igeocodable] import adapter description

[dataimport] tell more and nicely about transaction status

[dataimport] propagate stack

Added tag cubicweb-debian-version-3.12.0-1 for changeset 92b56939b7c7

Added tag cubicweb-version-3.12.0 for changeset fd502219eb76

prepare 3.12.0

[time zone] support for TZDatetime and TZTime data type Should be usable and cause no crash, though some stuff may still be refined (test value generation, display in views/forms...) Proprify some data structures dealing with yams base types along the way and adding warning when some were missing (eg Interval usually).

merged test fix from stable

[http] implement 1587305: provide better implementation of Accept header parsing + tests

[web test] extract a set_auth_mode method from init_authentication and use it in test_fb_login_concept to avoid bad test interaction

merge stable to default

fix failing tests before 3.12 release added a skip in unittest_reledit, I'd like acampeas to give it a look.

[dataimport] new 'lazydbtable' generator function to feed data from a database table

[dataimport] ObjectStore.create_entity should return something that looks like an entity (eg no more using dict protocol to access to attributes)

[dataimport] cleanups, update docstring to up-to-date usage

[doc] improve dostring of server.hook

merge back stable to default

[cwctl] refactor ui messages aiming for consistency and simplicity

[entity vocabulary] refactor unrelated rql to allow usage of RQLRewriter to insert schema constraints. Closes #1561806

[entity vocabulary] fix unrelated rql generation to skip rql constraints that don't make sense

[schema, refactoring] use RQLExpression as base class for RQL constraint classes

[reledit] fix crash due to wrong attributes usage

merge

make it easier to inherit from EditionFormView

more TZDatetime/TZTime test fixes

fix test_knownValues_load_schema

backport stable to default

[doc] fix typo

[doc] fix typo

[AnyEntity] rename __linkto attribute as cw_linkto to avoid name mangling which make overriding/monkey-patching unnecessarily harder

[sql generation test] avoid lgdb warnings when a db module is faked

backport stable

[c-c create] unification of c-c create and its subcommands handling * create/db-create/db-init uniformly accept --automatic and --config-level options, properly passed along the way * --automatic option fixed so it doesn't need yes or no argument * closes ##1537265 on the way

[rql rewriter] to properly handle 'relation' rql expressions, rql rewriter must support multiple variables (eg S and O) at once to be given as varmap

[rql rewriter] drop unused argument

[rql rewriter] don't add unnecessary (potentially buggy) exists

update lgc dependency also in pkginfo

updated lgc dependency

allow CW to act as a Pyro Server without registering the server to a Pyro Nameserver (closes #1528533) This is achieved by configuring the pyro-ns-host to __NO_PYRONS__ (which is an illegal value for a host name) The Pyro URI for the server can be retrieved by reading the pyro_uri attribute of the Repository

[date picker] apply Carlos patch fixing spanish date picker translation file. Closes #1558893

cleanup

[c-c create] we should also skip option with no type, else we may generate title for section without any option to fill

[config] do not set base-url during instance creation, we don't want generated value to ends up in the configuration file

[config] generalise config.creating, allowing to drop set_language class attribute

[web test] fix broken url in reledit. tests BROKEN ANYWAY (crash due to missing attribute)

merge

Added tag cubicweb-debian-version-3.11.2-1 for changeset 954b5b51cd92

Added tag cubicweb-version-3.11.2 for changeset 56ae3cd5f855

[packaging] prepare 3.11.2

try to reconstruct the file forgotten by syt in changeset e094b3d4eb95

[javascript] fix loadRemote test for JSON_BASE_URL / baseuri matching put both url and baseuri() to lowercase since baseuri() might have uppercase characters. Thanks to Florent for spotting this.

cleanups

[cwuser, persistent properties] fix recent set_property implementation on CWUser: for_user is automatically handled for non-managers users (this is seriously debatable though)

[repository] fix crash in optimized [add|remove]_relation w/ inlined relation (broken by cw 3.10 refactoring)

[server] move EditedEntity class to its own module, to avoid cyclic dependency when needed from e.g. session.py

[facets] closes #1569459 (date-range facet with year < 1900) use lgc.date.ustrftime() and lgc.date.ticks2datetime to convert js date ticks and have a chance to handle dates with year < 1900.

[session] add find_entities and find_one_entity to session/request API (closes #1550045)

[web formwidgets] add missing tabindex to jquery date and time widgets (closes #1568475)

[c-c create] db-create doesn't not take a verbose option any longer

[css] we should use padding instead of margin here, else the element as size greater than <body>, forcing an horizontal scrollbar to appear

[db connection] fix db connections method: verbose should be named interactive, it's not a question of verbosity but wether question should be asked or not

[cwprops, migration] fix [set_]property to ensure we don't retrieve a user specific value. Add some docstring along the way

[cwprops] add set_property method on CWUser instances, to ease setting of user specific properties

[merge] backport stable fixes into default

Abstract the support for ORDER BY and LIMIT/OFFSET SQL generation all DB engines do not support the same syntax for these features, MS SQLServer being the bad boy we try to support in CW. * Use two new methods of dbhelper to add LIMIT/OFFSET clauses and ORDER BY clauses * added unit tests for sqlserver backend * changed unittest_rql2sql to lauch the backend tests even if the driver module is not installed on the machine, so that we can run the sqlserver tests on linux (and the mysql tests too) * adapt msstep.py to the new interface closes #1154756

backport oldstable

[migration] Lesser memory consumption of cwuri fix + actually commit every 100 processed entities Don't use the ORM as added value is poor while all intentiated object are keept by rset cache.

[migration] improve fix cwuri progress bar * Use the progress context manager, * Adds a title * Informs that operation have been partially committed.

[migration] explicit first step of 3.10.9 migration. Previously there was on a "commit now" confirmation. The reason of the request are now explained and both request must be confirmed.

cleanups

[uiprops, css] make header background actually modifiable through uiprops

[components] add **kwargs to render method of header components to make them usable as regular components (eg in other places than the header

[schema views] don't propose 'view all' action for final entity types (closes #1560549)

[doc] fix urls pointing to repositories and download sites

backported tag to stable

Added tag cubicweb-version-3.9.x for changeset 48f468f33704

merge

[devtools] missing py2.5 compat import

merge oldstable into default

fix stupid typo

merge

merge: [testlib] require explicite overwriting of TestDataBaseHandler. A new overwrite (default to False) parametters is added.

[testlib] require explicite overwriting of TestDataBaseHandler. A new overwrite (default to False) parametters is added.

remove conflict marker

merge old stable into stable

fix pylint helper methods: need a classmathod in cwconfig.py

fix pylint helper methods: need a classmathod in cwconfig.py

merged back pylint help changes to stable

merge

help pylint by explicitely defining some attributes * the logging functions automatically set by set_log_methods * the attributes of Hook classes (eidfrom, entity...):

[doc] fix indentation spelling and grammar of tutorials/advanced/part03_bfss

[doc] complete description of EXISTS in rql/language.rst

[doc] fix rql/debugging.rst and server.__init__ docstrings

[doc] fix rql/debugging.rst and server.__init__ docstrings

[test] New Handling of database for test. This patch adds a new TestDataBaseHandler class. TestDataBaseHandler are in charge of Setup, backup, restore, connection, repository caching and cleanup for database used during the test. TestDataBaseHandler reuse code and logic previously found in cubicweb.devtools functions and devtools.testlib.CubicwebTC. TestDataBaseHandler is an abstract class and must be subclassed to implement functionalities specific to each driver. TestDataBaseHandler can store and restore various database setups. devtools.testlib.CubicwebTC gains a test_db_id class attribute to specify that its TestCase uses a specific database that should be cached. The pre_setup_database class method is used to setup the database that will be cached. The setup_database method is kept uncached. The same TestDataBaseHandler are reused for every test using the same config object. TestDataBaseHandler try to reuse Repository objects as much as possible. All cubicweb test have been updated.

[reledit] repair some brokennes

[reledit] kill the reledit/doreledit duality * * * [reledit] use action to determine form content * * * [reledit] use self.entity instead of passing entity everywhere

default (3.11.X) is now stable

stable (3.10.X) is now oldstable

[test] add some tags

[test] properly close connections

[devtools] fix anonymous user handling in test classes

[web] provide a data_url() method on req and get_rid of explicit datadir_url usage (#1438736)

[views] #1499661 get rid of base tag

backport stable

[tabs] forward url parameters to lazy tabs views If http://www.cubicweb.org/project/foo?x=12&y=13 dislays a LazyTabView, this patch forwards {x: 12, y: 13} to subsequent lazy tabs (i.e. called through ajax queries).

[testlib] fix regression introduced in 7065:6a6ea9966931

[testlib] simplify code by using a class attribute

[repo] fix multi-threads bug with get_option_value: pyro proxy can't be used from a thread to another without caution (closes #1535206)

fix editable_attributes bug (closes #1534802)

[http test] fix typo in super call

backport stable

[testlib] New assertion method assertSentEmail() to test presence of emails in system mailbox

[tests] Fix web test for windmill and forms - new component 'inout' needed to be clicked (windmill) - renamed id will fail html tests (windmill and unittest_forms.py)

[uilib] fix eid_param implementation

[test] fix bad super call

[dbapi] split in_memory_cnx functions

Remove trailing white space

Add a "closed" property on session This will simplify check and allow nicer error thatn the current "no _tx_data" attribute error.

[test] Improve tagging and error message of TwistedCWIdentTC

[test/windmill] Gracefully skip windmill test if windmill can't be imported. If windmill import fails the windmill module is set to None and a dummy CubicWebWindmillUseCase test class is create. This class contains a test that skip itself with a proper warning message.

[devtools/qunit] had "qunit" test for tag.

[3.10.9 migration] don't display progress bar if stdout is not a tty

[source host alias] match_host is the attribute, match is the method