fix ldapuser test

Prepare 3.15.4

migration: replace empty passwords with random ones on upgrade

ldapuser2ldapfeed: create CWUsers with random passwords, not empty ones

[source/native] only system source users should be authenticated by the native source (closes #2465883)

[web test] fix test broken by 199fefe396ab

[fti] add some documentation

[form] add assertion to ensure field has a name when `role_name` is called

Added tag cubicweb-debian-version-3.15.3-1 for changeset 7ad423a5b6a8

Added tag cubicweb-version-3.15.3 for changeset 0e012eb80990

[pkg] prepare 3.15.3 release

[entity edition] stop comparing values as it may trigger exceptions (e.g. timeseries cube tests) Rely on a changes in yams instead where we have guarantee to have only comparable objects. This follows changesets 1527b012802f, 25da1e5c7c50 and 4ba11607d84a, and should definitly closes #2423719

[tabbed view] make tabs optionaly lazy: lazy=False on the tabbed view trigger synchronous tabs. Closes #2443038 This is useful for tabs holding a self-posted form for instance.

[web form] refactor Form.__init__ so that extra kwargs are set earlier in the process. Closes #2443040 (eg if you want to use them in .session_key)

[test rql completion] dont limit number of completion, else we've impredicable results. Also should tell rql.parse to not print error on stdout This repairs test introduced by dcd9bc1d1bca which closes #2439846

[entity] fix deprecation warnings (closes #2423719)

merge oldstable in stable

Added tag cubicweb-debian-version-3.14.9-1 for changeset 68c762adf2d5

Added tag cubicweb-version-3.14.9 for changeset 9337812cef6b

[ui] provide an autocomplete RQL bar (closes #2439846)

[ajax] improve backward compatibility for redefined ajax functions (closes #2447189) If an ajax function from stdlib (e.g. js_reledit_form) was redefined in a cube, the cube version should still takes the precedence< => check for existing ajax function on deprecated controller _before_ checking ajax function availability on the new one.

prepare version 3.14.9

[composite] apply composite on new enty too (closes #2450679) Before this changesets, automatic deletion did not applied to entity created in the same transaction. This patch remove this filtering in the dedicated operation. The original filtering where introduced by 5d889b4928bb but no rational where found for this changes. The former behavior is seen as inconsistent and creates bug in some cubes.

[storage] relies on event=='deleted' to detect "delete" event (closes #2450680) When we delete a previously edited entity, it *will* have a cw_edited attribute even if the goal is to delete it. The function get an argument that explicitly contains the "delete" event. The code now uses that instead.

[composite] apply composite on new enty too Before this changesets, automatic deletion did not applied to entity created in the same transaction. This patch remove this filtering in the dedicated operation. The original filtering where introduced by 5d889b4928bb but no rational where found for this changes. The former behavior is seen as inconsistent and creates bug in some cubes.

[storage] relies on event=='deleted' to detect "delete" event When we delete a previously edited entity, it *will* have a cw_edited attribute even if the goal is to delete it. The function get an argument that explicitly contains the "delete" event. The code now uses that instead.

[web navigation] previous / next icons are missing mandatory alt attribute

[testlib] consider rset for template / view selection (closes #2447183) The original code did something like: kwargs['rset'] = rset viewfunc = lambda **k: viewsreg.main_template(req, template, **kwargs) kwargs.pop('rset') return self._test_view(viewfunc, view, template, kwargs) meaning that by the time ``viewfunc`` (i.e. the lambda function) is called, ``rset`` was popped from ``kwargs`` and had no chance to be passed to ``main_template``.

[documentation] fix some ReST compilation problems

[test] remove no more necessary attribute cache manipulation to repair test

[entity] more tweaks for entity attribute cache handling on cw_set/cw_create to fix test regression * when an attribute is listed in dont-cache-attrs, purge any previous value * test value is actually modified in EditedEntity.__setitem__ before adding attribute to dont-cache-attrs

[entity/hooks] fix regression introduced by 4ba11607d84a on create_entity, attributes weren't cached, but they are since 4ba11607d84a and this triggered a bug: used values may be transformed by hooks (e.g. TidyHtmlFields), ending in invalid value in the cache. This is the regression. Now, set_attributes used to update the attributes cache while suffering from the very same pb. This is the now fixed old bug. Transformed attributes are now recorded in a transaction shared variable, and those are omitted from the client cache.

[doc] use :meth: and remove doc to deprecated methods

[doc] add passlib to list of dependencies

Added tag cubicweb-debian-version-3.15.2-1 for changeset 9aa5553b2652

Added tag cubicweb-version-3.15.2 for changeset 2afc157ea9b2

[test] missing future import

[web test] fix tests broken by 8de41063d629

3.15.2

[web login] fix after login redirection: redirect expect an url not a relative path. Breaks on cases like '?vid=aview'. Closes #2423575

[config] load_configuration should not crash because of fs errors. Closes #2286215

[entity api] unify set_attributes / set_relations into a cw_set method. Closes #2423719 Allowing similar usage as create_entity/cw_instantiate. Update cw code base to remove deprecated calls.

[workflow ui] fix state/transition edition form on existing entity. Closes #2423531 It should not return unrelated entities only in case where the entity exists. Also fix a deprecation warning, vocabulary values should be an unicode string.

[predicates] fix predicates that erroneously evaluate the entity passed as a parameter as a boolean, instead of testing its existence in the keyword arguments -using the kwargs.get('entity') idiom instead of 'entity' in kwargs or similar- ; closes #2424288

[book] fix build warnings/errors. Closes #2430042

[ldap feed] add missing future import

[ldap feed] fix error since with read security activated, password value is not selecteable (closes #2406597). Also add a note in the book about packages required to connect to an ldap server

[config] Set CWDEV, aka dev mode, according to presence of the i18n directory, not .hg

[book] Some tweaks to fix cubicweb-documentation package generation - Fix up PYTHONPATH setting to make sure sphinx can find cubicweb modules - Add a few missing build-dependencies

[webconfig] debug mode should not be special wrt data_url handling (closes #2405487)

[test] missing future import

[ldap] allow working connection to some ADs (closes #2408829)

[entity] fix unrelated_rql for creation form vocabulary for relation with specific permissions (closes #2423854)

[form widgets] fix JQueryDatePicker and JQueryTimePicker so they consider widget custom attributes. Closes #2423720

[web app] handle Redirect raised during session establishment, as this may be used by eg openid authentication. Closes #2430018

backport stable

[ldapuser2ldapfeed] fix confusing script structure and decode the extid to avoid an UnicodeDecodeError (closes #2413437)

[migraction] rename rename_relation method to rename_relation_type for consistency

[web app] only log tb when explicitly asked

typo

[views/tables|css] show actions in small tabs instead of menu indirection (closes #2004109)

stable is now 3.15

oldstable is now 3.14

[test] update server security test using login and new temporary_permissions context managers

[testlib] introduce temporary_permissions context manager Fix a test failure due to cached method on the way as usage of the context manager enforce proper interaction with schema objects

[rql2sql] remove debug print and fix bug introduced in 8469:69ad9a509bc3

[html form] use __linkto url parameter value as a default value of the corresponding field in a creation form (closes #2407770)

[rql2sql] fix generated SQL when an attribute relation with a variable is ored with another attribute relation. Closes #2410405

[repository] drop unused argument

[ui] actions box should be displayed if there are some actions, not if context is an entity. Closes #2419040

backport stable

[packaging] bump rql dependency to 0.29 (closes #2410042) Needed for add_eid_restriction with 4 args, usage of which was introduced in changeset aed065b97f12 (refactor entity fetch_rql method to use a RQL syntax tree instead of RQL strings)

[rql security] fix rql bug when using yams inheritance and read permissions (closes #2410156) problems occurings when querying using is_instance_of while a subtype has some permissions not shared by the parent type

[c-c schema] devtools: the output file for cw-ctl schema is not supposed to exist When using the 'file' type, logilab-common errors out if the file doesn't exist. Which, if the option refers to an output file, is not so useful. Use 'string' instead.

[fti] allow usage of custom RQL to fetch entities to index (closes #2410509)

[fti] make db-rebuild-fti accept etypes on command line (closes #2410508)

backport stable

[fti] drop entity cache once an etype is indexed (closes #2410507)

[server/utils] add_looping_task can be used any time (closes #2408814)

[formrenderers] if a tag object gets there, it blows (closes #2410462) - cwtags monkeypatches cubicweb's UStringIO's .write and .getvalue methods - but it cannot monkeypatch list.append ...

[login] redirect to real instance root if no postlogin_path is provided When not postlogin_path is provided, the login form issue a redirect to "/". The instance root may not be at "/" on the server. Then issuing a redirect to "/" send the user to the wrong location. We now redirect to "." which works fine because the "login" controller a direct children of instance root (http://babar.com/instance/login). All other redirection of the login controller use relative path too and then rely on this relative path from the login controleur to the instance root. This mechanism may be considered fragile and may deserve a proper fix. but this is to be discussed and implemented in another changeset.

[web/application] declare default 'content' value sooner (closes #2406560) It may be used while processing AuthenticationError. Such error may be raised before the former declaration.

[views/tabs] fix rql/eid param conflict when either one is already in the request form (closes #2405249)

Added tag cubicweb-debian-version-3.15.1-1 for changeset fe5e60862b64

Added tag cubicweb-version-3.15.1 for changeset 783a5df54dc7

[debian] prepare 3.15.1-1

[server/tests] fix tests

[registry|ajaxcontroller] the @ajaxcontroller decorator ought to return a compatible object (closes #2385155)

[cwconfig] shutup on absent i18n/ mo files when in operating in tests

[datafeed] correctly distinguish checked/updated

[ldapfeed] do not crash on ldap user deletion + pull + already deactivated users, cleanups (closes #2392933)

[server/session,repo] turn InternalSession, hence repo.internal_session, into a context manager (closes #2393651)

[ldapparser] missing return

[ldapparser] remove spurious print

fix ldap removal handling in ldapfeed (closes #2376625 and #2385133)

[ldapfeed] fix crash on sql cursor usage (closes #2380246)

[sources/ldapfeed] do not user cwuri as url (closes #2380324)

[web/views/staticcontroller] safety belt for unguessed mimetypes (closes #2380304)

[server/hook] fix identation

backport stable

Added tag cubicweb-debian-version-3.14.8-1 for changeset 81394043ad22

Added tag cubicweb-version-3.14.8 for changeset 15fe07ff6872

[css] do not use display:block for all images, but only for rest generated

3.14.8

[css] make ReST align statement works for images (closes #1280176)

[doc] cubicweb.view documentation (closes: #2099962)

[docstrings] typos corrected

[views] enable paginate toggle on RsetTableView (closes #2200675)

[ui] display author name in box instead of login (closes #1529147)

[doc] remove deprecated doc (wrong link) (closes #2329206)

Fixes for compatibility with passlib 1.6 (closes #2356393) Somebody missed the memo about API backwards compatibility: - calc_checksum is renamed _calc_checksum - passlib.utils.handlers.GenericHandler strict keyword removed - bytes vs str vs unicode issues

[formrenderers] Factor-out render_title to ease customisation in derived classes

[IE] use document.createStyleSheet to add CSS dynamically (closes #2356261)

[pkginfo] the before_shutdown event was not in 3.15.0

[migration] do not crash if the conf file is already migrated (closes #2361061)

[datafeed] fix/finish cleanup started by auc in 8393:c25b96ae4f8a: parser.process prototytpe is (url, raise_on_error=False). Drop partialcommit argument which were never specified

backport stable

[logs table view] properly translate level buy using the correct msgid. Closes #2356329

[data import] don't crash if value isn't in the file, simply no key/value in the output dict. Closes #2356328

[logs table view] only put values starting with http in <a> tag

[db-api] fix typo leading to crash on client connection (config has no translations). Closes #2357044

[data import] allow a request to be given as argument, ease use from web ui

[datafeed] allow the xml datafeed parser to work with client-side connections

small doc updates

[ldapfeed] properly mark email address as encountered during import to avoid deleting them

[merge] backport stable

[server/utils] passlib 1.6 is now less tolerant wrt handler names (closes #2349330)

backport stable

[web] remove some unused imports

[selectors] make multi_columns_rset work with a simple list of lists

[server/hook] a tiny bit of doc about before_server_shutdown

[events] add a new before_shutdown event (closes #2345728)

[ldapparser] cleanup

[ldapparser] reapply dropped fix

[app] turn these info into debug logs (this being too chatty for .info)

fix static file serving when url has parameters (like cache busters do)

[repo test] Avoid hangs in zmq repo unit test - interaction through the zmq event loop from a different thread is only allowed through add_callback - notify the background thread when the client dies with an exception so it doesn't spin forever

[ldap] we may actually get back password from ldap

[ldapfeed, test] use default source config

[ldapfeed, test] use a safe internal session, as in real life

[datafeed] give a dictionary as sourceparams to avoid crash if attempt to import the user is done

[yams] Binary instance passwords should not be given to str()

[ldapfeed] don't crash if entity is None. Closes (superficialy) #2341266

[merge] backport stable fixes

[bin/clonedeps] fix NameError (closes #2334080)

[sources/native] do not let a log message crash on us

[merge] backport stable

[cwconfig] impose an order on appobject paths processing: entities first (closes #2330799)

[serverctl] avoid a crash if zmq-address is not defined/empty (config.get is a false friend wrt dict behaviour)

fix an horrible typo

[migration/3.14.4] prevent migration crash when there are NULLs in asource

Added tag cubicweb-debian-version-3.15.0-1 for changeset 925db25a3250

Added tag cubicweb-version-3.15.0 for changeset 0642b2d03aca

typo

3.15.0

[static web] fix fckeditor static files delivery: remove leading subpath and url parameters from computed file path

[doc] 3.15 services api description

[service-api] Add unified service API on `_cw` attribute This will allow writting generic entity code that could run on both client and repo side. This addition have been discussed with Sylvain Sylvain Thenault.

fix ``call_service`` API and add test service API ``call_service`` was taking a session argument. But Service is an AppoObject and already has the same session accessible as ``self._cw``.

[skel] update newcube skeleton (closes #2312509)

[doc] improved 3.15 blog using developpers'contributions

[devtool-testlib] add deprecated entry point for publish method 6c2119509fac renamed ``publish`` to ``handle_request``. And removed the older testlib function (because the semantic of handle_request is quite different from the publish one). However it seems to do more harm that good and I'm adding proxy with deprecation warning for those.

[doc] improve 3.15 release blog

[web/views/staticcontrollers] restore windows compat

Added tag cubicweb-debian-version-3.14.7-1 for changeset 20ee573bd237

Added tag cubicweb-version-3.14.7 for changeset 3ba3ee5b3a89

3.14.7

[3.15 migration] repo-uri is a c-c command option and does not need migration since it doesn't exist in the configuration file

[remote rql source] fix super call

[zmq] Add a new ZMQ-based RQL source (closes #2290203)

[pyro] Refactor the pyrorql source Extract most of the code that is not related to Pyro from PyroRQLSource in a new RemoteSource abstract class.

[zmq] add unit tests for ZMQ-based repository (server and dbapi)

[dbapi] add possibility to connect to a remote ZMQRepository (closes #2290126)

[repository] fire 'server_shutdown' hooks before waiting for theads This is required for threaded tasks that use the 'server_shutdown' hook to die properly, as for example the ZMQ server in an all-in-one configuration

[zmq] Implement a ZMQ-based Repository (closes #2290125) This Repository server behave mainly like the Pyro-based repository.

backport stable

[test] update create_user call

[test] use setUpClass rather than setUpModule to avoid inter-dependency pb with CubicWebTC sub-classes

[test] with yams#stable, ordernum is different than with yams#default

[bin] Force clone_deps.py to use mercurial command-line interface - closes #2296057

[table view] EntityTableView should accept **kwargs as RsetTableView

Fix a Python 2.5 regression introduced by previous commit

[rql annotation] fix has_text_query detection (if coming from sub-query and if has_text on a column aliases. Closes #2275322

[etwist] fix static directory serving; closes #2174797

[form renderer] refactor inline form renderer to ease overriding. Closes #2282662

[devtools] fix bashism in xvfb-run.sh bash's trap builtin accepts SIGUSR1, whereas dash complains. So use USR1 instead.

[devtools] fix xvfb-run.sh permissions (exec bit)

[form] add a new property telling if the form is being generated or posted. Closes #2262340

[workflow] set default test/plain option for workflow default comment (closes #993083)

[js] get rid of `partial` function (closes #1972794)

[css] change `h3` and `h4` styles(closes #893244)

querier: Improve error message when ERQLExpression fails on some entity (closes #2267081) When an RQL variable is indeed "constant" (we know it's eid) ERQL expression are not inserted but checked prior query execution. If the session have no read access to the entity an `Unauthorized` exception is raised. This changeset add a meaningfull message to this exception:: No read acces on "X" with eid 42.

[js] fix error in loadRemote docstring

[doc] add missing section titles

[doc] fix bad indentation

[server/ldaputils] do not allow ldap.server_down to crash on us

Add missing with_statement import for python2.5 compat

[devtools] make xvfb-run not wait 3s each time (closes #2265710) Ask Xvfb to tell us when it's ready instead of unconditionally waiting 3 seconds. Sync from http://anonscm.debian.org/gitweb/?p=pkg-xorg/xserver/xorg-server.git;a=blob_plain;f=debian/local/xvfb-run;hb=HEAD

[view] breadcrumbs layout broken with long elements (closes #1347486)

[static-file] return Unauthorized on blocked directory listing This is more appropriate than 404 NOT FOUND

[login redirect] only add postlogin_path argument when meaningful

static-file: properly set/use cache header for static file (closes #2255013) This changesets enables the standard http cache mechanism where the static controller may reply "304 Not modified" based on `last-modified` in HTTP response and `if-modified-since` in HTTP query. The last modified time is computed using the file-system information. The pre-existing logic using an `Expires` header to prevent client from sending request stay in place. The new logic just prevents sending the file again if not necessary.

[repository] move task manager instantiation outside repository. Repository callers are in charge of providing a task manager. The task manager is optional when the repository is not a server. This part is not really expected to work well yet. But we aim to remove all task management responsibilities from the Repository object.

[repository] split repo initialization from starting looping task (closes #2204047) This separation highlights that two distinct operations are done. This is a step towards a full distinction between repo, server and looping tasks

[repo looping task] move looping task logic in a dedicated object (progress #2204047)

[manage / default index views] discard login/logout templates

devtools-request: transmit the headers keyword argument to the request class Otherwise the headers kwargs end up in the form. This is very useful for testing publish logic related to http header (as cache).

[security] use a stronger encryption algorythm for password, keeping bw compat Administrator should ask their users to reenter new password so they benefit from the new encryption. Also, new encryption is cross-platform compatible, eg you may now move an instance from windows to linux painlessly

[cache] factorize _validate_cache() logic implemented in wsgi and twisted handlers

[fake-request] support `http_method()`

[Web-Request] Use rich header (closes #2204164) Unify header management. All web request use the Headers class now (imported from twisted). Code dedicated to header management have been merged into the base WebRequest class.

http-header: support __contains__ in Headers You can now use:: >>> 'expires" in headers True

[web] Move request handling logic into cubicweb application. (closes #2200684) We improve http status handling in the process: ``application.publish`` have been renamed to ``application.handle`` to better reflect it's roles. The request object gain a status_out attribute to convey the HTTP status of the response. WSGI and etwist code have been updated. Exception gain status attribute

[login] split authentication logic from post authentication logic (closes #2200755) * The Session manager is now only in charge of providing a valid session. * LoginControllers are now used in all case but wrong credential. * The LoginControllers are in charge of redirecting the user to the page wanted to see in the first place, expected to see. * The login form is now always submitted to the login controller with an extra argument pointing to the url we should redirect too after successful authentication. The ``"log out first logic"`` logic on login controller is removed because: 1. Other web actor do not do that. 2. Removed code do not need to be reimplemented. 3. We can only get it to work again in a single case: use do a GET request on http://www.my-cw-stuff.io/login 4. I do not see it's purpose.

[LoginForm] refactor to ease other implementation An Abstract BaseLoginForm is created. It is intended to be used by cubes who want to implement new login form. It gather common login form elements in particular the form action. This will ease redefinition of this form action in later commit.

[request] gather all base_url logic in a single place (closes #2200756) * Handle ``https base-url`` in the core code: ``./req.py`` and ``web/request.py`` * Remove custom ``base_url`` handling if web request

[http] drop use-request-subdomain feature (closes #2251986) This feature do not have any user nowaday and lays in the path to WSGI.

backport stable

[config, undo] Fix undo-support option migration

Added tag cubicweb-debian-version-3.14.6-1 for changeset 75364c099490

Added tag cubicweb-version-3.14.6 for changeset db021578232b

3.14.6

[debian] add a watch file Allows tools like uscan to find the tarball for new debian revisions.

[uilib] don't print timedeltas between 0 and 23h as negative (closes #2236352)

[storage/bfss] ensure bfss never remove a cw_edited item (closes #2236287) When the <old value> == <new value> (not really and update but can happen), the value was popped but never restored. The cw_edited attribut had wrong content for a small time lapse.

[datafeed xml parser] fix typo

[twisted] move out url logic from twisted (closes #2200593) Data, fck and static file are now served by cubicweb controller by default. Some hackish url rewriting is necessary to have them selected. This is necessary because cubicweb does not selection controller on multi level path. - 'Expires' header seems to conflict with Cache-Control set by HTTPCacheManger (don't know yet why HTTPCacheManager is involved here) mod_wsgi is now usable in simple cases (e.g. still requires persisten sessions).

[cwconfig] improve assert error message. Single tuple element are processed in a non trivial way.

rqlrewrite: remove element in rewritten when we remove them from the select (closes #2236985) update _cleanup_inserted to avoid leaving rewritten variable behind when removing a snipset. insert_varmap_snippets was impacted too for unclear reason --- Before A KeyError was raised when: * multiple snipset is to be inserted on a statement * some *supported* snipset adds ambiguity (increase the number of solution) * some *unsupported* snipset adds new variable * The new variable require rewritting :: File "/home/pyves/src/fcw/cubicweb/rqlrewrite.py", line 185, in rewrite newsolutions = self.remove_ambiguities(snippets, newsolutions) File "/home/pyves/src/fcw/cubicweb/rqlrewrite.py", line 436, in remove_ambiguities variantes = self.build_variantes(newsolutions) File "/home/pyves/src/fcw/cubicweb/devtools/repotest.py", line 340, in _build_variantes variantes = _orig_build_variantes(self, newsolutions) File "/home/pyves/src/fcw/cubicweb/rqlrewrite.py", line 470, in build_variantes variante.append( (key, sol[newvar]) ) KeyError: u'D' This happen because the mechanism removing unsupported snipset does not remove entry in ``self.rewritten`` when it removes entry from ``self.select.defined_vars``. Iteration on ``self.rewritten`` then crash because values of ``rewritten`` are expected to be found in solution.

[js] fix $.fullCalendar.regional call (closes #2232028)

Added tag cubicweb-debian-version-3.14.5-1 for changeset 55fc796ed5d5

Added tag cubicweb-version-3.14.5 for changeset f559ab9602e7

[undo, test] fix undohistory selector et related tests

prepare version 3.14.5

fix events display in calendar (closes #2167866)

[repo test] fix test regression introduced by 8286:8b0146e31baa

[css] in old css, more space around the text, and try to make it centered

[js] translate calendar in french (closes #2167866)

[entity url] rest path fallback should be the url used as cwuri. Closes #2186039

[migration] fix add_relation_type in case it already exists, broken by 67660d5f1916