[selectors] move lltrace decorator and traced_selection cm to appobject module so we can apply lltrace to And/Or/Not selectors, fixing #662565

with cw 3.9, no more Image type

[vreg] on registration completed, don't crash if an object depends on an unexistant registry, simply kick the object out

[selectors] ensure adaptable('IDownloadable') takes precedence over implements('Any')

[primary view] fix name error on dispctrl w/ pre 3.5 box definition

[entity] fix access to attribute which has been renamed two revisions ago

[schema migration] make some stuff to ease file 1.9 migration : we want to kill the Image entity so that existing image are turned into (existing entity type) File entities

[entity] continue cleanup of Entity/AnyEntity namespace * prefix by cw_ or _cw all '2nd zone' attributes / methods, other most commonly used will be done later (some methods used by client are made private anyway when they are for internal purpose anyway) * kill set_eid, use direct affectation instead * kill the auto-transmutation feature (pre_add_hook), hence releasing 3.9 will require releasing file cube as well

[entity] introduce a new 'adapters' registry This changeset introduces the notion in adapters (as in Zope Component Architecture) in a cubicweb way, eg using a specific registry of appobjects. This allows nicer code structure, by avoid clutering entity classes and moving code usually specific to a place of the ui (or something else) together with the code that use the interface. We don't use actual interface anymore, they are implied by adapters (which may be abstract), whose reg id is an interface name. Appobjects that used to 'implements(IFace)' should now be rewritten by: * coding an IFaceAdapter(EntityAdapter) defining (implementing if desired) the interface, usually with __regid__ = 'IFace' * use "adaptable('IFace')" as selector instead Also, the implements_adapter_compat decorator eases backward compatibility with adapter's methods that may still be found on entities implementing the interface. Notice that unlike ZCA, we don't support automatic adapters chain (yagni?). All interfaces defined in cubicweb have been turned into adapters, also some new ones have been introduced to cleanup Entity / AnyEntity classes namespace. At the end, the pluggable mixins mecanism should disappear in favor of adapters as well.

backport stable

[config] move web specific config to the web section of the configuration file

* * * [server] move daemonize code to lgc.daemon. Fix on the way pb w/closed standard output on repository config

typo

[migration] fix storage_change migraction to avoid exhausting the server's memory

[repo] set log methods on the actually desired class

[bfss] ensure base name doesn't contain path separator

merge

[web] remove dead code

[forms] consider __action_xxx field if passed to JSonController.validate_form

backport stable

Added tag cubicweb-debian-version-3.8.2-1 for changeset 2b962bb9eee8

Added tag cubicweb-version-3.8.2 for changeset ef2e37d34013

[test] absolute sqlite database names in source initialization, avoid pb when cwd is changed later

clenup

3.8.2

[wdoc] update users changelog

[integrity] keep ordering for schema integrity checks set_operation gained a new containercls argument, so one can choose to use list or set (by default). Use this when registering schema integrity check operation.

[i18ncube] do not crash if cube has nothing to translate

[skel] enable wdoc support in new cubes

[preferences] support dot (.) in registry id of configurable appobjects

[i18ncube] we must load site_cubicweb file before calling set_schema, else we may miss some options or other initialization stuff necessary to appobject loading

[dtd] add unselimg attribute use by widget for HasRelationFacet

remove 3.7 deprecation warning

catch unauthorized when executing rql to check an rql expression. Fix #968824

[startup view] sort startup views by alphabetical order

[table view] should use __regid__ instead of hard-coded 'table' view identifier

cleanup

backport stable

[facet] control i18nization of values on AttributeFacet

[views] tab schema image renamed to schema diagram

[uicfg] fix handling of 'order' in the primaryview_display_ctrl rtag: consider by default only schema order, not order of appearance of rules

[db-check] RQLConstraint is not a 'unique' constraint

[entity] avoid getting w in cw_extra_kwargs when calling .view

[actions box] enhance add related menu generation: don't propose to add relation of single cardinality where entity already have the relation set

[primary view] allow new 'subvid' parameter in primaryview_display_ctrl

[primary view] give dispctrl to side box views as for relations section

[web] unify list views call arguments: use subvid to specify the view to use for each item

[web] refactor side box to use autolimited view

[req] avoid getting w in cw_extra_kwargs when calling .view

[config] rename remaining inputlevel to level in option definitions, as expected by lgc >= 0.50

[fti] simplify UpdateFTIHook code

[twisted] we must set response code before starting to write the answer, else it's ignored

cleanup

[web data] remove files not used by the framework

[css] keep old css according to a configuration variable (true by default)

[3.8 execute] remove deprecation warnings

backport stable

[dbapi] missing import

[ajax] missing html heads processing in reloadComponent (sic\!)

[deprecation] missing version number to old warning message

[table view] we should call the cell view using the table rset, not one rebuilded for a specific entity

[table view] take care to None label

[selectors] new logged_user_in_rset selector

merge

replaced hardcoded 'web/view' by os.path.join('web', 'view') so views path is also valid under windows

fixed bug of non-normalized path under Windows, that broke the reload mechanism

[c-c list] configuration pb cubes directly hold version number now, avoid crash when reporting errors

Handle new way of reporting unmodified FileFields when a FileField has not been modified, value is an empty string. Handle this is raise UnmodifiedField accordingly.

merge

attempt to port windows service to 3.8.1

[web session] fix potential key error on logout (occurs once the session has been transparently reconnected, hence session.sessionid and session.cnx.sessionid differs)

[css] update print css

[doc] cleanup

[python2.6] do not import simplejson directly use indirect import through cubicweb.web

[selectors] fix no_cnx selector's prototype

[web config] set default uiprops on web config class to avoid error on commands such as i18n instance

backport stable

[migration] ask_confirm argument of show_diff doesn't contain an _

backport stable

backport oldstable

[upgrade] don't ask confirm to replace configuration file with -v0

merge good/bad versions of imported patches...

[css] start using uiprops in cubicweb.css

[css] progressively fixing rhythm diff -r a1dbdf887ef4 web/data/banner.png Binary file web/data/banner.png has changed diff -r a1dbdf887ef4 web/data/banner.png Binary file web/data/banner.png has changed

[css] introducing scale and rhythm composition

[css] start using uiprops in cubicweb.css

[css] progressively fixing rhythm diff -r a1dbdf887ef4 web/data/banner.png Binary file web/data/banner.png has changed diff -r a1dbdf887ef4 web/data/banner.png Binary file web/data/banner.png has changed

[css] introducing scale and rhythm composition

[doc/book] a very simple example of entity form extension

[doc/book] refresh a bit the edit controller section

[doc/book] explain the form loop validation process

backport stable

backport oldstable

[c-c dev] fix i18ncubicweb command

[book] add generated js documentation to cw book

[packaging] we should add schemas to include_dirs so sql extensions files are properly installed

[web test] missing test data file

[https] fix resource urls in https version of a site: should use the https version as well to avoid warnings from the nrowser

[uiprops] test and fix reloading of modified css files; update c-c newcube; deprecates config.has_resource.

[doc/book] not anymore ...

[doc/book] dissection of a form chapter

[doc/book] move examples to a separate chapter, fix autoform module docstring

[doc/book] copious choices example

[css] fix schema css + d-t-w

[web/schemaviewer] fix bad call

[doc/book] regroup form/editcontroller stuff under an "edition control" chapter

[doc/book] complete a bit the request api

fixed unittest_wfobjs

merged back oldstable into stable

fix bad reading of options in ldapuser.py time related options have type time and not int, so use the proper function to handle conversions

[json-controller] - refactoring of js_component and js_view, it now uses _call_view - _call_view accepts paginate as a parameter

[widget] kill buggy / unused (only in cmhn) AddComboBox widget

[doc] typos

ignore annoying warnings about pygments already being imported and stuff being added to python path

[hooks/integrity & tests/entities] fix test to check for sibling error (set_operations yields a different order for constraints)

[hooks/...] fix previous commit

[hooks/operations] use set_operations for three ops (huge gains for massive imports)

[vreg repo] shouldn't call init_registration in on hook registry bootstrap, already done before

[vreg] we should now reset in init_registration since we don't do it in __init__

[web] use uiprops value to compile css transparently, handlig cache and reloading in debug mode

[webconfig] introduce property sheets. Use them to replace external_resources

[webconfig] cleanup base_url management

[webconfig] refactor/cleanup debug mode management on startup: simply use config.debugmode instead of debug argument everywhere...

Added tag cubicweb-debian-version-3.7.5-1 for changeset 2d0982252e8d

Added tag cubicweb-version-3.7.5 for changeset c476d106705e

prepare 3.7.5 release

[css] avoid repeating reset css

[css] use meyer's public domain reset css

[c-c shell] make script arguments available as __args__ in the script namespace. Use scriptargs instead of args as process_script argument name.

[management] fix vocab: use cube instead of package

[sparql] bugfix

[xy] define standard prefixes

[doc] various small improvements

fix i18ncube for pegase where we do strange things by redefining relations

[shell] #715938: support of script parameters (using standard '--' as arguments separator) Arguments after bare "--" string will not be processed by the shell command You can use it to pass extra arguments to your script and expect for them in 'scriptargs' afterwards.

[dbapi] more test and documentation of dbapi

move rarely used (imo) settings to inputlevel3 in cwctl create

default is now forthcoming cw 3.9

backport oldstable changes

backport default into stable: stable is now actually cw 3.8

replace logilab-common by CubicWeb in disclaimer

backport default into stable: stable is now cw 3.8

backport stable into oldstable: oldstable is now cw 3.7

proper licensing information (LGPL-2.1). Hope I get it right this time.

[ms] fix planning bug with rewritten constants: when removing some source for a const due to relation constraints, we should propagate this change to other constants coming from the same original variable

[repo security] deal with rewriten constant nodes in check_read_access, necessary when repo is used as an external source

[doc] reorganize for chapter structure

[web auth] remove assertion, we may want to remove authentication info retreivers to disallow login from the web ui

merge

ask pyro group config questions for all-in-one config site when pyro is enabled in serverctl.py, the pyro questions are not asked for all-in-one configs, because this is webctl.py's responsibility. However for a all-in-one instance, repo_method is "in-memory" so the pyro questions would not be asked even if pyro had been explicitely enabled before.

enforce use of environment variables when running as a service CW_INSTANCES_DIR, CW_INSTANCES_DATA_DIR, CW_RUNTIME_DIR must be positionned at the system level. This will ensure that cubicweb-ctl commands issued on the computer will use the proper directories.

added db-extra-arguments to configuration parameters for native source

Added tag cubicweb-debian-version-3.8.1-1 for changeset eb972d125eef

Added tag cubicweb-version-3.8.1 for changeset 1e074c6150fe

cubicweb-ctl create improvements * list sqlserver2005 as supported database * tell that each name must have a unique name * pass the input level to other sources that we want to configure

3.8.1

backport stable

disable CERT check

proper copyright file

[web/views] fix docstring

merge

cleanup debugging trace

[python2.6] careful: json-py provides a json package. We don't want that. To simplify usage, import json via cubicweb.web

[testlib] move _cnxs initialization before setup_database so one can login in it

[doc/book] various content fixes

[cw-shell] Write ignored scripts warning on stderr instead of stdout.

[repo] cleanup

[bfss] new storage_changed migration action to move an attribute to a custom storage. Closes #893941

[bfss] use set_operation for AddFileOp/DeleteFileOp

merge

[doc/book] move devweb up from development, turn development into devrepo (much better structure)

[doc/book] hide most XXXs

[view] better control wether same etype view should display title or not

[config] augment default value for short-line-size

cleanup debugging trace

[python2.6] careful: json-py provides a json package. We don't want that. To simplify usage, import json via cubicweb.web

[doc/book] rename images with non suffix dots to please latex

[i18n] yams constraint messages updated

[test] stop using ObjectRelation in schema

backport stable

[widgets] move form controls at the end of the file

[widgets] fix super calls, bug introduced in 5367:4176a50c81c9

[skeleton] short_desc is now description in pkginfo

[config] include cube name in warning

[c-c status] return status code 1 when some instances isn't running. Closes #510817

[schema] update for yams 0.29: BoundConstraint renamed to BoundaryConstraint; new constraint messages; ObjectRelation deprecated

[schema] cleanup

[python2.6] prefer python2.6's builtin json module over simplejson

[python2.6] don't add a name property on Thread in Python2.6 the threading.Thread class has a name attribute (used to be __name). The old code would trigger a infinite recursion.

[c-c exlog] #687204: cubicweb-ctl exlog: use a proper file and not stdin for input

[doc] restore file accidentaly deleted

[selector] allow inplace operator in selector computation Intended to facilitate overriding of existing selectors chain in view declaration. It make the code shorter and clearer when you've to import long module pathnames

Add a basic script to compare the db_schema to the fs_schema. Allow SchemaViewer to be used without a request object Most use of self.req have been hidden in method that fallback on a simple behaviour when no req are provided. Several element have been sorted to ease comparison.

le patch some_admin_doc_for_migration a été importé

[lazy view] give it a proper hole node in the no spinbox case

fix NameError

[book] start documenting the HTML form system

[form] small api cleanup and refactoring before documenting the form system

[masmailing] cleanup: use authenticated_user selectors, define stuff on form instead of on selection when possible, other cleanups

[service] do not bluntly override these things if they exist

[dbapi] some compat with distant < 3.8 repo

[3.8 api update] remaining cache keys

[doc/book] make the .css converge back to proper cwo style, fix a bunch of typos

merge

[skel] fix setup.py

[dbapi] take care vreg may not be set

[forms] no crash if restore_previous_post has not be called, has in report bug form in management.py for instance

Added tag cubicweb-debian-version-3.8.0-1 for changeset 24cc65ab2eca

Added tag cubicweb-version-3.8.0 for changeset 3c703f3245dc

3.8

[debian] don't use setuptools to build debian package

[packaging] fix setup.py for use w/ lgp

[debian] don't use setuptools to build debian package

[doc/book] a proper note (style)

[doc] replace c-c with cubicweb-ctl

[doc/book] fix wrong (https) url

[doc/book] typos

merge stable, fixing dependencies generation on c-c newcube on the way

[skel] include __recommends_cubes__ as well for completness

[dbapi] document connect() function

[skeleton/dependencies] fix typo & new cube generation from template

backport stable

[debian] depends on twisted.web instead of twisted.web2

[db-check] cleanup

[db-check] don't check entities from external sources have owned_by

[db-check] fix unexistent multisource entity detection

[db-check] fix duplicated schema constraint detection

[etwist] proper getChild implementation (eventually): fix fckeditor resources locating bugs by properly using file resources

[js] remove unnecessary log

[etwist] nicer, thouhg really not perferct) request max size exceeded support of json/frame posts

[skel] packaging fix: should build package without setuptools, and fix default for dependency_links

[controllers] cleanup unused js var

[packaging] update lgc dependency

[skel] cleanup default cube setup.py

[web] no more needed with the bytes option type

[packaging] setup.py cleanups

backport stable

[config] use bytes option type for max post length

[config] properly use time type for options representing a time.

[web] consistent cleanup session interval time

[migration] makes Yes the default answer to replace configuration file

[config] with lgc >= 0.50, option's dict inputlevel becomes level

[config] graph ordering function moved to lgc 0.50

[dbapi] fallback to Entity when etypes registry isn't initialized (weird we haven't catchi this pb before)

[json] provide a custom json encoder for entities that includes eid in the json object

[doc/book] an introduction to yams, layout tweaks

[doc/book] talk about the existing categories

[doc/book] explain what happens/to do when issuing upgrade command

[doc/book] note about reducing log level

fix docstring

[doc/book] refresh the autoform section with uicfg content (moved there)

[doc/book] complete the urlrewrite sections with examples

[doc/book] misc on views, docstrings

[doc/book] talk a bit of the Result Set class

[doc/book] add image for the breadcrumbs section

[doc/book] fix docstrings, add notes

[doc/book] complete the breadcrumbs section

[doc/book] complete/fix the dbapi stuff, including cursor

[doc/book] some fixes for vregistry, selectors & appobjects

merge

Added tag cubicweb-debian-version-3.7.4-1 for changeset fefeda65bb83

Added tag cubicweb-version-3.7.4 for changeset ec23f3ebcd34

backport stable

[doc/book] stuff a bit the publishing process (including various docstrings)

[doc/book] bitstream vera sans is a terrific font

[3.7.4] fix migration of configuration file

[config] fix #799884: do not attempt to load stuff with incorrect names which sit in cubes/

[c-c newcube] finish #676915: cubicweb-ctl newcube must be aware of python modules and debian package convention (python part already implemented)

[debian] fix bad dependency

3.7.4

i18nupdate

[migration] fix bug when trying to add a new entity type that inherit from another

[repo] fix more indentation pb in repo.glob_update_entity, causing duplicated inline relation hooks call

(implement #761403) The breadcrumb final element is now a link too. This allow getting a proper url for item fetched throught search.

[doc/book] fix a bit the request chapter, add autodoc

[migration] fix error when synchronizing everything and some schema still in the db schema but not anymore in the fs schema

don't fail on cube's pkginfo without __use__

[hook] backport bad .events fix from default

[doc/book] complete the facet section

[doc/book] change font to improve lisibility (in particular cl -> d)

[doc/book] rework the templates chapter (wipe out horrible example, talk more about structure)

[config] better *-session-time documentation and usage in session handler

[facet] fix #873742: erroenously use self.cw_rset instead of context rset

[vreg] fix traced_selection

added note about interesting page about SQL implementation differences

use MB for Megabytes, instead of french Mo

merge

[doc] save idiotic changes to some drawing

[devtools/validators] add an Xml validator able to degrade to Html validation because of views perusing demote_to_html

[vreg] fix bug introduced in 5273:c4caef6f09c9 : we should not force_reload in vreg reset done because of a set_schema

backport stable

[vreg] refactor the [re]loading process so things get clearer and fix spurious errors on edge cases

cleanup

[dbapi] fix user handling on dbapi request. Avoid getting None as _user and remove the need for a property.

[etwist] allow to specify max size for POST request in the configuration. We should deal with this nicely on the js form validation code.

[doc/book] missing .svg files, refresh .pngs, fixlets

merge

[devtools] do not forbid use of postgres as a source for tests (but it still needs proper dump/restore support)

[doc/book] regroup views chapters under common umbrella (in the development part) & some fixes

section moved to the book

fix the dosctring

[doc/book] merge controller/editcontroller

[doc/book] move a big chunk of primary view customisation example in the primary view chapter

[doc/book] refresh the style

[doc/book] kill remaining warnings

[doc/book] add a ref from hooks to adv tutorial

[doc/book] add a better standard theme

[doc/book] misc fixes

[doc/book] reorg. a bit the top-level toc, complete the windows setup part

[doc/book] complete the unit tests chapter

[doc/book] update primary view layout pic: added missing elements, removed main layout around

[doc/book] include sylvain great advanced tutorial, move tutorials in one proper section

[etwist] upgrade post max size to 200Mo until it's configurable

[web session] fix web session id bug on automatic reconnection. The web session id should keep the first connection id, then differ of the repo connection id once some reconnection has been done (since the session cookie isn't updated in such cases). Also, use a lock to avoid potential race condition on reconnection.

[packaging] 3.8 depends on lgc 0.50 (new argument to dot generator in lgc.graph)

backport stable

[views] fix bug on gc debugging view

[testlib] ctrl_publish now allow to specify the controller id as argument

[web] stop having actions configurable through cwproperties: this clutter site management and .po files for a useless fonctionnality (which, where and how actions are displayed is handled by code)

[testlib] we should not replace db-name in sources, this cause undesired side effect (when running pytest on whole cw for instance). Proper fix in logilab.database

[web] put a fake object that raise Unauthorized on any attribute access as req.cnx and req._user, so we are properly asked to authenticated on any view that tries to do something with one of those attributes (instead of doing defensive programming everywhere we're doing that)

[etwist] we must call all error not handled in _render_request, else the thread fail silently and nothing ends up on the ui

backport stable

[test] fix unittest_viewselector

[tests] fix bfss tests to match new uniquify implementation

[schema view] the final touch. Things are getting nicely displayed, and code clean

backport stable

[schema view] fixes

catalogs update

ticket #344404, cwgroup primary view improvement, use tabs to display nicely permissions

ticket #787103, relation schema view enhancements

ticket #787103, entity schema view enhancements

ticket #787032, schema view improvement

[doc/book] misc fixes/enhancements & notes

[doc/book] remove refs to aafig (it uses a sphynx extension unavailable as a .deb)

[doc/book] expand tesing material

[doc/book] add sections to the FAQ, try to reorder stuff

[doc/book] primary view section enhancements

[session] better readability

[facet] don't crash in rset_vocabulary if an unauthorized error was raised in rqlexec

[mq]: worklfow view

#773448: refactor session and 'no connection' handling, by introducing proper web session. We should now be able to see page even when no anon is configured, and be redirected to the login form as soon as one tries to do a query.

[doc/book] more flesh to views/primary view

[doc/book] remove merged chapter

[doc/book] complete chapter on hooks & ops

[storage] missing qrefresh in previous patch applied: fix comment, error message, and use a storage specified encoding, not cubicweb's encoding

[fix] fix path unicity process in BytesFileSystemStorage.new_fs_path The previous implementation was bugged (prefixing the whole path with '_' instead of the base name). A new version (using number) replace it. * * * Improve BytesFileSystemStorage.new_fs_path to use available metadata This version try to get some hint about how to name the file using metadata. Using the real file name and extension when available. Keeping the extension might be usefull for exemple in the case of processing that use filename extension to detect content-type.

[source] small refactoring to avoid being doomed by a wrong assertion message on buggy storage raising attribute error

[twisted] fix LongTimeExpiringFile and getChild implementation

merge

fix cwctl db-init -d on SQL Server

[repository] fix edited_attributes management in multiple SET queries entity.edited_attributes was messed up with previous edited entities. The UpdateStep now gives a new fresh edited_attributes set to repository.glob_update_entity() so that each entity can modify it during its "transaction".

[testlib] fix dummy bug in reset_test_database(): s/if/elif

merge

merge

merge

enable tests against sqlserver2005 database

fix bad indentation

merge

merge

merge

merge

[doc/book] more about hooks (simple examples with entities and relations)

backport stable

[web] on logout, use the base_url argument of build_url instead of hacking the request to get proper url. This fix a bug on site with http/https versions: the session cookie is badly removed on logout

[entity] move req.create_entity content to a cw_instantiate factory method on entity classes, so cube developpers will be able to easily customize instance creation

[controller] refactor send mail controller to use cwconfig.sendmails

[test] properly close session

backport stable

le patch move-pdf-export-to-cubes a été importé

[hooks] fix set_operation options passing (** -> *)

[session] no way for queries from an InternalSession to be a dbapi query

[merge]

[doc/book] begin chapter on Hooks/Operations

[doc/book] dbapi: talk about IN exception, simplify

[doc/book] rql/dbapi cleanup, rip cachekey (prematurely ?)

[doc/css] cleanup a bit the sphinx default css

[repository] fix bad indentation in glob_update_entity, source.update_entity() should be called once per update

[doc] note on pytestconf, fixlets

[test] avoid weird bug when test are changing the cwd

[c-c newcube] #1192: simpler cubicweb-ctl newcube, and more * new --layout option, to get 'simple' or 'full' cube * new --licence option to specify license for the cube * added README and sobjects.py template (the later only added in full layout) * fixed python file templates to get proper headers according to the config

[storage] consider fs_importing on update operations too

[primary] fix name error

[migration] propagate TrInfo.comment permissions fix to existing instances

[xthml] fix #696079, potential empty table cause xhtml validation error

[schema] #847739: test and fix bad permission on TrInfo.comment

[iprogress] use xml_escape instead of buggy replace

backport stable

[querier] don't need a Cache instance for rql cacke key cache

[testlib] properly close connections opened during test in tearDown

#759035: Automate addition of eid cachekey in RQL analysis

[rql annotation] add test and fix for bug introduced by 5004:4cc020ee70e2. While it sounded good, it wasn't because stinfo['relations'] didn't include anymore stinfo['typerels']

merge

merge

merged back old local changeset

fixed indentation error in devtools/__init__.py

SQL Server port: temporary table handling Together with support from logilab.database, handle temp tables for SQLServer (which are denoted by a name starting with '#', just don't ask) Note updated dependency on logilab.database 1.0.2

log RQL query in case of unexpected failure (priceless when porting to new database)

enable live test against sqlserver 2005 database

fixed skeleton help strings

[wf] should use is_in_group to avoid error with internal manager

[pkginfo] when only __depends__ is specified, deduced __depends_cubes__ from it (same thing for recommends) ; fix ad skel pkginfo on the way

[hook] fix name error in case of error on hook's .event checking

[ms] fix planning bug introduced with recent rql refactoring for queries with only eids (fix unittest_multisources.test_in_eid)

[hook] proper bad .events detection. Fix unittest_hook

backport stable

[test] _gc_debug deleted from etwist.server

[doc/book] talk about reloadComponent, misc tweaks and notes

[doc/book] add q/a on i18n customisation, misc tweaks

Switched from TwistedWeb2 to TwistedWeb - added HTTPResponse class in etwist/http.py (could be then abstracted in cubicweb/web) - added twisted.web2 http_headers.py file in cubicweb/web to handle HTTP headers conversion between raw headers and python object - deleted caching for base views (except for startup views). A better solution would be using weak entity tags (but they don't seem to be implemented in twisted.web). - added forbidden access message when browsing static local directories - tested with TwistedWeb 8, 9 and 10 TODO: ===== - Handle file uploading in forms. twisted.web seems to keep very little information (only file content) about uploaded files in twisted_request.args['input_field_name']. But it doesn't seem to keep track of filenames. Possible solutions : - use web2 code to parse raw request content still stored and available in twisted_request.content - find a magic function in twisted.web API to get the filenames - More tests.

merge

[ldap] fix email synchronization code: bad rql query + avoid integrity error on creating the address + nicer use_email / primary_email handling

[doc/book] adjust a bit

[doc/book] expand the js chapter with an ajax story

[doc] remove useless directories

temporary move

[web components] refactor as book recommends :$

more / cleaner / in code documentation of vreg, selectors and appobject

add note about running repository / client code

added information about the naming conventions in schema.py also: * some typo fix * note about ObjectRelation soon being deprecated * clarified a few hazy points

[doc/book] a new chapter on how to use the ORM

improved doc on selectors an vregistry

fix rest formatting

typo fix

merge

catch and log errors caused by bad json data

list allowed values for ldap protocol setting in help, so that the generated file includes this in a comment

[doc/book] enhance i18n section #656191

[doc] more (doc oriented) feature in list

[doc] enhanced setup section: fix sections'level, more postgres tips, merge environment doc with cwconfig.py module docstring using custom autodocstring directive

[doc] enhanced concepts section

remove ref to no more existing file

[cleaning] simpler implementation of cmd_create_entity

[storages] fix fs_importing side-effect on entity.data When creating a new File object, if fs_importing is set, we want entity.data to be the file content instead of the filepath for the rest of the transaction. (see test_bfss_fs_importing_transparency) for test implementation To make this possible, the storage hooks (entity_added / entity_updated) must return the correct value to set in the entity dict.

nicer warning

[doc] started full features list

[python] take care to this detail of @contextmanager: if an unhandled exception occurs in the block, it is reraised inside the generator at the point where the yield occurred

[entity] explain why the assert failed

[test] fix expected error

fix bad merge

fix #822890, missing argument on abstract source backup method make backup failed on multi-sources instances

merge

[schema] ensure we don't remove has_text relation type unfortunatly

merge

Added tag cubicweb-debian-version-3.7.3-1 for changeset 44c7bf90df71

Added tag cubicweb-version-3.7.3 for changeset 768beb8e15f1

[distrib] fix pkginfo

3.7.3

[hooks] better message on bad .event class attribute

[repository] forbid usage of set_attributes() in before_add_entity set_attributes() will generate a RQL query that will silently fail. An explicit error is better. You can still use the ``entity[attr] = value`` notation that won't generate a SQL query but still update the inner state of the entity and its edited_attributes attribute.

merge

[cleanup] tb already printed by self.exception; add note

[facet] fix 'bookmark this search': * vid wasn't included in the link generated by the facet box * proper url quoting in both js / box code (try an has_text search with '&' inside...)

[widget] more wide textarea on bookmark edition

[distribution] the web/data/images directory has to be handled in pkginfo

[test] use the new temporary_appojects CM to simplfy unittest_storage

[session] try to reconnect on unexpected error in system_sql. We need this for proper reconnection of pool used by hooks or looping task doing sql queries (such as cw_cleanup_transaction)

[source] log attempt to reconnect using warning level. Also, don't relog failed sql (already logged)

[test] avoid critical log by informing the source we consider Personne as a multi-sources type

[test] use new temporary_appobjects context manager

[test] that doesn't smell good but fix the test...

[vreg] we do want the opposite...

[testlib] simple helper method to register temporary appobjects (hooks for instance) with a context manager

[undo] fix transactions table name in cleanup operation

Add context management methode to dbapi.Connection the connection is automaticly closed when exiting the context.

i18n update

[i18n] use named substitution to avoid gettext warnings

[dataimport] print transaction id when we get one

[cleanup] add some notes

[optimisation] _select_best is used very intensivly. Peanuts optimization may count :)

[optimization] traced_selection is used very intensively in debug mode optimizing it is worth the pain. Basically : don't do stuff unnecessary when we don't trace anything.

[optimization] improve massive write performance by optimizing hooks selection profiling on some massive deletion showed up that 2/3 of the time was spent in hooks selection. Those changes make it much more acceptable (through selection is still not negligeable): * use one registry for each event, so we've much less hooks to check when emiting an event as well as no more need for the match_event selector. This required ability to put one appobject into several registries, using a __registries__ class attribute. * check for deprecated .enabled at registry initialization time instead of at selection time A very simple HooksManager class has been reintroduce to choose the right registry on call_hooks. Those optimisations leads to a ~x3 factor of time necessary to delete 16000 entities.

[upgrade] after upgrade, fork command to start instance avoid grave uicfg pb (explicit rules all removed...)

merge

[repo creation] removing existing entities of 'single' cardinality relatino should be considered as 'activeintegrity' hook. Also don't disable that category during repo creation to avoid pb such as two default workflows for one entity types

merge

handle Service Close request correctly (closes #736039) The windows event self._stop_event was not used, and twisted was not getting a chance of terminating cleanly by calling its shutdown event handlers (which would eventually call pyro_unregister). Fixed by calling reactor.stop()

[js form validation] fix case where we've None/null keys in the errors dictionnary

[cleanup] exists imported, use it

[form] CompoundField should not return itself in actual_fields, this avoid error on iliane with 3.7.2 where it's marked as required (from the schema) while value are provided by subfields

[repo] we want a hooks manager and hooks initialized event on quick start (we trigger events such as server_backup / server_restore for instance)

[distribution] sql extensions files now have proper extension, fix manifest file

backport stable

[events manager] onevent decorator may be given extra arguments to give to em.bind

[cleanup] some notes

[reload] on registry reloading, we should change class of users of opened session

[appobject imports] don't include __init__ in package's name. See comment for more info

[rset] cubes such as iliane hi-jack rset description by poping some lines from it. Handle this on RepeatList

[undo] basic support for undoing of entity creation / relation addition

[undo] init entity cache when undoing an entity deletion

[undo] consistent is/is_instance_of processing

[repo] don't need rset description on those queries

[cleanup] style fixes, add nodes, 0.2 cents refactorings

[undo] during undoing, call hooks in the [active]integrity and undo categories

[repo] refactor fti operation to use set_operation and a single operation whatever the number of entities to ft index

[querier] introduce RepeatList class, used to optimize size of data returned for result set description When rql query has no ambiguity, we used to return the same description * N where N is the size of the result set. Returning RepeatList class avoid that multiplication. According to quick benchmark this improve performance for result set whose size is ~ > 50, has very small penalty for rset < 50, and in any case improve the size of data to be transfered over the network through pyro connection.

[repo] on add entity, set cache as soon as possible + fill type/source cache

[repo] more efficient eid cache operations handling based on set_operation; refactor * split CleanupEidTypeCache operation into one operation for deleted eids and another for added eids, and put them in cw.server.hook * for consistency, move fti unindexing handling from the repository to the system source * handling of deleted eids is done in plan execution (ssplanner), no needs to redo it in *delete_info -> no more need for _prepare_delete_info method, killed

[repo] move eschema_eid function from hooks.metadata to server.utils

[primary view] skip virtual rtypes anyway

[test] CubicWebTC.create_user expect an actual query, and we don't need to give session here

[dataimport] stop disabling undo ; commit return transaction id

[logging] demote static file served to debug

[cleanup]

[repo] optimize massive insertion/deletion by using the new set_operation function Idea is that on massive insertion, cost of handling the list of operation become non negligeable, so we should minimize the number of operations in that list. The set_operation function ease usage of operation associated to data in session.transaction_data, and we only add the operation when data set isn't initialized yet, else we simply add data to the set. The operation then simply process accumulated data.

[repo] make etype which should go in deleted_entities configurable: we only need this for types imported from other multi-sources instances

[repo] don't execute child step twice in EntitiesDeleteStep

[form] consider autoform_field_kwargs for meta fields; allow required customization

[workflow] support for automatic transition starting from the initial state

[testlib] create_user support extra kwargs to give to create_entity(CWUser)

fix dataimport for 3.7.2

use lgc.testlib.TestCase

backport stable

Added tag cubicweb-debian-version-3.7.2-1 for changeset 8fda29a6c219

Added tag cubicweb-version-3.7.2 for changeset d010f749c21d

take care to empty string in cubes search path

backport stable

[ms] fix name error introduced by rql 0.26 api update

add note

3.7.2

[selectors] new is_in_state select to avoid common error when writing state based selector

[repo config] cleanup read_instance_schema / bootstrap_schema / creating mess

fix #726167: i18ninstance use data in bootstrab_cubes instead of the database one

[cleanup] remove 3.7 deprecation warning

[form controller] clear caches in case some attribute participating to the rest path has been modified, avoid redirection to a no more existant page (fix #753567)

i18nupdate

[form] fix validation error handling * type when possible ValidationError raised by the edit controller * don't rely on repository to check required field * turn css class used for field error message to errorMsg to avoid confusion with the error class added to input * fix css when errors are added by the form renderer * fix form renderer to add the error message

[captcha] handle captcha validation properly in the captcha widget also, avoid error if pil isn't installed (only a recommendation)

[testlib] __errorurl may be a relative path, check we're actually removing base url first

[i18ncube] clear_rtag_objects imported when generating cube's .po file

[maintainance] don't crash if we've no in-memory repository

[db dump/restore] fix '#615840: db-dump must be always runnable' by setting repairing on config. Also, avoid to read the whole schema from the database on dump/restore: the bootstrap schema is enough.

cleanup

__missing__ main

[form] put qualified name on validation error, should fix #784299

[test] fixes when executed under apycot environment (also added ldap1 to test host /etc/hosts)

...

[config] move ConfigurationProblem to migration + refactor it to benefit from config methods

[config] more cleanup

deprecate __use__ and __recommend__

add egg support with dependencies auto-installation

fix dumb name error

fix _cubes dir

handle nicely typical installation other than debian package / mercurial forest * new _find_prefix method to detect installation prefix (maybe specified using CW_INSTALL_PREFIX environment variable) * set various resource accessors according to this, cleanup on the way * remove no more necessary APYCOT_ROOT hacks

When a TC failed to initiliase the database, the following test are SKIPPED When a TC failed to initiliase the database, the other test of the same TestCase are skipped with an explicite message instead of failing later for with an unrelated message.

[c-c] new server_maintenance hook, called on c-c shell / upgrade

[appobject] add version number to deprecation warning

update rql dependency

backport stable

fix migration script

[cleanup] useless try except

[source storage] refactor source sql generation and results handling to allow repository side callbacks for instance with the BytesFileSystemStorage, before this change: * fspath, _fsopen function were stored procedures executed on the database -> files had to be available both on the repository *and* the database host * we needed implementation for each handled database Now, those function are python callbacks executed when necessary on the repository side, on data comming from the database. The litle cons are: * you can't do anymore restriction on mapped attributes * you can't write queries which will return in the same rset column some mapped attributes (or not mapped the same way) / some not This seems much acceptable since: * it's much more easy to handle when you start having the db on another host than the repo * BFSS works seemlessly on any backend now * you don't bother that much about the cons (at least in the bfss case): you usually don't do any restriction on Bytes... Bonus points: BFSS is more efficient (no queries under the cover as it was done in the registered procedure) and we have a much nicer/efficient fspath implementation. IMO, that rocks :D

[bfss] fix name error

[source storage] on deletion, entity has no edited_attributes

[cleanup] rename dbms_helper to dbhelper for consistency

[entity] we also have to override dict.pop to properly maintain edited_attributes consistency

[bfss test] some minor refactoring. Test deletion + creation/update/deletion rollback

don't put hooks deleting orphan composites into the 'integrity' category, we usually want it when integrity is deactivated

[facet] allow to specify a target type on relation facets for case such as Keyword/CodeKeyword where we only targets Keyword

don't rewrite config's url during migration

le patch rql26 a été importé

backport stable

[D] book: update backup procedures in additional tips

[cleanup] remove accidentaly commited print

[test] don't try to reset session manager during test, this leads to weird failures when running multiple tests

don't update dontcheck until everything went fine: see usage in after_update_entity, where if we got an Unauthorized at hook time, we will retry and commit time.

[test] having two eid relations is now forbiden by rql

[web test] a basic test, to be completed

[test] don't clear rtags during tests, may cause breakage with manually import appobjects modules (see unittest_tracker for instance)

[web] move workflow related uicfg stuff to the workflow module

dont get eid from entity's dict

[notification] don't create 'changes' in transaction data until actually needed

backport pending_operations on hi-jacked session, see comment

[entity] fix dumb name error on .set_relations(rel=None)

[security] don't add attribute into skip_security if already in edited_attributes, else we may accidentaly skip a desired security check

[repo entity] we have to provide a __delitem__ implementation as well, see example in the docstring

[yams] on creation, specify relations anyway so we don't get spurious warning for accessing eid through the dict api on yams validation

[repo] fix warning message and implementation of bw compat unsafe_execute

stable is now 3.7

oldstable is now 3.6

backport stable

merge

Added tag cubicweb-debian-version-3.6.3-1 for changeset f9fce56d6a0c

Added tag cubicweb-version-3.6.3 for changeset 9c342fa4f1b7

Added tag cubicweb-debian-version-3.7.1-1 for changeset 9194740f070e

Added tag cubicweb-version-3.7.1 for changeset 6b0832bbd1da

backport debian control changes done in 3.7

3.6.3

ticket #636927, add ajaxhtmlhead in controller js_component

[widget] allow kwargs passed to Select widget

take care to empty breadcrumbs

fix bug with damned transmutation functionality, occuring when using an INSERT query which also add relation to the entity

update skeleton for __pkginfo__.py

don't use optional on final relation

fix security issue introduced by 4967:04543ed0bbdc: attributes explicitly set by hooks should not be checked by security hooks

[form js] apply vgodard patch fixing #750056: reorderTabindex js function crashes when form dom id is not 'entityForm'

missing unittest_main

[server] add unit tests for storages

[registry] trigger reload events on set_schema()

[source] only consider edited_attributes in source.preprocess_entity()

[source] implement storages right in the source rather than in hooks The problem is that Storage objects will most probably change entity's dictionary so that values are correctly set before the source's corresponding method (e.g. entity_added()) is called. For instance, the BFSFileStorage will change the original binary data and replace it with the destination file path in order to store the file path in the database. This change must be local to the source in order not to impact other hooks or attribute access during the transaction, the whole idea being that the same application code should work exactly the same whether or not a BFSStorage is used or not.

i18n update

3.7.1

backport stable

[etwist] cleanup, use cProfile instead of hotshot

[repo] start looping task on repo only config (though I bet more work is needed to get it actually working

[repo] call server_startup event in start_looping_task the repo is fully started (registered in pyro for instance)

[security] take care uidrels may contains a relation targetting something else than a constant node (eg IN function)

[ms] this test is already done before putting a relation in uidrels

cleanup

[security] experimental rqlst cache for read security: to activate using a 'security-rqlst-cache' flag in transaction data when you'll issue a lot of identic queries with only kwargs varying

[read security] minor optimizations

[web] get rid of spurious '[Errno 2] No such file or directory' on load This was caused by can_do_pdf_conversion() which tries to use '/usr/bin/fop'. When fop was not available, an OSError was raised by suprocess.Popen. This changeset first checks for /usr/bin/fop presence, then tries to run fop. If an error occurs, log it instead of printing it. NOTE for later: why do we test explicitly for "/usr/bin/fop" rather than simply "fop" ?

backport stable

[schema sync] fix another potential name error on synchronizing rdefs

[schema sync] don't try to synchronize infered relation defs, fixing a name error on the way

cleanup

don't update constraints when it's not necessary

[repo] don't call server_shutdown hooks when creating/repairing instance to be consistence with server_startup hooks

[migration] new build_descr argument to rqlexec on the migration helper

fix migration when upgrading from cw < 3.6 to cw 3.7

disable security when undoing

merge

[sql] fix FSPATH implementation plpy.execute() returns a list of dictionaries with column names as keys and corresponding values as values.

[web deletion] must use set_message

fix limited_rql w/ UNION query

backport stable

fix import

Fixed some of the documentation warnings when building the book with sphinx.

move pdf icon component with it's template so we don't see it when the template isn't available due to missing dependancies

backport stable

add missing warn imports

add missing warn imports

improve documentation for uicfg and rtags

backport stable

merge

[cleanup] objtype not used

[schema sync] test and fix bug when updating multiple constraint for the same rdef in the same transaction

3.6 want __regid__, not id

[migration] disable notification by default during migration

[session] fix hijack_user: most transaction_data should be copied (everything but the entity cache

Added tag cubicweb-debian-version-3.7.0-1 for changeset 0c9ff7e496ce

Added tag cubicweb-version-3.7.0 for changeset 270aba1e6fa2

fix control file by using virtual packages

fix common/rql dependencies

3.7.0

test fixes

merge

fix tests

fix test broken by recent rql rewrite / querier changes

backport stable into default

server/web api for accessing to deleted_entites

[R] dataimport: changes - deprecate checkpoint() in favour of commit() - filter on None value in mk_entity - rearrange log messages order

#750055: make it easier to change post logout url

[web auth] fix authentication pb when anonymous are allowed, avoiding the first authentifier to return an anon connection while a following one may find correct authentication info. This make things simpler (eventually)

[web server] simplify base-url handling on startup. Ensure config['base-url'] is correctly set once started

[rql rewrite] until a better solution is found raise BadSchemaDefinition when two inlined relations with security on an optional variable is used, explaining how to bypass it

[rql rewriting] handle case where we've and optional inlined relation in the original query. Also, we should append EXISTS even in subquery to avoid inserting duplicates in results

[rql rewriting] handle case where we want to insert snippet on a variable that has previously been moved to a subquery

backport stable

[backup] fix misplaced paren

fix bad conflict resolution

backport stable

LazySuggestField : remote version of RestrictedSuggestField

typo

backport stable

Add a rssitem_id attribut to RSSView to easly choose the view used for items.

[web] start a new message system based on id of message stored in session's data instead of using __message as today, which is problematic (allow message injection). Also we can have html in messages. Removed the __createdpath hack used to escape those limitation. The old system should still work though (and will probably for a while, though we should progressivly move to the new system where it's possible). Cleanup request paramaters handling on the way.

[notification] fix dumb name error in hijack user

[dbapi] return default argument instead of None when no connection set yet

[cleanup selectors] use authenticated_user, check for form params instead of handling potential key error on missing params

[db backup] fix name error in backup_to_file: we've to pass .confirm all along the chain as for restore

[cleanup] use iteritems

[url] new rebuild_url method on base request

typo

fix apycot detection

provide logilab.database compat when creating database

update debian changelog

[db creation] fix some bugs introduced by the migration to logilab.database