backport stable

Added tag cubicweb-debian-version-3.8.3-1 for changeset 1ccaa9247860

Added tag cubicweb-version-3.8.3 for changeset 7e6c6a2a272d

[edit ctrl] fix bad interaction with fields: the loop on actual fields should be done in has_been_modified

[web test] add basic windmill tests and documentation - connection / deconnection - user creation

[web test] Add windmill functional testing capability.

3.8.3

i18nupdate

[editform] consistent [do]reledit between attributes and relations: check if rdef is hidden in main section of uicfg.afs for both attributes and relations, and in the reledit view, not in doreledit

on entity creation, accept attributes without any update access

[table] propagate paginate

no more need for specific handling of table view's displayaction it's handled as other view arguments in vidargs

[rset] do not break when rset.related_entity(x,y) is not an entity

[migration] fix schema synchronization bug sync_schema_props_perms('Repository', syncprops=False) to synchronize permission of entity's attributes wasn't working as expected: only the entity's permission were updated.

[javascript] refactor execution flow of handleFormValidationResponse so that location hash is set to #header whatever the error is

[package] now depends on yams 0.30 because of xy API changes

[xy] switch order of arguments for register_prefix()

HAVING sql clause don't know about comma...

[web/formwidgets] check on list (entity.related_cache swapped from tuple to list a while ago without known reasons), do not unicode wrap the eids

merge

[win32] defer import of logilab.common.daemon The module is not importable on windows, and etwist.service carefully avoids importing it (but imports etwist.server). Wait until we are sure not to be on windows to do the import)

[ajax] refactor/cleanup low-level ajax functions * loadxhtml/replacePageChunck/reload_component/reload_box deprecated in favor of loadXHTML / ajaxFuncArgs * some other cleanups in cubicweb.ajax.js * add js_render which will replace js_component (more generic, nicer argument passing handling)

[querier] test and fix potential bug in insertion query with multiple relations inside, caused by a name conflict. Also fix another bug non reproduced by using a set instead of a list (list may leads to compare entity instances which isn't allowed).

[form] avoid spurious warning subsequent for form's action refactoring w/ autoforms

backport stable

[web test] Add a CubicWebServerTC class to run test with a cw web serveur available.

[web server] vregistry may now be passed as named argument in CubicWebRootResource constructor This will be needed to start an http server for testing purpose. Also, server run command has now a debug name argument to set debug mode explicitly

[etwist] twisted won't install signal handler outside the main thread. This patch avoid some warning about this issue.

[vreg] ensure you can register an object from module not known yet. This ease registration of arbitrary objects during testing.

[web] cleanup use of config in web application initialisation

fix unit tests by not using the new create_eid implementation with sqlite Actually, fix a couple of issues with a previous attempt: * do not use double underscores as method patching will fail with these * old method must always be used with sqlite regardless of the no_sqlite_wrap attribute

cleanup the no_sqlite_wrap attribute after this test is executed

merge back on-site fixes

various brown paper bag fixes

merge

fix create_eid for sqlite (and bring back tests)

backport improved on-site change

TimedCache now only accepts values expressed in seconds updated ldapuser.py and pyrorql.py to that new interface.

backported to stable some changes made on site for a customer

logging settings * document helpful log format when dealing with MT issues * on Win32, use a logrotate equivalent so that logs get a bit lighter (requires updates logilab.common)

[win32] fix deadlock occuring on the sequence tables with SQLServer actually, this deadlock would occur with any db backend other that PostgreSQL as the previous code was heavily relying on PG's SEQUENCE facility, not available elsewhere. Deadlock description: Thread1 starts creating entities (and therefore calls create_eid): -> this creates a DB-level lock on the entities_id_seq table, which will last until end of transaction Thread2 calls create_eid, which acquires the Python lock object, but updating the entities_id_seq is held by the DB lock Thread1 wants to create a new entity, calls create_eid, and is stuck by the Python lock object held by Thread2. Solution: use a separate connection to read and write the entities_id_seq table.

log the user name on session opening for easier debugging

more robust handling of looping task configuration in ldap source * use minimum times * updated documentation and help strings * fix the minutes vs. seconds confusion

backport stable

[rql2sql] fix scope computation of variable from temporary table

stop being dumb please

backport stable

[tableview / facets] to work properly with facet, initial table should handle case where actualrql isn't specified

[test] generated html differs w/ pygments version

[storage] source's callback has a new prototype, update usage

grmbl

grmbl

backport stable

cleanup

[external storage] refactor to give session to storage's callback (needed by vcsfile storage)

[navigation] use pageContent instead of paginated-content as default div id, paginated-content doesn't seems used anymore

[test] update test to follow recent navigation/facets fixes

[tableview] use pageContent instead of paginated-content as default div id, paginated-content doesn't seems used anymore

[sparql] improve error reporting and fix one bug

[test] add missing __main__ as expected by apycot pyunit checker

[tableview] don't fail with AttributeError when paginated as main content view

[facet] we must add type restriction for attribute facets as well

[tableview] support for json-paginated table if paginable

[navigation] view may implements page_navigation_url to handle them self url generated for pagination

[navigation] when there are to much results, use a <select> based page navigation

[primary] add missing version number to deprecation warnings

[sparql] fix type inference (test_dctitle_both_project_cwuser) and support for <http://www.w3.org/1999/02/22-rdf-syntax-ns#type tag (test_base_rdftype)

[form] remove double property call

cleanups

[sparql] add failing test for two entities with dc:title

[sparql] adding test for "rdf:type -> is"

proof read documentation some clarifications, some typo fixes, and a couple of other strings fixed on the way

skip flymake junk when reloading this avoids nasty ex aequo scores in selectors in dev. mode

merge back to stable some changes made on site for a customer.

[win32 SQLServer] connection lost detection The pyodbc driver when connected to SQLServer 2005 reports lost connections in a quite strange way, raising a pyodbc.Error exception with a specific exc.args value. This patch catches these and reconnect properly.

ldap: reset cache when a user is deleted When a user is deleted from ldap, reset both caches used by the source otherwise the search is not performed again and exceptions such as UnknownEid: No entity with eid 74078 in the repository will occur

ldap source logging Added some extra logging statement to understand what happens in the ldap source.

forbid looping tasks with an interval of 0 This severly harm the server, and generally are the result of a baaad configuration file. We want to stop the server asap when this is detected to give people a chance to fix the configuration.

/siteinfo page: display information about the names of the running threads

[win32 service] activate logging to the configured file as soon as possible since we don't always have access to the system events of the computer running CW it is important to get as much information as possible in the log file, especially startup failure messages.

[bfss] Rename filenames according to their metadata on entity update.

[form] missing return...

[adapters] fix NameError introduced by adapters refactoring

[security] fix security insertion on DISTINCT queries

[adapters] fix bad copy and past....

backport stable

[rql2sql] properly compute scope for variable from temporary tables

[form] fix bw compat issue introduced by 5588:377c9adfe81e

[web] update to 3.9 Entity api

backport stable

[migration] force 3.8.3 migration, and fix it (same_as not necessarily there, missing group change for max-post-length)

[forms] refactor action handling to ease overriding while keeping action overrideable by instance (closes #969167)

[web] dont attempt to update last login time on ldap users, avoiding spurious tb in logs (closes #914464)

[c-c] use logilab.database, not lgc.db

[sqlite] fix crash on db-create with sqlite abd unexistent database due to missing paren in logical expression (closes #909604)

[web] disallow authenticated users to access to the login form (closes #914873)

[reledit] #894131: use "<`attribute` unset>" instead of generic "<not specified>" when an attribute or relation has no value

[rql2sql] follow rql 0.26.1 changes: NOT nodes normalization, allowing simplification of sql generation, and fix #XXX

[repo] ensure thread is alive before calling .join. Closes #963580

[migration] add migration file commands to follow option group changes

fix 978144: exception with view send-email if empty subject

[test] fix test broken by introduction of adapters

[schema] fix same_as cardinality and bump Bookmark.path max length to approximative max url size

[deprecation] fix 3.9 deprecation warning

no more Image type w/ cw 3.9

[fti] fix name conflict introduced by the new IFTIAdapter

[entity] clearing adapters cache in clear_relations_cache avoid weird caching issue, notably on repository session's user

[vreg] should raise exception on select ambiguity when running in test mode

[adapters compat] make implements_adapter_compat selector compatible with attributes

[test] no more Image type w/ cw 3.9

[adapters] refactoring fixes

[selectors] ensure selector return an int

[selectors] adaptable selector should not accept None in rset

[selectors] lltrace appobject_selectable selector

[selectors] allow to override `accept_none` value of EClassSelector / EntitySelector based selector by specifying a value in selection context

[selectors] move lltrace decorator and traced_selection cm to appobject module so we can apply lltrace to And/Or/Not selectors, fixing #662565

with cw 3.9, no more Image type

[vreg] on registration completed, don't crash if an object depends on an unexistant registry, simply kick the object out

[selectors] ensure adaptable('IDownloadable') takes precedence over implements('Any')

[primary view] fix name error on dispctrl w/ pre 3.5 box definition

[entity] fix access to attribute which has been renamed two revisions ago

[schema migration] make some stuff to ease file 1.9 migration : we want to kill the Image entity so that existing image are turned into (existing entity type) File entities

[entity] continue cleanup of Entity/AnyEntity namespace * prefix by cw_ or _cw all '2nd zone' attributes / methods, other most commonly used will be done later (some methods used by client are made private anyway when they are for internal purpose anyway) * kill set_eid, use direct affectation instead * kill the auto-transmutation feature (pre_add_hook), hence releasing 3.9 will require releasing file cube as well

[entity] introduce a new 'adapters' registry This changeset introduces the notion in adapters (as in Zope Component Architecture) in a cubicweb way, eg using a specific registry of appobjects. This allows nicer code structure, by avoid clutering entity classes and moving code usually specific to a place of the ui (or something else) together with the code that use the interface. We don't use actual interface anymore, they are implied by adapters (which may be abstract), whose reg id is an interface name. Appobjects that used to 'implements(IFace)' should now be rewritten by: * coding an IFaceAdapter(EntityAdapter) defining (implementing if desired) the interface, usually with __regid__ = 'IFace' * use "adaptable('IFace')" as selector instead Also, the implements_adapter_compat decorator eases backward compatibility with adapter's methods that may still be found on entities implementing the interface. Notice that unlike ZCA, we don't support automatic adapters chain (yagni?). All interfaces defined in cubicweb have been turned into adapters, also some new ones have been introduced to cleanup Entity / AnyEntity classes namespace. At the end, the pluggable mixins mecanism should disappear in favor of adapters as well.

backport stable

[config] move web specific config to the web section of the configuration file

* * * [server] move daemonize code to lgc.daemon. Fix on the way pb w/closed standard output on repository config

typo

[migration] fix storage_change migraction to avoid exhausting the server's memory

[repo] set log methods on the actually desired class

[bfss] ensure base name doesn't contain path separator

merge

[web] remove dead code

[forms] consider __action_xxx field if passed to JSonController.validate_form

backport stable

Added tag cubicweb-debian-version-3.8.2-1 for changeset 2b962bb9eee8

Added tag cubicweb-version-3.8.2 for changeset ef2e37d34013

[test] absolute sqlite database names in source initialization, avoid pb when cwd is changed later

clenup

3.8.2

[wdoc] update users changelog

[integrity] keep ordering for schema integrity checks set_operation gained a new containercls argument, so one can choose to use list or set (by default). Use this when registering schema integrity check operation.

[i18ncube] do not crash if cube has nothing to translate

[skel] enable wdoc support in new cubes

[preferences] support dot (.) in registry id of configurable appobjects

[i18ncube] we must load site_cubicweb file before calling set_schema, else we may miss some options or other initialization stuff necessary to appobject loading

[dtd] add unselimg attribute use by widget for HasRelationFacet

remove 3.7 deprecation warning

catch unauthorized when executing rql to check an rql expression. Fix #968824

[startup view] sort startup views by alphabetical order

[table view] should use __regid__ instead of hard-coded 'table' view identifier

cleanup

backport stable

[facet] control i18nization of values on AttributeFacet

[views] tab schema image renamed to schema diagram

[uicfg] fix handling of 'order' in the primaryview_display_ctrl rtag: consider by default only schema order, not order of appearance of rules

[db-check] RQLConstraint is not a 'unique' constraint

[entity] avoid getting w in cw_extra_kwargs when calling .view

[actions box] enhance add related menu generation: don't propose to add relation of single cardinality where entity already have the relation set

[primary view] allow new 'subvid' parameter in primaryview_display_ctrl

[primary view] give dispctrl to side box views as for relations section

[web] unify list views call arguments: use subvid to specify the view to use for each item

[web] refactor side box to use autolimited view

[req] avoid getting w in cw_extra_kwargs when calling .view

[config] rename remaining inputlevel to level in option definitions, as expected by lgc >= 0.50

[fti] simplify UpdateFTIHook code

[twisted] we must set response code before starting to write the answer, else it's ignored

cleanup

[web data] remove files not used by the framework

[css] keep old css according to a configuration variable (true by default)

[3.8 execute] remove deprecation warnings

backport stable

[dbapi] missing import

[ajax] missing html heads processing in reloadComponent (sic\!)

[deprecation] missing version number to old warning message

[table view] we should call the cell view using the table rset, not one rebuilded for a specific entity

[table view] take care to None label

[selectors] new logged_user_in_rset selector

merge

replaced hardcoded 'web/view' by os.path.join('web', 'view') so views path is also valid under windows

fixed bug of non-normalized path under Windows, that broke the reload mechanism

[c-c list] configuration pb cubes directly hold version number now, avoid crash when reporting errors

Handle new way of reporting unmodified FileFields when a FileField has not been modified, value is an empty string. Handle this is raise UnmodifiedField accordingly.

merge

attempt to port windows service to 3.8.1

[web session] fix potential key error on logout (occurs once the session has been transparently reconnected, hence session.sessionid and session.cnx.sessionid differs)

[css] update print css

[doc] cleanup

[python2.6] do not import simplejson directly use indirect import through cubicweb.web

[selectors] fix no_cnx selector's prototype

[web config] set default uiprops on web config class to avoid error on commands such as i18n instance

backport stable

[migration] ask_confirm argument of show_diff doesn't contain an _

backport stable

backport oldstable

[upgrade] don't ask confirm to replace configuration file with -v0

merge good/bad versions of imported patches...

[css] start using uiprops in cubicweb.css

[css] progressively fixing rhythm diff -r a1dbdf887ef4 web/data/banner.png Binary file web/data/banner.png has changed diff -r a1dbdf887ef4 web/data/banner.png Binary file web/data/banner.png has changed

[css] introducing scale and rhythm composition

[css] start using uiprops in cubicweb.css

[css] progressively fixing rhythm diff -r a1dbdf887ef4 web/data/banner.png Binary file web/data/banner.png has changed diff -r a1dbdf887ef4 web/data/banner.png Binary file web/data/banner.png has changed

[css] introducing scale and rhythm composition

[doc/book] a very simple example of entity form extension

[doc/book] refresh a bit the edit controller section

[doc/book] explain the form loop validation process

backport stable

backport oldstable

[c-c dev] fix i18ncubicweb command

[book] add generated js documentation to cw book

[packaging] we should add schemas to include_dirs so sql extensions files are properly installed

[web test] missing test data file

[https] fix resource urls in https version of a site: should use the https version as well to avoid warnings from the nrowser

[uiprops] test and fix reloading of modified css files; update c-c newcube; deprecates config.has_resource.

[doc/book] not anymore ...

[doc/book] dissection of a form chapter

[doc/book] move examples to a separate chapter, fix autoform module docstring

[doc/book] copious choices example

[css] fix schema css + d-t-w

[web/schemaviewer] fix bad call

[doc/book] regroup form/editcontroller stuff under an "edition control" chapter

[doc/book] complete a bit the request api

fixed unittest_wfobjs

merged back oldstable into stable

fix bad reading of options in ldapuser.py time related options have type time and not int, so use the proper function to handle conversions

[json-controller] - refactoring of js_component and js_view, it now uses _call_view - _call_view accepts paginate as a parameter

[widget] kill buggy / unused (only in cmhn) AddComboBox widget

[doc] typos

ignore annoying warnings about pygments already being imported and stuff being added to python path

[hooks/integrity & tests/entities] fix test to check for sibling error (set_operations yields a different order for constraints)

[hooks/...] fix previous commit

[hooks/operations] use set_operations for three ops (huge gains for massive imports)

[vreg repo] shouldn't call init_registration in on hook registry bootstrap, already done before

[vreg] we should now reset in init_registration since we don't do it in __init__

[web] use uiprops value to compile css transparently, handlig cache and reloading in debug mode

[webconfig] introduce property sheets. Use them to replace external_resources

[webconfig] cleanup base_url management

[webconfig] refactor/cleanup debug mode management on startup: simply use config.debugmode instead of debug argument everywhere...

Added tag cubicweb-debian-version-3.7.5-1 for changeset 2d0982252e8d

Added tag cubicweb-version-3.7.5 for changeset c476d106705e

prepare 3.7.5 release

[css] avoid repeating reset css

[css] use meyer's public domain reset css

[c-c shell] make script arguments available as __args__ in the script namespace. Use scriptargs instead of args as process_script argument name.

[management] fix vocab: use cube instead of package

[sparql] bugfix

[xy] define standard prefixes

[doc] various small improvements

fix i18ncube for pegase where we do strange things by redefining relations

[shell] #715938: support of script parameters (using standard '--' as arguments separator) Arguments after bare "--" string will not be processed by the shell command You can use it to pass extra arguments to your script and expect for them in 'scriptargs' afterwards.

[dbapi] more test and documentation of dbapi

move rarely used (imo) settings to inputlevel3 in cwctl create

default is now forthcoming cw 3.9

backport oldstable changes

backport default into stable: stable is now actually cw 3.8

replace logilab-common by CubicWeb in disclaimer

backport default into stable: stable is now cw 3.8

backport stable into oldstable: oldstable is now cw 3.7

proper licensing information (LGPL-2.1). Hope I get it right this time.

[ms] fix planning bug with rewritten constants: when removing some source for a const due to relation constraints, we should propagate this change to other constants coming from the same original variable

[repo security] deal with rewriten constant nodes in check_read_access, necessary when repo is used as an external source

[doc] reorganize for chapter structure

[web auth] remove assertion, we may want to remove authentication info retreivers to disallow login from the web ui

merge

ask pyro group config questions for all-in-one config site when pyro is enabled in serverctl.py, the pyro questions are not asked for all-in-one configs, because this is webctl.py's responsibility. However for a all-in-one instance, repo_method is "in-memory" so the pyro questions would not be asked even if pyro had been explicitely enabled before.

enforce use of environment variables when running as a service CW_INSTANCES_DIR, CW_INSTANCES_DATA_DIR, CW_RUNTIME_DIR must be positionned at the system level. This will ensure that cubicweb-ctl commands issued on the computer will use the proper directories.

added db-extra-arguments to configuration parameters for native source

Added tag cubicweb-debian-version-3.8.1-1 for changeset eb972d125eef

Added tag cubicweb-version-3.8.1 for changeset 1e074c6150fe

cubicweb-ctl create improvements * list sqlserver2005 as supported database * tell that each name must have a unique name * pass the input level to other sources that we want to configure

3.8.1

backport stable

disable CERT check

proper copyright file

[web/views] fix docstring

merge

cleanup debugging trace

[python2.6] careful: json-py provides a json package. We don't want that. To simplify usage, import json via cubicweb.web

[testlib] move _cnxs initialization before setup_database so one can login in it

[doc/book] various content fixes

[cw-shell] Write ignored scripts warning on stderr instead of stdout.

[repo] cleanup

[bfss] new storage_changed migration action to move an attribute to a custom storage. Closes #893941

[bfss] use set_operation for AddFileOp/DeleteFileOp

merge

[doc/book] move devweb up from development, turn development into devrepo (much better structure)

[doc/book] hide most XXXs

[view] better control wether same etype view should display title or not

[config] augment default value for short-line-size

cleanup debugging trace

[python2.6] careful: json-py provides a json package. We don't want that. To simplify usage, import json via cubicweb.web

[doc/book] rename images with non suffix dots to please latex

[i18n] yams constraint messages updated

[test] stop using ObjectRelation in schema

backport stable

[widgets] move form controls at the end of the file

[widgets] fix super calls, bug introduced in 5367:4176a50c81c9

[skeleton] short_desc is now description in pkginfo

[config] include cube name in warning

[c-c status] return status code 1 when some instances isn't running. Closes #510817

[schema] update for yams 0.29: BoundConstraint renamed to BoundaryConstraint; new constraint messages; ObjectRelation deprecated

[schema] cleanup

[python2.6] prefer python2.6's builtin json module over simplejson

[python2.6] don't add a name property on Thread in Python2.6 the threading.Thread class has a name attribute (used to be __name). The old code would trigger a infinite recursion.

[c-c exlog] #687204: cubicweb-ctl exlog: use a proper file and not stdin for input

[doc] restore file accidentaly deleted

[selector] allow inplace operator in selector computation Intended to facilitate overriding of existing selectors chain in view declaration. It make the code shorter and clearer when you've to import long module pathnames

Add a basic script to compare the db_schema to the fs_schema. Allow SchemaViewer to be used without a request object Most use of self.req have been hidden in method that fallback on a simple behaviour when no req are provided. Several element have been sorted to ease comparison.

le patch some_admin_doc_for_migration a été importé

[lazy view] give it a proper hole node in the no spinbox case

fix NameError

[book] start documenting the HTML form system

[form] small api cleanup and refactoring before documenting the form system

[masmailing] cleanup: use authenticated_user selectors, define stuff on form instead of on selection when possible, other cleanups

[service] do not bluntly override these things if they exist

[dbapi] some compat with distant < 3.8 repo

[3.8 api update] remaining cache keys

[doc/book] make the .css converge back to proper cwo style, fix a bunch of typos

merge

[skel] fix setup.py

[dbapi] take care vreg may not be set

[forms] no crash if restore_previous_post has not be called, has in report bug form in management.py for instance

Added tag cubicweb-debian-version-3.8.0-1 for changeset 24cc65ab2eca

Added tag cubicweb-version-3.8.0 for changeset 3c703f3245dc

3.8

[debian] don't use setuptools to build debian package

[packaging] fix setup.py for use w/ lgp

[debian] don't use setuptools to build debian package

[doc/book] a proper note (style)

[doc] replace c-c with cubicweb-ctl

[doc/book] fix wrong (https) url

[doc/book] typos

merge stable, fixing dependencies generation on c-c newcube on the way

[skel] include __recommends_cubes__ as well for completness

[dbapi] document connect() function

[skeleton/dependencies] fix typo & new cube generation from template

backport stable

[debian] depends on twisted.web instead of twisted.web2

[db-check] cleanup

[db-check] don't check entities from external sources have owned_by

[db-check] fix unexistent multisource entity detection

[db-check] fix duplicated schema constraint detection

[etwist] proper getChild implementation (eventually): fix fckeditor resources locating bugs by properly using file resources

[js] remove unnecessary log

[etwist] nicer, thouhg really not perferct) request max size exceeded support of json/frame posts

[skel] packaging fix: should build package without setuptools, and fix default for dependency_links

[controllers] cleanup unused js var

[packaging] update lgc dependency

[skel] cleanup default cube setup.py

[web] no more needed with the bytes option type

[packaging] setup.py cleanups

backport stable

[config] use bytes option type for max post length

[config] properly use time type for options representing a time.

[web] consistent cleanup session interval time

[migration] makes Yes the default answer to replace configuration file

[config] with lgc >= 0.50, option's dict inputlevel becomes level

[config] graph ordering function moved to lgc 0.50

[dbapi] fallback to Entity when etypes registry isn't initialized (weird we haven't catchi this pb before)

[json] provide a custom json encoder for entities that includes eid in the json object

[doc/book] an introduction to yams, layout tweaks

[doc/book] talk about the existing categories

[doc/book] explain what happens/to do when issuing upgrade command

[doc/book] note about reducing log level

fix docstring

[doc/book] refresh the autoform section with uicfg content (moved there)

[doc/book] complete the urlrewrite sections with examples

[doc/book] misc on views, docstrings

[doc/book] talk a bit of the Result Set class

[doc/book] add image for the breadcrumbs section

[doc/book] fix docstrings, add notes

[doc/book] complete the breadcrumbs section

[doc/book] complete/fix the dbapi stuff, including cursor

[doc/book] some fixes for vregistry, selectors & appobjects

merge

Added tag cubicweb-debian-version-3.7.4-1 for changeset fefeda65bb83

Added tag cubicweb-version-3.7.4 for changeset ec23f3ebcd34

backport stable

[doc/book] stuff a bit the publishing process (including various docstrings)

[doc/book] bitstream vera sans is a terrific font

[3.7.4] fix migration of configuration file

[config] fix #799884: do not attempt to load stuff with incorrect names which sit in cubes/

[c-c newcube] finish #676915: cubicweb-ctl newcube must be aware of python modules and debian package convention (python part already implemented)

[debian] fix bad dependency

3.7.4

i18nupdate

[migration] fix bug when trying to add a new entity type that inherit from another

[repo] fix more indentation pb in repo.glob_update_entity, causing duplicated inline relation hooks call

(implement #761403) The breadcrumb final element is now a link too. This allow getting a proper url for item fetched throught search.

[doc/book] fix a bit the request chapter, add autodoc

[migration] fix error when synchronizing everything and some schema still in the db schema but not anymore in the fs schema

don't fail on cube's pkginfo without __use__

[hook] backport bad .events fix from default

[doc/book] complete the facet section

[doc/book] change font to improve lisibility (in particular cl -> d)

[doc/book] rework the templates chapter (wipe out horrible example, talk more about structure)

[config] better *-session-time documentation and usage in session handler

[facet] fix #873742: erroenously use self.cw_rset instead of context rset

[vreg] fix traced_selection

added note about interesting page about SQL implementation differences

use MB for Megabytes, instead of french Mo

merge

[doc] save idiotic changes to some drawing

[devtools/validators] add an Xml validator able to degrade to Html validation because of views perusing demote_to_html

[vreg] fix bug introduced in 5273:c4caef6f09c9 : we should not force_reload in vreg reset done because of a set_schema

backport stable

[vreg] refactor the [re]loading process so things get clearer and fix spurious errors on edge cases

cleanup

[dbapi] fix user handling on dbapi request. Avoid getting None as _user and remove the need for a property.

[etwist] allow to specify max size for POST request in the configuration. We should deal with this nicely on the js form validation code.

[doc/book] missing .svg files, refresh .pngs, fixlets

merge

[devtools] do not forbid use of postgres as a source for tests (but it still needs proper dump/restore support)

[doc/book] regroup views chapters under common umbrella (in the development part) & some fixes

section moved to the book

fix the dosctring

[doc/book] merge controller/editcontroller

[doc/book] move a big chunk of primary view customisation example in the primary view chapter

[doc/book] refresh the style

[doc/book] kill remaining warnings

[doc/book] add a ref from hooks to adv tutorial

[doc/book] add a better standard theme

[doc/book] misc fixes

[doc/book] reorg. a bit the top-level toc, complete the windows setup part

[doc/book] complete the unit tests chapter

[doc/book] update primary view layout pic: added missing elements, removed main layout around

[doc/book] include sylvain great advanced tutorial, move tutorials in one proper section

[etwist] upgrade post max size to 200Mo until it's configurable

[web session] fix web session id bug on automatic reconnection. The web session id should keep the first connection id, then differ of the repo connection id once some reconnection has been done (since the session cookie isn't updated in such cases). Also, use a lock to avoid potential race condition on reconnection.

[packaging] 3.8 depends on lgc 0.50 (new argument to dot generator in lgc.graph)

backport stable

[views] fix bug on gc debugging view

[testlib] ctrl_publish now allow to specify the controller id as argument

[web] stop having actions configurable through cwproperties: this clutter site management and .po files for a useless fonctionnality (which, where and how actions are displayed is handled by code)

[testlib] we should not replace db-name in sources, this cause undesired side effect (when running pytest on whole cw for instance). Proper fix in logilab.database

[web] put a fake object that raise Unauthorized on any attribute access as req.cnx and req._user, so we are properly asked to authenticated on any view that tries to do something with one of those attributes (instead of doing defensive programming everywhere we're doing that)

[etwist] we must call all error not handled in _render_request, else the thread fail silently and nothing ends up on the ui

backport stable

[test] fix unittest_viewselector

[tests] fix bfss tests to match new uniquify implementation

[schema view] the final touch. Things are getting nicely displayed, and code clean

backport stable

[schema view] fixes

catalogs update

ticket #344404, cwgroup primary view improvement, use tabs to display nicely permissions

ticket #787103, relation schema view enhancements

ticket #787103, entity schema view enhancements

ticket #787032, schema view improvement

[doc/book] misc fixes/enhancements & notes

[doc/book] remove refs to aafig (it uses a sphynx extension unavailable as a .deb)

[doc/book] expand tesing material

[doc/book] add sections to the FAQ, try to reorder stuff

[doc/book] primary view section enhancements

[session] better readability

[facet] don't crash in rset_vocabulary if an unauthorized error was raised in rqlexec

[mq]: worklfow view

#773448: refactor session and 'no connection' handling, by introducing proper web session. We should now be able to see page even when no anon is configured, and be redirected to the login form as soon as one tries to do a query.

[doc/book] more flesh to views/primary view

[doc/book] remove merged chapter

[doc/book] complete chapter on hooks & ops

[storage] missing qrefresh in previous patch applied: fix comment, error message, and use a storage specified encoding, not cubicweb's encoding

[fix] fix path unicity process in BytesFileSystemStorage.new_fs_path The previous implementation was bugged (prefixing the whole path with '_' instead of the base name). A new version (using number) replace it. * * * Improve BytesFileSystemStorage.new_fs_path to use available metadata This version try to get some hint about how to name the file using metadata. Using the real file name and extension when available. Keeping the extension might be usefull for exemple in the case of processing that use filename extension to detect content-type.

[source] small refactoring to avoid being doomed by a wrong assertion message on buggy storage raising attribute error

[twisted] fix LongTimeExpiringFile and getChild implementation

merge

fix cwctl db-init -d on SQL Server

[repository] fix edited_attributes management in multiple SET queries entity.edited_attributes was messed up with previous edited entities. The UpdateStep now gives a new fresh edited_attributes set to repository.glob_update_entity() so that each entity can modify it during its "transaction".

[testlib] fix dummy bug in reset_test_database(): s/if/elif

merge

merge

merge

enable tests against sqlserver2005 database

fix bad indentation

merge

merge

merge

merge

[doc/book] more about hooks (simple examples with entities and relations)

backport stable

[web] on logout, use the base_url argument of build_url instead of hacking the request to get proper url. This fix a bug on site with http/https versions: the session cookie is badly removed on logout

[entity] move req.create_entity content to a cw_instantiate factory method on entity classes, so cube developpers will be able to easily customize instance creation

[controller] refactor send mail controller to use cwconfig.sendmails

[test] properly close session

backport stable

le patch move-pdf-export-to-cubes a été importé

[hooks] fix set_operation options passing (** -> *)

[session] no way for queries from an InternalSession to be a dbapi query

[merge]

[doc/book] begin chapter on Hooks/Operations

[doc/book] dbapi: talk about IN exception, simplify

[doc/book] rql/dbapi cleanup, rip cachekey (prematurely ?)

[doc/css] cleanup a bit the sphinx default css

[repository] fix bad indentation in glob_update_entity, source.update_entity() should be called once per update

[doc] note on pytestconf, fixlets

[test] avoid weird bug when test are changing the cwd

[c-c newcube] #1192: simpler cubicweb-ctl newcube, and more * new --layout option, to get 'simple' or 'full' cube * new --licence option to specify license for the cube * added README and sobjects.py template (the later only added in full layout) * fixed python file templates to get proper headers according to the config

[storage] consider fs_importing on update operations too

[primary] fix name error

[migration] propagate TrInfo.comment permissions fix to existing instances

[xthml] fix #696079, potential empty table cause xhtml validation error

[schema] #847739: test and fix bad permission on TrInfo.comment

[iprogress] use xml_escape instead of buggy replace

backport stable

[querier] don't need a Cache instance for rql cacke key cache

[testlib] properly close connections opened during test in tearDown

#759035: Automate addition of eid cachekey in RQL analysis

[rql annotation] add test and fix for bug introduced by 5004:4cc020ee70e2. While it sounded good, it wasn't because stinfo['relations'] didn't include anymore stinfo['typerels']

merge

merge

merged back old local changeset

fixed indentation error in devtools/__init__.py

SQL Server port: temporary table handling Together with support from logilab.database, handle temp tables for SQLServer (which are denoted by a name starting with '#', just don't ask) Note updated dependency on logilab.database 1.0.2

log RQL query in case of unexpected failure (priceless when porting to new database)

enable live test against sqlserver 2005 database

fixed skeleton help strings

[wf] should use is_in_group to avoid error with internal manager

[pkginfo] when only __depends__ is specified, deduced __depends_cubes__ from it (same thing for recommends) ; fix ad skel pkginfo on the way

[hook] fix name error in case of error on hook's .event checking

[ms] fix planning bug introduced with recent rql refactoring for queries with only eids (fix unittest_multisources.test_in_eid)

[hook] proper bad .events detection. Fix unittest_hook

backport stable

[test] _gc_debug deleted from etwist.server

[doc/book] talk about reloadComponent, misc tweaks and notes

[doc/book] add q/a on i18n customisation, misc tweaks

Switched from TwistedWeb2 to TwistedWeb - added HTTPResponse class in etwist/http.py (could be then abstracted in cubicweb/web) - added twisted.web2 http_headers.py file in cubicweb/web to handle HTTP headers conversion between raw headers and python object - deleted caching for base views (except for startup views). A better solution would be using weak entity tags (but they don't seem to be implemented in twisted.web). - added forbidden access message when browsing static local directories - tested with TwistedWeb 8, 9 and 10 TODO: ===== - Handle file uploading in forms. twisted.web seems to keep very little information (only file content) about uploaded files in twisted_request.args['input_field_name']. But it doesn't seem to keep track of filenames. Possible solutions : - use web2 code to parse raw request content still stored and available in twisted_request.content - find a magic function in twisted.web API to get the filenames - More tests.

merge

[ldap] fix email synchronization code: bad rql query + avoid integrity error on creating the address + nicer use_email / primary_email handling

[doc/book] adjust a bit

[doc/book] expand the js chapter with an ajax story

[doc] remove useless directories

temporary move

[web components] refactor as book recommends :$

more / cleaner / in code documentation of vreg, selectors and appobject

add note about running repository / client code

added information about the naming conventions in schema.py also: * some typo fix * note about ObjectRelation soon being deprecated * clarified a few hazy points

[doc/book] a new chapter on how to use the ORM

improved doc on selectors an vregistry

fix rest formatting

typo fix

merge

catch and log errors caused by bad json data

list allowed values for ldap protocol setting in help, so that the generated file includes this in a comment

[doc/book] enhance i18n section #656191

[doc] more (doc oriented) feature in list

[doc] enhanced setup section: fix sections'level, more postgres tips, merge environment doc with cwconfig.py module docstring using custom autodocstring directive

[doc] enhanced concepts section

remove ref to no more existing file

[cleaning] simpler implementation of cmd_create_entity

[storages] fix fs_importing side-effect on entity.data When creating a new File object, if fs_importing is set, we want entity.data to be the file content instead of the filepath for the rest of the transaction. (see test_bfss_fs_importing_transparency) for test implementation To make this possible, the storage hooks (entity_added / entity_updated) must return the correct value to set in the entity dict.

nicer warning

[doc] started full features list

[python] take care to this detail of @contextmanager: if an unhandled exception occurs in the block, it is reraised inside the generator at the point where the yield occurred

[entity] explain why the assert failed

[test] fix expected error

fix bad merge

fix #822890, missing argument on abstract source backup method make backup failed on multi-sources instances

merge

[schema] ensure we don't remove has_text relation type unfortunatly

merge

Added tag cubicweb-debian-version-3.7.3-1 for changeset 44c7bf90df71

Added tag cubicweb-version-3.7.3 for changeset 768beb8e15f1

[distrib] fix pkginfo

3.7.3

[hooks] better message on bad .event class attribute

[repository] forbid usage of set_attributes() in before_add_entity set_attributes() will generate a RQL query that will silently fail. An explicit error is better. You can still use the ``entity[attr] = value`` notation that won't generate a SQL query but still update the inner state of the entity and its edited_attributes attribute.

merge

[cleanup] tb already printed by self.exception; add note

[facet] fix 'bookmark this search': * vid wasn't included in the link generated by the facet box * proper url quoting in both js / box code (try an has_text search with '&' inside...)

[widget] more wide textarea on bookmark edition

[distribution] the web/data/images directory has to be handled in pkginfo

[test] use the new temporary_appojects CM to simplfy unittest_storage

[session] try to reconnect on unexpected error in system_sql. We need this for proper reconnection of pool used by hooks or looping task doing sql queries (such as cw_cleanup_transaction)

[source] log attempt to reconnect using warning level. Also, don't relog failed sql (already logged)

[test] avoid critical log by informing the source we consider Personne as a multi-sources type

[test] use new temporary_appobjects context manager

[test] that doesn't smell good but fix the test...

[vreg] we do want the opposite...

[testlib] simple helper method to register temporary appobjects (hooks for instance) with a context manager

[undo] fix transactions table name in cleanup operation

Add context management methode to dbapi.Connection the connection is automaticly closed when exiting the context.

i18n update

[i18n] use named substitution to avoid gettext warnings

[dataimport] print transaction id when we get one

[cleanup] add some notes

[optimisation] _select_best is used very intensivly. Peanuts optimization may count :)

[optimization] traced_selection is used very intensively in debug mode optimizing it is worth the pain. Basically : don't do stuff unnecessary when we don't trace anything.

[optimization] improve massive write performance by optimizing hooks selection profiling on some massive deletion showed up that 2/3 of the time was spent in hooks selection. Those changes make it much more acceptable (through selection is still not negligeable): * use one registry for each event, so we've much less hooks to check when emiting an event as well as no more need for the match_event selector. This required ability to put one appobject into several registries, using a __registries__ class attribute. * check for deprecated .enabled at registry initialization time instead of at selection time A very simple HooksManager class has been reintroduce to choose the right registry on call_hooks. Those optimisations leads to a ~x3 factor of time necessary to delete 16000 entities.

[upgrade] after upgrade, fork command to start instance avoid grave uicfg pb (explicit rules all removed...)

merge

[repo creation] removing existing entities of 'single' cardinality relatino should be considered as 'activeintegrity' hook. Also don't disable that category during repo creation to avoid pb such as two default workflows for one entity types

merge

handle Service Close request correctly (closes #736039) The windows event self._stop_event was not used, and twisted was not getting a chance of terminating cleanly by calling its shutdown event handlers (which would eventually call pyro_unregister). Fixed by calling reactor.stop()

[js form validation] fix case where we've None/null keys in the errors dictionnary

[cleanup] exists imported, use it

[form] CompoundField should not return itself in actual_fields, this avoid error on iliane with 3.7.2 where it's marked as required (from the schema) while value are provided by subfields

[repo] we want a hooks manager and hooks initialized event on quick start (we trigger events such as server_backup / server_restore for instance)

[distribution] sql extensions files now have proper extension, fix manifest file

backport stable

[events manager] onevent decorator may be given extra arguments to give to em.bind

[cleanup] some notes

[reload] on registry reloading, we should change class of users of opened session

[appobject imports] don't include __init__ in package's name. See comment for more info

[rset] cubes such as iliane hi-jack rset description by poping some lines from it. Handle this on RepeatList

[undo] basic support for undoing of entity creation / relation addition

[undo] init entity cache when undoing an entity deletion

[undo] consistent is/is_instance_of processing

[repo] don't need rset description on those queries

[cleanup] style fixes, add nodes, 0.2 cents refactorings

[undo] during undoing, call hooks in the [active]integrity and undo categories

[repo] refactor fti operation to use set_operation and a single operation whatever the number of entities to ft index

[querier] introduce RepeatList class, used to optimize size of data returned for result set description When rql query has no ambiguity, we used to return the same description * N where N is the size of the result set. Returning RepeatList class avoid that multiplication. According to quick benchmark this improve performance for result set whose size is ~ > 50, has very small penalty for rset < 50, and in any case improve the size of data to be transfered over the network through pyro connection.

[repo] on add entity, set cache as soon as possible + fill type/source cache

[repo] more efficient eid cache operations handling based on set_operation; refactor * split CleanupEidTypeCache operation into one operation for deleted eids and another for added eids, and put them in cw.server.hook * for consistency, move fti unindexing handling from the repository to the system source * handling of deleted eids is done in plan execution (ssplanner), no needs to redo it in *delete_info -> no more need for _prepare_delete_info method, killed

[repo] move eschema_eid function from hooks.metadata to server.utils

[primary view] skip virtual rtypes anyway

[test] CubicWebTC.create_user expect an actual query, and we don't need to give session here

[dataimport] stop disabling undo ; commit return transaction id

[logging] demote static file served to debug

[cleanup]

[repo] optimize massive insertion/deletion by using the new set_operation function Idea is that on massive insertion, cost of handling the list of operation become non negligeable, so we should minimize the number of operations in that list. The set_operation function ease usage of operation associated to data in session.transaction_data, and we only add the operation when data set isn't initialized yet, else we simply add data to the set. The operation then simply process accumulated data.

[repo] make etype which should go in deleted_entities configurable: we only need this for types imported from other multi-sources instances

[repo] don't execute child step twice in EntitiesDeleteStep

[form] consider autoform_field_kwargs for meta fields; allow required customization

[workflow] support for automatic transition starting from the initial state

[testlib] create_user support extra kwargs to give to create_entity(CWUser)

fix dataimport for 3.7.2

use lgc.testlib.TestCase

backport stable

Added tag cubicweb-debian-version-3.7.2-1 for changeset 8fda29a6c219

Added tag cubicweb-version-3.7.2 for changeset d010f749c21d

take care to empty string in cubes search path

backport stable

[ms] fix name error introduced by rql 0.26 api update

add note

3.7.2

[selectors] new is_in_state select to avoid common error when writing state based selector

[repo config] cleanup read_instance_schema / bootstrap_schema / creating mess

fix #726167: i18ninstance use data in bootstrab_cubes instead of the database one

[cleanup] remove 3.7 deprecation warning

[form controller] clear caches in case some attribute participating to the rest path has been modified, avoid redirection to a no more existant page (fix #753567)

i18nupdate

[form] fix validation error handling * type when possible ValidationError raised by the edit controller * don't rely on repository to check required field * turn css class used for field error message to errorMsg to avoid confusion with the error class added to input * fix css when errors are added by the form renderer * fix form renderer to add the error message

[captcha] handle captcha validation properly in the captcha widget also, avoid error if pil isn't installed (only a recommendation)

[testlib] __errorurl may be a relative path, check we're actually removing base url first

[i18ncube] clear_rtag_objects imported when generating cube's .po file

[maintainance] don't crash if we've no in-memory repository

[db dump/restore] fix '#615840: db-dump must be always runnable' by setting repairing on config. Also, avoid to read the whole schema from the database on dump/restore: the bootstrap schema is enough.

cleanup

__missing__ main

[form] put qualified name on validation error, should fix #784299

[test] fixes when executed under apycot environment (also added ldap1 to test host /etc/hosts)

...

[config] move ConfigurationProblem to migration + refactor it to benefit from config methods

[config] more cleanup

deprecate __use__ and __recommend__

add egg support with dependencies auto-installation

fix dumb name error

fix _cubes dir

handle nicely typical installation other than debian package / mercurial forest * new _find_prefix method to detect installation prefix (maybe specified using CW_INSTALL_PREFIX environment variable) * set various resource accessors according to this, cleanup on the way * remove no more necessary APYCOT_ROOT hacks

When a TC failed to initiliase the database, the following test are SKIPPED When a TC failed to initiliase the database, the other test of the same TestCase are skipped with an explicite message instead of failing later for with an unrelated message.

[c-c] new server_maintenance hook, called on c-c shell / upgrade

[appobject] add version number to deprecation warning

update rql dependency

backport stable

fix migration script

[cleanup] useless try except

[source storage] refactor source sql generation and results handling to allow repository side callbacks for instance with the BytesFileSystemStorage, before this change: * fspath, _fsopen function were stored procedures executed on the database -> files had to be available both on the repository *and* the database host * we needed implementation for each handled database Now, those function are python callbacks executed when necessary on the repository side, on data comming from the database. The litle cons are: * you can't do anymore restriction on mapped attributes * you can't write queries which will return in the same rset column some mapped attributes (or not mapped the same way) / some not This seems much acceptable since: * it's much more easy to handle when you start having the db on another host than the repo * BFSS works seemlessly on any backend now * you don't bother that much about the cons (at least in the bfss case): you usually don't do any restriction on Bytes... Bonus points: BFSS is more efficient (no queries under the cover as it was done in the registered procedure) and we have a much nicer/efficient fspath implementation. IMO, that rocks :D

[bfss] fix name error

[source storage] on deletion, entity has no edited_attributes

[cleanup] rename dbms_helper to dbhelper for consistency

[entity] we also have to override dict.pop to properly maintain edited_attributes consistency

[bfss test] some minor refactoring. Test deletion + creation/update/deletion rollback

don't put hooks deleting orphan composites into the 'integrity' category, we usually want it when integrity is deactivated

[facet] allow to specify a target type on relation facets for case such as Keyword/CodeKeyword where we only targets Keyword

don't rewrite config's url during migration

le patch rql26 a été importé

backport stable

[D] book: update backup procedures in additional tips