Synnefo

pithos: Revert pep8 changes from sqlalchemy ClauseElements

pep8 complains for comparison with boolean in sqlalchemy.sql.expression.ClauseElement
with "E712 comparison to True should be 'if cond is True:' or 'if cond:'"
but sqlalchemy does not understand it otherwise.

pithos: Fix migrations

Some data migrations require to import pithos app settings.
These migrations used to fail in nodes where snf-pithos-app
is not installed.
Disable these migrations if they fail to import the necessary settings.

pithos: pep8 fixes

pithos: Fix attribute copy

The newly created attributed used to point in the source node
instead of the destination

Refs: 3510

pithos backend: Extend list domain objects method

This method optionally accepts a user paramter and used to return
the objects shared to the user and having a specific domain.
This commit extends this functionality and returns also the objects
owned by the user and having the specific domain...

pithos: improve performance of get_domain_list

Before it used to query the database
for all the objects having the specific domain
and finally filtered out the objects to which the user had no access.
Now gets first the allowed_paths for the user and then...

pithos backend: Extend list domain objects method

This method optionally accepts a user paramter and used to return
the objects shared to the user and having a specific domain.
This commit extends this functionality and returns also the objects
owned by the user and having the specific domain...

pithos: backend.util pep8 fixes

pithos: Restore sqlite backend module

pithos: fix syntax in sqlite backend

pithos: return always etag

Refs: #3554

If update md5 is deactivated Pithos does not return an etag header.
Pithos in that case should return the merkle hash as etag

pithos: move transaction managment and quotaholder sync in frontend

Remove backend_method decorator and move logic in the pithos api method

Conflicts:
snf-pithos-app/pithos/api/util.py

pithos: fix empty account usage computation

Usage computation for empty accounts used to fail with:
TypeError: 'NoneType' object is unsubscriptable

pithos: move transaction managment and quotaholder sync in frontend

Remove backend_method decorator and move logic in the pithos api method

pithos: conditional select for update in lookup account

pithos: update pithos statistics computation

Compute account statistics instead of storing them in the database
Fix container statistics computation
Related commit: 3a9f1f113c1e2c853b7ae223fbcbb843d19f7f95

pithos: update recursively statistics up to the container level

To achieve atomicity we lock the container path.
However, the write operations update the statistics for the ancestor
nodes (container/account).
Therefore, the backend restricts the recursion up to the container...

pithos-backend: disable AstakosClient if no URL given

If the backend is initialized with astakos_url=None,
or AstakosClient cannot be imported,
a fake AstakosClient is instantiated which will raise
an AssertionError on any attempt to access it.

Read-only uses of pithos backend, as in pithcat,...

pithos: remove dependency from synnefo.lib.queue.Receipt

Merge branch 'tmp-pithos-db-escape-warning' into develop

pithos: Remove obsolete settings from database migrations

Use astakosclient to retrieve user information

pithos: Update pithos management commands

Refs: #3625

WIP astakosclient for quotas in pithos

pithos:Ensure serial registration before commission

Commit transaction before accepting the commission
and delete registered serials after successful commission.

Refs: #3594

pithos: use other db escape string literal character

Refs: #3645

pithos backend: update get_domain_objects method

Rename and change it to backend method
(add the backend_method decorator)

Fix trasactionless query in pithos sqlite backend init

Refs: #3580

pithos: Fix container quota violation control

Pithos backend before performing the quota violation checks
creates a new version of object and updates the
usage of the ancestor nodes (the container).

In Postgresql SELECT does see the effects
of previous updates executed within its own transaction...

Fix pithos-reconcile-commissions command

Get pending commissions specifically for pithos

Refs: #3594

Move astakos lib from snf-common to snf-django-lib

Change pithos backend DEFAULT_PUBLIC_URL_SECURITY

Change value from 8 to 16, to conform with the default
PITHOS_PUBLIC_URL_SECURITY setting.

Change pithos public implementation

Public URLs should consist of a random part.
A public URL should be unique and should not be
equal to any deleted public URL.
Finally publishing a public object has no effect.
Therefore, to generate a new public URL for an...

Fix pithos purging accounting

Refs: #3442
Refs: #1733

• free: do not include object history version size
  to the total account usage
• debit: include object history version size to
  the total account usage...

Fix UUID bug breaking image list and VM creation

latest_uuid(uuid) returned the latest version with the given uuid.
This is called from pithos backend method get_uuid(),
which is called from plankton backend method get_image().

For the use in get_image() the uuid alone is not enough,...

set DJANGO_SETTINGS_MODULE for pithos-migrate

Update pithos migration

Display progress

Pithos stop unnecessary contacts with quotaholder

Do not issue commission if there is not size change

Provide command for managing pithos duplicate accounts

Merge branch 'feature-rados' into develop

Conflicts:
snf-pithos-app/README

Merge branch 'feature-projects' into develop

Change error handling in uuid to displayname pithos path migration.

Stop migraton if it fails to retrieve a uuid/displayname.

Expose /user_catalogs service api call

Change migration scripts to use this instead of the user api call

Fix exception handling in RADOS blocker/mapper

Handle only KeyError exception in blocker/mapper initialization, and propagate
all other, as they indicate errors.

Restore container policy check

Optionally import rados

Merge branch 'radosblocker' of https://code.grnet.gr/git/pithos into latest-quota

Conflicts:
snf-pithos-app/pithos/api/util.py
snf-pithos-backend/pithos/backends/modular.py
snf-pithos-backend/pithos/backends/util.py

Return quotaholder holding in pithos backend

Merge branch 'latest-quota' of https://code.grnet.gr/git/synnefo into latest-quota

Conflicts:
snf-astakos-app/astakos/im/forms.py
snf-astakos-app/astakos/im/functions.py

Fix pithos versioning (better implementation)

Migrate username to uuid in pithos permissions