Synnefo

pithos: Add default Archipelago config file

Add new constant ArchipelagoConfFile for the default Archipelago
config file. Set ArchipelagoConfFile after calling setupXsegPool
function.

pithos: New constants in ModularBackend class

Introduce new constants archipelago_conf_file and xseg_pool_size
in ModularBackend class. The new constant DEFAULT_ARCHIPELAGO_CONF_FILE
is set in the default path '/etc/archipelago/archipelago.conf'.

Create the XSEG Object Pool while initializing ModularBackend class.

pithos: Use synnefo.settings in backend/__init__.py

pithos: pep8 fixes

pithos: Change relative import "base"

Relative import "base" should be "pithos.backends.base"

pithos: Do not put xseg request before map retrieval

During map_retr_archipelago, we should not put the xseg request which fetched
the map data, before actually retrieving them.

The ctypes "from_address" method, does not copy the data where the pointer
points. It simply creates a ctypes instance using the given memory. Ctypes...

pithos: Add monkey patch for making XSEG Request go green

pithos: Add Archipelago Blocker and Mapper

pithos: Add support for recognizing Archipelago Volumes

Fix mapfile support the new snapshot naming

Introduce new IllegalOperationError exception

Add access control to Archipelago Volume hashmaps and blocks.
Raise an IllegalOperationError exception when trying to update an...

Merge branch 'release-0.15' into develop

Conflicts:
ci/utils.py
version

pithos: Further code refactoring in _list_objects()

pithos: Reduce astakosclient instances

Use backend astakosclient instance to query the account quotas.

pithos: Fix ordering in detailed listing of public objects

Refs: #4727

pithos: Slight modifications in file-show command

• Search by object UUID
• Do not display hashmap by default

Merge branch 'master' into develop

Conflicts:
Changelog
astakosclient/astakosclient/keypath.py
ci/utils.py
docs/admin-guide.rst
snf-astakos-app/astakos/im/cookie.py
snf-astakos-app/astakos/im/functions.py
snf-astakos-app/astakos/im/quotas.py
snf-astakos-app/astakos/im/views/projects.py...

snf-pithos-app: Use the new AstakosClient

pithos: Fix permission listing for objects containing / in their name

Add tests

pithos: Do not report size change in move folder operation

Refs: #4154

Resolve some undefined names

Add missing imports; remove call to sqlite3_changes; set key and val
in render_meta.

pithos: Fix typo in _get_permissions_path_bulk function

pithos: Fix timestamps

pithos: Optimize latest_attribute_keys

pep8 fixes

Merge branch 'feature-pithos-performance-optimizations-develop' into feature-pithos-performance-optimizations-perf

pithos: Optimize latest_version_list query

Merge branch 'hotfix-0.14.6' into develop

Conflicts:
Changelog
docs/admin-guide.rst
snf-cyclades-app/synnefo/api/management/commands/network-remove.py
snf-cyclades-app/synnefo/api/servers.py
snf-cyclades-app/synnefo/api/tests/servers.py
snf-cyclades-app/synnefo/logic/backend.py...

pithos: Add missing locks

_lookup_container() locks the container path
but it was not called from some write backend methods
that expect the container path to be locked.

In such cases optionally _lookup_object() calls
the _lookup_container() in order to lock the container path.

pithos: Acquire locks in alphabetical path order in copy object

pithos: Use pithos backend as context manager

Substitue pre_exec() and post_exec()

Revert "pithos: conditional select for update in lookup account"

This reverts commit 8a7ddfb0545348849d99fb686fec51659cbead58.

Select for update is not useful in case of account creation.
If there is no such account, 0 rows are returned
so there are no rows locked.

pithos: Remove obsolete backend method

pithos: Destroy test database after test execution
:
Pithos uses a pool for the backend objects.
Pooled backend objects override the default close behavior
and return the object to the pool instead.
Therefore, django was unable to destroy the database
since there were active connections....

pithos: Fix delete deleted object

Delete object used to create a new object version flagged as deleted
regarless of the status of the previous version.
However, delete requests of a deleted object
should return 404 (NOT FOUND) response.

Merge branch 'hotfix-0.14.5' into develop

Conflicts:
snf-pithos-backend/pithos/backends/modular.py
version

pithos: Fix TypeError when trying to retrieve invalid object version

pithos: Do not report size change in move object operation

Refs: #4154

pithos: Fix reconcile-resource-pithos command

• Improved performance (reduce interaction with the database)
• Fix command when `userid` option is provided

Conflicts:
snf-pithos-app/pithos/api/management/commands/reconcile-resources-pithos.py
snf-pithos-backend/pithos/backends/lib/sqlite/node.py

pithos: Update/extend tests

pithos backend: Introduce debug_method decorator

Substitute debug statements with a backend method decorator
which registers the method execution arguments, the return values
and the exceptions occured.

pithos: Add missing blocksize attribute to blocker.

Blocksize was undefined for the blocker that combines files and rados objecsts.
Define it, according to the block parameters.

pithos: Fix attribute copy

The newly created attributed used to point in the source node
instead of the destination

Refs: 3510

pithos backend: Extend list domain objects method

This method optionally accepts a user paramter and used to return
the objects shared to the user and having a specific domain.
This commit extends this functionality and returns also the objects
owned by the user and having the specific domain...

pithos: improve performance of get_domain_list

Before it used to query the database
for all the objects having the specific domain
and finally filtered out the objects to which the user had no access.
Now gets first the allowed_paths for the user and then...

pithos backend: Extend list domain objects method

This method optionally accepts a user paramter and used to return
the objects shared to the user and having a specific domain.
This commit extends this functionality and returns also the objects
owned by the user and having the specific domain...

pithos: backend.util pep8 fixes

pithos: Restore sqlite backend module

pithos: fix syntax in sqlite backend

pithos: return always etag

Refs: #3554

If update md5 is deactivated Pithos does not return an etag header.
Pithos in that case should return the merkle hash as etag

pithos: move transaction managment and quotaholder sync in frontend

Remove backend_method decorator and move logic in the pithos api method

Conflicts:
snf-pithos-app/pithos/api/util.py

pithos: fix empty account usage computation

Usage computation for empty accounts used to fail with:
TypeError: 'NoneType' object is unsubscriptable

pithos: move transaction managment and quotaholder sync in frontend

Remove backend_method decorator and move logic in the pithos api method