Statistics
| Branch: | Tag: | Revision:

root / snf-pithos-backend / pithos @ 329b8349

# Date Author Comment
329b8349 01/29/2014 05:35 pm Sofia Papagiannaki

pithos: Resolve db migration conflict

57310278 01/29/2014 04:48 pm Sofia Papagiannaki

pithos: Change default value for PITHOS_BACKEND_MAP_CHECK_INTERVAL.

e0525d86 01/29/2014 04:12 pm Sofia Papagiannaki

pithos: Evaluate "available" during object metadata access

7be22e8d 01/29/2014 04:11 pm Chrysostomos Nanakos

pithos: Use new Archipelago conffile for mapper

472353d4 01/29/2014 04:11 pm Chrysostomos Nanakos

pithos: Use new Archipelago conffile for glue

844542e5 01/29/2014 04:11 pm Chrysostomos Nanakos

pithos: Adjust glue for XSEG dynamic port allocation

XSEG now supports dynamic port allocation. Pithcat instances can run
simultaneously by utilizing this new feature providing support for
Archipelago volumes.

876d7486 01/29/2014 04:11 pm Sofia Papagiannaki

pithos: Lazy evaluation of "available" attribute

Whenever the backend tries to access the object's content
checks its database records whether the snapshot map is available or not.
If it is not, it pings Archipelago to check the status of the map.
If the map exists, then it updates the snapshot record in the Pithos...

eaaec098 01/29/2014 04:11 pm Sofia Papagiannaki

pithos: Database migration for "available" attribute.

863d25a5 01/29/2014 04:11 pm Filippos Giannakos

pithos: Close archipelago resource after reading it.

Archipelago implicitly opens a resource after reading the map file. So we should
close it, after successfully reading it.

ba9df843 01/29/2014 04:11 pm Chrysostomos Nanakos

pithos: Use new Archipelago conffile for blocker

f62290bb 01/29/2014 03:53 pm Chrysostomos Nanakos

pithos: pep8 fixes

be433794 01/29/2014 03:53 pm Chrysostomos Nanakos

pithos: Move Xseg Pool initialization

Move Xseg Object Pool initialization to hashfiler module

26dff0ef 01/29/2014 03:53 pm Chrysostomos Nanakos

pithos: Add snf-image support

809b482a 01/29/2014 03:53 pm Chrysostomos Nanakos

pithos: Add default Archipelago config file

Add new constant ArchipelagoConfFile for the default Archipelago
config file. Set ArchipelagoConfFile after calling setupXsegPool
function.

9b3a95f1 01/29/2014 03:53 pm Chrysostomos Nanakos

pithos: Use new ArchipelagoConfFile constant

Remove BACKEND_ARCHIPELAGO_CONF and use the new ArchipelagoConfFile
introduced in WorkerGlue class.

b20f5e4a 01/29/2014 03:53 pm Chrysostomos Nanakos

pithos: New constants in ModularBackend class

Introduce new constants archipelago_conf_file and xseg_pool_size
in ModularBackend class. The new constant DEFAULT_ARCHIPELAGO_CONF_FILE
is set in the default path '/etc/archipelago/archipelago.conf'.

Create the XSEG Object Pool while initializing ModularBackend class.

b6e93a67 01/29/2014 03:53 pm Chrysostomos Nanakos

pithos: Use synnefo.settings in backend/__init__.py

cbe81673 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: pep8 fixes

34f3d4fa 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Change relative import "base"

Relative import "base" should be "pithos.backends.base"

8b1719d2 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Remove unused import objpool

e7682feb 01/29/2014 03:52 pm Filippos Giannakos

pithos: Do not put xseg request before map retrieval

During map_retr_archipelago, we should not put the xseg request which fetched
the map data, before actually retrieving them.

The ctypes "from_address" method, does not copy the data where the pointer
points. It simply creates a ctypes instance using the given memory. Ctypes...

32293ec0 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Add Archipelago Blocker and Mapper

a1557c9c 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Remove File - RADOS Blocker and Mapper

Add new constant for Archipelago configuration file in pithos API,
PITHOS_BACKEND_ARCHIPELAGO_CONF

1e47e49d 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Add support for recognizing Archipelago Volumes

Fix mapfile support the new snapshot naming

Introduce new IllegalOperationError exception

Add access control to Archipelago Volume hashmaps and blocks.
Raise an IllegalOperationError exception when trying to update an...

e851ad95 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Introduce new register_object_map function

Register an object without providing any data. Cyclades can
use this function to register a newly created VM snapshot

f75f40cb 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: pep8 fixes

91b63720 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Add Gevent Gunicorn Worker for Archipelago

6a6aed61 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Add glue code for Archipelago XSEG Object Pool and Gunicorn

5dd1a322 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Add monkey patch for making XSEG Request go green

660ee574 01/29/2014 03:52 pm Chrysostomos Nanakos

pithos: Add configuration file for Gunicorn

Make workers delegate only one XSEG port pool

caf6cb1f 01/29/2014 03:46 pm Christos Stavrakakis

Merge branch 'release-0.15' into develop

Conflicts:
snf-deploy/snfdeploy/__init__.py
version

73c37386 01/29/2014 01:41 pm Sofia Papagiannaki

pithos: Database data migration for the plankton properties.

0d573e18 01/14/2014 05:46 pm Sofia Papagiannaki

pithos: Reduce database interactions for access control.

Each frontend method calls several backend methods.
Each backend method checks whether the user has permission to access the
specific path.
This results to several identical queries to the database....

ebdbac7a 01/14/2014 03:39 pm Sofia Papagiannaki

pithos: Reduce database interactions for access control.

Each frontend method calls several backend methods.
Each backend method checks whether the user has permission to access the
specific path.
This results to several identical queries to the database....

680dd4b8 01/09/2014 01:18 pm Ilias Tsitsimpis

Merge branch 'release-0.15' into develop

Conflicts:
ci/utils.py
version

e5b77cde 12/23/2013 02:45 pm Sofia Papagiannaki

pithos: Simplify code for applying listing limits

Use a decorator instead

9c6ddb46 12/23/2013 02:45 pm Sofia Papagiannaki

pithos: Further code refactoring in _list_objects()

ec6f741b 12/23/2013 02:00 pm Sofia Papagiannaki

pithos: Reduce astakosclient instances

Use backend astakosclient instance to query the account quotas.

3b8f938b 12/23/2013 01:36 pm Sofia Papagiannaki

pithos: Reduce astakosclient instances

Use backend astakosclient instance to query the account quotas.

b045ca90 12/16/2013 05:44 pm Sofia Papagiannaki

pithos: Reduce interaction with the database

2c2513fc 12/11/2013 12:20 pm Sofia Papagiannaki

pithos: Fix ordering in detailed listing of public objects

Refs: #4727

ba402621 12/07/2013 11:59 am Sofia Papagiannaki

pithos: Fix ordering in detailed listing of public objects

Refs: #4727

91fc9266 12/03/2013 04:01 pm Sofia Papagiannaki

pithos: Slight modifications in file-show command

  • Search by object UUID
  • Do not display hashmap by default
135f864e 11/25/2013 03:43 pm Sofia Papagiannaki

pithos: Fix unbound reference

80a548e3 11/11/2013 12:59 pm Christos Stavrakakis

Merge branch 'master' into develop

Conflicts:
Changelog
astakosclient/astakosclient/keypath.py
ci/utils.py
docs/admin-guide.rst
snf-astakos-app/astakos/im/cookie.py
snf-astakos-app/astakos/im/functions.py
snf-astakos-app/astakos/im/quotas.py
snf-astakos-app/astakos/im/views/projects.py...

5d022141 11/01/2013 03:09 pm Sofia Papagiannaki

pithos: Decorate backend methods for transaction management

The decorator checks whether
the frontend has initiated a database transaction
and if not it wraps the backend method inside a new transaction
and handles the failures.

Conflicts:
snf-pithos-backend/pithos/backends/modular.py

f759041f 10/29/2013 04:15 pm Ilias Tsitsimpis

snf-pithos-app: Use the new AstakosClient

6c9df07c 10/29/2013 01:46 pm Sofia Papagiannaki

pithos: Handle database errors during permission updates

Refs: #4502

e161c24f 10/25/2013 06:36 pm Sofia Papagiannaki

pithos: Fix permission listing for objects containing / in their name

Add tests

d3c34119 10/22/2013 07:44 pm Sofia Papagiannaki

pithos: Update/fix sqlite backend module

277faddf 10/21/2013 11:46 am Sofia Papagiannaki

pithos: Do not report size change in move folder operation

Refs: #4154

96f9f6fd 10/17/2013 04:34 pm Sofia Papagiannaki

pithos: Delete rejected quotaholder serials

3d5906fe 10/16/2013 06:21 pm Giorgos Korfiatis

Resolve some undefined names

Add missing imports; remove call to sqlite3_changes; set key and val
in render_meta.

ace7592b 10/09/2013 12:43 pm Sofia Papagiannaki

pithos: pep8 fixes

62e6d12e 10/08/2013 05:16 pm Nanakos Chrysostomos

pithos: Fix typo in _get_permissions_path_bulk function

ae0a4858 10/03/2013 02:52 pm Nanakos Chrysostomos

pithos: Fix latest version list with specific timestamp

Return the sorted list of the latest attributes keys

87835e94 10/02/2013 11:27 pm Nanakos Chrysostomos

pithos: Fix timestamps

569f852b 10/02/2013 10:47 am Nanakos Chrysostomos

pithos: Remove unused variable.

4a7b190f 09/30/2013 03:25 pm Nanakos Chrysostomos

pithos: Optimize latest_attribute_keys

pep8 fixes

b83df225 09/23/2013 09:49 pm Nanakos Chrysostomos

pithos: Optimize xfeature_get_bulk query

e751cad7 09/20/2013 01:07 pm Nanakos Chrysostomos

Merge branch 'feature-pithos-performance-optimizations-develop' into feature-pithos-performance-optimizations-perf

e98c5561 09/19/2013 05:46 pm Nanakos Chrysostomos

pithos: Further optimize latest_version_list query

76da16c3 09/19/2013 04:05 pm Nanakos Chrysostomos

pithos: Optimize latest_version_list query

7fef13f0 09/19/2013 12:30 pm Nanakos Chrysostomos

pithos: Optimize statistics_latest subquery

ed2064f8 09/18/2013 05:17 pm Christos Stavrakakis

Merge branch 'hotfix-0.14.6' into develop

Conflicts:
Changelog
docs/admin-guide.rst
snf-cyclades-app/synnefo/api/management/commands/network-remove.py
snf-cyclades-app/synnefo/api/servers.py
snf-cyclades-app/synnefo/api/tests/servers.py
snf-cyclades-app/synnefo/logic/backend.py...

16b0ed4a 09/17/2013 11:27 am Nanakos Chrysostomos

pithos: Fixed missing _get_permissions_path function.

683d4324 09/16/2013 05:39 pm Sofia Papagiannaki

pithos: Add missing locks

_lookup_container() locks the container path
but it was not called from some write backend methods
that expect the container path to be locked.

In such cases optionally _lookup_object() calls
the _lookup_container() in order to lock the container path.

dc88754b 09/16/2013 04:19 pm Nanakos Chrysostomos

pithos: Performance Optimizations in Object Listing.

a06c276e 09/12/2013 02:34 pm Sofia Papagiannaki

pithos: Acquire locks in alphabetical path order in copy object

d47565d8 09/12/2013 01:09 pm Build Bot

Revert "pithos: Use pithos backend as context manager"

This reverts commit 23b41f6fefa1a066748810c4642e58e18a4b83f9.

23b41f6f 09/12/2013 11:06 am Sofia Papagiannaki

pithos: Use pithos backend as context manager

Substitue pre_exec() and post_exec()

48bb9c89 09/12/2013 10:22 am Sofia Papagiannaki

pithos: Add missing locks

_lookup_container() locks the container path
but it was not called by some write backend methods
which expected the container path to be locked.

In those cases optionally _lookup_object() calls
the _lookup_container() in order to lock the container path....

af395b9c 09/12/2013 10:15 am Sofia Papagiannaki

Revert "pithos: conditional select for update in lookup account"

This reverts commit 8a7ddfb0545348849d99fb686fec51659cbead58.

Select for update is not useful in case of account creation.
If there is no such account, 0 rows are returned
so there are no rows locked.

3a5994a8 09/09/2013 01:59 pm Sofia Papagiannaki

Pithos: Catch invalid hashmap input

Refs: #3745

76ef2478 09/09/2013 01:59 pm Sofia Papagiannaki

pithos: Remove obsolete backend method

f6d499b0 09/04/2013 07:49 pm Sofia Papagiannaki

pithos: Set attr lock_container_path during backend initialization

de8fb87d 09/02/2013 03:40 pm Sofia Papagiannaki

pithos: Destroy test database after test execution
:
Pithos uses a pool for the backend objects.
Pooled backend objects override the default close behavior
and return the object to the pool instead.
Therefore, django was unable to destroy the database
since there were active connections....

6e0f3e65 08/08/2013 05:40 pm Sofia Papagiannaki

pithos: Fix shared listing for implicitly shared objects

Provide also the appropriate tests

Refs: #4131

33af031c 08/08/2013 12:42 pm Sofia Papagiannaki

pithos: Fix delete deleted object

Delete object used to create a new object version flagged as deleted
regarless of the status of the previous version.
However, delete requests of a deleted object
should return 404 (NOT FOUND) response.

b1aca3e6 08/08/2013 12:12 pm Sofia Papagiannaki

pithos: Fix backend logging.

  • Log unicode arguments
  • Do not log get_block return value (too long)
057c0977 08/07/2013 11:33 am Christos Stavrakakis

Merge branch 'hotfix-0.14.5' into develop

Conflicts:
snf-pithos-backend/pithos/backends/modular.py
version

d2fc71c9 08/05/2013 05:02 pm Sofia Papagiannaki

pithos: Fix access object version data/metadata

adce84cd 08/02/2013 08:02 pm Sofia Papagiannaki

pithos: Fix TypeError when trying to retrieve invalid object version

d4e4e501 07/25/2013 12:46 pm Christos Stavrakakis

Merge branch 'hotfix-0.14.3' into develop

Conflicts:
Changelog
snf-astakos-app/astakos/im/messages.py
snf-pithos-app/pithos/api/manage_accounts/__init__.py
snf-pithos-app/pithos/api/management/commands/reconcile-resources-pithos.py
snf-pithos-app/pithos/api/settings.py...

9e3a38bb 07/23/2013 03:33 pm Sofia Papagiannaki

pithos: Do not report size change in move object operation

Refs: #4154

96090728 07/22/2013 06:40 pm Sofia Papagiannaki

pithos: Fix line continuation format

2ff02341 07/22/2013 06:19 pm Sofia Papagiannaki

pithos: Fix reconcile-resource-pithos command

  • Improved performance (reduce interaction with the database)
  • Fix command when `userid` option is provided

Conflicts:
snf-pithos-app/pithos/api/management/commands/reconcile-resources-pithos.py
snf-pithos-backend/pithos/backends/lib/sqlite/node.py

fbafd482 07/17/2013 07:06 pm Sofia Papagiannaki

pithos: Revert pep8 changes from sqlalchemy ClauseElements

pep8 complains for comparison with boolean in sqlalchemy.sql.expression.ClauseElement
with "E712 comparison to True should be 'if cond is True:' or 'if cond:'"
but sqlalchemy does not understand it otherwise.

bc4f25c0 07/17/2013 11:41 am Sofia Papagiannaki

pithos: Update/extend tests

72e191e5 07/17/2013 11:41 am Sofia Papagiannaki

pithos: Fix migrations

Some data migrations require to import pithos app settings.
These migrations used to fail in nodes where snf-pithos-app
is not installed.
Disable these migrations if they fail to import the necessary settings.

1f96b68d 07/17/2013 11:41 am Sofia Papagiannaki

pithos backend: Introduce debug_method decorator

Substitute debug statements with a backend method decorator
which registers the method execution arguments, the return values
and the exceptions occured.

29148653 07/17/2013 11:41 am Sofia Papagiannaki

pithos: pep8 fixes

57ccbdbf 07/15/2013 04:01 pm Filippos Giannakos

pithos: Add missing blocksize attribute to blocker.

Blocksize was undefined for the blocker that combines files and rados objecsts.
Define it, according to the block parameters.

890f3d4c 07/12/2013 01:22 pm Christos Stavrakakis

Merge branch 'hotfix-0.14.2' into develop

Conflicts:
Changelog
snf-astakos-app/astakos/im/messages.py
snf-astakos-app/astakos/im/views/target/__init__.py
snf-cyclades-app/synnefo/logic/backend.py
snf-cyclades-app/synnefo/logic/management/commands/reconcile-servers.py...

9f5c8386 07/11/2013 06:22 pm Sofia Papagiannaki

pithos: Fix attribute copy

The newly created attributed used to point in the source node
instead of the destination

Refs: 3510

762baa68 07/11/2013 02:56 pm Christos Stavrakakis

pithos: fix typo

18d46d23 07/11/2013 01:55 pm Sofia Papagiannaki

pithos backend: Extend list domain objects method

This method optionally accepts a user paramter and used to return
the objects shared to the user and having a specific domain.
This commit extends this functionality and returns also the objects
owned by the user and having the specific domain...

4100e0ee 07/11/2013 01:55 pm Sofia Papagiannaki

pithos: Update get objects in a specific domain

Improve performance

Refs: #3510

8b365874 07/11/2013 01:55 pm Sofia Papagiannaki

pithos: improve performance of get_domain_list

Before it used to query the database
for all the objects having the specific domain
and finally filtered out the objects to which the user had no access.
Now gets first the allowed_paths for the user and then...

3248f20a 07/10/2013 04:37 pm Sofia Papagiannaki

pithos: Handle backend transaction management

In commit 9f135224edf6e50386dc29e0a35806a92c56a50c
the transaction management has been moved
from the pithos backend to pithos frontend.
This commit updates all modules use pithos backend
to handle transactions manually.