pithos:Ensure serial registration before commission
Commit transaction before accepting the commissionand delete registered serials after successful commission.
Refs: #3594
pithos: extend sqlite library for commission reconciliation
Add database migration
Provide an alembic migration to add an indexon the attributes.domain field
pithos backend: update get_domain_objects method
Rename and change it to backend method(add the backend_method decorator)
Pithos backend: Return objects in a specific domain
Refs: #3510
Fix trasactionless query in pithos sqlite backend init
Refs: #3580
fix trasactionless query in pithos backend init
The query was submitted for execution without any prior transactionsetup, which caused:
1. psycopg2 to implicitly start a transaction2. the new transaction to remain unknown to the sqlalchemy layer since it was implicit...
pithos: Fix container quota violation control
Pithos backend before performing the quota violation checkscreates a new version of object and updates theusage of the ancestor nodes (the container).
In Postgresql SELECT does see the effectsof previous updates executed within its own transaction...
Change pithos default container policy quota to unlimited
Refs: #3543
Fix pithos-reconcile-commissions command
Get pending commissions specifically for pithos
pithos: Register commission serials to allow for recoery
Move astakos lib from snf-common to snf-django-lib
Use 'python-objpool' instead of 'synnefo.lib.pool'
Use the python-objpool package for pooling resources as object, insteadof the pooling code that existed in snf-common ('synnefo.lib.pool')
Refs #3524
Change pithos backend DEFAULT_PUBLIC_URL_SECURITY
Change value from 8 to 16, to conform with the defaultPITHOS_PUBLIC_URL_SECURITY setting.
Change pithos public URL implementation
Refs: commit: 56f3c759
Do not include encoded serial in the public URL.
Change PITHOS_PUBLIC_URL_MIN_LENGTH setting toPITHOS_PUBLIC_URL_SECURITY.
Log public set/unset functions.
Change pithos public implementation
Public URLs should consist of a random part.A public URL should be unique and should not beequal to any deleted public URL.Finally publishing a public object has no effect.Therefore, to generate a new public URL for an...
Eliminate mutable default arguments
Fix pithos purging accounting
Refs: #3442Refs: #1733
Fix+move HTTP quotaholder client in synnefo.lib
Allow per-service configuration of the (http) quotaholder client.Kamaki is no longer needed in service (or ganeti) nodes,because the client has been moved to snf-common.
Also fix the default quotaholder settings for pithos backend to be disabled...
Fix UUID bug breaking image list and VM creation
latest_uuid(uuid) returned the latest version with the given uuid.This is called from pithos backend method get_uuid(),which is called from plankton backend method get_image().
For the use in get_image() the uuid alone is not enough,...
Fix serious inefficiency in pithos 0.13 migration
As was run on production during migration.
The migration looped over all rows (node, muser) from versions,and update muser in each one.
However, the tuples (node, muser) are not unique in the table,and more important, the muser values are much fewer than the nodes...
set DJANGO_SETTINGS_MODULE for pithos-migrate
Explicitly enabled/disable pithos quotaholder component
Use PITHOS_USE_QUOTAHOLDER setting
Update pithos migration
Display progress
Improve pithos migrate
Cache also non existing accounts.
Pithos stop unnecessary contacts with quotaholder
Do not issue commission if there is not size change
Fix pithos purging
Error if there were no objects to purge
Provide command for managing pithos duplicate accounts
Migrate pithos object modification user
Merge branch 'feature-rados' into develop
Conflicts: snf-pithos-app/README
Remove automatic RADOS pool creation.
If a specified RADOS pool does not exist, do not try and create it. Throw anexception instead.
Merge branch 'feature-projects' into develop
Pithos: handle quotaholder exception errors
Change error handling in uuid to displayname pithos path migration.
Stop migraton if it fails to retrieve a uuid/displayname.
Remove trailing space
Expose /user_catalogs service api call
Change migration scripts to use this instead of the user api call
Change feedback & user_catalogs astakos && pithos api calls
Fix exception handling in RADOS blocker/mapper
Handle only KeyError exception in blocker/mapper initialization, and propagateall other, as they indicate errors.
snf-pithos-backend: Fix backend.meesages attribute
backend.messages attribute was not initialized correctly, resulting inan AttributeError exception in _pool_cleanup.
Restore container policy check
Debit pithos object owner not the request user
Optionally import rados
fix radosblocker merge, fix some tabs/whitespace
Merge branch 'radosblocker' of https://code.grnet.gr/git/pithos into latest-quota
Conflicts: snf-pithos-app/pithos/api/util.py snf-pithos-backend/pithos/backends/modular.py snf-pithos-backend/pithos/backends/util.py
Fix pithos backend external_quota argument initialization
Return quotaholder holding in pithos backend
Fix pithos get_account_meta.
Do now show usage if request user is other than the owner
Merge branch 'latest-quota' of https://code.grnet.gr/git/synnefo into latest-quota
Conflicts: snf-astakos-app/astakos/im/forms.py snf-astakos-app/astakos/im/functions.py
Fix pithos versioning
Do not remove previous object version in case of free versioning policy
Fix pithos versioning (better implementation)
Change pithos sharing to work with account uuids
Migrate username to uuid in pithos permissions
fix indentation in pithos.backend.modular
Fix negative population in statistics table
Provide error feedback during pithos database path migration to container uuid instead of email
Update Astakos API to provider calls for retrieving uuid from the username and vice versa, extend astakos client library (snf-common) and update pithos to use uuids instead of email for account identification
Pithos backend should send the token to the quotaholder
Pithos issue_commission using user uuid instead of id
Merge branch 'dev' of https://code.grnet.gr/git/pithos into latest-quota
Conflicts: .gitignore devtools/fabfile.py snf-pithos-app/pithos/api/util.py
Merge branch 'projects' of https://code.grnet.gr/git/astakos into latest-quota
Conflicts: .gitignore snf-astakos-app/conf/20-snf-astakos-app-settings.conf
fix quotaholder imports
fix pool creation
Merge remote-tracking branch 'origin/dev' into radosblocker
Conflicts: snf-pithos-app/pithos/api/util.py snf-pithos-backend/pithos/backends/lib/hashfiler/blocker.py snf-pithos-backend/pithos/backends/lib/hashfiler/mapper.py snf-pithos-backend/pithos/backends/modular.py...
make rados storage configurable
add support to store blocks on RADOS
Intergation with updated quotaholder module
If PITHOS_QUOTAHOLDER_URL is None do not try to connect to the quotaholder
Fix indent and add logging in case of QuotaError
If PITHOS_QUOTAHOLDER_URL is None, perform internal pithos quota checking
Merge branch 'dev' of https://code.grnet.gr/git/pithos into dev
Conflicts: snf-pithos-app/pithos/api/util.py snf-pithos-backend/pithos/backends/modular.py
Conflicts: snf-pithos-app/pithos/api/dispatch.py snf-pithos-app/pithos/api/management/commands/storagequota.py snf-pithos-app/pithos/api/util.py snf-pithos-backend/pithos/backends/modular.py
By default report size change in object delete/update (do not include older version size)
Fix undefined variable
Fix sqlalchemy warning: IN-predicate invoked with an empty sequence.
Send versions as string in resource events queue
Include version information in aquarium messages
Comment out sqlalchemy echo
Change QuotaholderSync to QuotaholderSerial
incorporate AMQPClient instead of synnefo.lib.queue methods for sending queue messages
fix backends.lib.sqlite.config.Config set_value
fix backend variable name
fix access to backend library classes Config and QuotaholderSync
fix mispelling
New database tables to keep track of quota holder commisions
Fix code formatting to conform to the PEP 8 style guide
rename resource to pithos+.diskspace
make sure backend hasattr 'messages'
fix: initialize per-request quotaholder seriallist
use astakos resource name in issue_commission
quotaholder serial handling fix
accept/reject commission on backend_method deco
wip issue_commision(). no accept or reject yet
wip quotaholder client in backend
Merge branch 'master' of https://code.grnet.gr/git/pithos
fix UnboundLocalError
Move PithosBackendPool to snf-pithos-backend
Move PithosBackendPool from snf-pithos-app to snf-pithos-backend