Statistics
| Branch: | Tag: | Revision:

root / snf-cyclades-app / synnefo @ eec66d97

# Date Author Comment
bcd80cd9 05/16/2013 06:30 pm Christos Stavrakakis

cyclades: Move common code to seperate function

Move common between API method and management command for creating a
server to a separate function.

eec66d97 05/16/2013 06:30 pm Christos Stavrakakis

cyclades: Fix bug in flavor-modify command

Fix bug in flavor-modify command, which resulted in flavors being always
deleted. Deleted option must be parsed to bool, otherwise is always
True.

d2c9adac 05/15/2013 06:36 pm Christos Stavrakakis

Use custom method for joining urls

Implement 'join_urls' method for joining a base URL with a path,
without worrying about redundant or missing "/". Do not use
'urlparse.urljoin', since it has different semantics.

e4ce2d35 05/15/2013 06:35 pm Christos Stavrakakis

cyclades: fix db migration

Migration 0066 should not run on a fresh installation.

3dbd9457 05/15/2013 05:05 pm Christos Stavrakakis

cyclades: Make cyclades work with pycrypto==2.6

In PyCrypto 2.6, it is mandatory to use an IV of 16 bytes when using AES
encryption. This commit updates 'aes_encrypt' module to use a random IV.
Also, a data migration is required to re-encrypt the old passwords, as...

c6c889f7 05/14/2013 02:09 pm Christos Stavrakakis

cyclades: Various fixes to tests

fd95834e 05/14/2013 01:25 pm Christos Stavrakakis

dispatcher: Handle NICs in callbacks.

Update 'update_db' callback to handle instance NICs together with
instance status.

Also update the relevant tests.

be4d8aed 05/14/2013 01:25 pm Christos Stavrakakis

cyclades: simplify comparison of NICs

95059648 05/14/2013 01:25 pm Christos Stavrakakis

Remove 'snf-events-net' queue and binding

Remove 'snf-events-net' queue (together with the corresponding routing
key and binding) from the queues that snf-dispatcher is consuming
messages. This queue is no longer needed, because messages for instance
NICs will be sended by snf-ganeti-eventd to 'snf-events-op' queue....

acfc71ef 05/14/2013 01:25 pm Christos Stavrakakis

cyclades: Fix deadlock when connecting vms

Fix deadlock caused by 'get_or_create' method, since it acquires an
implicit shared lock. Take an exclusive lock on network to fix this
deadlock.

5b0832fc 05/14/2013 01:24 pm Christos Stavrakakis

cyclades: Fix stale 'DeletedError' exception

a5781130 05/14/2013 01:24 pm Christos Stavrakakis

cyclades: Fix typo in comment

27cda06b 05/14/2013 01:24 pm Christos Stavrakakis

cyclades: Fixes relevant to lazy networks

de1fed2b 05/14/2013 01:24 pm Christos Stavrakakis

cyclades: Simplify reconcile-networks checks

Refactor and simplify checks of reconcile-networks to take advantage
of lazy networks.

b471b597 05/14/2013 01:24 pm Christos Stavrakakis

cyclades: Fix bug in management command

Do not try to issue commission for networks without user (e.g. public
networks), when deleting them.

1d04ef8b 05/13/2013 01:36 pm Christos Stavrakakis

cyclades: update tests for lazy networks

e34b35d9 05/13/2013 01:36 pm Christos Stavrakakis

cyclades: Update 'backend-add' for lazy networks

Do not create private networks when adding a new backend. Since,
"lazy networks" this is no longer needed.

99af08a4 05/13/2013 12:38 pm Christos Stavrakakis

cyclades: Implement lazy networks

Implement "lazy networks", which are not created to all Ganeti backends
upon creation, but only when an instance that resides in a Ganeti is
connected to that network.

Update 'create_network' to create the Network object in DB without...

47b8d4b1 05/13/2013 12:15 pm Christos Stavrakakis

Merge branch 'feature-quotas' into develop

Conflicts:
docs/dev-guide.rst

c34b2908 05/13/2013 12:06 pm Christos Stavrakakis

cyclades: add commissioning to create/remove cmds

Update create/remove management commands to issue commission when
needed.

79b5d61b 05/10/2013 12:45 pm Sofia Papagiannaki

astakos: WIP move all api calls under ``/astakos/api``

Refs: #3340

28c41829 05/09/2013 06:37 pm Christos Stavrakakis

Add 'ASTAKOS_POOLSIZE' setting.

d91de78c 05/09/2013 05:23 pm Christos Stavrakakis

helpdesk: Fix helpdesk tests

b5eef933 05/09/2013 03:12 pm Christos Stavrakakis

cyclades: Fix vmapi test

Use 'urljoin' to compute the 'config_url' parameter.

cfb0ff80 05/09/2013 02:54 pm Constantinos Venetsanopoulos

Merge branch 'feature-api-docs' into develop

Minor Conflict:
docs/cyclades-api-guide.rst

6856b4ff 05/08/2013 10:52 am Giorgos Korfiatis

cyclades ui: Remove deprecated setting

426e1fb9 05/02/2013 04:36 pm Kostas Papadimitriou

cyclades ui: Expose and use the new astakos quota api

- Removed /userdata/quota view in respect of astakos quotas api delegate
views served in the same urls used by astakos api (/astakos/api/quotas,
/astakos/api/resources). Base url is configurable using the...

c8a79b3a 05/01/2013 06:00 pm Giorgos Korfiatis

pithos, cyclades: Name reconciling commissions

Use commission name "RECONCILE" to distinguish such operations
in the quotaholder provision log.

2c2ccd2d 05/01/2013 02:19 pm Giorgos Korfiatis

cyclades: Fix import of urlparse

93d963c4 05/01/2013 12:15 pm Sofia Papagiannaki

Merge branch 'feature-quotas-pithos' into feature-quotas

Conflicts:
snf-cyclades-app/synnefo/plankton/backend.py
snf-pithos-app/README
snf-pithos-app/pithos/api/util.py

16f2673e 05/01/2013 12:00 pm Sofia Papagiannaki

pithos: Rename backend quotaholder properties

Refer to astakosclient instead of quotaholder

b17e5550 05/01/2013 12:00 pm Giorgos Korfiatis

WIP astakosclient for quotas in pithos

07419e58 04/30/2013 06:23 pm Christos Stavrakakis

Fix typo in network-list command

d195e752 04/30/2013 05:33 pm Christos Stavrakakis

cyclades: Rename 'qh_resolve_commissions' function

Rename 'qh_resolve_commissions' function to 'resolve_commissions'.

30096a2e 04/30/2013 05:06 pm Christos Stavrakakis

cyclades: Remove obsolete code for static quotas

Remove the following obsolete settings, since their usage is covered
by Quotaholder:
- MAX_VMS_PER_USER
- MAX_NETWORKS_PER_USER
- VMS_USER_QUOTA
- NETWORKS_USER_QUOTA

Also remove 'cyclades-export-quota' management command.

4060cac5 04/30/2013 05:06 pm Christos Stavrakakis

Implement resource-export-cyclades command

Implement managemtn command to export cyclades resources in JSON format,
in order to be imported to Astakos.

d0986bac 04/30/2013 05:05 pm Christos Stavrakakis

Cyclades: remove all quotaholder settings

Remove from cyclades all settings that were relative with Quotaholder.
Remove CYCLADES_USE_QUOTAHOLDER settings, since Cyclades can not work
any more without quotas.
Remove CYCLADES_QUOTAHOLDER_URL and CYCLADES_QUOTAHOLDER_TOKEN since...

ccfbf77b 04/30/2013 05:05 pm Christos Stavrakakis

Varous fixes to cyclades-usage-verify command

Extend 'cyclades-usage-verify' management command to cover the usage of
'cyclades-reset-usage' and remove the second one. The new command
reconciles resources(usage) by detecting inconsistencies between the
usage of resources in Astakos and Cyclades DB and fixing them by issuing...

62c86226 04/30/2013 05:05 pm Christos Stavrakakis

cyclades: Rename quotas management commands

Rename 'cyclades-reconcile-commissions' to 'reconcile-commissions-cyclades.'
Rename 'cyclades-usage-verify' to 'reconcile-resources-cyclades.'

39d44eba 04/30/2013 05:05 pm Christos Stavrakakis

reconcile-resources: check that user exists in QH

Do not consider 0 usage for users and resources that are not included in
Quotaholder resources list, since Quotaholder returns zero usage for all
users and all resources. If a user/resource does not belong to QH...

97fffe10 04/30/2013 05:05 pm Christos Stavrakakis

Refactor QuotaHolder serial model

  • Merge 'accepted' and 'rejected' field to 'accept' field.
  • Add 'resolved' field, indicating whether this commission has been
    accepted/rejected to Quotaholder
  • Remove custom save() method. Handle 'pending' field manually....
9b964eff 04/30/2013 05:05 pm Christos Stavrakakis

Fix info message of reconcile-resources-cyclades

2509ce17 04/30/2013 05:05 pm Christos Stavrakakis

cyclades: refactor code relative to commission

Refactor Cyclades code that handles commissioning with Quotaholder. This
commit removes the 'uses_commission' decorator. Instead it introduces
the 'issue_and_accept_commission' function that is responsible for...

4ed25171 04/30/2013 05:05 pm Christos Stavrakakis

cyclades: resolve previous commissions

Extend 'issue_and_accept_commission' function to resolve previous
unresolved commission, if exists. In order to resolve it, the
commission must not be pending, because if it is there is not
enough information to resolve it.

184a2a8c 04/30/2013 05:05 pm Christos Stavrakakis

Mock quotaholder for Cyclades tests

Create 'mocked_quotaholder' context manager to bypass commission and use
it in Cyclades tests. Also this commit does some various fixes to other
tests.

5db3a1e6 04/30/2013 05:05 pm Christos Stavrakakis

cyclades: Check qh resolve commission response

Check Quotaholder response to see if the commissions were accepted or
rejected as requested, or failed for some reason.

Accepting or rejecting a commission will fail if the commission was
already resolved. Since this is sometimes accepted, like when...

7907af91 04/30/2013 05:05 pm Christos Stavrakakis

Restore quotas if enqueuing job to Ganeti fails

When creating a server, we commit the VM model in DB and reserve the
corresponding quotas in Quotaholder before enqueuing the
OP_INSTANCE_CREATE job (because messages from dispatcher may arrive
before committing). In case enqueuing job to Ganeti fails we must...

629acc65 04/30/2013 05:04 pm Giorgos Korfiatis

cyclades: Use astakosclient for quotas and commissions

af48fdf0 04/30/2013 05:04 pm Christos Stavrakakis

Remove unused 'models' file

656cf771 04/30/2013 05:04 pm Christos Stavrakakis

Various fixes to quotas

468ba00b 04/30/2013 05:03 pm Ilias Tsitsimpis

snf-cyclades-app: Use astakosclient

6e27e449 04/30/2013 05:03 pm Christos Stavrakakis

cyclades: remove redundant settings

Remove 'CYCLADES_USER_CATALOG_URL' and 'CYCLADES_USER_FEEDBACK_URL'
settings, since both of them can be derived from 'ASTAKOS_URL' setting.

3e749401 04/30/2013 05:03 pm Christos Stavrakakis

plankton: Remove 'TRANSLATE_UUIDS' setting

Remove 'TRANSLATE_UUIDS' from plankton setting.

479c3051 04/30/2013 05:03 pm Ilias Tsitsimpis

PEP8 style fixes

3fff9189 04/30/2013 04:59 pm Christos Stavrakakis

cyclades: fix bug in server-create command

Make --flavor-id mandatory in 'snf-manage server-create' management
command.

eefb7355 04/30/2013 04:59 pm Christos Stavrakakis

cyclades: Require user when creating private net

Update 'network-create' management command, to require an owner when
creating a private network.

fa8c2506 04/29/2013 04:24 pm Christos Stavrakakis

cyclades: Fix typo in create_server

State of public NIC should be 'BUILDING'

acd8cd7d 04/26/2013 01:44 pm Christos Stavrakakis

vmapi: Remove extra '/' from config_url

Use urlparse.urljoin create the config url in order to avoid extra '/'.

85919a0f 04/25/2013 04:14 pm Christos Stavrakakis

Fix deadlock when creating server

Fix deadlock when creating a server that was introduced by commit
501053a. Allocating the public IP in the same transaction with creating
the server resulted in a deadlock with backend allocator, because
inserting the new VM in the database waits on an exclusive lock of the...

9523af40 04/22/2013 06:04 pm Christos Stavrakakis

Fix help message of management command

501053a1 04/22/2013 01:35 pm Christos Stavrakakis

Cyclades: reserve public IP after commission

When creating a server, do not reserve a public IP address before
issuing commission to quotaholder. This bug resulted in unsynchronized
IP pools between Cyclades and Ganeti, and needed external
reconciliation to synchronize them....

cda71050 04/22/2013 10:10 am Christos Stavrakakis

plankton: Cleanup and improve code

Major refactor in plankton APP and ImageBackend code:
  • Remove unused code
  • Remove 'plankton_method' decorator that added an ImageBackend to
    requests an replace it with 'image_backend' context manager. This
    context manager is responsible for opening and closing connections...
14c94c48 04/22/2013 10:10 am Christos Stavrakakis

Improve performance in listing images

Use '_get_domain_objects' function of Pithos backend, to list all
objects in a 'plankton' domain, instead of looping over all accessible
accounts, containers and objects. This function also returns metadata
and permissions for each object in order to avoid two extra calls for...

07f5a62c 04/22/2013 10:10 am Christos Stavrakakis

List all images in snf-manage image-list

Until now 'snf-manage image-list' management command printed only images
that were public, or accessible by a specific user. This commit changes
this command to print all images (regardless of the owner).

59573532 04/22/2013 10:10 am Christos Stavrakakis

plankton: raise BadRequest for invalid location

Modify 'add_image' plankton API method, to check that location parameter
is a valid Pithos url, and raise BadRequest if not.

22b5ac0b 04/22/2013 10:10 am Christos Stavrakakis

plankton: Correct image unregister

Correct usage of 'update_object_meta' function to remove all metadata
from plankton domain. Use an empty dictionary with replace=True.

Refs #3522

62d3ea53 04/22/2013 10:10 am Christos Stavrakakis

plankton: add logging to backend functions

a1a4cbfb 04/22/2013 10:10 am Christos Stavrakakis

Bypass authentication in image-show command

Make image-show management command to show information about an image
without passing a userid. Use 'image_list' command of ImageBackend
instead of 'get_image' because the second one will raise Forbidden for
non-public images....

6cc65c86 04/22/2013 10:10 am Christos Stavrakakis

Remove transaction from 'backend-add' command

Do not run 'backend-add' command inside transaction, because if
'snf-dispatcher' is running, it will receive messages that will arrive
from a Ganeti backend that does not exist in the DB and will not be able
to process them.

baca1e50 04/19/2013 12:27 pm Stavros Sachtouris

Merge branch 'develop' into feature-api-docs

ce6eb935 04/16/2013 04:30 pm Christos Stavrakakis

Fix small typo in import statements

4ab620b6 04/15/2013 04:11 pm Christos Stavrakakis

Improve settings related to ASTAKOS url

Rename 'PITHOS_AUTHENTICATION_URL' setting to 'ASTAKOS_URL'. Also remove
'PITHOS_AUTHENTICATION_USERS' from docs (it was removed from code in
commit 8df4fae).

Modify 'ASTAKOS_URL' to point to the node hosting the Astakos service...

a9be7bf7 04/15/2013 04:11 pm Christos Stavrakakis

Fix small typo in import statement

f0001470 04/11/2013 11:34 am Christos Stavrakakis

Merge branch 'feature-snf-django' into develop

Conflicts:
docs/older/Changelog.pithos-app
snf-astakos-app/astakos/im/api/__init__.py
snf-pithos-app/pithos/api/util.py

e7f22a2a 04/10/2013 07:05 pm Christos Stavrakakis

Merge branch 'release-0.13' into develop

Conflicts:
snf-astakos-app/astakos/im/messages.py

5ef4d441 04/10/2013 06:35 pm Kostas Papadimitriou

Fix create vm view images filtering in cyclades ui

use the new synnefo.user method `get_username` to populate
personal/shared images.

0e214bbe 04/10/2013 06:14 pm Stavros Sachtouris

Add Server Create documentation

be5ea27b 04/08/2013 06:17 pm Christos Stavrakakis

Fix typo

04a1b675 04/08/2013 06:17 pm Christos Stavrakakis

Move astakos lib from snf-common to snf-django-lib

1a736ca8 04/08/2013 04:27 pm Christos Stavrakakis

Use 'python-objpool' instead of 'synnefo.lib.pool'

Use the python-objpool package for pooling resources as object, instead
of the pooling code that existed in snf-common ('synnefo.lib.pool')

Refs #3524

d2b8ec7b 04/08/2013 11:07 am Christos Stavrakakis

Move common test code to snf_django.lib.testing

05d401cf 04/08/2013 11:06 am Christos Stavrakakis

Remove VM/Network DeletedError and BuildingError

Handle these errors explicitly in the code instead of the "api_method"
decorator.

f6ff4b40 04/08/2013 11:06 am Christos Stavrakakis

Remove ImageBackend NotAllowedError

Refs #3359

d9d1763e 04/08/2013 11:06 am Christos Stavrakakis

Use the common 'api_method' decorator in plankton

Use the common 'api_method' decorator in all plankton API methods.
Modify the 'plankton_method' decorator to only create and close
the ImageBackend.

b3fd98ae 04/08/2013 11:06 am Christos Stavrakakis

Use common 'api_method' decorator to cyclades api

Update Cyclades API methods to use the new common 'api_method'
decorator. Also, update all the relevant tests.

65bbcd43 04/08/2013 11:06 am Christos Stavrakakis

Use common 'api_method' decorator in pithos api

Update all pithos API methods to use the new common 'api_method'
decorator. However, this decorator is not enough for pithos since
pithos methods require some extra tasks:
  • Create a PithosBackend connection...
9dcb5b8a 04/08/2013 11:06 am Christos Stavrakakis

Remove dead code

bd40abfa 04/08/2013 11:06 am Christos Stavrakakis

Move cloud faults to 'snf_django.lib.api.faults'

Gather all faults from all synnefo projects into common
'snf_django.lib.api.faults'.

27d564ba 04/07/2013 01:33 pm Christos Stavrakakis

Fix typo in network-list command

28578e52 04/02/2013 01:49 pm Christos Stavrakakis

Use pprint_table in server-show command

d552dddd 04/02/2013 01:49 pm Christos Stavrakakis

Simple tests for synnefo.quotas

4e1133ab 04/02/2013 01:49 pm Christos Stavrakakis

Make 'type' parameter for network-create mandatory

Do not use a default value (was "MAC_FILTERED") for "type" parameter of
"network_create" API method. The client must explicitly choose the
network type.

f13aab5d 04/02/2013 01:49 pm Christos Stavrakakis

Delete Image without deleting file from Pithos

Until now, deleting an image resulted in deletion of the corresponding
file from Pithos. Plankton Images are files in Pithos with special
metadata on the 'plankton' metadata domain. Adding an Image to plankton...

4fb602b1 04/02/2013 01:49 pm Christos Stavrakakis

Fix plankton ItemNotFound exception

Plankton backend raised AssertionError when an Image was not found.
Change this to raise faults.ItemNotFound error. Temporary commit
until common API decorator is implemented.

Refs #3356

f770d29f 04/02/2013 12:56 pm Kostas Papadimitriou

Merge branch 'release-0.13' into develop

Conflicts:
snf-astakos-app/astakos/im/messages.py
snf-astakos-app/astakos/im/views.py
version

cc5c8608 04/02/2013 10:29 am Kostas Papadimitriou

Allow helpdesk users to shutdown/start vms

Include an additional action to helpdesk view. Based on the current
status of the virtual machine helpdesk user is allowed to start it or
shut it down.

This comes handy since in most cases vm suspension needs to be...

24906909 04/02/2013 09:08 am Kostas Papadimitriou

Remove ui debug statement

51718b22 04/02/2013 09:05 am Kostas Papadimitriou

Update cyclades webproject settings

remove deprecated admin app entries

878d9cf3 04/02/2013 08:49 am Kostas Papadimitriou

Merge branch 'tmp-common-email-recipients' into develop

354b9b6f 04/01/2013 07:02 pm Kostas Papadimitriou

Merge branch 'feature-astakos-authpolicies' into develop

Conflicts:
snf-cyclades-app/synnefo/api/management/commands/flavor-create.py
version