Statistics
| Branch: | Tag: | Revision:

root / snf-cyclades-app / synnefo / logic @ ec22dfc4

# Date Author Comment
3f018af1 09/27/2012 03:59 pm Christos Stavrakakis

Make snf-dispatcher work with gevent

Remove workers from snf-dispatcher in order to make it compatible with gevent
and specifically the green, monkey patched version of psycopg2
(synnefo.lib.db.psyco_gevent). Also after daemonizing, gevent must be
reinitialized because the deamon context forks.

7f9f3018 09/27/2012 03:59 pm Christos Stavrakakis

Add pool-create and pool-remove commands

6c9c95d8 09/27/2012 03:59 pm Christos Stavrakakis

Change process title to simplify 'ps' display

Use python-setproctitle to change the process title of the running
daemon. Make it appear as a native executable to simplify
administration. Only set executable name, because cannot set individual
values for arguments.

5e1a5f9b 09/27/2012 03:59 pm Christos Stavrakakis

Fix presentation of pools

ec22dfc4 09/27/2012 03:59 pm Christos Stavrakakis

Fix two bugs in network reconciliation

47d1d754 09/21/2012 11:23 am Christos Stavrakakis

Add some logging to backend allocator

fdc94944 09/20/2012 12:14 pm Christos Stavrakakis

Refactor IP pools

Treat IP pool the same way as bridge and mac-prefix pools. The pool is
removed from the Network table and moved to an IPPoolTable containing the
IP pools for all networks. Also added support for external reservations.

Migration files for transfering the pool to the new tables are included....

9727ac2f 09/20/2012 12:14 pm Christos Stavrakakis

Handle case of no pools in reconcile-pools

0eed6cf8 09/19/2012 01:16 pm Christos Stavrakakis

Management commands for pools

Create three new management commands for listing, showing and modifying
a pool.

af6a3bc5 09/19/2012 01:16 pm Christos Stavrakakis

Unique mac-prefix only for mac-filtered networks

03992c72 09/19/2012 01:16 pm Christos Stavrakakis

Refactor bridge and mac-prefix pool tables

Redesign the implementation of pools and map mac-prefix and bridge pools
to that design.

Each pool type is mapped to a table in the database, and each row of
that table is a pool of that type. All pool tables must contain the...

4a37a0be 09/19/2012 11:34 am Christos Stavrakakis

Fix bug in server-inspect

341c818e 09/07/2012 05:41 pm Dimitris Aragiorgis

Enable hotplug during create_instance

This passes hotplug = True to ganeti and enables hotplug per instance.
It checks GANETI_USE_HOTPLUG setting.

Signed-off-by: Dimitris Aragiorgis <>

7cfbbf32 09/07/2012 05:36 pm Christos Stavrakakis

New method for creating BackendNetwork entries

Create a new method to the Network model, in order to create the
BackendNetwork entries tha correspond to this network. Also remove
the custom save method, since when multiple public network will be
supported, we want them to be correlated with specific backends.

370f69ec 09/07/2012 05:36 pm Christos Stavrakakis

Remove dead code

7fede91e 09/07/2012 05:36 pm Christos Stavrakakis

Implement multiple public networks

Implement multiple public networks in order to support:
- different public networks per backend
- non-consecutive IP ranges in each backend

To support this, public networks are treated different from private
ones. Namely, they are correlated with one backend (and so have...

30418cbe 09/07/2012 05:36 pm Christos Stavrakakis

Reserve gateway's IP when creating an IP pool

296682fe 08/06/2012 11:45 am Kostas Papadimitriou

Support for ext disk providers

Extract provider from flavor disk template name and set the additional
`provider` parameter in disk options. Flavor disk_template should be
formated as `ext_<provider_name>`.

16ddd1fe 07/27/2012 07:26 pm Christos Stavrakakis

Add setting indicating whether to use hotplug

3f52dd82 07/27/2012 02:57 pm Christos Stavrakakis

Management command for removing backend

14fd6983 07/27/2012 02:57 pm Christos Stavrakakis

Add command for checking pool consistency

Add new management command 'reconcile-pools' which checks the consistency of the
pools and the uniqueness of the associated resources. Currently this
commands detects the inconcistencies, without trying to resolve them.

c807398f 07/27/2012 02:57 pm Kostas Papadimitriou

Fix serious bug in reconciliation

Do not perform reconciliation for VMs that are hosted in Backends
that are currently offline, since it is impossible to get the
state of these VMs from the backend. Before this patch, the
reconciliation mechanism would report these VMs as stale (and with...

3165f027 07/27/2012 02:57 pm Christos Stavrakakis

Implement MAC Prefix Management

In order to guarantee uniqueness of MAC address accross all backends,
synnefo assignes a unique mac prefix to each network in each backend.

A mac-prefix of 20 bits, which is picked from the MacPrefixPool, is
assigned to each Network. The mac-prefix of the network in each...

a9ba398e 07/26/2012 06:29 pm Christos Stavrakakis

Fix bug when adding a new backend

Fix wrong reporting messages when adding a new backend.

aeb523a4 07/26/2012 06:29 pm Christos Stavrakakis

Get public network by public attribute

Do not find the public network by the primary key, as the initial_data.json
is obsolete. Instead, ise the public attribute of the Network Model.
Currently only one public Network is supported, and the used can not
create or delete the public Network. But this can easily change in the...

90b29b33 07/24/2012 02:27 pm Christos Stavrakakis

Fix creation of networks in new backend

2b36eda5 07/24/2012 02:26 pm Christos Stavrakakis

Fix bug in process_net_status

Check that nic has an ipv4 before trying to release it.

ad297723 07/23/2012 03:31 pm Christos Stavrakakis

Setting for using IP Pool to public network

Introduce new setting 'PUBLIC_ROUTED_USE_POOL', to indicate whether
synnefo will be responsible for the IP management of the public network,
or this responsibility will be delegated to Ganeti.

e8afa9ff 07/23/2012 01:40 pm Christos Stavrakakis

Consider cpu ratio when allocating vm's

d5b7fd7f 07/23/2012 12:33 pm Christos Stavrakakis

Fix case of empty address pool

967d3f83 07/23/2012 12:16 pm Christos Stavrakakis

Transaction on create_instance

c55b0cdc 07/23/2012 11:49 am Christos Stavrakakis

Reconciliation for network IP pool management

Reconcile the contents of each networks IP pool by comparing it
with combination of IP pools of all ganeti backends.

Add extra option for detecting conflicting IPs.

864bed43 07/23/2012 11:49 am Christos Stavrakakis

Implement model manager using row-level db locking

Implement ForUpdateManager that uses SELECT .. FOR UPDATE statement in
order to acquire row-level exclusive locks to DB. Essentially this
manager backports the select_for_update() method that is implemented in...

8a4a931d 07/23/2012 11:49 am Christos Stavrakakis

Fix IP pool exceptions

439ff929 07/23/2012 11:49 am Christos Stavrakakis

Display IP pool map in network-inspect command

bd392934 07/23/2012 11:49 am Christos Stavrakakis

Release IP addresses when nics are destroyed

cc3f266e 07/23/2012 11:49 am Christos Stavrakakis

Add support for IPv6

- Extend the Network model with fields for holding the IPv6 subnet and
gateway.
- Update network API methods.
- Modify ganeti hooks to return IPv6 address for all network interfaces.
IPv6 is now derived from the IPv6 subnet of the network in Ganeti,...

9c65f166 07/23/2012 11:49 am Christos Stavrakakis

Fix error state of BackendNetwork

77f0fa63 07/23/2012 11:49 am Christos Stavrakakis

Implement IP management

Delegate IP management to synnefo, in order to be able to allocate IP
addresses accross multiple Ganeti backends. This is achieved by creating a
Pool of IPs for each Network, in the form of a bitarray, which is stored
in the DB as a base64 string....

839e2bd0 07/23/2012 11:48 am Christos Stavrakakis

Update network settings

56a1134d 07/23/2012 11:48 am Christos Stavrakakis

Rename management commands

0196d9a3 07/23/2012 11:43 am Christos Stavrakakis

Add dirty bit to NetworkInterface

Extend NetworkInterface model with a dirty bit, indicating whether
the index of the NIC is consistent with the one in Ganeti. This flag is
set when deleting a NIC, and is switched off after processing the
notification from Ganeti. Removing a NIC with the dirty bit on is not...

91954b45 07/23/2012 11:42 am Christos Stavrakakis

Revert "Fix bug in dispatcher callback"

This reverts commit 5d40a128fb593ed641400c462f0e00a1b457f76e.

788a54be 07/23/2012 11:42 am Christos Stavrakakis

Remove machine if ganeti job fails

Set the VM deleted flag when receiving a failure notification for a
Ganeti OP_INSTANCE_REMOVE operation, even if the VM operstate is not
ERROR. The server may not exist in the backend not only because the
creation failed, but also because a remove notification was lost.

0e9a423f 07/23/2012 11:39 am Christos Stavrakakis

Implement network reconciliation

00051a6a 07/23/2012 11:39 am Christos Stavrakakis

New management commands to inspect network/server

d30f29aa 07/23/2012 11:39 am Christos Stavrakakis

Common functions for instance/network backend name

44e2c577 07/23/2012 11:39 am Christos Stavrakakis

Fix use of network name prefix

15cb13b5 07/23/2012 11:39 am Christos Stavrakakis

Fix bug about unknown network in instance's nics

e41977e2 07/23/2012 11:39 am Christos Stavrakakis

Fix management commands

- Fix bug in backend_add
- Display backend_name in network_inspect command

0b827aa4 07/23/2012 11:39 am Christos Stavrakakis

Bug fixes concerning networks

910f80db 07/23/2012 11:39 am Christos Stavrakakis

Fix bug in dispatcher callback

During handling of ganeti-op-status messages, state was set to error
only if the the opcode was OP_INSTANCE_CREATE. This resulted to
vm's never being deleted, if they did not exist in Ganeti.

36f4cb29 07/23/2012 11:39 am Christos Stavrakakis

Add backend method for removing a vm's nic

22ee6892 07/23/2012 11:39 am Christos Stavrakakis

Modification in logic for new-style networks

b3d28af2 07/23/2012 11:39 am Christos Stavrakakis

Synchronize networks when adding a new backend

b4eaff05 07/23/2012 11:39 am Christos Stavrakakis

Rename backend_create to backend_add

fd65ab41 07/23/2012 11:36 am Christos Stavrakakis

Implement BackendNetwork model

Create a new model, to represent the state of each network in each
backend.

a17a8e98 07/23/2012 11:36 am Christos Stavrakakis

Create network queues and refactor dispatcher

cc7c0f44 07/23/2012 11:33 am Christos Stavrakakis

Implement backend allocator and management command

New module implementing instance allocation to one of the available
backends. Allocation is performed based on memory and disk utilization.
Statistics for each backend are stored in DB and updated periodically....

4161cb41 07/23/2012 11:33 am Christos Stavrakakis

Fix issues concerning reconciliation

f5b4f2a3 07/23/2012 11:33 am Christos Stavrakakis

Use the Backend client instead of global RAPI

Replace use of global RAPI client, with the cached client from the
VirtualMachine or Backend model.

Dispatch network actions to all backends.

1a894bfe 07/23/2012 11:33 am Christos Stavrakakis

New management commands concerning backends

- Create command to create a backend (snf-manage backend_create)
- Create command to modify a backend (snf-manage backend_list)
- Create command to list backends (snf-manage backend_modify)
- Modify listservers command to display the backend that hosts the VM

924d8085 07/23/2012 11:32 am Christos Stavrakakis

Rename backend_id to backend_vm_id

Rename backend_id field of VirtualMachine model to avoid conflict between the
backend that hosts the VM and the id that the VM will have on the backend.

cf2a3529 07/16/2012 11:19 am Christos Stavrakakis

Remove stale pid lockfiles on daemon invocation

8c6de8ca 07/10/2012 12:05 pm Christos Stavrakakis

Rename management command

28f83276 07/09/2012 03:38 pm Kostas Papadimitriou

Merge branch 'simplequotas' into queues+minor_net

ce55f211 07/02/2012 08:25 pm Kostas Papadimitriou

Simple per user quota mechanism for networks/vms

- New dict setting VMS_USER_QUOTA to allow setting per user quota
(overrides MAX_VMS_PER_USER setting)
- Private networks quota mechanism (based on MAX_NETWORKS_PER_USER and
NETWORKS_USER_QUOTA settings)...

db400d82 06/29/2012 01:38 pm Christos Stavrakakis

Refactor AMQP client

e3c3e1bc 06/18/2012 05:23 pm Christos Stavrakakis

Remove messages that can not be handled from queue

Temprory fix for removing accumulated messages from RabbitMQ. Currently
snf-ganeti-eventd produces messages that can not be handled from
snf-dispatcher (e.g messages not concering an instance). These messages...

8417c3df 06/06/2012 05:10 pm Christos Stavrakakis

Add management command to inspect queue messages

33b93f81 06/06/2012 05:10 pm Christos Stavrakakis

Refactor common code in dispatcher's callbacks

9c766317 06/06/2012 05:10 pm Christos Stavrakakis

Minor fixes

f2264859 06/06/2012 05:10 pm Christos Stavrakakis

Remove unused code

Remove old code used for reconciliation, as the reconciliation mechanism has
changed

b47b895d 06/06/2012 05:10 pm Christos Stavrakakis

Add prefix to debug queue

4cbef2a0 06/06/2012 05:10 pm Christos Stavrakakis

Small refactoring in getting vm id

31c4ae44 06/06/2012 05:10 pm Christos Stavrakakis

Clean up dead code

c4e55622 06/06/2012 04:56 pm Christos Stavrakakis

Update modules interacting with AMQP

Update all modules which are interacting with the RabbitMQ messaging system to
use the AMQPClient in order to use highly available queues in active/active
mode.

Extend messages to include a unique identifier in order to handle...

1e239ea1 06/05/2012 12:32 pm Dimitris Aragiorgis

Minor change in rapi call

Ganeti 2.5 needs a tupple of length 3 for nics modifications.
So in ModifyInstance rapi call we pass (add, -1, {..}) for nis.

Signed-off-by: Dimitris Aragiorgis <>

3c755209 06/05/2012 12:32 pm Dimitris Aragiorgis

Take advantage of ganeti hotplug

No race condition. No need for ther NetworkInterface to have an
operstate. Hook runs during instance-modify and depicts the currently
existing nics. No reboot needed modification to take place.

Later in mutliple backend mac prefix handling should be done by synnefo....

9c21a2e2 06/01/2012 12:46 pm Christos Stavrakakis

Delete VM nics on update path

Delete VM nics when a message of type OP_INSTANCE_REMOVE has been received
from ganeti, and not when doing the RAPI call.

d1eaa651 06/01/2012 12:41 pm Christos Stavrakakis

Simplify disconnecting vm from network

Use the new option of Ganeti, to remove a specific nic.

7f691719 06/01/2012 12:38 pm Christos Stavrakakis

Use 'network' instead of 'link'

- Rename GANETI_PUBLIC_LINK to GANETI_PUBLIC_NETWORK
- modify create_instance of backend module

b84092e7 04/02/2012 12:35 pm Giorgos Verigakis

Remove --detect-orphan-{servers,networks}

They have to depend on Astakos, move their functionality externally.

e3e7e245 03/19/2012 04:09 pm Giorgos Verigakis

Remove unused imports

7e136fd8 03/19/2012 04:09 pm Giorgos Verigakis

Add --detect-orphan-{servers,networks}

2035039b 02/24/2012 05:49 pm Giorgos Verigakis

Switch to the logging middleware

fd56d250 02/21/2012 04:50 pm Giorgos Verigakis

Remove email queues from dispatcher

1ed37c1d 02/21/2012 04:13 pm Giorgos Verigakis

Remove legacy code from dispatcher

fd00a867 02/03/2012 05:33 pm Giorgos Verigakis

Remove obsolete files that were restored due to merge

cc875294 02/02/2012 05:10 pm Giorgos Verigakis

Merge remote-tracking branch 'origin/master' into astakos-integration

Conflicts:
runtests.sh
snf-cyclades-app/synnefo/aai/__init__.py
snf-cyclades-app/synnefo/aai/fixtures/auth_test_data.json
snf-cyclades-app/synnefo/aai/middleware.py
snf-cyclades-app/synnefo/aai/models.py...

9c0ac5af 01/30/2012 06:55 pm Kostas Papadimitriou

Renamed snf-app to snf-cyclades-app