Synnefo

Make snf-dispatcher work with gevent

Remove workers from snf-dispatcher in order to make it compatible with gevent
and specifically the green, monkey patched version of psycopg2
(synnefo.lib.db.psyco_gevent). Also after daemonizing, gevent must be
reinitialized because the deamon context forks.

Fix no-time in eventd messages

Ganeti opcodes may not have an end-timestamp when they go to
an error state. In that case send the job end-timestamp.

Fix bug in http connection pool

Do not reset connetion _pool attribute, since it is not (yet?)
initialized when getting the object from the pool.

Fix broken logging

Rename LOGGING setup to LOGGING_SETUP, as this name is required by
the LoggingConfigMiddleware. Django's default LOGGING setting can
be used with Django>=1.3

Also change default handler to 'console' and add a more verbose format.

port pooled psycopg2 to new pool api

Enhance pooling API, implementation, and tests

- Verify objects (new and old) with a hook _pool_verify.
Discard objects from the pool that fail verification.
A newly created object failing verification is fatal.

- Remove all hooks from the pool set access critical section....

Move pooling psycopg2 wrapper to synnefo.lib.db

Move pooling psycopg2 wrapper to synnefo.lib.db,
please see commit e83ed1fb8fb4d0d19c2d3f86152fde60b3cadfd9 for all the
details on how to use the pooling wrapper for psycopg2.

simple http_request objects over connection pools

Propagate NIC change event to the associated vm

so that nic changed attributes get propagated to the vm views (e.g. nic ip
change).

Catch error caused by duplicate NIC removal in ui

NICs get removed once their associated vm or network trigger their
corresponding remove signal. Synchronous removal of vm/network will
cause duplicate NIC removes to be called.

Make pool more robust on obj creation failure

Make ObjectPool handle failures during object creation more robustly,
and release the pool semaphore.

Rename ObjectPool methods to pool_{put(), get()}

Update GANETI_DISK_TEMPLATES setting description

Describe how to set ext disk template provider.

Support for ext disk providers

Extract provider from flavor disk template name and set the additional
`provider` parameter in disk options. Flavor disk_template should be
formated as `ext_<provider_name>`.

Remove spare div from html

Firefox ui fix

add overflow to `hidden` to properly clear upper div in single vm view.

Make minor fixes to Singleton class unit tests

Fix servers api list response

filter out deleted vms !!!!!!!

Add check for maximum secret encryption key

SECRET_ENCRYPTION_KEY can be up to 32 bytes long, since bigger keys are
not supported by AES encryption. Add comment to the setting and better
message to exception.

Rename setting

Rename ENCRYPTION_KEY to SECRET_ENCRYPTION_KEY to prevent from being
displayed at django debug traces.

Revert "Start pool indexing from 0"

This reverts commit 2f998a3756c6fc7ddce9e0f83dea738e473320b8.

Fix bug in creating network

Exclude deleted networks.

Start pool indexing from 0

Get cluster name from Ganeti

Query Ganeti for getting the cluster name, instead of reading the
ssconf files.

Management command for removing backend

Fix serious bug in reconciliation

Do not perform reconciliation for VMs that are hosted in Backends
that are currently offline, since it is impossible to get the
state of these VMs from the backend. Before this patch, the
reconciliation mechanism would report these VMs as stale (and with...

Store action when creating a network

Warning about missing setting to migration file

Get public network by public attribute

Do not find the public network by the primary key, as the initial_data.json
is obsolete. Instead, ise the public attribute of the Network Model.
Currently only one public Network is supported, and the used can not
create or delete the public Network. But this can easily change in the...

Update admin guide

snf-image needs snf-pithos-backend in all VM-capable nodes.
snf-pithos-backend is not a dependency. We install it manually.

Fix AMQP bug in snf-progress-monitor

Update admin guide to reflect new AMQP settings

Implement Singleton pattern

Implement Singleton pattern inside synnefo.lib.singleton.

Whenever a class inherits from ArgBasedSingleton,
attempts to call the class do not always create a new
class instance, but return pre-existing, already made objects.
...

Fix bugs in migration files

Fix bug in process_net_status

Check that nic has an ipv4 before trying to release it.

Minor fixes in README and scripts

Split cronjob example to snf-burnin run and check scripts

Fix dispatcher default file

Fix case of empty address pool

Limit allowed network size

Limit the size of networks that users can create, since big IP
pools can have negative impact on performance. Allowed network
size is controled by 'MAX_CIDR_BLOCK' setting.

Implement model manager using row-level db locking

Implement ForUpdateManager that uses SELECT .. FOR UPDATE statement in
order to acquire row-level exclusive locks to DB. Essentially this
manager backports the select_for_update() method that is implemented in...

Fix IP pool exceptions

Use ForUpdateManager to Pool objects

Release IP addresses when nics are destroyed

New management command for creating a network

Create a management command for creating networks. Also remove
the initial_data.json, since it is currently not necessary.

Implement IP management

Delegate IP management to synnefo, in order to be able to allocate IP
addresses accross multiple Ganeti backends. This is achieved by creating a
Pool of IPs for each Network, in the form of a bitarray, which is stored
in the DB as a base64 string....

Filter deleted entries when changes-since is used

Modify list_networks and list_servers to filter deleted entries when
if-modified-since HTTP header is used, because deleted entries can be
updated after deletion through the reconciliation mechanism.

Encrypt Backend password

Use cipher to encrypt the passwords of the Ganeti backends in the DB.
Encryption/decryption is based on a configurable key, defined by the
ENCRYPTION_KEY setting. After modifying this setting, synnefo will be
unable to decrypt already stored passwords, and passwords must be...

Add dirty bit to NetworkInterface

Extend NetworkInterface model with a dirty bit, indicating whether
the index of the NIC is consistent with the one in Ganeti. This flag is
set when deleting a NIC, and is switched off after processing the
notification from Ganeti. Removing a NIC with the dirty bit on is not...

Update cyclades ui jquery lib to 1.7.2