Synnefo

Encrypt instance ids in the stats URLs

cyclades: Catch exception in verify_personality

The verify_personality function assumes that the contents of a
personality is encoded in base64 and tries to decode them. But if the
client didn't encode them a TypeError `Incorrect padding' will be
raised. Catch this exception and raise a BadRequest.

cyclades: Create 'cyclades_network' service

Create 'cyclades_network' service which is part of Cyclades, of 'network'
type and with 'network' prefix to hold all API endpoints that are
relative with networks. So, for example, the endpoint for networks will...

cyclades: Refactor code

Move code relative with allocating ips and floating IPs to 'logic.ips'
module.

cyclades: Fix permissions when looking up ports

Look up of ports should check the port userid and not the network
userid.

cyclades: Fix bugs relative to pool allocation

Fix bug when trying to allocate a specified IPv4 address. Only one of
the IP pools will contain this address, so you must bypass InvalidValue
exceptions until searching all pools.

Also PoolManager raised 'EmptyPool' exception when trying to allocate from an...

cyclades: Fix default values for IP pool

Temporary commit to change default offset and size of IPPoolTable
factory.

cyclades: snf-manage floating-ip-attach

snf-manage floating-ip-attach <address> --machine <server_id/router_id>

cyclades: snf-manage floating-ip-release <address>

cyclades: snf-manage port-create

• Create new command snf-manage port-create
• Create new function util.get_security_group

cyclades: Refactor code for allocating IPs

Refactor code that was used for allocating IP addresses and creating
NetworkInterfaces. The new code is more suitable to the new DB schema
where each network may have many IPv4 subnets and each subnet may
have many IP pools. Also, the new functions are using prefetch related...

cyclades: Fix code for networks logic and API

Integrate /networks API call

cyclades: Make API server tests pass

Refactor Cyclades code so that it follows the new models for Networks,
Subnets and IPAddresses. This refactor is not complete. Instead is the
necessary refactor for making tests for server API calls succeed.

cyclades: Use NIC UUID in firewall tags

Use NICs UUID instead of index to generate firewall tags. Make the
'set_firewall_profile' action to take the NICs ID as argument. Also,
update the firewall settings.

cyclades: Use Ganeti NIC UUIDs

Since Ganeti 2.8, it is supported to refer to devices (NICs and Disks)
not only by their index but also by their name or UUID. This commit
updates Synnefo to refer to devices by their name. Synnefo will set the
name of the devices which will be a UUID. We do not use Ganeti's UUIDs...

cyclades: Move code for validating network values

Move code for network parameters validation from 'api' module to 'logic'.

cyclades: Support IPv6 only networks

Make Cyclades support IPv6 only networks. Such networks will have
the 'subnet' attribute set to None, in the same way that IPv4 only
networks have the 'subnet6' attribute set to None.

Because currently Ganeti does not support IPv6 only networks, we create the...

cyclades: Remove PUBLIC_USE_POOL setting

Remove PUBLIC_USE_POOL setting, since in order to use floating IPs, the
cyclades must be responsible for managing all IP pools.

cyclades: Auto allocate a floating IP

Make 'pool' attribute of POST /os-floating-ips request optional. If
attribute is missing, the server will allocate a floating IP from one of
the available public networks.

cyclades: Handle 'EmptyPool' in util method

Refactor cyclades code to handle 'EmptyPool' exception in
'get_network_free_address' function.

cyclades: Add 'links' to compute endpoints

Add 'links' attribute to API responses for servers, networks, flavors
and images endpoints.

cyclades: Add 'drained' flag to Network

Extend Network model with the 'drained' attribute, to indicate whether a
network should be used in public IP allocation when creating servers.
This option is only useful for public networks.

cyclades: Fix stale 'DeletedError' exception

plankton: Cleanup and improve code

• Remove unused code
• Remove 'plankton_method' decorator that added an ImageBackend to
  requests an replace it with 'image_backend' context manager. This
  context manager is responsible for opening and closing connections...

Remove VM/Network DeletedError and BuildingError

Handle these errors explicitly in the code instead of the "api_method"
decorator.

Use common 'api_method' decorator to cyclades api

Update Cyclades API methods to use the new common 'api_method'
decorator. Also, update all the relevant tests.

Move cloud faults to 'snf_django.lib.api.faults'

Gather all faults from all synnefo projects into common
'snf_django.lib.api.faults'.

Fix bug: Detect malformed network subnet

Fix bug in Cyclades network API. API should raise BadRequest if
specified network subnet is invalid. Also, do not allow subnets with
host bits set (like 10.0.0.1/28).

Fix image 'backend_id' for archipelago

Archipelago needs as disk origin, the hashmap of the image
instead of its url in the backend.

Introduce network flavors to replace network types

Add tags and mode to network db model. Replace existing type with
flavor. Introduce 4 different flavors. Each flavor has mode, link,
mac_prefix, tags. Supported flavors are CUSTOM, IP_LESS_ROUTED,
MAC_FILTERED, PHYSICAL_VLAN and are hardcoded in db models....

Merge handling of ext_<provider> disk templates

Merge branch 'origin/devel-0.13' into quota

Conflicts:
snf-cyclades-app/synnefo/api/servers.py

Refactor some code to API create_server method

Use select_for_update for VirtualMachines

Use select_for_update method when accessing VM objects to prevent
race conditions. Also move start_action from logic to api.

Return the VM!

Include deleted networks in get_flavor_info

Block create instance api call with deleted flavor

Do not allow creation of instances with deleted flavors
Refs #2481

Log 5xx API faults

Fix race conditions when updating network objects

Use for_update() object manager in order to exclude race conditions
when updating network objects.

Unique mac-prefix only for mac-filtered networks

Implement multiple public networks

Implement multiple public networks in order to support:
- different public networks per backend
- non-consecutive IP ranges in each backend

To support this, public networks are treated different from private
ones. Namely, they are correlated with one backend (and so have...

Implement MAC Prefix Management

In order to guarantee uniqueness of MAC address accross all backends,
synnefo assignes a unique mac prefix to each network in each backend.

A mac-prefix of 20 bits, which is picked from the MacPrefixPool, is
assigned to each Network. The mac-prefix of the network in each...

Update servers/networks responses for new API

- Reponses for servers and netowrks details (list or solo) are now
consistent to recent backend changes.
- Methods get_nic_from_index and construct_nic_id have been created
- Syntax for nic removal from network/vm has been adjusted

Use lib.astakos instead of our own middleware

Merge remote-tracking branch 'origin/master' into astakos-integration

Conflicts:
runtests.sh
snf-cyclades-app/synnefo/aai/__init__.py
snf-cyclades-app/synnefo/aai/fixtures/auth_test_data.json
snf-cyclades-app/synnefo/aai/middleware.py
snf-cyclades-app/synnefo/aai/models.py...