Synnefo

snf-ci: Replace usage of CachedAstakosClient

CachedAstakosClient is an internal class of kamaki.
Instead of using this, use the AstakosClient class that
kamaki re-exports from astakosclient library.

Huuuuge snf-deploy refactor

Introduce the concept of Roles and Components.

Roles are ns, mq, db, nfs, astakos, cyclades, pithos, cms, stats,
ganeti, master, and client.

Each role consists of various SynnefoComponents which should define:

• commands to check installation prerequisites (check)...

snf-ci: Fix a typo with `network_id'

snf-ci: Don't install kamaki from pypi

snf-ci: Add delete command

This patch adds the delete command to snf-ci which deletes
ci's created servers. Also it delete the floating IP attached
to the deleted server.

snf-ci: Update burnin command line parameters

Add the kamaki_version parameter to the ci config file.
Using this parameter the user can specify a version of kamaki
to be used (mostly by burnin).

Force the use of version 0.11next-1811-197b413 for kamaki,...

snf-ci: Fix a typo

ci: Prefer IPv4 over IPv6

Set up the newly created machine to prefer IPv4 connections
(mainly for apt-get) over IPv6 connections.

ci: Improve pep8 script

Rewrite the script in python.
Invoke pep8 for a list of files given in the command line.
Exclude files which are not python ones (their names don't
end with .py) or are not real files (i.e. have been removed
during the last commit).

snf-ci: Add --no-colors options

By default use a colorful output.

ci: Use ci_wheezy.conf as the default ci config

snf-ci: Create new section, even with -n option

ci: Use -U when installing with pip

ci: Fix a bug with config_file relative filepath

ci: Support wheezy installation

• Add new schema (one_node_wheezy) and rename the old
  one to one_node_squeeze.
• Add new ci config file (ci_wheezy.conf) and rename the
  old one to ci_squeeze.conf.

ci: Add an x2goplugin command to snf-ci

With this command snf-ci produces an html file
which uses the x2goplugin to connect to the remote
machine.

ci: Change run_burnin exit status

Make run_burnin snf-ci function to exit with the same
exit code as snf-burnin did.

ci: Allow the use of local repo

Instead of cloning Synnefo from its official repo,
user can choose (using --local-repo option, or by not
setting the synnefo_repo config parameter) to use
his local repo.

ci: Install x2goserver

ci: Automatic yes to apt-get prompts

ci: Fix bugs with path expansion

Python does not do any automatic path expansions.
User has to call functions such as expanduser() and
expandvars().

Add uesr's id_rsa.pub file as default ssh_keys file.

ci: Implement file lock mechanism for temp_config

Before writing to temp config file, acquire a lock
and re-read it's contents to make sure we don't
overwrite anything.

ci: Add --force-yes option to apt-get install

ci: Include user images and config improvements

Include the user images in the list of images that are matched against
the image name from the config file. Also, change config file to use
archipelago flavors and create instances from the SynnefoCI image.

ci: Get flavor by name

The option flavor_name support a list of flavors to try.

Refs #4192

ci: Temporary_config supports multiple machines

Use one temporary_config that will contain information
about every machine we have build until now, so we
can go back and use/inspect one of them.

Refs #4199

ci: Make some options optional

Make 'ssh_keys' and 'accept_ssh_from' optional, since there are not
mandatory for ci to work.

ci: Merge 'fetch_packages.py' to snf-ci script

Add '--fetch-packages' option to snf-ci script, in order to download the
created debian packages.

ci: Parse branch from repository

Guess the branch to build, based on the current branch of the
repository. Also track all remote branches when cloning Synnefo, because
it is needed by devflow.

ci: Add option to build and fetch documentation

ci: s/mail/email in git config

ci: turn system_uuid option into a hardcoded one

User doesn't need to specify the UUID of the owner of
system images (it's usually hard to find it).

Instead save the uuids for these users for our production and
testing deployments inside a list (DEFAULT_SYSTEM_IMAGES_UUID) and...

ci: Add --ssh-keys command line option

Using this option one can specify a file containing
ssh authentication keys to be uploaded and installed
on the newly created server.

ci: Specify a flavor_name instead of a flavor_id

Specify a flavor_name (in form of a reg expression) to use.

ci: Fix some typos in utils.py

ci: Fixes to ci code

• override config file from env variable
• pep8 fixes
• do not display vm password
• fail if cloning repo fails
• do not use eval

ci: Get credentials by kamakirc

Get credentials for deployment from .kamakirc instead of config file.
Also, add option in config file indicating which cloud for kamaki to
use. Finally, add option in SynnefoCI to override the cloud from config.

Refs #4193

ci: Remove 'deploy_on_io' option

Remove the 'deploy_on_io' option. Instead check if you will need to
compute manually the ssh port by the domain of the cyclades url.

ci: Add an x2goplugin command to snf-ci

With this command snf-ci produces an html file
which uses the x2goplugin to connect to the remote
machine.

ci: Instruct snf-deploy to generate ssh keys

ci: Include user images and config improvements

Include the user images in the list of images that are matched against
the image name from the config file. Also, change config file to use
archipelago flavors and create instances from the SynnefoCI image.

ci: Add --force-yes option to apt-get install

ci: Implement file lock mechanism for temp_config

Before writing to temp config file, acquire a lock
and re-read it's contents to make sure we don't
overwrite anything.

ci: Fix bugs with path expansion

Python does not do any automatic path expansions.
User has to call functions such as expanduser() and
expandvars().

Add uesr's id_rsa.pub file as default ssh_keys file.

ci: Automatic yes to apt-get prompts

ci: Install x2goserver

ci: Allow the use of local repo

Instead of cloning Synnefo from its official repo,
user can choose (using --local-repo option, or by not
setting the synnefo_repo config parameter) to use
his local repo.

ci: Temporary_config supports multiple machines

Use one temporary_config that will contain information
about every machine we have build until now, so we
can go back and use/inspect one of them.

Refs #4199

ci: Get flavor by name

The option flavor_name support a list of flavors to try.

Refs #4192

ci: Specify a flavor_name instead of a flavor_id

Specify a flavor_name (in form of a reg expression) to use.