Statistics
| Branch: | Tag: | Revision:

root / ci / utils.py @ 9f41ab1e

History | View | Annotate | Download (37.3 kB)

# Date Author Comment
2afd10bf 12/02/2013 02:12 pm Ilias Tsitsimpis

snf-ci: Update burnin command line parameters

Add the kamaki_version parameter to the ci config file.
Using this parameter the user can specify a version of kamaki
to be used (mostly by burnin).

Force the use of version 0.11next-1811-197b413 for kamaki,...

2945e7ed 11/22/2013 04:35 pm Christos Stavrakakis

ci: Add --name option to override server name

7a8e156f 11/19/2013 03:00 pm Ilias Tsitsimpis

snf-ci: Fix a typo

cb1060f2 10/29/2013 04:15 pm Ilias Tsitsimpis

ci: Extend tests.sh to run astakosclient unittests

a7d32e21 10/29/2013 04:15 pm Ilias Tsitsimpis

ci: Prefer IPv4 over IPv6

Set up the newly created machine to prefer IPv4 connections
(mainly for apt-get) over IPv6 connections.

84d2db4f 10/25/2013 04:32 pm Ilias Tsitsimpis

ci: kamaki config.get_global method is deprecated

Use the newer config.get("global", ..) syntax.
Fallback to the old one for older version of kamaki.

09f7ad00 10/23/2013 11:07 am Ilias Tsitsimpis

ci: Improve pep8 script

Rewrite the script in python.
Invoke pep8 for a list of files given in the command line.
Exclude files which are not python ones (their names don't
end with .py) or are not real files (i.e. have been removed
during the last commit).

99d39120 10/10/2013 12:17 pm Ilias Tsitsimpis

snf-ci: Bulid pithos-web-client package

Synnefo depends on pithos-web-client. Up until now
we were downloading this package from apt.dev.grnet.gr.
But when we make a change in Synnefo that also affects
pithos-web-client, we have to upload a new version of...

106659f1 10/03/2013 12:02 pm Ilias Tsitsimpis

snf-ci: Add --no-colors options

By default use a colorful output.

329705c8 10/03/2013 11:37 am Ilias Tsitsimpis

snf-ci: Check uniqueness of build_ids

If the user tries to overwrite a build_id that is
already in use, exit with an error message.

7585f464 10/02/2013 11:24 am Ilias Tsitsimpis

ci: Use ci_wheezy.conf as the default ci config

0a70d2c5 10/01/2013 06:16 pm Christos Stavrakakis

Merge branch 'hotfix-0.14.8' into develop

Merge hotfix-0.14.8 which ports Synnefo to wheezy and Django 1.4.5

Conflicts:
ci/ci_squeeze.conf
ci/ci_wheezy.conf
ci/schemas/one_node_squeeze/packages.conf
ci/schemas/one_node_squeeze/squeeze.conf
ci/schemas/one_node_squeeze/wheezy.conf...

c7828946 09/30/2013 05:28 pm Ilias Tsitsimpis

snf-ci: Create new section, even with -n option

2cbdb63f 09/30/2013 05:12 pm Ilias Tsitsimpis

snf-ci: Fix a race condition

When creating a new build_id to be used by snf-ci,
we have to lock the ci_temp_conf file.

8d2c08e4 09/25/2013 10:55 am Christos Stavrakakis

ci: Use -U when installing with pip

6a14ac68 09/24/2013 05:18 pm Ilias Tsitsimpis

ci: Fix a bug with config_file relative filepath

2c4a641b 09/24/2013 05:10 pm Ilias Tsitsimpis

ci: Fix a bug with config_file relative filepath

170ac4b1 09/24/2013 04:44 pm Ilias Tsitsimpis

ci: Support wheezy installation

  • Add new schema (one_node_wheezy) and rename the old
    one to one_node_squeeze.
  • Add new ci config file (ci_wheezy.conf) and rename the
    old one to ci_squeeze.conf.
9e6eecbc 09/24/2013 04:44 pm Ilias Tsitsimpis

ci: Support wheezy installation

  • Add new schema (one_node_wheezy) and rename the old
    one to one_node_squeeze.
  • Add new ci config file (ci_wheezy.conf) and rename the
    old one to ci_squeeze.conf.
fcfef550 09/24/2013 12:30 pm Ilias Tsitsimpis

ci: Add xterm into published applications

Published applications are used by X2Go and makes it possible to
display a menu with a list of the available remote applications
for the user, which when started behaves like a locally installed
application.

e213881d 09/24/2013 12:27 pm Ilias Tsitsimpis

ci: Add an x2goplugin command to snf-ci

With this command snf-ci produces an html file
which uses the x2goplugin to connect to the remote
machine.

0373e3cf 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Fix a bug

Flavor ids are integers so we have to turn them
into strings before comparing them with our value.

f8607bde 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Change run_burnin exit status

Make run_burnin snf-ci function to exit with the same
exit code as snf-burnin did.

87e2667b 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Instruct snf-deploy to generate ssh keys

1d9f2031 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Allow the use of local repo

Instead of cloning Synnefo from its official repo,
user can choose (using --local-repo option, or by not
setting the synnefo_repo config parameter) to use
his local repo.

064d2f1b 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Install firefox

eaf0b161 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Install x2goserver

e5d2788b 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Remove forgotten debug message

fb4988ce 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Automatic yes to apt-get prompts

6f8b2632 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Improve flavors/images finder

Allow for search both by name (using regular
expressions) or by id.

8baa4ae7 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Fix bugs with path expansion

Python does not do any automatic path expansions.
User has to call functions such as expanduser() and
expandvars().

Add uesr's id_rsa.pub file as default ssh_keys file.

69a64e60 09/24/2013 10:55 am Christos Stavrakakis

ci: Add build ID to server name

4b61ee63 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Implement file lock mechanism for temp_config

Before writing to temp config file, acquire a lock
and re-read it's contents to make sure we don't
overwrite anything.

c4c22bb4 09/24/2013 10:55 am Christos Stavrakakis

ci: Handle ssh access for demo.synnefo.org

769db39e 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Add --force-yes option to apt-get install

fe402df2 09/24/2013 10:55 am Christos Stavrakakis

ci: Verify values of image and flavor options

ac1e7de3 09/24/2013 10:55 am Christos Stavrakakis

ci: Include user images and config improvements

Include the user images in the list of images that are matched against
the image name from the config file. Also, change config file to use
archipelago flavors and create instances from the SynnefoCI image.

39dd21c2 09/24/2013 10:55 am Christos Stavrakakis

ci: Disable snf-deploy colors

Use --disable-colors option of snf-deploy to disable colors when
running snf-deploy from ci scripts.

c314fcd2 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Get flavor by name

The option flavor_name support a list of flavors to try.

Refs #4192

24ccf5d3 09/24/2013 10:55 am Ilias Tsitsimpis

ci: snf-deploy is now part of Synnefo software

Install snf-deploy from the Synnefo repo
and not from it's old one.

c441b6a7 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Temporary_config supports multiple machines

Use one temporary_config that will contain information
about every machine we have build until now, so we
can go back and use/inspect one of them.

Refs #4199

ef695867 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Better handling of build_ids

Now a new build id is created every time we issue a
create command and build_id is None. Any subsequent
commands will use this build_id.

In case we don't provide a build_id (None) and we
try to run a command other than create (that needs to...

0082c787 09/24/2013 10:55 am Christos Stavrakakis

ci: Make some options optional

Make 'ssh_keys' and 'accept_ssh_from' optional, since there are not
mandatory for ci to work.

e2db4a57 09/24/2013 10:55 am Christos Stavrakakis

ci: Add option to override configuration file

Add 'config_file' argument to SynnefoCI in order to use a different
configuration file. Also, added the corresponding option to 'snf-ci'
scirpt.

85bcc8da 09/24/2013 10:55 am Christos Stavrakakis

ci: Merge 'fetch_packages.py' to snf-ci script

Add '--fetch-packages' option to snf-ci script, in order to download the
created debian packages.

46a07468 09/24/2013 10:55 am Christos Stavrakakis

ci: Add option to override schema

024faf05 09/24/2013 10:55 am Christos Stavrakakis

ci: Parse branch from repository

Guess the branch to build, based on the current branch of the
repository. Also track all remote branches when cloning Synnefo, because
it is needed by devflow.

ee2419c5 09/24/2013 10:55 am Christos Stavrakakis

ci: Specify directory to fetch packages to

124c300e 09/24/2013 10:55 am Christos Stavrakakis

ci: Add option to build and fetch documentation

358750d8 09/24/2013 10:55 am Christos Stavrakakis

ci: Create version files before building docs

Run 'devflow-update-version' to create all the version files, before
trying to build the docs.

b642f737 09/24/2013 10:55 am Christos Stavrakakis

ci: s/mail/email in git config

33ad9a0d 09/24/2013 10:55 am Ilias Tsitsimpis

ci: pep8 fixes

60ddcdc3 09/24/2013 10:55 am Ilias Tsitsimpis

ci: turn system_uuid option into a hardcoded one

User doesn't need to specify the UUID of the owner of
system images (it's usually hard to find it).

Instead save the uuids for these users for our production and
testing deployments inside a list (DEFAULT_SYSTEM_IMAGES_UUID) and...

d8363ea2 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Redirect logging to stdout/stderr

Use stdout for info/debug messages and stderr for
warning/error messages.

4c818bb2 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Add --ssh-keys command line option

Using this option one can specify a file containing
ssh authentication keys to be uploaded and installed
on the newly created server.

2fab294e 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Add support for downloading ssh_keys file

Currently support http, https and ftp protocols
using the wget utility.

dae06cfc 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Specify a flavor_name instead of a flavor_id

Specify a flavor_name (in form of a reg expression) to use.

525f2979 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Redesign CI scripts

Spawn VM to use as builder-slave.
Build packages inside this VM.
Deploy Synnefo using snf-deploy.
Run unit tests.
Run functional tests using burnin.

2255812d 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Fix some typos in utils.py

c04c5379 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Include commands between $()

133e5a5b 09/24/2013 10:55 am Christos Stavrakakis

ci: Fixes to ci code

  • override config file from env variable
  • pep8 fixes
  • do not display vm password
  • fail if cloning repo fails
  • do not use eval
5c3b5c9f 09/24/2013 10:55 am Christos Stavrakakis

ci: Copy ssh keys

Add option for copying ssh keys to the created vm.

da593e0c 09/24/2013 10:55 am Christos Stavrakakis

ci: Get credentials by kamakirc

Get credentials for deployment from .kamakirc instead of config file.
Also, add option in config file indicating which cloud for kamaki to
use. Finally, add option in SynnefoCI to override the cloud from config.

Refs #4193

947b6106 09/24/2013 10:55 am Christos Stavrakakis

ci: Option to override image and flavor

Add option to use a custom image_id and flavor_id instead of getting
them from config file.

ddd240ff 09/24/2013 10:55 am Christos Stavrakakis

ci: Remove 'deploy_on_io' option

Remove the 'deploy_on_io' option. Instead check if you will need to
compute manually the ssh port by the domain of the cyclades url.

8ddb541b 09/23/2013 05:33 pm Ilias Tsitsimpis

ci: Add xterm into published applications

Published applications are used by X2Go and makes it possible to
display a menu with a list of the available remote applications
for the user, which when started behaves like a locally installed
application.

cf99ca80 09/23/2013 04:37 pm Ilias Tsitsimpis

ci: Add an x2goplugin command to snf-ci

With this command snf-ci produces an html file
which uses the x2goplugin to connect to the remote
machine.

694c79bb 09/20/2013 11:56 am Ilias Tsitsimpis

ci: Fix a bug

Flavor ids are integers so we have to turn them
into strings before comparing them with our value.

985442f5 09/19/2013 03:54 pm Ilias Tsitsimpis

ci: Instruct snf-deploy to generate ssh keys

281c7634 09/16/2013 05:17 pm Ilias Tsitsimpis

ci: Change run_burnin exit status

Make run_burnin snf-ci function to exit with the same
exit code as snf-burnin did.

905bb10b 09/07/2013 05:59 pm Christos Stavrakakis

ci: Include user images and config improvements

Include the user images in the list of images that are matched against
the image name from the config file. Also, change config file to use
archipelago flavors and create instances from the SynnefoCI image.

6958ffc6 09/07/2013 05:30 pm Christos Stavrakakis

ci: Verify values of image and flavor options

71f2649f 08/28/2013 12:52 pm Ilias Tsitsimpis

ci: Add --force-yes option to apt-get install

705f70a9 08/27/2013 09:00 am Christos Stavrakakis

ci: Handle ssh access for demo.synnefo.org

62fcf0e5 08/26/2013 03:36 pm Ilias Tsitsimpis

ci: Implement file lock mechanism for temp_config

Before writing to temp config file, acquire a lock
and re-read it's contents to make sure we don't
overwrite anything.

07c13754 08/26/2013 01:05 pm Christos Stavrakakis

ci: Add build ID to server name

6058ae72 08/23/2013 06:04 pm Ilias Tsitsimpis

ci: Fix bugs with path expansion

Python does not do any automatic path expansions.
User has to call functions such as expanduser() and
expandvars().

Add uesr's id_rsa.pub file as default ssh_keys file.

358a19bc 08/23/2013 03:31 pm Ilias Tsitsimpis

ci: Improve flavors/images finder

Allow for search both by name (using regular
expressions) or by id.

3754fdcd 08/23/2013 01:00 pm Ilias Tsitsimpis

ci: Automatic yes to apt-get prompts

d1f57c47 08/22/2013 05:18 pm Ilias Tsitsimpis

ci: Remove forgotten debug message

6c3cc77e 08/22/2013 05:06 pm Ilias Tsitsimpis

ci: Install x2goserver

07710fc3 08/22/2013 01:28 pm Ilias Tsitsimpis

ci: Install firefox

5323404f 08/21/2013 01:48 pm Ilias Tsitsimpis

ci: Allow the use of local repo

Instead of cloning Synnefo from its official repo,
user can choose (using --local-repo option, or by not
setting the synnefo_repo config parameter) to use
his local repo.

b7496c88 08/20/2013 05:36 pm Ilias Tsitsimpis

ci: Better handling of build_ids

Now a new build id is created every time we issue a
create command and build_id is None. Any subsequent
commands will use this build_id.

In case we don't provide a build_id (None) and we
try to run a command other than create (that needs to...

79144a72 08/20/2013 04:07 pm Ilias Tsitsimpis

ci: Temporary_config supports multiple machines

Use one temporary_config that will contain information
about every machine we have build until now, so we
can go back and use/inspect one of them.

Refs #4199

1c230fd8 08/20/2013 01:50 pm Ilias Tsitsimpis

ci: snf-deploy is now part of Synnefo software

Install snf-deploy from the Synnefo repo
and not from it's old one.

a8bfeffc 08/20/2013 01:25 pm Ilias Tsitsimpis

ci: Get flavor by name

The option flavor_name support a list of flavors to try.

Refs #4192

f82ce32a 08/20/2013 08:33 am Christos Stavrakakis

ci: Disable snf-deploy colors

Use --disable-colors option of snf-deploy to disable colors when
running snf-deploy from ci scripts.

ad21ffa9 08/06/2013 01:37 pm Ilias Tsitsimpis

ci: Specify a flavor_name instead of a flavor_id

Specify a flavor_name (in form of a reg expression) to use.

e2a0abb8 08/05/2013 05:18 pm Ilias Tsitsimpis

ci: pep8 fixes

62f3f54f 08/05/2013 05:18 pm Ilias Tsitsimpis

ci: turn system_uuid option into a hardcoded one

User doesn't need to specify the UUID of the owner of
system images (it's usually hard to find it).

Instead save the uuids for these users for our production and
testing deployments inside a list (DEFAULT_SYSTEM_IMAGES_UUID) and...

56ee1bbc 08/05/2013 05:18 pm Ilias Tsitsimpis

ci: Redirect logging to stdout/stderr

Use stdout for info/debug messages and stderr for
warning/error messages.

6868804a 08/05/2013 05:18 pm Ilias Tsitsimpis

ci: Add --ssh-keys command line option

Using this option one can specify a file containing
ssh authentication keys to be uploaded and installed
on the newly created server.

4b743650 08/05/2013 05:18 pm Ilias Tsitsimpis

ci: Add support for downloading ssh_keys file

Currently support http, https and ftp protocols
using the wget utility.

b52c7bb0 08/02/2013 02:23 pm Christos Stavrakakis

ci: s/mail/email in git config

f041c796 08/02/2013 01:36 pm Christos Stavrakakis

ci: Create version files before building docs

Run 'devflow-update-version' to create all the version files, before
trying to build the docs.

88e6558b 08/02/2013 01:23 pm Christos Stavrakakis

ci: Add option to build and fetch documentation

e2dc37b2 08/02/2013 09:56 am Christos Stavrakakis

ci: Specify directory to fetch packages to

b69b55ca 08/02/2013 09:55 am Christos Stavrakakis

ci: Parse branch from repository

Guess the branch to build, based on the current branch of the
repository. Also track all remote branches when cloning Synnefo, because
it is needed by devflow.

ec8bc030 08/02/2013 09:54 am Christos Stavrakakis

ci: Add option to override schema