Statistics
| Branch: | Tag: | Revision:

root / ci @ 7a8e156f

# Date Author Comment
7a8e156f 11/19/2013 03:00 pm Ilias Tsitsimpis

snf-ci: Fix a typo

03f01e0d 11/14/2013 09:52 am Dimitris Aragiorgis

deploy: update ganeti and nfqueue packages

Use latest custom 2.8.2 ganeti which consists of ganeti-haskell,
ganeti-htools, snf-ganeti.

nfqueue-bindings-python is replaced by python-nfqueue in
wheezy. Use our custom package which supports an extra method...

a1dae38d 11/12/2013 01:34 pm Christos Stavrakakis

Merge branch 'feature-cyclades-networks' into develop

Conflicts:
snf-cyclades-app/synnefo/api/management/commands/server-inspect.py
snf-cyclades-app/synnefo/app_settings/urls.py
snf-cyclades-app/synnefo/logic/backend.py
snf-cyclades-app/synnefo/logic/backend_allocator.py...

cb1060f2 10/29/2013 04:15 pm Ilias Tsitsimpis

ci: Extend tests.sh to run astakosclient unittests

a7d32e21 10/29/2013 04:15 pm Ilias Tsitsimpis

ci: Prefer IPv4 over IPv6

Set up the newly created machine to prefer IPv4 connections
(mainly for apt-get) over IPv6 connections.

e77c59a6 10/25/2013 05:59 pm Ilias Tsitsimpis

snf-ci: Run the unit tests for cyclades-userdata

84d2db4f 10/25/2013 04:32 pm Ilias Tsitsimpis

ci: kamaki config.get_global method is deprecated

Use the newer config.get("global", ..) syntax.
Fallback to the old one for older version of kamaki.

09f7ad00 10/23/2013 11:07 am Ilias Tsitsimpis

ci: Improve pep8 script

Rewrite the script in python.
Invoke pep8 for a list of files given in the command line.
Exclude files which are not python ones (their names don't
end with .py) or are not real files (i.e. have been removed
during the last commit).

99d39120 10/10/2013 12:17 pm Ilias Tsitsimpis

snf-ci: Bulid pithos-web-client package

Synnefo depends on pithos-web-client. Up until now
we were downloading this package from apt.dev.grnet.gr.
But when we make a change in Synnefo that also affects
pithos-web-client, we have to upload a new version of...

2b4f7cc5 10/09/2013 07:31 pm Christos Stavrakakis

deploy: Install snf-ganeti 2.8 from unstable

81cb992d 10/09/2013 11:40 am Christos Stavrakakis

deploy: Update nfqueue-bindings-python dependency

c0dc9e93 10/08/2013 04:02 pm Dimitris Aragiorgis

snf-deploy: Remove packages.conf

This is not needed any more because we have squeeze and wheezy ones

Signed-off-by: Dimitris Aragiorgis <>

04660f63 10/08/2013 04:02 pm Dimitris Aragiorgis

snf-deploy: fix snf-deploy ganeti

A typo and explicitely install drbd8-utils package for ganeti.

Signed-off-by: Dimitris Aragiorgis <>

010e6c43 10/03/2013 06:37 pm Giorgos Korfiatis

ci: Fix install script

Check correctly for environment variable $VIRTUAL_ENV;
pass option -N in `setup.py develop'.

ed0dd751 10/03/2013 05:55 pm Ilias Tsitsimpis

snf-deploy: Change email backend file location

Change Django's filebased email backend location
from '/var/log/gunicorn/synnefo-mail/' to
'/var/tmp/synnefo-mail/'. We do this due to permission
errors.

106659f1 10/03/2013 12:02 pm Ilias Tsitsimpis

snf-ci: Add --no-colors options

By default use a colorful output.

329705c8 10/03/2013 11:37 am Ilias Tsitsimpis

snf-ci: Check uniqueness of build_ids

If the user tries to overwrite a build_id that is
already in use, exit with an error message.

09aa843b 10/02/2013 12:50 pm Christos Stavrakakis

deploy: Add python-django to wheezy conf files

7585f464 10/02/2013 11:24 am Ilias Tsitsimpis

ci: Use ci_wheezy.conf as the default ci config

7435e91f 10/01/2013 06:59 pm Christos Stavrakakis

deploy: python-django squeeze-backports

0a70d2c5 10/01/2013 06:16 pm Christos Stavrakakis

Merge branch 'hotfix-0.14.8' into develop

Merge hotfix-0.14.8 which ports Synnefo to wheezy and Django 1.4.5

Conflicts:
ci/ci_squeeze.conf
ci/ci_wheezy.conf
ci/schemas/one_node_squeeze/packages.conf
ci/schemas/one_node_squeeze/squeeze.conf
ci/schemas/one_node_squeeze/wheezy.conf...

c7828946 09/30/2013 05:28 pm Ilias Tsitsimpis

snf-ci: Create new section, even with -n option

2cbdb63f 09/30/2013 05:12 pm Ilias Tsitsimpis

snf-ci: Fix a race condition

When creating a new build_id to be used by snf-ci,
we have to lock the ci_temp_conf file.

7aa13555 09/30/2013 03:43 pm Ilias Tsitsimpis

snf-deploy Use symbolic debian_base_url

For debian_base_url use a link that always resolves
to the latest image.

6be91b06 09/30/2013 03:39 pm Ilias Tsitsimpis

snf-deploy Use symbolic debian_base_url

For debian_base_url use a link that always resolves
to the latest image.

f4cb5d92 09/30/2013 12:14 pm Ilias Tsitsimpis

deploy: Modify dir for filebased email_backend

Allow user to modify the directory that will
be used for the filebased email backend by Django.

Also move the EMAIL_BACKEND option from astakos to
common.

2a2c6c0a 09/25/2013 03:56 pm Ilias Tsitsimpis

deploy: Modify dir for filebased email_backend

Allow user to modify the directory that will
be used for the filebased email backend by Django.

Also move the EMAIL_BACKEND option from astakos to
common.

feec1494 09/25/2013 03:43 pm Christos Stavrakakis

ci: Frist try to use SynnefoCIWheezy image

cbf73c9d 09/25/2013 12:18 pm Ilias Tsitsimpis

deploy: Install rabbitmq from Debian repos

Now that squeeze-backports has 2.8.4-1~bpo60+1 and
wheezy has 2.8.4-1 version we can install rabbitmq-server
from the official Debian repos.

8d2c08e4 09/25/2013 10:55 am Christos Stavrakakis

ci: Use -U when installing with pip

6a14ac68 09/24/2013 05:18 pm Ilias Tsitsimpis

ci: Fix a bug with config_file relative filepath

2c4a641b 09/24/2013 05:10 pm Ilias Tsitsimpis

ci: Fix a bug with config_file relative filepath

170ac4b1 09/24/2013 04:44 pm Ilias Tsitsimpis

ci: Support wheezy installation

  • Add new schema (one_node_wheezy) and rename the old
    one to one_node_squeeze.
  • Add new ci config file (ci_wheezy.conf) and rename the
    old one to ci_squeeze.conf.
9e6eecbc 09/24/2013 04:44 pm Ilias Tsitsimpis

ci: Support wheezy installation

  • Add new schema (one_node_wheezy) and rename the old
    one to one_node_squeeze.
  • Add new ci config file (ci_wheezy.conf) and rename the
    old one to ci_squeeze.conf.
4a23280d 09/24/2013 12:51 pm Christos Stavrakakis

ci: Do not run pithos tests by default

fcfef550 09/24/2013 12:30 pm Ilias Tsitsimpis

ci: Add xterm into published applications

Published applications are used by X2Go and makes it possible to
display a menu with a list of the available remote applications
for the user, which when started behaves like a locally installed
application.

e213881d 09/24/2013 12:27 pm Ilias Tsitsimpis

ci: Add an x2goplugin command to snf-ci

With this command snf-ci produces an html file
which uses the x2goplugin to connect to the remote
machine.

5079dec2 09/24/2013 11:20 am Christos Stavrakakis

Various fixes to make tests work in hotfix branch

  • Remove PithosTestSuiteRunner because it is only implemented in
    develop branch
  • Do not run pithos tests by default
9b9d719c 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Change deploy config files

Whenever we change deploy's config files, we also have to
change the snf-ci's schema files.

0373e3cf 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Fix a bug

Flavor ids are integers so we have to turn them
into strings before comparing them with our value.

4b9ae9a2 09/24/2013 10:55 am Ilias Tsitsimpis

Remove obsolete autopkg_debian script

01b47803 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Change pep8 script

Instead of pep8 testing all files, the script
now accepts a list of files to be checked.

3f868eeb 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Exit if there are no file to check with pep8

b3a67b6e 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Check only .py files for pep8 errors

dfaacac0 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Strip \" from `py_files'

We want to pass `py_files' to pep8 command
as arguments and not as one single string.

fd55102c 09/24/2013 10:55 am Dimitris Aragiorgis

ci: add missing squeeze/wheezy conf files

Signed-off-by: Dimitris Aragiorgis <>

3f9db536 09/24/2013 10:55 am Christos Stavrakakis

snf-django: pep8 fixes

f8607bde 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Change run_burnin exit status

Make run_burnin snf-ci function to exit with the same
exit code as snf-burnin did.

0b0d69f5 09/24/2013 10:55 am Christos Stavrakakis

deploy: By default use only file disk template

By default snf-deploy will not enable lvm and drbd storage. So, the
default setting for flavors should include only 'file' disk template.

87e2667b 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Instruct snf-deploy to generate ssh keys

1d9f2031 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Allow the use of local repo

Instead of cloning Synnefo from its official repo,
user can choose (using --local-repo option, or by not
setting the synnefo_repo config parameter) to use
his local repo.

c1bd5d1c 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Remove ssh_keys value from config file

064d2f1b 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Install firefox

eaf0b161 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Install x2goserver

e5d2788b 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Remove forgotten debug message

fb4988ce 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Automatic yes to apt-get prompts

6f8b2632 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Improve flavors/images finder

Allow for search both by name (using regular
expressions) or by id.

8baa4ae7 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Fix bugs with path expansion

Python does not do any automatic path expansions.
User has to call functions such as expanduser() and
expandvars().

Add uesr's id_rsa.pub file as default ssh_keys file.

69a64e60 09/24/2013 10:55 am Christos Stavrakakis

ci: Add build ID to server name

4b61ee63 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Implement file lock mechanism for temp_config

Before writing to temp config file, acquire a lock
and re-read it's contents to make sure we don't
overwrite anything.

c4c22bb4 09/24/2013 10:55 am Christos Stavrakakis

ci: Handle ssh access for demo.synnefo.org

8ed8742f 09/24/2013 10:55 am Christos Stavrakakis

deploy: Performance tune for postgresql

Turn off fsync, synchronous_commit and full_pages_writer to speed up
postgresql. DB is not no longer crash-safe, but this is no needed for
tests.

Also, introduce 'testing_vm' setting to distinquish between the type of...

769db39e 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Add --force-yes option to apt-get install

fe402df2 09/24/2013 10:55 am Christos Stavrakakis

ci: Verify values of image and flavor options

31922f7e 09/24/2013 10:55 am Christos Stavrakakis

ci: Allow multiple commands in snf-ci script

Allow snf-ci script to accept a comma seperated list of commands to run.

ac1e7de3 09/24/2013 10:55 am Christos Stavrakakis

ci: Include user images and config improvements

Include the user images in the list of images that are matched against
the image name from the config file. Also, change config file to use
archipelago flavors and create instances from the SynnefoCI image.

ac23e868 09/24/2013 10:55 am Dionysis Grigoropoulos

ci: update ci/schemas/one_node/synnefo.conf

39dd21c2 09/24/2013 10:55 am Christos Stavrakakis

ci: Disable snf-deploy colors

Use --disable-colors option of snf-deploy to disable colors when
running snf-deploy from ci scripts.

c314fcd2 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Get flavor by name

The option flavor_name support a list of flavors to try.

Refs #4192

24ccf5d3 09/24/2013 10:55 am Ilias Tsitsimpis

ci: snf-deploy is now part of Synnefo software

Install snf-deploy from the Synnefo repo
and not from it's old one.

c441b6a7 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Temporary_config supports multiple machines

Use one temporary_config that will contain information
about every machine we have build until now, so we
can go back and use/inspect one of them.

Refs #4199

ef695867 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Better handling of build_ids

Now a new build id is created every time we issue a
create command and build_id is None. Any subsequent
commands will use this build_id.

In case we don't provide a build_id (None) and we
try to run a command other than create (that needs to...

19b7ddfb 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Update schema files

Package snf-deploy has add a new section (keys) in deploy.conf

3fbbd85d 09/24/2013 10:55 am Christos Stavrakakis

ci: Helper script to run ci commands

Make 'snf-ci' python script to run CI commands.

0082c787 09/24/2013 10:55 am Christos Stavrakakis

ci: Make some options optional

Make 'ssh_keys' and 'accept_ssh_from' optional, since there are not
mandatory for ci to work.

e2db4a57 09/24/2013 10:55 am Christos Stavrakakis

ci: Add option to override configuration file

Add 'config_file' argument to SynnefoCI in order to use a different
configuration file. Also, added the corresponding option to 'snf-ci'
scirpt.

85bcc8da 09/24/2013 10:55 am Christos Stavrakakis

ci: Merge 'fetch_packages.py' to snf-ci script

Add '--fetch-packages' option to snf-ci script, in order to download the
created debian packages.

46a07468 09/24/2013 10:55 am Christos Stavrakakis

ci: Add option to override schema

024faf05 09/24/2013 10:55 am Christos Stavrakakis

ci: Parse branch from repository

Guess the branch to build, based on the current branch of the
repository. Also track all remote branches when cloning Synnefo, because
it is needed by devflow.

ee2419c5 09/24/2013 10:55 am Christos Stavrakakis

ci: Specify directory to fetch packages to

124c300e 09/24/2013 10:55 am Christos Stavrakakis

ci: Add option to build and fetch documentation

358750d8 09/24/2013 10:55 am Christos Stavrakakis

ci: Create version files before building docs

Run 'devflow-update-version' to create all the version files, before
trying to build the docs.

b642f737 09/24/2013 10:55 am Christos Stavrakakis

ci: s/mail/email in git config

0ab2fa42 09/24/2013 10:55 am Christos Stavrakakis

ci: Add --noinput option to tests

Modify tests script to pass the --noinput option to snf-manage test
command, so that Django will promt user for any input.

33ad9a0d 09/24/2013 10:55 am Ilias Tsitsimpis

ci: pep8 fixes

f195386e 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Use -c as sort version of --conf

Follow kamaki convention where -c should mean --conf
and not --cloud.

60ddcdc3 09/24/2013 10:55 am Ilias Tsitsimpis

ci: turn system_uuid option into a hardcoded one

User doesn't need to specify the UUID of the owner of
system images (it's usually hard to find it).

Instead save the uuids for these users for our production and
testing deployments inside a list (DEFAULT_SYSTEM_IMAGES_UUID) and...

d8363ea2 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Redirect logging to stdout/stderr

Use stdout for info/debug messages and stderr for
warning/error messages.

4c818bb2 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Add --ssh-keys command line option

Using this option one can specify a file containing
ssh authentication keys to be uploaded and installed
on the newly created server.

2fab294e 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Add support for downloading ssh_keys file

Currently support http, https and ftp protocols
using the wget utility.

dae06cfc 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Specify a flavor_name instead of a flavor_id

Specify a flavor_name (in form of a reg expression) to use.

525f2979 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Redesign CI scripts

Spawn VM to use as builder-slave.
Build packages inside this VM.
Deploy Synnefo using snf-deploy.
Run unit tests.
Run functional tests using burnin.

2255812d 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Fix some typos in utils.py

c04c5379 09/24/2013 10:55 am Ilias Tsitsimpis

ci: Include commands between $()

8a276529 09/24/2013 10:55 am Christos Stavrakakis

ci: Install south from squeeze-backports

133e5a5b 09/24/2013 10:55 am Christos Stavrakakis

ci: Fixes to ci code

  • override config file from env variable
  • pep8 fixes
  • do not display vm password
  • fail if cloning repo fails
  • do not use eval
5c3b5c9f 09/24/2013 10:55 am Christos Stavrakakis

ci: Copy ssh keys

Add option for copying ssh keys to the created vm.

da593e0c 09/24/2013 10:55 am Christos Stavrakakis

ci: Get credentials by kamakirc

Get credentials for deployment from .kamakirc instead of config file.
Also, add option in config file indicating which cloud for kamaki to
use. Finally, add option in SynnefoCI to override the cloud from config.

Refs #4193

947b6106 09/24/2013 10:55 am Christos Stavrakakis

ci: Option to override image and flavor

Add option to use a custom image_id and flavor_id instead of getting
them from config file.

ddd240ff 09/24/2013 10:55 am Christos Stavrakakis

ci: Remove 'deploy_on_io' option

Remove the 'deploy_on_io' option. Instead check if you will need to
compute manually the ssh port by the domain of the cyclades url.