Synnefo

.. image:: images/synnefo-architecture1.png

   :target: _images/synnefo-architecture1.png

Architecture

------------

    The ``--snap`` and ``--size`` are optional, but at least one of them is

    mandatory. e.g:

    ``vlmc create <volumename> --snap <snapname>`` creates a volume named

    volumename from snapshot snapname. The size of the volume is the same as

    the size of the snapshot.

    ``vlmc create <volumename> --size <size>`` creates an empty volume of size

    <size> named <volumename>.

````````````

Here we will describe how to deploy all services, interconnected with each

other, on multiple physical nodes.

synnefo components

------------------

You need to install the appropriate synnefo software components on each node,

depending on its type, see :ref:`Architecture <cyclades-architecture>`.

Please see the page of each synnefo software component for specific

installation instructions, where applicable.

Install the following synnefo components:

Nodes of type :ref:`APISERVER <APISERVER_NODE>`

    Components

    :ref:`snf-common <snf-common>`,

    :ref:`snf-webproject <snf-webproject>`,

    :ref:`snf-cyclades-app <snf-cyclades-app>`

Nodes of type :ref:`GANETI-MASTER <GANETI_MASTER>` and :ref:`GANETI-NODE <GANETI_NODE>`

    Components

    :ref:`snf-common <snf-common>`,

    :ref:`snf-cyclades-gtools <snf-cyclades-gtools>`

Nodes of type :ref:`LOGIC <LOGIC_NODE>`

    Components

    :ref:`snf-common <snf-common>`,

    :ref:`snf-webproject <snf-webproject>`,

    :ref:`snf-cyclades-app <snf-cyclades-app>`.

**Example Update Network Name Request: JSON**::

This is the complete Synnefo Developer's Guide

Tying it all up with kamaki

===========================

kamaki

------

Storage API (Pithos+)

This is the Pithos+ Object Storage API:

Pithos+ clients

---------------

.. _i-apache:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

apache ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Apache Setup

++++++++++++

The following apply to ``astakos``, ``pithos``, ``cyclades`` and ``cms`` nodes.

Here we assume that these nodes have FQDM ``nodeX.example.com``.

First install corresponding packet:

.. code-block:: console

   # apt-get install apache2

In `/etc/apache2/sites-available/synnefo` add:

.. code-block:: console

   <VirtualHost *:80>

     ServerName nodeX.example.com

     RewriteEngine On

     RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI}

   </VirtualHost>

In `/etc/apache2/sites-available/synnefo-ssl` add:

.. code-block:: console

   <IfModule mod_ssl.c>

   <VirtualHost _default_:443>

     ServerName nodeX.example.com

     Alias /static "/usr/share/synnefo/static"

     AllowEncodedSlashes On

     RequestHeader set X-Forwarded-Protocol "https"

     <Proxy * >

       Order allow,deny

       Allow from all

     </Proxy>

     SetEnv                proxy-sendchunked

     SSLProxyEngine        off

     ProxyErrorOverride    off

     ProxyPass        /static !

     ProxyPass        / http://localhost:8080/ retry=0

     ProxyPassReverse / http://localhost:8080/

     SSLEngine on

     SSLCertificateFile    /etc/ssl/certs/ssl-cert-snakeoil.pem

     SSLCertificateKeyFile /etc/ssl/private/ssl-cert-snakeoil.key

   </VirtualHost>

   </IfModule>

Now enable sites and modules by running:

.. code-block:: console

   # a2enmod ssl

   # a2enmod rewrite

   # a2dissite default

   # a2ensite synnefo

   # a2ensite synnefo-ssl

   # a2enmod headers

   # a2enmod proxy_http

Test your Setup:

++++++++++++++++

.. _i-apt:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

apt ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

APT Setup

+++++++++

The following apply to ``synnefo`` nodes.

To be able to download all synnefo components, you need to add the following

lines in `/etc/apt/sources.list.d/synnefo.list` file:

.. code-block:: console

    deb http://apt.dev.grnet.gr squeeze main

    deb-src http://apt.dev.grnet.gr squeeze main

    deb http://apt.dev.grnet.gr squeeze-backports main

    deb-src http://apt.dev.grnet.gr squeeze-backports main

    deb http://backports.debian.org/debian-backports squeeze-backports main

    deb http://www.rabbitmq.com/debian/ testing main

Import the additional repos' GPG key and get the packages list:

.. code-block:: console

   # wget http://www.rabbitmq.com/rabbitmq-signing-key-public.asc

   # apt-key add rabbitmq-signing-key-public.asc

   # curl https://dev.grnet.gr/files/apt-grnetdev.pub | apt-key add -

   # apt-get update

Test your Setup:

++++++++++++++++

.. _i-astakos:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

astakos ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Astakos Setup

+++++++++++++

The following apply to ``astakos`` node. In the following sections

we will refer to its IP as ``accounts.example.com`` . Make sure

you have db, mq, apache and gunicorn setup already.

IMPORTANT: Currently if astakos coexists with cyclades/pithos roles, your setup is prone to csrf attacks.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

First install the corresponding package:

.. code-block:: console

   # apt-get install snf-astakos-app

In `/etc/synnefo/astakos.conf` add:

.. code-block:: console

    CLOUDBAR_LOCATION = 'https://accounts.example.com/static/im/cloudbar/'

    CLOUDBAR_SERVICES_URL = 'https://accounts.example.com/im/get_services'

    CLOUDBAR_MENU_URL = 'https://accounts.example.com/im/get_menu'

    ASTAKOS_IM_MODULES = ['local']

    ASTAKOS_BASEURL = 'https://accounts.example.com'

    ASTAKOS_SITENAME = '~okeanos @ example.com'

    ASTAKOS_RECAPTCHA_PUBLIC_KEY = '6LeFidMSAAAAAM7Px7a96YQzsBcKYeXCI_sFz0Gk'

    ASTAKOS_RECAPTCHA_PRIVATE_KEY = '6LeFidMSAAAAAFv5U5NSayJJJhr0roludAidPd2M'

    ASTAKOS_RECAPTCHA_USE_SSL = True

    ASTAKOS_RECAPTCHA_ENABLED = True

    ASTAKOS_COOKIE_DOMAIN = 'example.com'

If ``astakos`` is on the same node with ``cyclades`` or ``pithos``, add the following

line in `/etc/synnefo/astakos.conf` but please note that your setup will be prone to

csrf attacks:

.. code-block:: console

   MIDDLEWARE_CLASSES.remove('django.middleware.csrf.CsrfViewMiddleware')

Then initialize the Database and register services with:

.. code-block:: console

   # /etc/init.d/gunicorn restart

   # snf-manage syncdb --noinput

   # snf-manage migrate im

   # snf-manage loaddata groups

   # snf-manage service-add "~okeanos home" https://cms.example.com/ home-icon.png

   # snf-manage service-add "cyclades" https://cyclades.example.com/ui/

   # snf-manage service-add "pithos+" https://pithos.example.com/ui/

   # /etc/init.d/gunicorn restart

   # /etc/init.d/apache2 restart

Please note that in case pithos and cyclades nodes are the same node, the pithos url

should be ``https://pithos.example.com/pithos/ui/`` .

Let's create our first user. Go at ``http://accounts.example.com/im/`` and

click the "CREATE ACCOUNT" button and fill all your data at the sign up form.

Then click "SUBMIT". You should now see a green box on the top, which informs

you that you made a successful request and the request has been sent to the

administrators. So far so good, let's assume that you created the user with

username ``user@example.com``.

Now we need to activate that user. Return to a command prompt aand run:

.. code-block:: console

   # snf-manage user-list

   # snf-manage user-modify --set-active 1

where 1 should be the id of the user you previously created.

All this can be done with one command:

.. code-block:: console

   # snf-manage user-add --password=12345 --active user@example.com Name LastName

Test your Setup:

++++++++++++++++

.. _i-backends:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

backends

Backends

++++++++

:ref:`ganeti <i-ganeti>` ||

:ref:`image <i-image>` ||

:ref:`gtools <i-gtools>` ||

:ref:`network <i-network>`

The sections above, guide you though the actions needed to create a synnefo

backend. Once you have at least one backend up and running you can go back to

the :ref:`cyclades  <i-cyclades>` section, add the backend, create a public

network and have full synnefo functionality.

In the following sections we will refer to the following roles:

 * ``ganeti`` (all nodes of a Ganeti cluster/synnefo backend)

 * ``master`` (ganeti master node)

 * ``router``

Please note that all these roles can be "played" by the same node.

Prerequisites:

~~~~~~~~~~~~~~

``master``:

 - Available master IP that resolves to FQDN (ganeti.example.com)

``ganeti``:

 - primary interface: `eth0` with IP that resolves to FQDN (nodeX.example.com)

 - /etc/hosts: hostname should not resolv to 127.* address.

 - /etc/ssh/ssh_host_rsa_key*: must be identical among all nodes.

 - extra interfaces: `eth1`, `eth2` (vlans can be used too)

 - NFS mount point: `/srv/pithos`

 - lvm: Volume Group named `ganeti`

``router``:

 - primary interface: `eth0` with public routable IP

 - extra interfaces: `eth1`, `eth2` (vlans can be used too) connected with ganeti nodes

.. _i-cms:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

cms ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

CMS Setup

+++++++++

The following apply to ``cms`` node. In the following sections

we will refer to its IP as ``cms.example.com`` . Before install make sure

you have db, apache and gunicorn setup already.

IMPORTANT: Currently cms cannot coexist with astakos, synnefo and pithos roles

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

First install the corresponding package:

.. code-block:: console

   # apt-get install snf-cloudcms

In `/etc/synnefo/cloudcms.conf` add:

.. code-block:: console

    CLOUDBAR_ACTIVE = True

    CLOUDBAR_LOCATION = 'https://accounts.example.com/static/im/cloudbar/'

    CLOUDBAR_SERVICES_URL = 'https://accounts.example.com/im/get_services'

    CLOUDBAR_MENU_URL = 'https://accounts.example.com/im/get_menu'

    WEBPROJECT_SERVE_STATIC = True

Then restart the services and initialize database:

.. code-block:: console

    # /etc/init.d/gunicorn restart

    # /etc/init.d/apache2 restart

    # snf-manage syncdb

    # snf-manage migrate

Here we can load some initial data. Add in `/tmp/sites.json` :

.. code-block:: console

    [

        {

            "pk": 1,

            "model": "sites.site",

            "fields": {

                "domain": "okeanos.grnet.gr",

                "name": "okeanos.grnet.gr"

            }

        }

    ]

and in `/tmp/pages.json`:

.. code-block:: console

    [

        {

            "fields": {

                "_cached_url": "/",

                "_content_title": "",

                "_page_title": "",

                "active": true,

                "creation_date": "2012-11-16 14:52:19",

                "in_navigation": false,

                "language": "en",

                "level": 0,

                "lft": 1,

                "meta_description": "",

                "meta_keywords": "",

                "modification_date": "2012-11-16 14:52:19",

                "navigation_extension": null,

                "override_url": "/",

                "parent": null,

                "publication_date": "2012-11-16 14:50:00",

                "publication_end_date": null,

                "redirect_to": "",

                "rght": 2,

                "site": 1,

                "slug": "okeanos",

                "symlinked_page": null,

                "template_key": "twocolwide",

                "title": "Okeanos",

                "translation_of": null,

                "tree_id": 1

            },

            "model": "page.page",

            "pk": 1

        },

        {

            "fields": {

                "ordering": 0,

                "parent": 1,

                "region": "main",

                "text": "Welcome to Okeanos!!\r\n\r\n"

            },

            "model": "page.rawcontent",

            "pk": 1

        }

    ]

and finally run:

.. code-block:: console

    # snf-manage loaddata /tmp/sites.json

    # snf-manage loaddata /tmp/page.json

    # snf-manage createsuperuser --username=admin --email=admin@example --noinput

Test your Setup:

++++++++++++++++

.. _i-cyclades:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

cyclades ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Cyclades Setup

++++++++++++++

The following apply to ``cyclades`` node. In the rest of the sections

we will refer to its IP with FQDN ``cyclades.example.com``.Please make sure you have

db, mq, gunicorn, apache, webproject, pithos and astakos already setup.

Install the corresponding package. Please note that memcache is needed for

versions >= 0.13 :

.. code-block:: console

    # apt-get install memcached

    # apt-get install python-memcache

    # apt-get install snf-cyclades-app

In `/etc/synnefo/cyclades.conf` add:

.. code-block:: console

    MAX_CIDR_BLOCK = 21

    PUBLIC_USE_POOL = True

    CUSTOM_BRIDGED_BRIDGE = 'br0'

    MAX_VMS_PER_USER = 5

    VMS_USER_QUOTA = {

        'user@example.com': 20,

    }

    MAX_NETWORKS_PER_USER = 3

    NETWORKS_USER_QUOTA = { 'user@example.com': 10 }

    GANETI_DISK_TEMPLATES = ('blockdev', 'diskless', 'drbd', 'file', 'plain',

                             'rbd',  'sharedfile', 'ext')

    ASTAKOS_URL = 'https://accounts.example.com/im/authenticate'

    SECRET_ENCRYPTION_KEY= "oEs0pt7Di1mkxA0P6FiK"

    GANETI_CREATEINSTANCE_KWARGS = {

        'os': 'snf-image+default',

        'hvparams': {'serial_console': False},

        'wait_for_sync': False}

    GANETI_USE_HOTPLUG = True

    CLOUDBAR_LOCATION = 'https://accounts.example.com/static/im/cloudbar/'

    CLOUDBAR_ACTIVE_SERVICE = '2'

    CLOUDBAR_SERVICES_URL = 'https://accounts.example.com/im/get_services'

    CLOUDBAR_MENU_URL = 'https://accounts.example.com/im/get_menu'

    BACKEND_DB_CONNECTION = 'postgresql://synnefo:example_passw0rd@db.example.com:5432/snf_pithos'

    BACKEND_BLOCK_PATH = '/srv/pithos/data/'

    AMQP_HOSTS = ["amqp://synnefo:example_rabbitmq_passw0rd@mq.example.com:5672"]

    CACHE_BACKEND = 'memcached://127.0.0.1:11211/'

    VMAPI_BASE_URL = 'https://cyclades.example.com/'

Restart services and initialize database:

.. code-block:: console

   # /etc/init.d/gunicorn restart

   # /etc/init.d/apache2 restart

   # snf-manage syncdb

   # snf-manage migrate

   # snf-manage loaddata flavors

Enable dispatcher:

.. code-block:: console

   # sed -i 's/false/true/' /etc/default/snf-dispatcher

   # /etc/init.d/snf-dispatcher start

In order end-user to have access to the VM's console:

.. code-block:: console

   # apt-get install snf-vncauthproxy

Edit `/etc/default/vncauthproxy`:

.. code-block:: console

   CHUID="www-data:nogroup"

At this point you should setup a :ref:`backend <i-backends>`. Please refer to the

coresponding section.  Here we assume that at least one backend is up and running,

so we can add it in Cyclades with:

.. code-block:: console

   # snf-manage backend-add --clustername=ganeti.example.com --user=synnefo --pass=example_rapi_passw0rd

After 0.13 every backend added stays in drained mode (no VMs can be added).

Therefore get your backend ID (propably 1) and run:

.. code-block:: console

   # snf-manage backend-list

   # snf-manage backend-modify --drained=False 1

Further assumptions:

- Preprovisioned Bridges: ``br0``, ``prv0``, ``prv1..prv20``

- Available "public" Subnet: ``10.0.1.0/24``

- Available "public" Gateway: ``10.0.1.1``

- Connectivity link for public network: ``br0``

Here admin has to define two different resource pools in Synnefo:

 - MAC prefix Pool

 - Bridge Pool

.. code-block:: console

   # snf-manage pool-create --type=mac-prefix --base=aa:00:0 --size=65536

   # snf-manage pool-create --type=bridge --base=prv --size=20

Add the synnefo setting in :file:`/etc/synnefo/cyclades.conf`:

.. code-block:: console

   PRIVATE_MAC_FILTERED_BRIDGE = 'prv0'

Add public network where the VM's will eventually connect to in order to

access Internet:

.. code-block:: console

   # snf-manage network-create --subnet=10.0.1.0/24 --gateway=10.0.1.1 --public --dhcp --flavor=CUSTOM --mode=bridged --link=br0 --name=Internet --backend-id=1

Test your Setup:

++++++++++++++++

.. _i-db:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

db ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Database Setup

++++++++++++++

The following apply to ``db`` node. For the rest of the sections we will

refer to its IP as ``db.example.com`` .

First install progresql:

.. code-block:: console

   # apt-get install postgresql

We create a database called ``snf_apps``, that will host all django

apps related tables. We also create the user ``synnefo`` and grant him all

privileges on the database. We do this by running:

.. code-block:: console

   # su - postgres

   postgres:~$ psql

   postgres=# CREATE DATABASE snf_apps WITH ENCODING 'UTF8' LC_COLLATE='C' LC_CTYPE='C' TEMPLATE=template0;

   postgres=# CREATE USER synnefo WITH PASSWORD 'example_passw0rd';

   postgres=# GRANT ALL PRIVILEGES ON DATABASE snf_apps TO synnefo;

We also create the database ``snf_pithos`` needed by the pithos+ backend and

grant the ``synnefo`` user all privileges on the database.

.. code-block:: console

   postgres=# CREATE DATABASE snf_pithos WITH ENCODING 'UTF8' LC_COLLATE='C' LC_CTYPE='C' TEMPLATE=template0;

   postgres=# GRANT ALL PRIVILEGES ON DATABASE snf_pithos TO synnefo;

Configure the database to listen to all network interfaces. You can do this by

editting the file `/etc/postgresql/8.4/main/postgresql.conf` with:

| ``listen_addresses = '*'``

Furthermore, edit `/etc/postgresql/8.4/main/pg_hba.conf` to allow the nodes

to connect to the database. Add the following line:

| ``host		all	all	4.3.2.0/24	md5``

.. code-block:: console

   # /etc/init.d/postgresql restart

Test your Setup:

++++++++++++++++

.. _i-ganeti:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Backends

++++++++

ganeti ||

:ref:`image <i-image>` ||

:ref:`gtools <i-gtools>` ||

:ref:`network <i-network>`

Ganeti Setup

~~~~~~~~~~~~

In ``ganeti`` nodes install GRNet specific Ganeti package and enable drbd:

.. code-block:: console

   # apt-get install python-bitarray

   # apt-get install snf-ganeti ganeti-htools

   # modprobe drbd minor_count=255 usermode_helper=/bin/true

The following apply to ``master`` node. Here we will create a Ganeti cluster with

all available ``ganeti`` nodes. Please note that Ganeti needs a pair of rsa/dsa keys

for the root user. If already exist in `/root/.ssh/` in all nodes then --no-ssh-init

can be used. In omitted then the existing files will be overriden. Upon node add

Ganeti will replace `/etc/ssh/ssh_host*` files with the master's ones:

.. code-block:: console

    # gnt-cluster init --enabled-hypervisors=kvm \

                       --vg-name=ganeti \

                       --nic-parameters link=br0,mode=bridged \

                       --master-netdev eth0 \

                       --default-iallocator hail \

                       --hypervisor-parameters kvm:kernel_path=,vnc_bind_address=0.0.0.0 \

                       --no-ssh-init --no-etc-hosts \

                       ganeti.example.com

    # gnt-cluster modify --disk-parameters=drbd:metavg=ganeti

    # gnt-group modify --disk-parameters=drbd:metavg=ganeti default

    # for n in node2 node3 node4 node5 node6; do

        gnt-node add --no-ssh-key-check --master-capable=yes --vm-capable=yes $n.example.com

      done

We need to add a rapi user to Ganeti so that Synnefo can talk with the backend:

.. code-block:: console

   # result=$(echo -n "synnefo:Ganeti Remote API:example_rapi_passw0rd" | openssl md5)

   # echo "synnefo {HA1} $result" >> /var/lib/ganeti/rapi/users

   # /etc/init.d/ganeti restart

Test your Setup:

++++++++++++++++

.. _i-gtools:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Backends

++++++++

:ref:`ganeti <i-ganeti>` ||

:ref:`image <i-image>` ||

gtools ||

:ref:`network <i-network>`

gtools Setup

~~~~~~~~~~~~

The following apply to ``ganeti`` nodes.

.. code-block:: console

   # apt-get install snf-cyclades-gtools

Add this line in `/etc/synnefo/gtools.conf`

.. code-block:: console

   AMQP_HOSTS = ["amqp://synnefo:example_rabbitmq_passw0rd@mq.example.com:5672"]

and enable ``snf-ganeti-eventd``:

.. code-block:: console

   # sed -i 's/false/true/' /etc/default/snf-ganeti-eventd

   # /etc/init.d/snf-ganeti-eventd start

Test your Setup:

++++++++++++++++

.. _i-gunicorn:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

gunicorn ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Gunicorn Setup

++++++++++++++

The following apply to ``astakos``, ``pithos``, ``cyclades`` and ``cms`` nodes.

.. code-block:: console

  # apt-get install -t squeeze-backports gunicorn

In `/etc/gunicorn.d/synnefo` add:

.. code-block:: console

   CONFIG = {

    'mode': 'django',

    'environment': {

      'DJANGO_SETTINGS_MODULE': 'synnefo.settings',

    },

    'working_dir': '/etc/synnefo',

    'user': 'www-data',

    'group': 'www-data',

    'args': (

      '--bind=127.0.0.1:8080',

      '--workers=4',

      '--worker-class=gevent',

      '--log-level=debug',

    ),

   }

Setting ``gevent`` for worker-class, requires webproject to support

pooling and greenlets.

Test your Setup:

++++++++++++++++

.. _i-image:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Backends

++++++++

:ref:`ganeti <i-ganeti>` ||

image ||

:ref:`gtools <i-gtools>` ||

:ref:`network <i-network>`

snf-image Setup

~~~~~~~~~~~~~~~

The following apply to ``ganeti`` nodes.

Firstly mount the ``pithos`` nfs mount point. Assuming that ``pithos`` node

(the one who does the NFS export) is node1.example.com, append the following

line in `/etc/fstab`:

.. code-block:: console

   node1:/pithos /srv/pithos nfs4 defaults,rw,noatime,nodiratime,intr,rsize=1048576,wsize=1048576,noacl

and then:

.. code-block:: console

   apt-get install -t squeeze-backports nfs-common

   mkdir /srv/pithos

   mount /srv/pithos

.. code-block:: console

   # apt-get install snf-image-host

Append this lines in `/etc/snf-image/default`

.. code-block:: console

    PITHOS_DB="postgresql://synnefo:example_passw0rd@db.example.com:5432/snf_pithos"

    PITHOS_DATA="/srv/pithos/data"

    PROGRESS_MONITOR='snf-progress-monitor'

and create snf-image-helper with:

.. code-block:: console

   # snf-image-update-helper -y

Test your Setup:

++++++++++++++++

.. _i-kamaki:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

:ref:`mq <i-mq>` ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`webproject <i-webproject>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

kamaki ||

:ref:`backends <i-backends>`

kamaki Setup

++++++++++++

The following apply to ``client`` node. Here we install a command line tool

that the end-user can use instead of web UI. Prerequisites are that the

client node can connect to synnefo nodes by using their FQDN and that

the user has already aquired an AUTH_TOKEN from his/her profile page after

signing in.

Install the corresponding package:

.. code-block:: console

    # apt-get install kamaki

and build the correct config file:

.. code-block:: console

    # kamaki config set astakos.url "https://accounts.example.com"

    # kamaki config set compute.url "https://cyclades.example.com/api/v1.1"

    # kamaki config set image.url "https://cyclades.example.com/plankton"

    # kamaki config set store.enable on

    # kamaki config set store.pithos_extensions on

    # kamaki config set store.url "https://pithos.example.com/v1"

    # kamaki config set store.account "user@example.com"

    # kamaki config set global.token AUTH_TOKEN

Please download a Debian Base image from our repo:

.. code-block:: console

    # wget https://pithos.okeanos.grnet.gr/public/66ke3 -O /tmp/debian_base.diskdump

create a container in pithos, upload it:

.. code-block:: console

   # kamaki store create images

   # kamaki store upload --container images /tmp/debian_base.diskdump debian_base.diskdump

and register it to plankton:

.. code-block:: console

   # kamaki image register "Debian Base"  pithos://user@example/images/debian_base.diskdump \

                    --disk-format=diskdump \

                    --property OSFAMILY=linux \

                    --property ROOT_PARTITION=1 \

                    --property description="Debian Squeeze Base System" \

                    --property size=450M \

                    --property kernel=2.6.32 \

                    --property GUI="No GUI" \

                    --property sortorder=1 \

                    --property USERS=root \

                    --property OS=debian \

                    --public

Test your Setup:

++++++++++++++++

.. _i-mq:

Synnefo

-------

:ref:`synnefo <i-synnefo>` ||

:ref:`ns <i-ns>` ||

:ref:`apt <i-apt>` ||

mq ||

:ref:`db <i-db>` ||

:ref:`gunicorn <i-gunicorn>` ||

:ref:`apache <i-apache>` ||

:ref:`astakos <i-astakos>` ||

:ref:`cms <i-cms>` ||

:ref:`pithos <i-pithos>` ||

:ref:`cyclades <i-cyclades>` ||

:ref:`kamaki <i-kamaki>` ||

:ref:`backends <i-backends>`

Message Queue Setup

+++++++++++++++++++

The following apply to ``mq`` node. For the rest of the sections we will refer to

its IP as ``mq.example.com`` .

.. code-block:: console

  # apt-get install rabbitmq-server