Synnefo » Pithos

Administrator Guide

===================

Simple Setup

------------

Assuming a clean debian squeeze (stable) installation, use the following steps to run the software.

Install packages::

  apt-get install git python-django python-setuptools python-sphinx

  apt-get install python-sqlalchemy python-mysqldb python-psycopg2

  apt-get install apache2 libapache2-mod-wsgi

Get the source::

  cd /

  git clone https://code.grnet.gr/git/pithos

Setup the files::

  cd /pithos/pithos

  python manage.py syncdb

  cd /pithos

  python setup.py build_sphinx

It is advised that you create a ``settings.local`` file to place any configuration overrides (at least change ``SECRET_KEY``).

Edit ``/etc/apache2/sites-available/pithos`` (change the ``ServerName`` directive)::

  <VirtualHost *:80>

    ServerAdmin webmaster@pithos.dev.grnet.gr

    ServerName pithos.dev.grnet.gr

    DocumentRoot /pithos/htdocs

    Alias /ui "/var/www/pithos_web_client"

    Alias /docs "/pithos/docs/build/html"

    <Directory />

        Options Indexes FollowSymLinks

        AllowOverride None

        Order allow,deny

        Allow from all

    </Directory>

    SetEnv no-gzip

    SetEnv dont-vary

    RewriteEngine On

    RewriteRule ^/v(.*) /api/v$1 [PT,NE]

    RewriteRule ^/public(.*) /api/public$1 [PT,NE]

    RewriteRule ^/tools(.*) /api/ui$1 [PT,NE]

    RewriteRule ^/im(.*) https://%{HTTP_HOST}%{REQUEST_URI} [NE]

    RewriteRule ^/login(.*) https://%{HTTP_HOST}%{REQUEST_URI} [NE]

    RequestHeader set X-Forwarded-Protocol "http"

    WSGIScriptAlias /api /pithos/pithos/wsgi/pithos.wsgi

    # WSGIDaemonProcess pithos

    # WSGIProcessGroup pithos

    LogLevel warn

    ErrorLog ${APACHE_LOG_DIR}/pithos.error.log

    CustomLog ${APACHE_LOG_DIR}/pithos.access.log combined

  </VirtualHost>

To disable non-SSL connections, ``/etc/apache2/sites-available/pithos`` should be::

  <VirtualHost *:80>

    ServerAdmin webmaster@pithos.dev.grnet.gr

    ServerName pithos.dev.grnet.gr

    RewriteEngine On

    RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI}

  </VirtualHost>

Edit ``/etc/apache2/sites-available/pithos-ssl`` (assuming files in ``/etc/ssl/private/pithos.dev.grnet.gr.key`` and ``/etc/ssl/certs/pithos.dev.grnet.gr.crt`` - change the ``ServerName`` directive)::

  <IfModule mod_ssl.c>

  <VirtualHost _default_:443>

    ServerAdmin webmaster@pithos.dev.grnet.gr

    ServerName pithos.dev.grnet.gr

    DocumentRoot /pithos/htdocs

    Alias /ui "/var/www/pithos_web_client"

    Alias /docs "/pithos/docs/build/html"

    <Directory />

        Options Indexes FollowSymLinks

        AllowOverride None

        Order allow,deny

        Allow from all

    </Directory>

    SetEnv no-gzip

    SetEnv dont-vary

    RewriteEngine On

    RewriteRule ^/v(.*) /api/v$1 [PT,NE]

    RewriteRule ^/public(.*) /api/public$1 [PT,NE]

    RewriteRule ^/tools(.*) /api/ui$1 [PT,NE]

    RewriteRule ^/im(.*) /api/im$1 [PT,NE]

    RewriteRule ^/login(.*) /api/im/login/dummy$1 [PT,NE]

    RequestHeader set X-Forwarded-Protocol "https"

    WSGIScriptAlias /api /pithos/pithos/wsgi/pithos.wsgi

    # WSGIDaemonProcess pithos

    # WSGIProcessGroup pithos

    LogLevel warn

    ErrorLog ${APACHE_LOG_DIR}/pithos.error.log

    CustomLog ${APACHE_LOG_DIR}/pithos.access.log combined

    SSLEngine on

    SSLCertificateFile    /etc/ssl/certs/pithos.dev.grnet.gr.crt

    SSLCertificateKeyFile /etc/ssl/private/pithos.dev.grnet.gr.key

  </VirtualHost>

  </IfModule>

Add in ``/etc/apache2/mods-available/wsgi.conf``::

  WSGIChunkedRequest On

Make sure the data folder is writable by the web server user::

  chown -R www-data:www-data /pithos/pithos/data

If using an SQLite database, the same goes for the database file and the containing folder::

  chown www-data:www-data /pithos/pithos/

  chown www-data:www-data /pithos/pithos/backend.db

Configure and run apache::

  a2enmod ssl

  a2enmod rewrite

  a2dissite default

  a2ensite pithos

  a2ensite pithos-ssl

  mkdir /var/www/pithos

  mkdir /var/www/pithos_web_client

  /etc/init.d/apache2 restart

Useful alias to add in ``~/.bashrc``::

  alias sync-pithos='cd /pithos && git pull && python setup.py build_sphinx && /etc/init.d/apache2 restart'

Gunicorn Setup

--------------

Add in ``/etc/apt/sources.list``::

  deb http://backports.debian.org/debian-backports squeeze-backports main

Then::

  apt-get update

  apt-get -t squeeze-backports install gunicorn

  apt-get -t squeeze-backports install python-gevent

Create ``/etc/gunicorn.d/pithos``::

  CONFIG = {

   'mode': 'django',

   'working_dir': '/pithos/pithos',

   'user': 'www-data',

   'group': 'www-data',

   'args': (

        '--bind=[::]:8080',

        '--worker-class=egg:gunicorn#gevent',

        '--workers=4',

        '--log-level=debug',

        '/pithos/pithos/settings.py',

   ),

  }

Replace the ``WSGI*`` directives in ``/etc/apache2/sites-available/pithos`` and ``/etc/apache2/sites-available/pithos-ssl`` with::

  <Proxy *>

    Order allow,deny

    Allow from all

  </Proxy>

  SetEnv                proxy-sendchunked

  SSLProxyEngine        off

  ProxyErrorOverride    off

  ProxyPass        /api http://localhost:8080 retry=0

  ProxyPassReverse /api http://localhost:8080

Make sure that in ``settings.local``::

  USE_X_FORWARDED_HOST = True

Configure and run::

  /etc/init.d/gunicorn restart

  a2enmod proxy

  a2enmod proxy_http

  /etc/init.d/apache2 restart

If experiencing timeout problems, try adding to ``/etc/gunicorn.d/pithos``::

        ...

        '--timeout=43200',

        ...

Shibboleth Setup

----------------

Install package::

  apt-get install libapache2-mod-shib2

Setup the files in ``/etc/shibboleth``.

Add in ``/etc/apache2/sites-available/pithos-ssl``::

  ShibConfig /etc/shibboleth/shibboleth2.xml

  Alias      /shibboleth-sp /usr/share/shibboleth 

  <Location /api/im/login/shibboleth>

    AuthType shibboleth

    ShibRequireSession On

    ShibUseHeaders On

    require valid-user

  </Location>

Configure and run apache::

  a2enmod shib2

  /etc/init.d/apache2 restart

  /etc/init.d/shibd restart

The following tokens should be available at the destination, after passing through the apache module::

  eppn # eduPersonPrincipalName

  Shib-InetOrgPerson-givenName

  Shib-Person-surname

  Shib-Person-commonName

  Shib-InetOrgPerson-displayName

  Shib-EP-Affiliation

  Shib-Session-ID

MySQL Setup

-----------

If using MySQL instead of SQLite for the database engine, consider the following.

Server side::

  apt-get install mysql-server

Add in ``/etc/mysql/conf.d/pithos.cnf``::

  [mysqld]

  sql-mode="NO_AUTO_VALUE_ON_ZERO"

Edit ``/etc/mysql/my.cnf`` to allow network connections and restart the server.

Create database and user::

  CREATE DATABASE pithos CHARACTER SET utf8 COLLATE utf8_bin;

  GRANT ALL ON pithos.* TO pithos@localhost IDENTIFIED BY 'password';

  GRANT ALL ON pithos.* TO pithos@'%' IDENTIFIED BY 'password';

Client side::

  apt-get install mysql-client

It helps to create a ``~/.my.cnf`` file, for automatically connecting to the server::

  [client]

  user = pithos

  password = 'password'

  host = pithos-storage.dev.grnet.gr

  [mysql]

  database = pithos

PostgreSQL Setup

----------------

If using PostgreSQL instead of SQLite for the database engine, consider the following.

Server side::

  apt-get install postgresql

Edit ``/etc/postgresql/8.4/main/postgresql.conf`` and ``/etc/postgresql/8.4/main/pg_hba.conf`` to allow network connections and restart the server.

Create database and user::

  CREATE DATABASE pithos WITH ENCODING 'UTF8' LC_COLLATE='C' LC_CTYPE='C' TEMPLATE=template0;

  CREATE USER pithos WITH PASSWORD 'password';

  GRANT ALL PRIVILEGES ON DATABASE pithos TO pithos;

Client side::

  apt-get install postgresql-client

It helps to create a ``~/.pgpass`` file, for automatically passing the password to the server::

  pithos-storage.dev.grnet.gr:5432:pithos:pithos:password

Connect with::

  psql -h pithos-storage.dev.grnet.gr -U pithos