root / docs / admin-guide.rst @ 9c9525e3
History | View | Annotate | Download (92.3 kB)
1 | bc055d09 | Constantinos Venetsanopoulos | .. _admin-guide: |
---|---|---|---|
2 | bc055d09 | Constantinos Venetsanopoulos | |
3 | bc055d09 | Constantinos Venetsanopoulos | Synnefo Administrator's Guide |
4 | bc055d09 | Constantinos Venetsanopoulos | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
5 | bc055d09 | Constantinos Venetsanopoulos | |
6 | bc055d09 | Constantinos Venetsanopoulos | This is the complete Synnefo Administrator's Guide. |
7 | bc055d09 | Constantinos Venetsanopoulos | |
8 | bc055d09 | Constantinos Venetsanopoulos | |
9 | 14267d89 | Constantinos Venetsanopoulos | .. _syn+archip: |
10 | bc055d09 | Constantinos Venetsanopoulos | |
11 | eab73849 | Constantinos Venetsanopoulos | General Synnefo Architecture |
12 | eab73849 | Constantinos Venetsanopoulos | ============================ |
13 | eab73849 | Constantinos Venetsanopoulos | |
14 | 14267d89 | Constantinos Venetsanopoulos | The following figure shows a detailed view of the whole Synnefo architecture |
15 | 14267d89 | Constantinos Venetsanopoulos | and how it interacts with multiple Ganeti clusters. We hope that after reading |
16 | 14267d89 | Constantinos Venetsanopoulos | the Administrator's Guide you will be able to understand every component and |
17 | 14267d89 | Constantinos Venetsanopoulos | all the interactions between them. |
18 | eab73849 | Constantinos Venetsanopoulos | |
19 | 301294a9 | Constantinos Venetsanopoulos | .. image:: images/synnefo-arch2.png |
20 | 16539dad | Kostas Papadimitriou | :width: 100% |
21 | 301294a9 | Constantinos Venetsanopoulos | :target: _images/synnefo-arch2.png |
22 | eab73849 | Constantinos Venetsanopoulos | |
23 | 14267d89 | Constantinos Venetsanopoulos | Synnefo also supports RADOS as an alternative storage backend for |
24 | 14267d89 | Constantinos Venetsanopoulos | Files/Images/VM disks. You will find the :ref:`corresponding figure |
25 | 14267d89 | Constantinos Venetsanopoulos | <syn+archip+rados>` later in this guide. |
26 | eab73849 | Constantinos Venetsanopoulos | |
27 | a1c707c9 | Constantinos Venetsanopoulos | |
28 | eab73849 | Constantinos Venetsanopoulos | Identity Service (Astakos) |
29 | eab73849 | Constantinos Venetsanopoulos | ========================== |
30 | f846d8df | Constantinos Venetsanopoulos | |
31 | f846d8df | Constantinos Venetsanopoulos | |
32 | eab73849 | Constantinos Venetsanopoulos | Authentication methods |
33 | 3a0ce98e | Constantinos Venetsanopoulos | ---------------------- |
34 | eab73849 | Constantinos Venetsanopoulos | |
35 | 3a0ce98e | Constantinos Venetsanopoulos | Astakos supports multiple authentication methods: |
36 | eab73849 | Constantinos Venetsanopoulos | |
37 | 3a0ce98e | Constantinos Venetsanopoulos | * local username/password |
38 | 3a0ce98e | Constantinos Venetsanopoulos | * LDAP / Active Directory |
39 | 3a0ce98e | Constantinos Venetsanopoulos | * SAML 2.0 (Shibboleth) federated logins |
40 | 3a0ce98e | Constantinos Venetsanopoulos | |
41 | 3a0ce98e | Constantinos Venetsanopoulos | |
42 | 3a0ce98e | Constantinos Venetsanopoulos | |
43 | eab73849 | Constantinos Venetsanopoulos | |
44 | eab73849 | Constantinos Venetsanopoulos | .. _shibboleth-auth: |
45 | eab73849 | Constantinos Venetsanopoulos | |
46 | eab73849 | Constantinos Venetsanopoulos | Shibboleth Authentication |
47 | 3a0ce98e | Constantinos Venetsanopoulos | ~~~~~~~~~~~~~~~~~~~~~~~~~ |
48 | eab73849 | Constantinos Venetsanopoulos | |
49 | eab73849 | Constantinos Venetsanopoulos | Astakos can delegate user authentication to a Shibboleth federation. |
50 | eab73849 | Constantinos Venetsanopoulos | |
51 | eab73849 | Constantinos Venetsanopoulos | To setup shibboleth, install package:: |
52 | eab73849 | Constantinos Venetsanopoulos | |
53 | eab73849 | Constantinos Venetsanopoulos | apt-get install libapache2-mod-shib2 |
54 | eab73849 | Constantinos Venetsanopoulos | |
55 | eab73849 | Constantinos Venetsanopoulos | Change appropriately the configuration files in ``/etc/shibboleth``. |
56 | eab73849 | Constantinos Venetsanopoulos | |
57 | eab73849 | Constantinos Venetsanopoulos | Add in ``/etc/apache2/sites-available/synnefo-ssl``:: |
58 | eab73849 | Constantinos Venetsanopoulos | |
59 | eab73849 | Constantinos Venetsanopoulos | ShibConfig /etc/shibboleth/shibboleth2.xml |
60 | eab73849 | Constantinos Venetsanopoulos | Alias /shibboleth-sp /usr/share/shibboleth |
61 | eab73849 | Constantinos Venetsanopoulos | |
62 | fb814235 | Kostas Papadimitriou | <Location /ui/login/shibboleth> |
63 | eab73849 | Constantinos Venetsanopoulos | AuthType shibboleth |
64 | eab73849 | Constantinos Venetsanopoulos | ShibRequireSession On |
65 | eab73849 | Constantinos Venetsanopoulos | ShibUseHeaders On |
66 | eab73849 | Constantinos Venetsanopoulos | require valid-user |
67 | eab73849 | Constantinos Venetsanopoulos | </Location> |
68 | eab73849 | Constantinos Venetsanopoulos | |
69 | eab73849 | Constantinos Venetsanopoulos | and before the line containing:: |
70 | eab73849 | Constantinos Venetsanopoulos | |
71 | eab73849 | Constantinos Venetsanopoulos | ProxyPass / http://localhost:8080/ retry=0 |
72 | eab73849 | Constantinos Venetsanopoulos | |
73 | eab73849 | Constantinos Venetsanopoulos | add:: |
74 | eab73849 | Constantinos Venetsanopoulos | |
75 | eab73849 | Constantinos Venetsanopoulos | ProxyPass /Shibboleth.sso ! |
76 | f846d8df | Constantinos Venetsanopoulos | |
77 | eab73849 | Constantinos Venetsanopoulos | Then, enable the shibboleth module:: |
78 | eab73849 | Constantinos Venetsanopoulos | |
79 | eab73849 | Constantinos Venetsanopoulos | a2enmod shib2 |
80 | f846d8df | Constantinos Venetsanopoulos | |
81 | eab73849 | Constantinos Venetsanopoulos | After passing through the apache module, the following tokens should be |
82 | eab73849 | Constantinos Venetsanopoulos | available at the destination:: |
83 | eab73849 | Constantinos Venetsanopoulos | |
84 | eab73849 | Constantinos Venetsanopoulos | eppn # eduPersonPrincipalName |
85 | eab73849 | Constantinos Venetsanopoulos | Shib-InetOrgPerson-givenName |
86 | eab73849 | Constantinos Venetsanopoulos | Shib-Person-surname |
87 | eab73849 | Constantinos Venetsanopoulos | Shib-Person-commonName |
88 | eab73849 | Constantinos Venetsanopoulos | Shib-InetOrgPerson-displayName |
89 | eab73849 | Constantinos Venetsanopoulos | Shib-EP-Affiliation |
90 | eab73849 | Constantinos Venetsanopoulos | Shib-Session-ID |
91 | eab73849 | Constantinos Venetsanopoulos | |
92 | b8603e8a | Kostas Papadimitriou | Astakos keeps a map of shibboleth users using the value of the ``REMOTE_USER`` |
93 | b8603e8a | Kostas Papadimitriou | header, passed by the ``mod_shib2`` module. This happens in order to be able to |
94 | b8603e8a | Kostas Papadimitriou | identify the astakos account the shibboleth user is associated to, every time |
95 | b8603e8a | Kostas Papadimitriou | the user logs in from an affiliate shibboleth IdP. |
96 | b8603e8a | Kostas Papadimitriou | |
97 | b8603e8a | Kostas Papadimitriou | The shibboleth attribute which gets mapped to the ``REMOTE_USER`` header can be |
98 | b8603e8a | Kostas Papadimitriou | changed in ``/etc/shibboleth/shibboleth2.xml`` configuration file. |
99 | b8603e8a | Kostas Papadimitriou | |
100 | b8603e8a | Kostas Papadimitriou | .. code-block:: xml |
101 | b8603e8a | Kostas Papadimitriou | |
102 | b8603e8a | Kostas Papadimitriou | <!-- The ApplicationDefaults element is where most of Shibboleth's SAML bits are defined. --> |
103 | b8603e8a | Kostas Papadimitriou | <ApplicationDefaults entityID="https://sp.example.org/shibboleth" |
104 | b8603e8a | Kostas Papadimitriou | REMOTE_USER="eppn persistent-id targeted-id"> |
105 | b8603e8a | Kostas Papadimitriou | |
106 | b8603e8a | Kostas Papadimitriou | .. warning:: |
107 | b8603e8a | Kostas Papadimitriou | |
108 | b8603e8a | Kostas Papadimitriou | Changing ``mod_shib2`` ``REMOTE_USER`` to map to different shibboleth |
109 | b8603e8a | Kostas Papadimitriou | attributes will probably invalidate any existing shibboleth enabled users in |
110 | b8603e8a | Kostas Papadimitriou | astakos database. Those users won't be able to login to their existing accounts. |
111 | b8603e8a | Kostas Papadimitriou | |
112 | b8603e8a | Kostas Papadimitriou | |
113 | eab73849 | Constantinos Venetsanopoulos | Finally, add 'shibboleth' in ``ASTAKOS_IM_MODULES`` list. The variable resides |
114 | eab73849 | Constantinos Venetsanopoulos | inside the file ``/etc/synnefo/20-snf-astakos-app-settings.conf`` |
115 | eab73849 | Constantinos Venetsanopoulos | |
116 | e0975bbf | Sofia Papagiannaki | Twitter Authentication |
117 | 3a0ce98e | Constantinos Venetsanopoulos | ~~~~~~~~~~~~~~~~~~~~~~ |
118 | e0975bbf | Sofia Papagiannaki | |
119 | e0975bbf | Sofia Papagiannaki | To enable twitter authentication while signed in under a Twitter account, |
120 | e0975bbf | Sofia Papagiannaki | visit dev.twitter.com/apps. |
121 | e0975bbf | Sofia Papagiannaki | |
122 | e0975bbf | Sofia Papagiannaki | Click Create an application. |
123 | e0975bbf | Sofia Papagiannaki | |
124 | e0975bbf | Sofia Papagiannaki | Fill the necessary information and for callback URL give:: |
125 | e0975bbf | Sofia Papagiannaki | |
126 | e0975bbf | Sofia Papagiannaki | https://node1.example.com/ui/login/twitter/authenticated |
127 | e0975bbf | Sofia Papagiannaki | |
128 | e0975bbf | Sofia Papagiannaki | Finally, add 'twitter' in ``ASTAKOS_IM_MODULES`` list. The variable resides |
129 | e0975bbf | Sofia Papagiannaki | inside the file ``/etc/synnefo/20-snf-astakos-app-settings.conf`` |
130 | e0975bbf | Sofia Papagiannaki | |
131 | e0975bbf | Sofia Papagiannaki | Google Authentication |
132 | 3a0ce98e | Constantinos Venetsanopoulos | ~~~~~~~~~~~~~~~~~~~~~ |
133 | e0975bbf | Sofia Papagiannaki | |
134 | e0975bbf | Sofia Papagiannaki | To enable google authentication while signed in under a Google account, |
135 | e0975bbf | Sofia Papagiannaki | visit https://code.google.com/apis/console/. |
136 | e0975bbf | Sofia Papagiannaki | |
137 | e0975bbf | Sofia Papagiannaki | Under API Access select Create another client ID, select Web application, |
138 | e0975bbf | Sofia Papagiannaki | expand more options in Your site or hostname section and in Authorized |
139 | e0975bbf | Sofia Papagiannaki | Redirect URIs add: |
140 | e0975bbf | Sofia Papagiannaki | |
141 | e0975bbf | Sofia Papagiannaki | |
142 | e0975bbf | Sofia Papagiannaki | Fill the necessary information and for callback URL give:: |
143 | e0975bbf | Sofia Papagiannaki | |
144 | e0975bbf | Sofia Papagiannaki | https://node1.example.com/ui/login/google/authenticated |
145 | e0975bbf | Sofia Papagiannaki | |
146 | e0975bbf | Sofia Papagiannaki | Finally, add 'google' in ``ASTAKOS_IM_MODULES`` list. The variable resides |
147 | e0975bbf | Sofia Papagiannaki | inside the file ``/etc/synnefo/20-snf-astakos-app-settings.conf`` |
148 | e0975bbf | Sofia Papagiannaki | |
149 | eab73849 | Constantinos Venetsanopoulos | |
150 | eab73849 | Constantinos Venetsanopoulos | Working with Astakos |
151 | eab73849 | Constantinos Venetsanopoulos | -------------------- |
152 | eab73849 | Constantinos Venetsanopoulos | |
153 | 77186edf | Kostas Papadimitriou | User registration |
154 | 77186edf | Kostas Papadimitriou | ~~~~~~~~~~~~~~~~~ |
155 | f846d8df | Constantinos Venetsanopoulos | |
156 | 0019cd7d | Christos Stavrakakis | When a new user signs up, he/she is not directly marked as active. You can see |
157 | 77186edf | Kostas Papadimitriou | his/her state by running (on the machine that runs the Astakos app): |
158 | f846d8df | Constantinos Venetsanopoulos | |
159 | f846d8df | Constantinos Venetsanopoulos | .. code-block:: console |
160 | f846d8df | Constantinos Venetsanopoulos | |
161 | 4404e02e | Ilias Tsitsimpis | $ snf-manage user-list |
162 | f846d8df | Constantinos Venetsanopoulos | |
163 | 0019cd7d | Christos Stavrakakis | More detailed user status is provided in the `status` field of the `user-show` |
164 | 77186edf | Kostas Papadimitriou | command: |
165 | f846d8df | Constantinos Venetsanopoulos | |
166 | 77186edf | Kostas Papadimitriou | .. code-block:: console |
167 | f846d8df | Constantinos Venetsanopoulos | |
168 | 77186edf | Kostas Papadimitriou | $ snf-manage user-show <user-id> |
169 | f846d8df | Constantinos Venetsanopoulos | |
170 | 77186edf | Kostas Papadimitriou | id : 6 |
171 | 77186edf | Kostas Papadimitriou | uuid : 78661411-5eed-412f-a9ea-2de24f542c2e |
172 | 77186edf | Kostas Papadimitriou | status : Accepted/Active (accepted policy: manual) |
173 | 77186edf | Kostas Papadimitriou | email : user@synnefo.org |
174 | 77186edf | Kostas Papadimitriou | .... |
175 | f846d8df | Constantinos Venetsanopoulos | |
176 | 3a0ce98e | Constantinos Venetsanopoulos | Based on the `astakos-app` configuration, there are several ways for a user to |
177 | 3a0ce98e | Constantinos Venetsanopoulos | get verified and activated in order to be able to login. We discuss the user |
178 | 3a0ce98e | Constantinos Venetsanopoulos | verification and activation flow in the following section. |
179 | 77186edf | Kostas Papadimitriou | |
180 | 77186edf | Kostas Papadimitriou | User activation flow |
181 | eab73849 | Constantinos Venetsanopoulos | ```````````````````` |
182 | eab73849 | Constantinos Venetsanopoulos | |
183 | 77186edf | Kostas Papadimitriou | A user can register for an account using the astakos signup form. Once the form |
184 | 77186edf | Kostas Papadimitriou | is submited successfully a user entry is created in astakos database. That entry |
185 | 77186edf | Kostas Papadimitriou | is passed through the astakos activation backend which handles whether the user |
186 | 77186edf | Kostas Papadimitriou | should be automatically verified and activated. |
187 | 77186edf | Kostas Papadimitriou | |
188 | 77186edf | Kostas Papadimitriou | Email verification |
189 | 77186edf | Kostas Papadimitriou | `````````````````` |
190 | 77186edf | Kostas Papadimitriou | |
191 | 77186edf | Kostas Papadimitriou | The verification process takes place in order to ensure that the user owns the |
192 | 77186edf | Kostas Papadimitriou | email provided during the signup process. By default, after each successful |
193 | 0019cd7d | Christos Stavrakakis | signup astakos notifies user with an verification url via email. |
194 | 77186edf | Kostas Papadimitriou | |
195 | 77186edf | Kostas Papadimitriou | At this stage: |
196 | 77186edf | Kostas Papadimitriou | |
197 | 0019cd7d | Christos Stavrakakis | * subsequent registrations invalidate and delete the previous registrations |
198 | 77186edf | Kostas Papadimitriou | of the same email address. |
199 | 77186edf | Kostas Papadimitriou | |
200 | 77186edf | Kostas Papadimitriou | * in case user misses the initial notification, additional emails can be |
201 | 77186edf | Kostas Papadimitriou | send either via the url which is prompted to the user if he tries to |
202 | 77186edf | Kostas Papadimitriou | login, or by the administrator using the ``snf-manage user-activation-send |
203 | 77186edf | Kostas Papadimitriou | <userid>`` command. |
204 | 77186edf | Kostas Papadimitriou | |
205 | 77186edf | Kostas Papadimitriou | * administrator may also enforce a user to get verified using the |
206 | 77186edf | Kostas Papadimitriou | ``snf-manage user-modify --verify <userid>`` command. |
207 | 77186edf | Kostas Papadimitriou | |
208 | 77186edf | Kostas Papadimitriou | Account activation |
209 | 77186edf | Kostas Papadimitriou | `````````````````` |
210 | 77186edf | Kostas Papadimitriou | |
211 | 3a0ce98e | Constantinos Venetsanopoulos | Once the user gets verified, it is time for Astakos to decide whether or not to |
212 | 77186edf | Kostas Papadimitriou | proceed through user activation process. If ``ASTAKOS_MODERATION_ENABLED`` |
213 | 0019cd7d | Christos Stavrakakis | setting is set to ``False`` (default value) user gets activated automatically. |
214 | 77186edf | Kostas Papadimitriou | |
215 | 3a0ce98e | Constantinos Venetsanopoulos | In case the moderation is enabled Astakos may still automatically activate the |
216 | 77186edf | Kostas Papadimitriou | user in the following cases: |
217 | 77186edf | Kostas Papadimitriou | |
218 | 77186edf | Kostas Papadimitriou | * User email matches any of the regular expressions defined in |
219 | 77186edf | Kostas Papadimitriou | ``ASTAKOS_RE_USER_EMAIL_PATTERNS`` (defaults to ``[]``) |
220 | 77186edf | Kostas Papadimitriou | * User used a signup method (e.g. ``shibboleth``) for which automatic |
221 | 0019cd7d | Christos Stavrakakis | activation is enabled (see |
222 | 77186edf | Kostas Papadimitriou | :ref:`authentication methods policies <auth_methods_policies>`). |
223 | 77186edf | Kostas Papadimitriou | |
224 | 3a0ce98e | Constantinos Venetsanopoulos | If all of the above fail to trigger automatic activation, an email is sent to |
225 | 3a0ce98e | Constantinos Venetsanopoulos | the persons listed in ``HELPDESK``, ``MANAGERS`` and ``ADMINS`` settings, |
226 | 3a0ce98e | Constantinos Venetsanopoulos | notifing that there is a new user pending for moderation and that it's up to |
227 | 3a0ce98e | Constantinos Venetsanopoulos | the administrator to decide if the user should be activated. The UI also shows |
228 | 3a0ce98e | Constantinos Venetsanopoulos | a corresponding 'pending moderation' message to the user. The administrator can |
229 | 3a0ce98e | Constantinos Venetsanopoulos | activate a user using the ``snf-manage user-modify`` command: |
230 | 77186edf | Kostas Papadimitriou | |
231 | 77186edf | Kostas Papadimitriou | .. code-block:: console |
232 | 77186edf | Kostas Papadimitriou | |
233 | 77186edf | Kostas Papadimitriou | # command to activate a pending user |
234 | 77186edf | Kostas Papadimitriou | $ snf-manage user-modify --accept <userid> |
235 | 77186edf | Kostas Papadimitriou | |
236 | 77186edf | Kostas Papadimitriou | # command to reject a pending user |
237 | 77186edf | Kostas Papadimitriou | $ snf-manage user-modify --reject --reject-reason="spammer" <userid> |
238 | 77186edf | Kostas Papadimitriou | |
239 | 3a0ce98e | Constantinos Venetsanopoulos | Once the activation process finishes, a greeting message is sent to the user |
240 | 3a0ce98e | Constantinos Venetsanopoulos | email address and a notification for the activation to the persons listed in |
241 | 3a0ce98e | Constantinos Venetsanopoulos | ``HELPDESK``, ``MANAGERS`` and ``ADMINS`` settings. Once activated the user is |
242 | 3a0ce98e | Constantinos Venetsanopoulos | able to login and access the Synnefo services. |
243 | 77186edf | Kostas Papadimitriou | |
244 | 77186edf | Kostas Papadimitriou | Additional authentication methods |
245 | 77186edf | Kostas Papadimitriou | ````````````````````````````````` |
246 | 77186edf | Kostas Papadimitriou | |
247 | 77186edf | Kostas Papadimitriou | Astakos supports third party logins from external identity providers. This |
248 | 0019cd7d | Christos Stavrakakis | can be usefull since it allows users to use their existing credentials to |
249 | 77186edf | Kostas Papadimitriou | login to astakos service. |
250 | 77186edf | Kostas Papadimitriou | |
251 | 77186edf | Kostas Papadimitriou | Currently astakos supports the following identity providers: |
252 | 77186edf | Kostas Papadimitriou | |
253 | 77186edf | Kostas Papadimitriou | * `Shibboleth <http://www.internet2.edu/shibboleth>`_ (module name |
254 | 77186edf | Kostas Papadimitriou | ``shibboleth``) |
255 | 77186edf | Kostas Papadimitriou | * `Google <https://developers.google.com/accounts/docs/OAuth2>`_ (module |
256 | 77186edf | Kostas Papadimitriou | name ``google``) |
257 | 77186edf | Kostas Papadimitriou | * `Twitter <https://dev.twitter.com/docs/auth>`_ (module name ``twitter``) |
258 | 77186edf | Kostas Papadimitriou | * `LinkedIn <http://developer.linkedin.com/documents/authentication>`_ |
259 | 77186edf | Kostas Papadimitriou | (module name ``linkedin``) |
260 | 77186edf | Kostas Papadimitriou | |
261 | 77186edf | Kostas Papadimitriou | To enable any of the above modules (by default only ``local`` accounts are |
262 | 0019cd7d | Christos Stavrakakis | allowed), retrieve and set the required provider settings and append the |
263 | 77186edf | Kostas Papadimitriou | module name in ``ASTAKOS_IM_MODULES``. |
264 | 77186edf | Kostas Papadimitriou | |
265 | 77186edf | Kostas Papadimitriou | .. code-block:: python |
266 | 77186edf | Kostas Papadimitriou | |
267 | 77186edf | Kostas Papadimitriou | # settings from https://code.google.com/apis/console/ |
268 | 77186edf | Kostas Papadimitriou | ASTAKOS_GOOGLE_CLIENT_ID = '1111111111-epi60tvimgha63qqnjo40cljkojcann3.apps.googleusercontent.com' |
269 | 77186edf | Kostas Papadimitriou | ASTAKOS_GOOGLE_SECRET = 'tNDQqTDKlTf7_LaeUcWTWwZM' |
270 | 0019cd7d | Christos Stavrakakis | |
271 | 77186edf | Kostas Papadimitriou | # let users signup and login using their google account |
272 | 77186edf | Kostas Papadimitriou | ASTAKOS_IM_MODULES = ['local', 'google'] |
273 | 77186edf | Kostas Papadimitriou | |
274 | 77186edf | Kostas Papadimitriou | |
275 | 77186edf | Kostas Papadimitriou | .. _auth_methods_policies: |
276 | 77186edf | Kostas Papadimitriou | |
277 | 77186edf | Kostas Papadimitriou | Authentication method policies |
278 | 77186edf | Kostas Papadimitriou | `````````````````````````````` |
279 | 77186edf | Kostas Papadimitriou | |
280 | 0019cd7d | Christos Stavrakakis | Astakos allows you to override the default policies for each enabled provider |
281 | 0019cd7d | Christos Stavrakakis | separately by adding the approriate settings in your ``.conf`` files in the |
282 | 77186edf | Kostas Papadimitriou | following format: |
283 | 77186edf | Kostas Papadimitriou | |
284 | 77186edf | Kostas Papadimitriou | **ASTAKOS_AUTH_PROVIDER_<module>_<policy>_POLICY** |
285 | 77186edf | Kostas Papadimitriou | |
286 | 77186edf | Kostas Papadimitriou | Available policies are: |
287 | 77186edf | Kostas Papadimitriou | |
288 | 0019cd7d | Christos Stavrakakis | * **CREATE** Users can signup using that provider (default: ``True``) |
289 | 0019cd7d | Christos Stavrakakis | * **REMOVE/ADD** Users can remove/add login method from their profile |
290 | 77186edf | Kostas Papadimitriou | (default: ``True``) |
291 | 77186edf | Kostas Papadimitriou | * **AUTOMODERATE** Automatically activate users that signup using that |
292 | 77186edf | Kostas Papadimitriou | provider (default: ``False``) |
293 | 77186edf | Kostas Papadimitriou | * **LOGIN** Whether or not users can use the provider to login (default: |
294 | 77186edf | Kostas Papadimitriou | ``True``). |
295 | 77186edf | Kostas Papadimitriou | |
296 | 0019cd7d | Christos Stavrakakis | e.g. to enable automatic activation for your academic users, while keeping |
297 | 77186edf | Kostas Papadimitriou | locally signed up users under moderation you can apply the following settings. |
298 | 77186edf | Kostas Papadimitriou | |
299 | 77186edf | Kostas Papadimitriou | .. code-block:: python |
300 | 77186edf | Kostas Papadimitriou | |
301 | 77186edf | Kostas Papadimitriou | ASTAKOS_AUTH_PROVIDER_SHIBBOLETH_AUTOMODERATE_POLICY = True |
302 | 77186edf | Kostas Papadimitriou | ASTAKOS_AUTH_PROVIDER_SHIBBOLETH_REMOVE_POLICY = False |
303 | 77186edf | Kostas Papadimitriou | |
304 | 3a0ce98e | Constantinos Venetsanopoulos | User login |
305 | 3a0ce98e | Constantinos Venetsanopoulos | ~~~~~~~~~~ |
306 | 3a0ce98e | Constantinos Venetsanopoulos | |
307 | 3a0ce98e | Constantinos Venetsanopoulos | During the logging procedure, the user is authenticated by the respective |
308 | 3a0ce98e | Constantinos Venetsanopoulos | identity provider. |
309 | 3a0ce98e | Constantinos Venetsanopoulos | |
310 | 3a0ce98e | Constantinos Venetsanopoulos | If ``ASTAKOS_RECAPTCHA_ENABLED`` is set and the user fails several times |
311 | 3a0ce98e | Constantinos Venetsanopoulos | (``ASTAKOS_RATELIMIT_RETRIES_ALLOWED`` setting) to provide the correct |
312 | 3a0ce98e | Constantinos Venetsanopoulos | credentials for a local account, he/she is then prompted to solve a captcha |
313 | 3a0ce98e | Constantinos Venetsanopoulos | challenge. |
314 | 3a0ce98e | Constantinos Venetsanopoulos | |
315 | 3a0ce98e | Constantinos Venetsanopoulos | Upon success, the system renews the token (if it has expired), logins the user |
316 | 3a0ce98e | Constantinos Venetsanopoulos | and sets the cookie, before redirecting the user to the ``next`` parameter |
317 | 3a0ce98e | Constantinos Venetsanopoulos | value. |
318 | eab73849 | Constantinos Venetsanopoulos | |
319 | 2988ae31 | Georgios D. Tsoukalas | Setting quota limits |
320 | 2988ae31 | Georgios D. Tsoukalas | ~~~~~~~~~~~~~~~~~~~~ |
321 | 2988ae31 | Georgios D. Tsoukalas | |
322 | 075b91de | Giorgos Korfiatis | Set default quota |
323 | 075b91de | Giorgos Korfiatis | ````````````````` |
324 | f72ba65d | Giorgos Korfiatis | To inspect current default base quota limits, run:: |
325 | 2988ae31 | Georgios D. Tsoukalas | |
326 | f72ba65d | Giorgos Korfiatis | # snf-manage resource-list |
327 | 2988ae31 | Georgios D. Tsoukalas | |
328 | d61d6007 | Giorgos Korfiatis | You can modify the default base quota limit for all future users with:: |
329 | 2988ae31 | Georgios D. Tsoukalas | |
330 | d61d6007 | Giorgos Korfiatis | # snf-manage resource-modify <resource_name> --default-quota <value> |
331 | 2988ae31 | Georgios D. Tsoukalas | |
332 | 075b91de | Giorgos Korfiatis | Set base quota for individual users |
333 | 075b91de | Giorgos Korfiatis | ``````````````````````````````````` |
334 | 2988ae31 | Georgios D. Tsoukalas | |
335 | 075b91de | Giorgos Korfiatis | For individual users that need different quota than the default |
336 | 2988ae31 | Georgios D. Tsoukalas | you can set it for each resource like this:: |
337 | 2988ae31 | Georgios D. Tsoukalas | |
338 | 075b91de | Giorgos Korfiatis | # use this to display quota / uuid |
339 | 075b91de | Giorgos Korfiatis | # snf-manage user-show 'uuid or email' --quota |
340 | 2988ae31 | Georgios D. Tsoukalas | |
341 | 45112d5a | Giorgos Korfiatis | # snf-manage user-modify <user-uuid> --base-quota 'cyclades.vm' 10 |
342 | 45112d5a | Giorgos Korfiatis | |
343 | 45112d5a | Giorgos Korfiatis | You can set base quota for all existing users, with possible exceptions, using:: |
344 | 45112d5a | Giorgos Korfiatis | |
345 | 45112d5a | Giorgos Korfiatis | # snf-manage user-modify --all --base-quota cyclades.vm 10 --exclude uuid1,uuid2 |
346 | 2988ae31 | Georgios D. Tsoukalas | |
347 | 5a0f9d6c | Giorgos Korfiatis | All quota for which values different from the default have been set, |
348 | 5a0f9d6c | Giorgos Korfiatis | can be listed with:: |
349 | 5a0f9d6c | Giorgos Korfiatis | |
350 | 5a0f9d6c | Giorgos Korfiatis | # snf-manage quota-list --with-custom=True |
351 | 5a0f9d6c | Giorgos Korfiatis | |
352 | 2988ae31 | Georgios D. Tsoukalas | |
353 | 2988ae31 | Georgios D. Tsoukalas | Enable the Projects feature |
354 | 2988ae31 | Georgios D. Tsoukalas | ~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
355 | 2988ae31 | Georgios D. Tsoukalas | |
356 | 2988ae31 | Georgios D. Tsoukalas | If you want to enable the projects feature so that users may apply |
357 | 2988ae31 | Georgios D. Tsoukalas | on their own for resources by creating and joining projects, |
358 | 2988ae31 | Georgios D. Tsoukalas | in ``20-snf-astakos-app-settings.conf`` set:: |
359 | 2988ae31 | Georgios D. Tsoukalas | |
360 | 2988ae31 | Georgios D. Tsoukalas | # this will make the 'projects' page visible in the dashboard |
361 | 2988ae31 | Georgios D. Tsoukalas | ASTAKOS_PROJECTS_VISIBLE = True |
362 | 2988ae31 | Georgios D. Tsoukalas | |
363 | 9770ba6c | Giorgos Korfiatis | You can change the maximum allowed number of pending project applications |
364 | 9770ba6c | Giorgos Korfiatis | per user with:: |
365 | 827de879 | Giorgos Korfiatis | |
366 | d61d6007 | Giorgos Korfiatis | # snf-manage resource-modify astakos.pending_app --default-quota <number> |
367 | 9770ba6c | Giorgos Korfiatis | |
368 | 9770ba6c | Giorgos Korfiatis | You can also set a user-specific limit with:: |
369 | 9770ba6c | Giorgos Korfiatis | |
370 | 45112d5a | Giorgos Korfiatis | # snf-manage user-modify <user-uuid> --base-quota 'astakos.pending_app' 5 |
371 | 827de879 | Giorgos Korfiatis | |
372 | 2988ae31 | Georgios D. Tsoukalas | When users apply for projects they are not automatically granted |
373 | 2988ae31 | Georgios D. Tsoukalas | the resources. They must first be approved by the administrator. |
374 | 2988ae31 | Georgios D. Tsoukalas | |
375 | 2988ae31 | Georgios D. Tsoukalas | To list pending project applications in astakos:: |
376 | 2988ae31 | Georgios D. Tsoukalas | |
377 | 2988ae31 | Georgios D. Tsoukalas | # snf-manage project-list --pending |
378 | 2988ae31 | Georgios D. Tsoukalas | |
379 | 2988ae31 | Georgios D. Tsoukalas | Note the last column, the application id. To approve it:: |
380 | 2988ae31 | Georgios D. Tsoukalas | |
381 | 2988ae31 | Georgios D. Tsoukalas | # <app id> from the last column of project-list |
382 | 2988ae31 | Georgios D. Tsoukalas | # snf-manage project-control --approve <app id> |
383 | 2988ae31 | Georgios D. Tsoukalas | |
384 | 2988ae31 | Georgios D. Tsoukalas | To deny an application:: |
385 | 2988ae31 | Georgios D. Tsoukalas | |
386 | 2988ae31 | Georgios D. Tsoukalas | # snf-manage project-control --deny <app id> |
387 | 2988ae31 | Georgios D. Tsoukalas | |
388 | 827de879 | Giorgos Korfiatis | Users designated as *project admins* can approve, deny, or modify |
389 | 827de879 | Giorgos Korfiatis | an application through the web interface. In |
390 | 827de879 | Giorgos Korfiatis | ``20-snf-astakos-app-settings.conf`` set:: |
391 | 827de879 | Giorgos Korfiatis | |
392 | 827de879 | Giorgos Korfiatis | # UUIDs of users that can approve or deny project applications from the web. |
393 | 827de879 | Giorgos Korfiatis | ASTAKOS_PROJECT_ADMINS = [<uuid>, ...] |
394 | 2988ae31 | Georgios D. Tsoukalas | |
395 | 2988ae31 | Georgios D. Tsoukalas | |
396 | eab73849 | Constantinos Venetsanopoulos | Astakos advanced operations |
397 | eab73849 | Constantinos Venetsanopoulos | --------------------------- |
398 | eab73849 | Constantinos Venetsanopoulos | |
399 | eab73849 | Constantinos Venetsanopoulos | Adding "Terms of Use" |
400 | eab73849 | Constantinos Venetsanopoulos | ~~~~~~~~~~~~~~~~~~~~~ |
401 | eab73849 | Constantinos Venetsanopoulos | |
402 | eab73849 | Constantinos Venetsanopoulos | Astakos supports versioned terms-of-use. First of all you need to create an |
403 | eab73849 | Constantinos Venetsanopoulos | html file that will contain your terms. For example, create the file |
404 | eab73849 | Constantinos Venetsanopoulos | ``/usr/share/synnefo/sample-terms.html``, which contains the following: |
405 | eab73849 | Constantinos Venetsanopoulos | |
406 | eab73849 | Constantinos Venetsanopoulos | .. code-block:: console |
407 | eab73849 | Constantinos Venetsanopoulos | |
408 | 3a0ce98e | Constantinos Venetsanopoulos | <h1>My cloud service terms</h1> |
409 | eab73849 | Constantinos Venetsanopoulos | |
410 | 3a0ce98e | Constantinos Venetsanopoulos | These are the example terms for my cloud service |
411 | eab73849 | Constantinos Venetsanopoulos | |
412 | eab73849 | Constantinos Venetsanopoulos | Then, add those terms-of-use with the snf-manage command: |
413 | eab73849 | Constantinos Venetsanopoulos | |
414 | eab73849 | Constantinos Venetsanopoulos | .. code-block:: console |
415 | eab73849 | Constantinos Venetsanopoulos | |
416 | eab73849 | Constantinos Venetsanopoulos | $ snf-manage term-add /usr/share/synnefo/sample-terms.html |
417 | eab73849 | Constantinos Venetsanopoulos | |
418 | eab73849 | Constantinos Venetsanopoulos | Your terms have been successfully added and you will see the corresponding link |
419 | eab73849 | Constantinos Venetsanopoulos | appearing in the Astakos web pages' footer. |
420 | eab73849 | Constantinos Venetsanopoulos | |
421 | 3a0ce98e | Constantinos Venetsanopoulos | During the account registration, if there are approval terms, the user is |
422 | 3a0ce98e | Constantinos Venetsanopoulos | presented with an "I agree with the Terms" checkbox that needs to get checked |
423 | 3a0ce98e | Constantinos Venetsanopoulos | in order to proceed. |
424 | 3a0ce98e | Constantinos Venetsanopoulos | |
425 | 3a0ce98e | Constantinos Venetsanopoulos | In case there are new approval terms that the user has not signed yet, the |
426 | 3a0ce98e | Constantinos Venetsanopoulos | ``signed_terms_required`` view decorator redirects to the ``approval_terms`` |
427 | 3a0ce98e | Constantinos Venetsanopoulos | view, so the user will be presented with the new terms the next time he/she |
428 | 3a0ce98e | Constantinos Venetsanopoulos | logins. |
429 | 3a0ce98e | Constantinos Venetsanopoulos | |
430 | a23251f4 | Constantinos Venetsanopoulos | Enabling reCAPTCHA |
431 | a23251f4 | Constantinos Venetsanopoulos | ~~~~~~~~~~~~~~~~~~ |
432 | a23251f4 | Constantinos Venetsanopoulos | |
433 | a23251f4 | Constantinos Venetsanopoulos | Astakos supports the `reCAPTCHA <http://www.google.com/recaptcha>`_ feature. |
434 | a23251f4 | Constantinos Venetsanopoulos | If enabled, it protects the Astakos forms from bots. To enable the feature, go |
435 | a23251f4 | Constantinos Venetsanopoulos | to https://www.google.com/recaptcha/admin/create and create your own reCAPTCHA |
436 | a23251f4 | Constantinos Venetsanopoulos | key pair. Then edit ``/etc/synnefo/20-snf-astakos-app-settings.conf`` and set |
437 | a23251f4 | Constantinos Venetsanopoulos | the corresponding variables to reflect your newly created key pair. Finally, set |
438 | a23251f4 | Constantinos Venetsanopoulos | the ``ASTAKOS_RECAPTCHA_ENABLED`` variable to ``True``: |
439 | a23251f4 | Constantinos Venetsanopoulos | |
440 | a23251f4 | Constantinos Venetsanopoulos | .. code-block:: console |
441 | a23251f4 | Constantinos Venetsanopoulos | |
442 | a23251f4 | Constantinos Venetsanopoulos | ASTAKOS_RECAPTCHA_PUBLIC_KEY = 'example_recaptcha_public_key!@#$%^&*(' |
443 | a23251f4 | Constantinos Venetsanopoulos | ASTAKOS_RECAPTCHA_PRIVATE_KEY = 'example_recaptcha_private_key!@#$%^&*(' |
444 | a23251f4 | Constantinos Venetsanopoulos | |
445 | a23251f4 | Constantinos Venetsanopoulos | ASTAKOS_RECAPTCHA_ENABLED = True |
446 | a23251f4 | Constantinos Venetsanopoulos | |
447 | a23251f4 | Constantinos Venetsanopoulos | Restart the service on the Astakos node(s) and you are ready: |
448 | a23251f4 | Constantinos Venetsanopoulos | |
449 | a23251f4 | Constantinos Venetsanopoulos | .. code-block:: console |
450 | a23251f4 | Constantinos Venetsanopoulos | |
451 | a23251f4 | Constantinos Venetsanopoulos | # /etc/init.d/gunicorn restart |
452 | a23251f4 | Constantinos Venetsanopoulos | |
453 | a23251f4 | Constantinos Venetsanopoulos | Checkout your new Sign up page. If you see the reCAPTCHA box, you have setup |
454 | a23251f4 | Constantinos Venetsanopoulos | everything correctly. |
455 | a23251f4 | Constantinos Venetsanopoulos | |
456 | eab73849 | Constantinos Venetsanopoulos | |
457 | 3a0ce98e | Constantinos Venetsanopoulos | Astakos internals |
458 | 3a0ce98e | Constantinos Venetsanopoulos | ----------------- |
459 | 3a0ce98e | Constantinos Venetsanopoulos | |
460 | 3a0ce98e | Constantinos Venetsanopoulos | X-Auth-Token |
461 | 3a0ce98e | Constantinos Venetsanopoulos | ~~~~~~~~~~~~ |
462 | 3a0ce98e | Constantinos Venetsanopoulos | |
463 | 3a0ce98e | Constantinos Venetsanopoulos | Alice requests a specific resource from a cloud service e.g.: Pithos. In the |
464 | 3a0ce98e | Constantinos Venetsanopoulos | request she supplies the `X-Auth-Token` to identify whether she is eligible to |
465 | 3a0ce98e | Constantinos Venetsanopoulos | perform the specific task. The service contacts Astakos through its |
466 | 3a0ce98e | Constantinos Venetsanopoulos | ``/account/v1.0/authenticate`` api call (see :ref:`authenticate-api-label`) |
467 | 3a0ce98e | Constantinos Venetsanopoulos | providing the specific ``X-Auth-Token``. Astakos checkes whether the token |
468 | 3a0ce98e | Constantinos Venetsanopoulos | belongs to an active user and it has not expired and returns a dictionary |
469 | 3a0ce98e | Constantinos Venetsanopoulos | containing user related information. Finally the service uses the ``uniq`` |
470 | 3a0ce98e | Constantinos Venetsanopoulos | field included in the dictionary as the account string to identify the user |
471 | 3a0ce98e | Constantinos Venetsanopoulos | accessible resources. |
472 | 3a0ce98e | Constantinos Venetsanopoulos | |
473 | 3a0ce98e | Constantinos Venetsanopoulos | .. _authentication-label: |
474 | 3a0ce98e | Constantinos Venetsanopoulos | |
475 | 3a0ce98e | Constantinos Venetsanopoulos | Django Auth methods and Backends |
476 | 3a0ce98e | Constantinos Venetsanopoulos | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
477 | 3a0ce98e | Constantinos Venetsanopoulos | |
478 | 3a0ce98e | Constantinos Venetsanopoulos | Astakos incorporates Django user authentication system and extends its User model. |
479 | 3a0ce98e | Constantinos Venetsanopoulos | |
480 | 3a0ce98e | Constantinos Venetsanopoulos | Since username field of django User model has a limitation of 30 characters, |
481 | 3a0ce98e | Constantinos Venetsanopoulos | AstakosUser is **uniquely** identified by the ``email`` instead. Therefore, |
482 | 3a0ce98e | Constantinos Venetsanopoulos | ``astakos.im.authentication_backends.EmailBackend`` is served to authenticate a |
483 | 3a0ce98e | Constantinos Venetsanopoulos | user using email if the first argument is actually an email, otherwise tries |
484 | 3a0ce98e | Constantinos Venetsanopoulos | the username. |
485 | 3a0ce98e | Constantinos Venetsanopoulos | |
486 | 3a0ce98e | Constantinos Venetsanopoulos | A new AstakosUser instance is assigned with a uui as username and also with a |
487 | 3a0ce98e | Constantinos Venetsanopoulos | ``auth_token`` used by the cloud services to authenticate the user. |
488 | 3a0ce98e | Constantinos Venetsanopoulos | ``astakos.im.authentication_backends.TokenBackend`` is also specified in order |
489 | 3a0ce98e | Constantinos Venetsanopoulos | to authenticate the user using the email and the token fields. |
490 | 3a0ce98e | Constantinos Venetsanopoulos | |
491 | 3a0ce98e | Constantinos Venetsanopoulos | Logged on users can perform a number of actions: |
492 | 3a0ce98e | Constantinos Venetsanopoulos | |
493 | 3a0ce98e | Constantinos Venetsanopoulos | * access and edit their profile via: ``/im/profile``. |
494 | 3a0ce98e | Constantinos Venetsanopoulos | * change their password via: ``/im/password`` |
495 | 3a0ce98e | Constantinos Venetsanopoulos | * send feedback for grnet services via: ``/im/send_feedback`` |
496 | 3a0ce98e | Constantinos Venetsanopoulos | * logout (and delete cookie) via: ``/im/logout`` |
497 | 3a0ce98e | Constantinos Venetsanopoulos | |
498 | 3a0ce98e | Constantinos Venetsanopoulos | Internal Astakos requests are handled using cookie-based Django user sessions. |
499 | 3a0ce98e | Constantinos Venetsanopoulos | |
500 | 3a0ce98e | Constantinos Venetsanopoulos | External systems should forward to the ``/login`` URI. The server, |
501 | 3a0ce98e | Constantinos Venetsanopoulos | depending on its configuration will redirect to the appropriate login page. |
502 | 3a0ce98e | Constantinos Venetsanopoulos | When done with logging in, the service's login URI should redirect to the URI |
503 | 3a0ce98e | Constantinos Venetsanopoulos | provided with next, adding user and token parameters, which contain the email |
504 | 3a0ce98e | Constantinos Venetsanopoulos | and token fields respectively. |
505 | 3a0ce98e | Constantinos Venetsanopoulos | |
506 | 3a0ce98e | Constantinos Venetsanopoulos | The login URI accepts the following parameters: |
507 | 3a0ce98e | Constantinos Venetsanopoulos | |
508 | 3a0ce98e | Constantinos Venetsanopoulos | ====================== ========================= |
509 | 3a0ce98e | Constantinos Venetsanopoulos | Request Parameter Name Value |
510 | 3a0ce98e | Constantinos Venetsanopoulos | ====================== ========================= |
511 | 3a0ce98e | Constantinos Venetsanopoulos | next The URI to redirect to when the process is finished |
512 | 3a0ce98e | Constantinos Venetsanopoulos | renew Force token renewal (no value parameter) |
513 | 3a0ce98e | Constantinos Venetsanopoulos | force Force logout current user (no value parameter) |
514 | 3a0ce98e | Constantinos Venetsanopoulos | ====================== ========================= |
515 | 3a0ce98e | Constantinos Venetsanopoulos | |
516 | 3a0ce98e | Constantinos Venetsanopoulos | External systems inside the ``ASTAKOS_COOKIE_DOMAIN`` scope can acquire the |
517 | 3a0ce98e | Constantinos Venetsanopoulos | user information by the cookie identified by ``ASTAKOS_COOKIE_NAME`` setting |
518 | 3a0ce98e | Constantinos Venetsanopoulos | (set during the login procedure). |
519 | 3a0ce98e | Constantinos Venetsanopoulos | |
520 | 3a0ce98e | Constantinos Venetsanopoulos | Finally, backend systems having acquired a token can use the |
521 | 3a0ce98e | Constantinos Venetsanopoulos | :ref:`authenticate-api-label` API call from a private network or through HTTPS. |
522 | 3a0ce98e | Constantinos Venetsanopoulos | |
523 | 3a0ce98e | Constantinos Venetsanopoulos | |
524 | eab73849 | Constantinos Venetsanopoulos | Compute/Network/Image Service (Cyclades) |
525 | eab73849 | Constantinos Venetsanopoulos | ======================================== |
526 | eab73849 | Constantinos Venetsanopoulos | |
527 | 6d8a47d0 | Christos Stavrakakis | Introduction |
528 | 6d8a47d0 | Christos Stavrakakis | ------------ |
529 | 6d8a47d0 | Christos Stavrakakis | |
530 | 6d8a47d0 | Christos Stavrakakis | Cyclades is the Synnefo component that implements Compute, Network and Image |
531 | 6d8a47d0 | Christos Stavrakakis | services and exposes the associated OpenStack REST APIs. By running Cyclades |
532 | 6d8a47d0 | Christos Stavrakakis | you can provide a cloud that can handle thousands of virtual servers and |
533 | 6d8a47d0 | Christos Stavrakakis | networks. |
534 | 6d8a47d0 | Christos Stavrakakis | |
535 | 6d8a47d0 | Christos Stavrakakis | Cyclades does not include any virtualization software and knows nothing about |
536 | 6d8a47d0 | Christos Stavrakakis | the low-level VM management operations, e.g. handling of VM creation or |
537 | 6d8a47d0 | Christos Stavrakakis | migrations among physical nodes. Instead, Cyclades is the component that |
538 | 6d8a47d0 | Christos Stavrakakis | handles multiple Ganeti backends and exposes the REST APIs. The administrator |
539 | 6d8a47d0 | Christos Stavrakakis | can expand the infrastructure dynamically either by adding more Ganeti nodes |
540 | 6d8a47d0 | Christos Stavrakakis | or by adding new Ganeti clusters. Cyclades issue VM control commands to Ganeti |
541 | 6d8a47d0 | Christos Stavrakakis | via Ganeti's remote API and receive asynchronous notifications from Ganeti |
542 | 6d8a47d0 | Christos Stavrakakis | backends whenever the state of a VM changes, due to Synnefo- or |
543 | 6d8a47d0 | Christos Stavrakakis | administrator-initiated commands. |
544 | 6d8a47d0 | Christos Stavrakakis | |
545 | 6d8a47d0 | Christos Stavrakakis | Cyclades is the action orchestrator and the API layer on top of multiple Ganeti |
546 | 6d8a47d0 | Christos Stavrakakis | clusters. By this decoupled design, Ganeti cluster are self-contained and |
547 | 6d8a47d0 | Christos Stavrakakis | the administrator has complete control on them without Cyclades knowing about |
548 | 6d8a47d0 | Christos Stavrakakis | it. For example a VM migration to a different physical node is transparent |
549 | 6d8a47d0 | Christos Stavrakakis | to Cyclades. |
550 | 6d8a47d0 | Christos Stavrakakis | |
551 | eab73849 | Constantinos Venetsanopoulos | Working with Cyclades |
552 | eab73849 | Constantinos Venetsanopoulos | --------------------- |
553 | eab73849 | Constantinos Venetsanopoulos | |
554 | 6d8a47d0 | Christos Stavrakakis | Flavors |
555 | 6d8a47d0 | Christos Stavrakakis | ~~~~~~~ |
556 | 6d8a47d0 | Christos Stavrakakis | |
557 | 6d8a47d0 | Christos Stavrakakis | When creating a VM, the user must specify the `flavor` of the virtual server. |
558 | 6d8a47d0 | Christos Stavrakakis | Flavors are the virtual hardware templates, and provide a description about |
559 | 6d8a47d0 | Christos Stavrakakis | the number of CPUs, the amount of RAM, and the size of the disk of the VM. |
560 | 6d8a47d0 | Christos Stavrakakis | Besides the size of the disk, Cyclades flavors describe the storage backend |
561 | 6d8a47d0 | Christos Stavrakakis | that will be used for the virtual server. |
562 | 6d8a47d0 | Christos Stavrakakis | |
563 | 6d8a47d0 | Christos Stavrakakis | Flavors are created by the administrator and the user can select one of the |
564 | 06f25e46 | Christos Stavrakakis | available flavors. After VM creation, the user can resize his VM, by |
565 | 06f25e46 | Christos Stavrakakis | adding/removing CPU and RAM. |
566 | 6d8a47d0 | Christos Stavrakakis | |
567 | 6d8a47d0 | Christos Stavrakakis | Cyclades support different storage backends that are described by the disk |
568 | 6d8a47d0 | Christos Stavrakakis | template of the flavor, which is mapped to Ganeti's instance `disk template`. |
569 | 6d8a47d0 | Christos Stavrakakis | Currently the available disk templates are the following: |
570 | 6d8a47d0 | Christos Stavrakakis | |
571 | 6d8a47d0 | Christos Stavrakakis | * `file`: regulars file |
572 | 6d8a47d0 | Christos Stavrakakis | * `sharedfile`: regular files on a shared directory, e.g. NFS |
573 | 6d8a47d0 | Christos Stavrakakis | * `plain`: logical volumes |
574 | 6d8a47d0 | Christos Stavrakakis | * `drbd`: drbd on top of lvm volumes |
575 | 6d8a47d0 | Christos Stavrakakis | * `rbd`: rbd volumes residing inside a RADOS cluster |
576 | 6d8a47d0 | Christos Stavrakakis | * `ext`: disks provided by an external shared storage. |
577 | 6d8a47d0 | Christos Stavrakakis | |
578 | 6d8a47d0 | Christos Stavrakakis | - `ext_archipelago`: External shared storage provided by |
579 | 6d8a47d0 | Christos Stavrakakis | `Archipelago <http://www.synnefo.org/docs/archipelago/latest/index.html>`_. |
580 | 6d8a47d0 | Christos Stavrakakis | |
581 | 6d8a47d0 | Christos Stavrakakis | Flavors are created by the administrator using `snf-manage flavor-create` |
582 | 6d8a47d0 | Christos Stavrakakis | command. The command takes as argument number of CPUs, amount of RAM, the size |
583 | 6d8a47d0 | Christos Stavrakakis | of the disks and the disk templates and create the flavors that belong to the |
584 | 6d8a47d0 | Christos Stavrakakis | cartesian product of the specified arguments. For example, the following |
585 | 6d8a47d0 | Christos Stavrakakis | command will create two flavors of `40G` disk size with `drbd` disk template, |
586 | 6d8a47d0 | Christos Stavrakakis | `4G` RAM and `2` or `4` CPUs. |
587 | 6d8a47d0 | Christos Stavrakakis | |
588 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
589 | 6d8a47d0 | Christos Stavrakakis | |
590 | 0019cd7d | Christos Stavrakakis | $ snf-manage flavor-create 2,4 4096 40 drbd |
591 | 6d8a47d0 | Christos Stavrakakis | |
592 | 6d8a47d0 | Christos Stavrakakis | To see the available flavors, run `snf-manage flavor-list` command. Finally, |
593 | 6d8a47d0 | Christos Stavrakakis | the administrator can delete a flavor by using `flavor-modify` command: |
594 | 6d8a47d0 | Christos Stavrakakis | |
595 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
596 | 6d8a47d0 | Christos Stavrakakis | |
597 | 0019cd7d | Christos Stavrakakis | $ snf-manage flavor-modify --deleted=True <flavor_id> |
598 | 6d8a47d0 | Christos Stavrakakis | |
599 | 6d8a47d0 | Christos Stavrakakis | Images |
600 | 6d8a47d0 | Christos Stavrakakis | ~~~~~~ |
601 | 6d8a47d0 | Christos Stavrakakis | |
602 | 6d8a47d0 | Christos Stavrakakis | When creating a VM the user must also specify the `image` of the virtual |
603 | 6d8a47d0 | Christos Stavrakakis | server. Images are the static templates from which VM instances are |
604 | 6d8a47d0 | Christos Stavrakakis | initiated. Cyclades uses Pithos to store system and user-provided images, |
605 | 6d8a47d0 | Christos Stavrakakis | taking advantage of all Pithos features, like deduplication and syncing |
606 | 6d8a47d0 | Christos Stavrakakis | protocol. An image is a file stored to Pithos with additional metadata that |
607 | 6d8a47d0 | Christos Stavrakakis | are describing the image, e.g. the OS family or the root partition. To create |
608 | 6d8a47d0 | Christos Stavrakakis | a new image, the administrator or the user has to upload it a file to Pithos, |
609 | 6d8a47d0 | Christos Stavrakakis | and then register it as an Image with Cyclades. Then the user can use this |
610 | 6d8a47d0 | Christos Stavrakakis | image to spawn new VMs from it. |
611 | 6d8a47d0 | Christos Stavrakakis | |
612 | 6d8a47d0 | Christos Stavrakakis | Images can be private, public or shared between users, exactly like Pithos |
613 | 6d8a47d0 | Christos Stavrakakis | files. Since user-provided public images can be untrusted, the administrator |
614 | 6d8a47d0 | Christos Stavrakakis | can denote which users are trusted by adding them to the |
615 | 0019cd7d | Christos Stavrakakis | ``UI_SYSTEM_IMAGES_OWNERS`` setting in the |
616 | 6d8a47d0 | Christos Stavrakakis | `/etc/synnefo/20-snf-cyclades-app-ui.conf` file. Images of those users are |
617 | 6d8a47d0 | Christos Stavrakakis | properly displayed in the UI. |
618 | 6d8a47d0 | Christos Stavrakakis | |
619 | 6d8a47d0 | Christos Stavrakakis | When creating a new VM, Cyclades pass the location of the image and it's |
620 | 6d8a47d0 | Christos Stavrakakis | metadata to Ganeti. After Ganeti creates the instance's disk, `snf-image` |
621 | 6d8a47d0 | Christos Stavrakakis | will copy the image to the new disk and perform the image customization |
622 | 6d8a47d0 | Christos Stavrakakis | phase. During the phase, `snf-image` sends notifications to Cyclades about |
623 | 6d8a47d0 | Christos Stavrakakis | the progress of the image deployment and customization. Customization includes |
624 | 6d8a47d0 | Christos Stavrakakis | resizing the root file system, file injection (e.g. SSH keys) and setting |
625 | 6d8a47d0 | Christos Stavrakakis | a custom hostname. For better understanding of `snf-image` read the |
626 | 6d8a47d0 | Christos Stavrakakis | corresponding `documentation |
627 | 6d8a47d0 | Christos Stavrakakis | <http://www.synnefo.org/docs/snf-image/latest/index.html>`_. |
628 | 6d8a47d0 | Christos Stavrakakis | |
629 | 6d8a47d0 | Christos Stavrakakis | For passing sensitive data about the image to Ganeti, like the VMs password, |
630 | 6d8a47d0 | Christos Stavrakakis | Cyclades keeps all sensitive data in memory caches (memcache) and never allows |
631 | 6d8a47d0 | Christos Stavrakakis | them to hit the disk. The data are exposed to `snf-image` via an one-time URL |
632 | 6d8a47d0 | Christos Stavrakakis | that is exposed from the `vmapi` application. So, instead of passing sensitive |
633 | 6d8a47d0 | Christos Stavrakakis | data to `snf-image` via Ganeti, Cyclades pass an one-time configuration URL |
634 | 6d8a47d0 | Christos Stavrakakis | that contains a random UUID. After `snf-image` gets the sensitive data, the |
635 | 6d8a47d0 | Christos Stavrakakis | URL is invalidated so no one else can access them. |
636 | 6d8a47d0 | Christos Stavrakakis | |
637 | 6d8a47d0 | Christos Stavrakakis | The administrator can register images, exactly like users, using a system user |
638 | 0019cd7d | Christos Stavrakakis | (a user that is defined in the ``UI_SYSTEM_IMAGES_OWNERS`` setting). For |
639 | 6d8a47d0 | Christos Stavrakakis | example, the following command will register the |
640 | 6d8a47d0 | Christos Stavrakakis | `pithos://u53r-un1qu3-1d/images/debian_base-6.0-7-x86_64.diskdump` as an |
641 | 6d8a47d0 | Christos Stavrakakis | image to Cyclades: |
642 | 6d8a47d0 | Christos Stavrakakis | |
643 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
644 | 6d8a47d0 | Christos Stavrakakis | |
645 | 0019cd7d | Christos Stavrakakis | $ kamaki image register "Debian Base" \ |
646 | 6d8a47d0 | Christos Stavrakakis | pithos://u53r-un1qu3-1d/images/debian_base-6.0-7-x86_64.diskdump \ |
647 | 6d8a47d0 | Christos Stavrakakis | --public \ |
648 | 6d8a47d0 | Christos Stavrakakis | --disk-format=diskdump \ |
649 | 6d8a47d0 | Christos Stavrakakis | --property OSFAMILY=linux --property ROOT_PARTITION=1 \ |
650 | 6d8a47d0 | Christos Stavrakakis | --property description="Debian Squeeze Base System" \ |
651 | 6d8a47d0 | Christos Stavrakakis | --property size=451 --property kernel=2.6.32 --property GUI="No GUI" \ |
652 | 6d8a47d0 | Christos Stavrakakis | --property sortorder=1 --property USERS=root --property OS=debian |
653 | 6d8a47d0 | Christos Stavrakakis | |
654 | 6d8a47d0 | Christos Stavrakakis | Deletion of an image is done via `kamaki image unregister` command, which will |
655 | 6d8a47d0 | Christos Stavrakakis | delete the Cyclades Images but will leave the Pithos file as is (unregister). |
656 | 6d8a47d0 | Christos Stavrakakis | |
657 | 6d8a47d0 | Christos Stavrakakis | Apart from using `kamaki` to see and hangle the available images, the |
658 | 6d8a47d0 | Christos Stavrakakis | administrator can use `snf-manage image-list` and `snf-manage image-show` |
659 | 6d8a47d0 | Christos Stavrakakis | commands to list and inspect the available public images. Also, the `--user-id` |
660 | 6d8a47d0 | Christos Stavrakakis | option can be used the see the images of a specific user. |
661 | 6d8a47d0 | Christos Stavrakakis | |
662 | 6d8a47d0 | Christos Stavrakakis | Virtual Servers |
663 | 6d8a47d0 | Christos Stavrakakis | ~~~~~~~~~~~~~~~ |
664 | 6d8a47d0 | Christos Stavrakakis | |
665 | 6d8a47d0 | Christos Stavrakakis | As mentioned, Cyclades uses Ganeti for management of VMs. The administrator can |
666 | 6d8a47d0 | Christos Stavrakakis | handle Cyclades VMs just like any other Ganeti instance, via `gnt-instance` |
667 | 6d8a47d0 | Christos Stavrakakis | commands. All Ganeti instances that belong to Synnefo, are separated from |
668 | 6d8a47d0 | Christos Stavrakakis | others, by a prefix in their names. This prefix is defined in |
669 | 6d8a47d0 | Christos Stavrakakis | ``BACKEND_PREFIX_ID`` setting in |
670 | 6d8a47d0 | Christos Stavrakakis | ``/etc/synnefo/20-snf-cyclades-app-backend.conf``. |
671 | 6d8a47d0 | Christos Stavrakakis | |
672 | 6d8a47d0 | Christos Stavrakakis | Apart from handling Cyclades VM at the Ganeti level, the administrator can |
673 | 6d8a47d0 | Christos Stavrakakis | also use the `snf-manage server-*` commands. These command cover the most |
674 | 6d8a47d0 | Christos Stavrakakis | common tasks that are relative with VM handling. Below we describe come |
675 | 6d8a47d0 | Christos Stavrakakis | of them, but for more information you can use the `--help` option of all |
676 | 6d8a47d0 | Christos Stavrakakis | `snf-manage server-* commands`. These command cover the most |
677 | 6d8a47d0 | Christos Stavrakakis | |
678 | 6d8a47d0 | Christos Stavrakakis | The `snf-manage server-create` command can be used to create a new VM for some |
679 | 6d8a47d0 | Christos Stavrakakis | user. This command can be useful when the administrator wants to test Cyclades |
680 | 6d8a47d0 | Christos Stavrakakis | functionality without starting the API service, e.g. after an upgrade. Also, by |
681 | 6d8a47d0 | Christos Stavrakakis | using `--backend-id` option, the VM will be created in the specified backend, |
682 | 6d8a47d0 | Christos Stavrakakis | bypassing automatic VM allocation. |
683 | 6d8a47d0 | Christos Stavrakakis | |
684 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
685 | 6d8a47d0 | Christos Stavrakakis | |
686 | 0019cd7d | Christos Stavrakakis | $ snf-manage server-create --flavor-id=1 --image-id=fc0f6858-f962-42ce-bf9a-1345f89b3d5e \ |
687 | 6d8a47d0 | Christos Stavrakakis | --user-id=7cf4d078-67bf-424d-8ff2-8669eb4841ea --backend-id=2 \ |
688 | 6d8a47d0 | Christos Stavrakakis | --password='example_passw0rd' --name='test_vm' |
689 | 6d8a47d0 | Christos Stavrakakis | |
690 | 6d8a47d0 | Christos Stavrakakis | The above commnd will create a new VM for user |
691 | 6d8a47d0 | Christos Stavrakakis | `7cf4d078-67bf-424d-8ff2-8669eb4841ea` in the Ganeti backend with ID 2. By |
692 | 6d8a47d0 | Christos Stavrakakis | default this command will issue a Ganeti job to create the VM |
693 | 6d8a47d0 | Christos Stavrakakis | (`OP_INSTANCE_CREATE`) and return. As in other commands, the `--wait=True` |
694 | 6d8a47d0 | Christos Stavrakakis | option can be used in order to wait for the successful completion of the job. |
695 | 6d8a47d0 | Christos Stavrakakis | |
696 | 6d8a47d0 | Christos Stavrakakis | `snf-manage server-list` command can be used to list all the available servers. |
697 | 6d8a47d0 | Christos Stavrakakis | The command supports some useful options, like listing servers of a user, |
698 | 6d8a47d0 | Christos Stavrakakis | listing servers that exist in a Ganeti backend and listing deleted servers. |
699 | 6d8a47d0 | Christos Stavrakakis | Also, as in most of `*-list` commands, the `--filter-by` option can be used to |
700 | 6d8a47d0 | Christos Stavrakakis | filter the results. For example, the following command will only display the |
701 | 6d8a47d0 | Christos Stavrakakis | started servers of a specific flavor: |
702 | 6d8a47d0 | Christos Stavrakakis | |
703 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
704 | 6d8a47d0 | Christos Stavrakakis | |
705 | 0019cd7d | Christos Stavrakakis | $ snf-manage server-list --filter-by="operstate=STARTED,flavor=<flavor_id>" |
706 | 6d8a47d0 | Christos Stavrakakis | |
707 | 6d8a47d0 | Christos Stavrakakis | Another very useful command is the `server-inspect` command which will display |
708 | 6d8a47d0 | Christos Stavrakakis | all available information about the state of the server in DB and the state |
709 | 6d8a47d0 | Christos Stavrakakis | of the server in the Ganeti backend. The output will give you an easy overview |
710 | 6d8a47d0 | Christos Stavrakakis | about the state of the VM which can be useful for debugging. |
711 | 6d8a47d0 | Christos Stavrakakis | |
712 | 6d8a47d0 | Christos Stavrakakis | Also the administrator can `suspend` a user's VM, using the `server-modify` |
713 | 6d8a47d0 | Christos Stavrakakis | command: |
714 | 6d8a47d0 | Christos Stavrakakis | |
715 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
716 | 6d8a47d0 | Christos Stavrakakis | |
717 | 0019cd7d | Christos Stavrakakis | $ snf-manage server-modify --suspended=True <server_id> |
718 | 6d8a47d0 | Christos Stavrakakis | |
719 | 6d8a47d0 | Christos Stavrakakis | The user is forbidden to do any action on an administratively suspended VM, |
720 | 6d8a47d0 | Christos Stavrakakis | which is useful for abuse cases. |
721 | 6d8a47d0 | Christos Stavrakakis | |
722 | 6d8a47d0 | Christos Stavrakakis | Ganeti backends |
723 | 6d8a47d0 | Christos Stavrakakis | ~~~~~~~~~~~~~~~ |
724 | 0768a1df | Christos Stavrakakis | |
725 | a1c707c9 | Constantinos Venetsanopoulos | Since v0.11, Synnefo is able to manage multiple Ganeti clusters (backends) |
726 | a1c707c9 | Constantinos Venetsanopoulos | making it capable to scale linearly to tens of thousands of VMs. Backends |
727 | a1c707c9 | Constantinos Venetsanopoulos | can be dynamically added or removed via `snf-manage` commands. |
728 | 0768a1df | Christos Stavrakakis | |
729 | a1c707c9 | Constantinos Venetsanopoulos | Each newly created VM is allocated to a Ganeti backend by the Cyclades backend |
730 | a1c707c9 | Constantinos Venetsanopoulos | allocator. The VM is "pinned" to this backend, and can not change through its |
731 | a1c707c9 | Constantinos Venetsanopoulos | lifetime. The backend allocator decides in which backend to spawn the VM based |
732 | a1c707c9 | Constantinos Venetsanopoulos | on the available resources of each backend, trying to balance the load between |
733 | edd28bbf | Christos Stavrakakis | them. Also, Networks are created to all Ganeti backends, in order to ensure |
734 | edd28bbf | Christos Stavrakakis | that VMs residing on different backends can be connected to the same networks. |
735 | 0768a1df | Christos Stavrakakis | |
736 | edd28bbf | Christos Stavrakakis | A backend can be marked as `drained` in order to be excluded from automatic |
737 | edd28bbf | Christos Stavrakakis | servers allocation and not receive new servers. Also, a backend can be marked |
738 | edd28bbf | Christos Stavrakakis | as `offline` to denote that the backend is not healthy (e.g. broken master) |
739 | edd28bbf | Christos Stavrakakis | and avoid the penalty of connection timeouts. |
740 | edd28bbf | Christos Stavrakakis | |
741 | edd28bbf | Christos Stavrakakis | Finally, Cyclades is able to manage Ganeti backends with different enabled |
742 | edd28bbf | Christos Stavrakakis | hypervisors (`kvm`, `xen`), and different enabled disk templates. |
743 | 0768a1df | Christos Stavrakakis | |
744 | a1c707c9 | Constantinos Venetsanopoulos | Listing existing backends |
745 | a1c707c9 | Constantinos Venetsanopoulos | ````````````````````````` |
746 | a1c707c9 | Constantinos Venetsanopoulos | To list all the Ganeti backends known to Synnefo, we run: |
747 | 90c74332 | Christos Stavrakakis | |
748 | 0768a1df | Christos Stavrakakis | .. code-block:: console |
749 | 0768a1df | Christos Stavrakakis | |
750 | 0768a1df | Christos Stavrakakis | $ snf-manage backend-list |
751 | 0768a1df | Christos Stavrakakis | |
752 | 0768a1df | Christos Stavrakakis | Adding a new Ganeti backend |
753 | 90c74332 | Christos Stavrakakis | ``````````````````````````` |
754 | 0768a1df | Christos Stavrakakis | Backends are dynamically added under the control of Synnefo with `snf-manage |
755 | 0768a1df | Christos Stavrakakis | backend-add` command. In this section it is assumed that a Ganeti cluster, |
756 | a1c707c9 | Constantinos Venetsanopoulos | named ``cluster.example.com`` is already up and running and configured to be |
757 | a1c707c9 | Constantinos Venetsanopoulos | able to host Synnefo VMs. |
758 | 0768a1df | Christos Stavrakakis | |
759 | a1c707c9 | Constantinos Venetsanopoulos | To add this Ganeti cluster, we run: |
760 | 90c74332 | Christos Stavrakakis | |
761 | 0768a1df | Christos Stavrakakis | .. code-block:: console |
762 | 0768a1df | Christos Stavrakakis | |
763 | 0768a1df | Christos Stavrakakis | $ snf-manage backend-add --clustername=cluster.example.com --user="synnefo_user" --pass="synnefo_pass" |
764 | 0768a1df | Christos Stavrakakis | |
765 | 46ccbcb9 | Christos Stavrakakis | where ``clustername`` is the Cluster hostname of the Ganeti cluster, and |
766 | 46ccbcb9 | Christos Stavrakakis | ``user`` and ``pass`` are the credentials for the `Ganeti RAPI user |
767 | 46ccbcb9 | Christos Stavrakakis | <http://docs.ganeti.org/ganeti/2.2/html/rapi.html#users-and-passwords>`_. All |
768 | 46ccbcb9 | Christos Stavrakakis | backend attributes can be also changed dynamically using the `snf-manage |
769 | 46ccbcb9 | Christos Stavrakakis | backend-modify` command. |
770 | 0768a1df | Christos Stavrakakis | |
771 | edd28bbf | Christos Stavrakakis | ``snf-manage backend-add`` will also create all existing public networks to |
772 | a1c707c9 | Constantinos Venetsanopoulos | the new backend. You can verify that the backend is added, by running |
773 | a1c707c9 | Constantinos Venetsanopoulos | `snf-manage backend-list`. |
774 | 0768a1df | Christos Stavrakakis | |
775 | a1c707c9 | Constantinos Venetsanopoulos | Note that no VMs will be spawned to this backend, since by default it is in a |
776 | edd28bbf | Christos Stavrakakis | ``drained`` state after addition in order to manually verify the state of the |
777 | edd28bbf | Christos Stavrakakis | backend. |
778 | a1c707c9 | Constantinos Venetsanopoulos | |
779 | edd28bbf | Christos Stavrakakis | So, after making sure everything works as expected, make the new backend active |
780 | edd28bbf | Christos Stavrakakis | by un-setting the ``drained`` flag. You can do this by running: |
781 | a1c707c9 | Constantinos Venetsanopoulos | |
782 | a1c707c9 | Constantinos Venetsanopoulos | .. code-block:: console |
783 | a1c707c9 | Constantinos Venetsanopoulos | |
784 | 46ccbcb9 | Christos Stavrakakis | $ snf-manage backend-modify --drained=False <backend_id> |
785 | 0768a1df | Christos Stavrakakis | |
786 | a1c707c9 | Constantinos Venetsanopoulos | Allocation of VMs in Ganeti backends |
787 | a1c707c9 | Constantinos Venetsanopoulos | ```````````````````````````````````` |
788 | a1c707c9 | Constantinos Venetsanopoulos | As already mentioned, the Cyclades backend allocator is responsible for |
789 | a1c707c9 | Constantinos Venetsanopoulos | allocating new VMs to backends. This allocator does not choose the exact Ganeti |
790 | a1c707c9 | Constantinos Venetsanopoulos | node that will host the VM but just the Ganeti backend. The exact node is |
791 | a1c707c9 | Constantinos Venetsanopoulos | chosen by the Ganeti cluster's allocator (hail). |
792 | 0768a1df | Christos Stavrakakis | |
793 | 0768a1df | Christos Stavrakakis | The decision about which backend will host a VM is based on the available |
794 | 0768a1df | Christos Stavrakakis | resources. The allocator computes a score for each backend, that shows its load |
795 | 0768a1df | Christos Stavrakakis | factor, and the one with the minimum score is chosen. The admin can exclude |
796 | a1c707c9 | Constantinos Venetsanopoulos | backends from the allocation phase by marking them as ``drained`` by running: |
797 | 90c74332 | Christos Stavrakakis | |
798 | 0768a1df | Christos Stavrakakis | .. code-block:: console |
799 | 0768a1df | Christos Stavrakakis | |
800 | 46ccbcb9 | Christos Stavrakakis | $ snf-manage backend-modify --drained=True <backend_id> |
801 | 0768a1df | Christos Stavrakakis | |
802 | 0768a1df | Christos Stavrakakis | The backend resources are periodically updated, at a period defined by |
803 | edd28bbf | Christos Stavrakakis | the ``BACKEND_REFRESH_MIN`` setting, or by running `snf-manage |
804 | edd28bbf | Christos Stavrakakis | backend-update-status` command. It is advised to have a cron job running this |
805 | edd28bbf | Christos Stavrakakis | command at a smaller interval than ``BACKEND_REFRESH_MIN`` in order to remove |
806 | edd28bbf | Christos Stavrakakis | the load of refreshing the backends stats from the VM creation phase. |
807 | 0768a1df | Christos Stavrakakis | |
808 | a1c707c9 | Constantinos Venetsanopoulos | Finally, the admin can decide to have a user's VMs being allocated to a |
809 | a1c707c9 | Constantinos Venetsanopoulos | specific backend, with the ``BACKEND_PER_USER`` setting. This is a mapping |
810 | a1c707c9 | Constantinos Venetsanopoulos | between users and backends. If the user is found in ``BACKEND_PER_USER``, then |
811 | 46ccbcb9 | Christos Stavrakakis | Synnefo allocates all his/hers VMs to the specific backend in the variable, |
812 | 46ccbcb9 | Christos Stavrakakis | even if is marked as drained (useful for testing). |
813 | 0768a1df | Christos Stavrakakis | |
814 | 09d07554 | Christos Stavrakakis | Allocation based on disk-templates |
815 | 09d07554 | Christos Stavrakakis | ********************************** |
816 | 09d07554 | Christos Stavrakakis | |
817 | 09d07554 | Christos Stavrakakis | Besides the available resources of each Ganeti backend, the allocator takes |
818 | 09d07554 | Christos Stavrakakis | into consideration the disk template of the instance when trying to allocate it |
819 | 09d07554 | Christos Stavrakakis | to a Ganeti backend. Specifically, the allocator checks if the flavor of the |
820 | 09d07554 | Christos Stavrakakis | instance belongs to the available disk templates of each Ganeti backend. |
821 | 09d07554 | Christos Stavrakakis | |
822 | 09d07554 | Christos Stavrakakis | A Ganeti cluster has a list of enabled disk templates |
823 | 09d07554 | Christos Stavrakakis | (`--enabled-disk-templates`) and a list of allowed disk templates for new |
824 | 09d07554 | Christos Stavrakakis | instances (`--ipolicy-disk-templates`). See the `gnt-cluster` manpage for more |
825 | 09d07554 | Christos Stavrakakis | details about these options. |
826 | 09d07554 | Christos Stavrakakis | |
827 | 09d07554 | Christos Stavrakakis | When Synnefo allocates an instance, it checks whether the disk template of the |
828 | 09d07554 | Christos Stavrakakis | new instance belongs both in the enabled and ipolicy disk templates. You can |
829 | 09d07554 | Christos Stavrakakis | see the list of the available disk-templates by running `snf-manage |
830 | 09d07554 | Christos Stavrakakis | backend-list`. This list should be updated automatically after changing |
831 | 09d07554 | Christos Stavrakakis | these options in Ganeti and it can also be updated by running `snf-manage |
832 | 09d07554 | Christos Stavrakakis | backend-update-status`. |
833 | 09d07554 | Christos Stavrakakis | |
834 | 09d07554 | Christos Stavrakakis | So the administrator, can route instances on different backends based on their |
835 | 09d07554 | Christos Stavrakakis | flavor disk template, by modifying the enabled or ipolicy disk templates of |
836 | 09d07554 | Christos Stavrakakis | each backend. Also, the administrator can route instances between different |
837 | 09d07554 | Christos Stavrakakis | nodes of the same Ganeti backend, by modifying the same options at the |
838 | 09d07554 | Christos Stavrakakis | nodegroup level (see `gnt-group` manpage for mor details). |
839 | 09d07554 | Christos Stavrakakis | |
840 | edd28bbf | Christos Stavrakakis | Removing an existing Ganeti backend |
841 | edd28bbf | Christos Stavrakakis | ``````````````````````````````````` |
842 | edd28bbf | Christos Stavrakakis | In order to remove an existing backend from Synnefo, you must first make |
843 | edd28bbf | Christos Stavrakakis | sure that there are not active servers in the backend, and then run: |
844 | edd28bbf | Christos Stavrakakis | |
845 | edd28bbf | Christos Stavrakakis | .. code-block:: console |
846 | edd28bbf | Christos Stavrakakis | |
847 | 0019cd7d | Christos Stavrakakis | $ snf-manage backend-remove <backend_id> |
848 | edd28bbf | Christos Stavrakakis | |
849 | edd28bbf | Christos Stavrakakis | |
850 | 6d8a47d0 | Christos Stavrakakis | Virtual Networks |
851 | 6d8a47d0 | Christos Stavrakakis | ~~~~~~~~~~~~~~~~ |
852 | 6d8a47d0 | Christos Stavrakakis | |
853 | 6d8a47d0 | Christos Stavrakakis | Cyclades also implements the Network service and exposes the Quantum Openstack |
854 | 6d8a47d0 | Christos Stavrakakis | API. Cyclades supports full IPv4 and IPv6 connectivity to the public internet |
855 | 6d8a47d0 | Christos Stavrakakis | for it's VMs. Also, Cyclades provides L2 and L3 virtual private networks, |
856 | 6d8a47d0 | Christos Stavrakakis | giving the user freedom to create arbitraty network topologies of |
857 | 6d8a47d0 | Christos Stavrakakis | interconnected VMs. |
858 | 6d8a47d0 | Christos Stavrakakis | |
859 | 6d8a47d0 | Christos Stavrakakis | Public networking is desployment specific and must be customized based on the |
860 | 6d8a47d0 | Christos Stavrakakis | specific needs of the system administrator. Private virtual networks can be |
861 | 6d8a47d0 | Christos Stavrakakis | provided by different network technologies which are exposed as different |
862 | 6d8a47d0 | Christos Stavrakakis | network flavors. For better understanding of networking please refer to the |
863 | 6d8a47d0 | Christos Stavrakakis | :ref:`Network <networks>` section. |
864 | 6d8a47d0 | Christos Stavrakakis | |
865 | 6d8a47d0 | Christos Stavrakakis | A Cyclades virtual network is an isolated Layer-2 broadcast domain. A network |
866 | 6d8a47d0 | Christos Stavrakakis | can also have an associated IPv4 and IPv6 subnet representing the Layer-3 |
867 | 6d8a47d0 | Christos Stavrakakis | characteristics of the network. Each subnet represents an IP address block |
868 | 6d8a47d0 | Christos Stavrakakis | that is used in order to assign addresses to VMs. |
869 | 6d8a47d0 | Christos Stavrakakis | |
870 | 6d8a47d0 | Christos Stavrakakis | To connect a VM to a network, a port must be created, which represent a virtual |
871 | 6d8a47d0 | Christos Stavrakakis | port on a network switch. VMs are connected to networks by attaching a virtual |
872 | 6d8a47d0 | Christos Stavrakakis | interface to a port. |
873 | 6d8a47d0 | Christos Stavrakakis | |
874 | 6d8a47d0 | Christos Stavrakakis | Cyclades also supports `floating IPs`, which are public IPv4 addresses that |
875 | 6d8a47d0 | Christos Stavrakakis | can dynamically(hotplug-able) be added and removed to VMs. Floating IPs are |
876 | 6d8a47d0 | Christos Stavrakakis | a quotable resource that is allocated to each user. Unlike other cloud |
877 | 6d8a47d0 | Christos Stavrakakis | platforms, floating IPs are not implemented using 1-1 NAT to a ports private |
878 | 6d8a47d0 | Christos Stavrakakis | IP. Instead, floating IPs are directly assigned to virtual interfaces of VMs. |
879 | 6d8a47d0 | Christos Stavrakakis | |
880 | 6d8a47d0 | Christos Stavrakakis | Exactly like VMS, networks can be handled as Ganeti networks via `gnt-network` |
881 | 6d8a47d0 | Christos Stavrakakis | commands. All Ganeti networks that belong to Synnefo are named with the prefix |
882 | 6d8a47d0 | Christos Stavrakakis | `${BACKEND_PREFIX_ID}-net-`. Also, there are a number of `snf-manage` commands |
883 | 6d8a47d0 | Christos Stavrakakis | for handling of `networks`, `subnets`, `ports` and `floating IPs`. Below |
884 | 6d8a47d0 | Christos Stavrakakis | we will present a use case scenario using some of these commands. For better |
885 | 6d8a47d0 | Christos Stavrakakis | understanding of these commands, refer to their help messages. |
886 | 6d8a47d0 | Christos Stavrakakis | |
887 | 6d8a47d0 | Christos Stavrakakis | Create a virtual private network for user |
888 | 6d8a47d0 | Christos Stavrakakis | `7cf4d078-67bf-424d-8ff2-8669eb4841ea` using the `PHYSICAL_VLAN` flavor, which |
889 | 6d8a47d0 | Christos Stavrakakis | means that the network will be uniquely assigned a phsyical VLAN. The network |
890 | 6d8a47d0 | Christos Stavrakakis | is assigned an IPv4 subnet, described by it's CIDR and gateway. Also, |
891 | 0019cd7d | Christos Stavrakakis | the `--dhcp=True` option is used, to make `nfdhcpd` response to DHCP queries |
892 | 6d8a47d0 | Christos Stavrakakis | from VMs. |
893 | 09d07554 | Christos Stavrakakis | |
894 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
895 | 9492387a | Christos Stavrakakis | |
896 | 0019cd7d | Christos Stavrakakis | $ snf-manage network-create --owner=7cf4d078-67bf-424d-8ff2-8669eb4841ea --name=prv_net-1 \ |
897 | 6d8a47d0 | Christos Stavrakakis | --subnet=192.168.2.0/24 --gateway=192.168.2.1 --dhcp=True --flavor=PHYSICAL_VLAN |
898 | 9492387a | Christos Stavrakakis | |
899 | 6d8a47d0 | Christos Stavrakakis | Inspect the state of the network in Cyclades DB and in all the Ganeti backends: |
900 | 9492387a | Christos Stavrakakis | |
901 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
902 | 9492387a | Christos Stavrakakis | |
903 | 0019cd7d | Christos Stavrakakis | $ snf-manage network-inspect <network_id> |
904 | 9492387a | Christos Stavrakakis | |
905 | 6d8a47d0 | Christos Stavrakakis | Inspect the state of the network's subnet, containg an overview of the |
906 | 6d8a47d0 | Christos Stavrakakis | subnet's IPv4 address allocation pool: |
907 | 6d8a47d0 | Christos Stavrakakis | |
908 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
909 | 6d8a47d0 | Christos Stavrakakis | |
910 | 0019cd7d | Christos Stavrakakis | $ snf-manage subnet-inspect <subnet_id> |
911 | 6d8a47d0 | Christos Stavrakakis | |
912 | 6d8a47d0 | Christos Stavrakakis | Connect a VM to the created private network. The port will be automatically |
913 | 6d8a47d0 | Christos Stavrakakis | be assigned an IPv4 address from one of the network's available IPs. This |
914 | 6d8a47d0 | Christos Stavrakakis | command will result in sending an `OP_INSTANCE_MODIFY` Ganeti command and |
915 | 6d8a47d0 | Christos Stavrakakis | attaching a NIC to the specified Ganeti instance. |
916 | 9492387a | Christos Stavrakakis | |
917 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
918 | 6d8a47d0 | Christos Stavrakakis | |
919 | 0019cd7d | Christos Stavrakakis | $ snf-manage port-create --network=<network_id> --server=<server_id> |
920 | a653c059 | Christos Stavrakakis | |
921 | 6d8a47d0 | Christos Stavrakakis | Inspect the state of the the port in Cyclades DB and in the Ganeti backend: |
922 | a653c059 | Christos Stavrakakis | |
923 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
924 | a653c059 | Christos Stavrakakis | |
925 | 0019cd7d | Christos Stavrakakis | $ snf-manage port-inspect <port_id> |
926 | 6d8a47d0 | Christos Stavrakakis | |
927 | 6d8a47d0 | Christos Stavrakakis | Disconnect the VM from the network and delete the network: |
928 | 6d8a47d0 | Christos Stavrakakis | |
929 | 6d8a47d0 | Christos Stavrakakis | .. code-block:: console |
930 | 6d8a47d0 | Christos Stavrakakis | |
931 | 0019cd7d | Christos Stavrakakis | $ snf-manage port-remove <port_id> |
932 | 0019cd7d | Christos Stavrakakis | $ snf-manage network-remove <network_id> |
933 | 0019cd7d | Christos Stavrakakis | |
934 | 0019cd7d | Christos Stavrakakis | |
935 | 0019cd7d | Christos Stavrakakis | Enabling DHCP |
936 | 0019cd7d | Christos Stavrakakis | ````````````` |
937 | 0019cd7d | Christos Stavrakakis | |
938 | 0019cd7d | Christos Stavrakakis | When connecting a VM to a network, Cyclades will automatically assign an IPv4 |
939 | 0019cd7d | Christos Stavrakakis | address from the IPv4 or/and IPv6 subnets of the network. If the network has |
940 | 0019cd7d | Christos Stavrakakis | no subnets, then it will not be assigned any IP address. |
941 | 0019cd7d | Christos Stavrakakis | |
942 | 0019cd7d | Christos Stavrakakis | If the network has DHCP enabled, then `nfdhcpd` daemon, which must be running |
943 | 0019cd7d | Christos Stavrakakis | on all Ganeti nodes, will respond to DHCP queries from VMs and assign to them |
944 | 0019cd7d | Christos Stavrakakis | the IP address that was allocated by Cyclades. DCHP can be enabled/disabled |
945 | 0019cd7d | Christos Stavrakakis | using the `--dhcp` option of `network-create` command. |
946 | 0019cd7d | Christos Stavrakakis | |
947 | 0019cd7d | Christos Stavrakakis | |
948 | 0019cd7d | Christos Stavrakakis | Public network connectivity |
949 | 0019cd7d | Christos Stavrakakis | ``````````````````````````` |
950 | 0019cd7d | Christos Stavrakakis | |
951 | 0019cd7d | Christos Stavrakakis | Since v0.14, users are able to dynamically connect and disconnect their VMs |
952 | 0019cd7d | Christos Stavrakakis | from public networks. In order to do that, they have to use a `floating IP`. |
953 | 0019cd7d | Christos Stavrakakis | Floating IPs are basically public IPv4 addresses that can be dynamically |
954 | 0019cd7d | Christos Stavrakakis | attached and detached from VMs. The user creates a floating IP address from a |
955 | 0019cd7d | Christos Stavrakakis | network that has set the `floating_ip_pool` attribute. The floating IP is |
956 | 0019cd7d | Christos Stavrakakis | accounted to the user, who can then connect his VMs to public networks by |
957 | 0019cd7d | Christos Stavrakakis | creating ports that they are using this floating IP. Performing this work-flow |
958 | 0019cd7d | Christos Stavrakakis | from `snf-manage` would look like this: |
959 | 0019cd7d | Christos Stavrakakis | |
960 | 0019cd7d | Christos Stavrakakis | .. code-block:: console |
961 | 0019cd7d | Christos Stavrakakis | |
962 | 0019cd7d | Christos Stavrakakis | $ snf-manage network-list --filter-by="floating_ip_pool=True" |
963 | 0019cd7d | Christos Stavrakakis | id name user.uuid state public subnet.ipv4 gateway.ipv4 drained floating_ip_pool |
964 | 0019cd7d | Christos Stavrakakis | --------------------------------------------------------------------------------------------- |
965 | 0019cd7d | Christos Stavrakakis | 1 Internet None ACTIVE True 10.2.1.0/24 10.2.1.1 False True |
966 | 0019cd7d | Christos Stavrakakis | |
967 | 0019cd7d | Christos Stavrakakis | $ snf-manage floating-ip-create --owner=7cf4d078-67bf-424d-8ff2-8669eb4841ea --network=1 |
968 | 0019cd7d | Christos Stavrakakis | |
969 | 0019cd7d | Christos Stavrakakis | $ snf-manage floating-ip-list --user=7cf4d078-67bf-424d-8ff2-8669eb4841ea |
970 | 0019cd7d | Christos Stavrakakis | id address network user.uuid server |
971 | 0019cd7d | Christos Stavrakakis | ------------------------------------------------------------------------ |
972 | 0019cd7d | Christos Stavrakakis | 38 10.2.1.2 1 7cf4d078-67bf-424d-8ff2-8669eb4841ea 42 |
973 | 0019cd7d | Christos Stavrakakis | |
974 | 0019cd7d | Christos Stavrakakis | $ snf-manage port-create --owner=7cf4d078-67bf-424d-8ff2-8669eb4841ea --network=1 \ |
975 | 0019cd7d | Christos Stavrakakis | --ipv4-address=10.2.1.2 --floating-ip=38 |
976 | 0019cd7d | Christos Stavrakakis | |
977 | 0019cd7d | Christos Stavrakakis | $ snf-manage port-list --user=7cf4d078-67bf-424d-8ff2-8669eb4841ea |
978 | 0019cd7d | Christos Stavrakakis | id user.uuid mac_address network server_id fixed_ips state |
979 | 0019cd7d | Christos Stavrakakis | -------------------------------------------------------------------------------------------------- |
980 | 0019cd7d | Christos Stavrakakis | 163 7cf4d078-67bf-424d-8ff2-8669eb4841ea aa:00:00:45:13:98 1 77 10.2.1.2 ACTIVE |
981 | 0019cd7d | Christos Stavrakakis | |
982 | 0019cd7d | Christos Stavrakakis | $ snf-manage port-remove 163 |
983 | 0019cd7d | Christos Stavrakakis | $ snf-manage floating-ip-remove 38 |
984 | 0019cd7d | Christos Stavrakakis | |
985 | 0019cd7d | Christos Stavrakakis | Users do not have permission to connect and disconnect VMs from public |
986 | 0019cd7d | Christos Stavrakakis | networks without using a floating IP address. However, the administrator |
987 | 0019cd7d | Christos Stavrakakis | have the ability to perform this tasks, using `port-create` and `port-remove` |
988 | 0019cd7d | Christos Stavrakakis | commands. |
989 | 0019cd7d | Christos Stavrakakis | |
990 | 0019cd7d | Christos Stavrakakis | Network connectivity for newly created servers |
991 | 0019cd7d | Christos Stavrakakis | `````````````````````````````````````````````` |
992 | 0019cd7d | Christos Stavrakakis | |
993 | 0019cd7d | Christos Stavrakakis | When creating a virtual server, the user can specify the networks that the |
994 | 0019cd7d | Christos Stavrakakis | newly created server will be connected to. Beyond this, the administrator can |
995 | 0019cd7d | Christos Stavrakakis | define a list of networks that every new server will be forced to connect to. |
996 | 0019cd7d | Christos Stavrakakis | For example, you can enforce all VMs to be connected to a public network |
997 | 0019cd7d | Christos Stavrakakis | containing a metadata server. The networks must be specified in the |
998 | 0019cd7d | Christos Stavrakakis | ``CYCLADES_FORCED_SERVER_NETWORKS`` that exists in the |
999 | 0019cd7d | Christos Stavrakakis | ``/etc/synnefo/20-snf-cyclades-app-api.conf``. For the networks in this |
1000 | 0019cd7d | Christos Stavrakakis | setting, no access control or quota policy are enforced! |
1001 | 0019cd7d | Christos Stavrakakis | |
1002 | 0019cd7d | Christos Stavrakakis | Finally, the administrator can define a list of networks that new servers will |
1003 | 0019cd7d | Christos Stavrakakis | be connected, *if the user has not* specified networks in the request to create |
1004 | 0019cd7d | Christos Stavrakakis | the server. Access control and quota policy are enforced, just as if the user |
1005 | 0019cd7d | Christos Stavrakakis | had specified these networks. The list of these networks is defined in the |
1006 | 0019cd7d | Christos Stavrakakis | ``CYCLADES_DEFAULT_SERVER_NETWORKS`` that exists in the |
1007 | 0019cd7d | Christos Stavrakakis | ``/etc/synnefo/20-snf-cyclades-app-api.conf``. This setting should only |
1008 | 0019cd7d | Christos Stavrakakis | be used if Cyclades are being accessed by external clients that are |
1009 | 0019cd7d | Christos Stavrakakis | unaware of the `Neutron API extensions` in the `Compute API`. |
1010 | 0019cd7d | Christos Stavrakakis | |
1011 | 0019cd7d | Christos Stavrakakis | Each member of the above mentioned settings can be: |
1012 | 0019cd7d | Christos Stavrakakis | |
1013 | 0019cd7d | Christos Stavrakakis | * a network UUID |
1014 | 0019cd7d | Christos Stavrakakis | * a tuple of network UUIDs: the server will be connected to only one of these |
1015 | 0019cd7d | Christos Stavrakakis | networks, e.g. one that has a free IPv4 address |
1016 | 0019cd7d | Christos Stavrakakis | * `SNF:ANY_PUBLIC_IPV4`: the server will be connected to any network with |
1017 | 0019cd7d | Christos Stavrakakis | an IPv4 subnet defined |
1018 | 0019cd7d | Christos Stavrakakis | * `SNF:ANY_PUBLIC_IPV6`: the server will be connected to any network with |
1019 | 0019cd7d | Christos Stavrakakis | only an IPv6 subnet defined. |
1020 | 0019cd7d | Christos Stavrakakis | * `SNF:ANY_PUBLIC`: the server will be connected to any public network. |
1021 | 0019cd7d | Christos Stavrakakis | |
1022 | 0019cd7d | Christos Stavrakakis | Public IP accounting |
1023 | 0019cd7d | Christos Stavrakakis | ```````````````````` |
1024 | 0019cd7d | Christos Stavrakakis | |
1025 | 0019cd7d | Christos Stavrakakis | There are many use cases, e.g. abuse ports, where you need to find which user |
1026 | 0019cd7d | Christos Stavrakakis | or which server had a public IP address. For this reason, Cyclades keeps track |
1027 | 0019cd7d | Christos Stavrakakis | usage of public IPv4/IPv6 addresses. Specifically, it keeps the date and time |
1028 | 0019cd7d | Christos Stavrakakis | that each public IP address was allocated and released from a virtual server. |
1029 | 0019cd7d | Christos Stavrakakis | This information can be found using `ip-list` command: |
1030 | 0019cd7d | Christos Stavrakakis | |
1031 | 0019cd7d | Christos Stavrakakis | .. code-block:: console |
1032 | 0019cd7d | Christos Stavrakakis | |
1033 | 0019cd7d | Christos Stavrakakis | $ snf-manage ip-list |
1034 | 0019cd7d | Christos Stavrakakis | |
1035 | 0019cd7d | Christos Stavrakakis | Show usage of a specific address: |
1036 | 0019cd7d | Christos Stavrakakis | $ snf-manage ip-list --address=192.168.2.1 |
1037 | 0019cd7d | Christos Stavrakakis | |
1038 | 0019cd7d | Christos Stavrakakis | Show public IPs of a specific server: |
1039 | 0019cd7d | Christos Stavrakakis | $ snf-manage ip-list --server=<server_id> |
1040 | 0019cd7d | Christos Stavrakakis | |
1041 | a653c059 | Christos Stavrakakis | |
1042 | 9c98c6fc | Christos Stavrakakis | Managing Network Resources |
1043 | a1c707c9 | Constantinos Venetsanopoulos | `````````````````````````` |
1044 | 9c98c6fc | Christos Stavrakakis | |
1045 | a1c707c9 | Constantinos Venetsanopoulos | Proper operation of the Cyclades Network Service depends on the unique |
1046 | a1c707c9 | Constantinos Venetsanopoulos | assignment of specific resources to each type of virtual network. Specifically, |
1047 | a1c707c9 | Constantinos Venetsanopoulos | these resources are: |
1048 | 9c98c6fc | Christos Stavrakakis | |
1049 | a1c707c9 | Constantinos Venetsanopoulos | * IP addresses. Cyclades creates a Pool of IPs for each Network, and assigns a |
1050 | a1c707c9 | Constantinos Venetsanopoulos | unique IP address to each VM, thus connecting it to this Network. You can see |
1051 | 6d8a47d0 | Christos Stavrakakis | the IP pool of each network by running `snf-manage subnet-inspect |
1052 | 6d8a47d0 | Christos Stavrakakis | <subnet_ID>`. IP pools are automatically created and managed by Cyclades, |
1053 | a1c707c9 | Constantinos Venetsanopoulos | depending on the subnet of the Network. |
1054 | 9492387a | Christos Stavrakakis | * Bridges corresponding to physical VLANs, which are required for networks of |
1055 | a1c707c9 | Constantinos Venetsanopoulos | type `PRIVATE_PHYSICAL_VLAN`. |
1056 | a1c707c9 | Constantinos Venetsanopoulos | * One Bridge corresponding to one physical VLAN which is required for networks of |
1057 | a1c707c9 | Constantinos Venetsanopoulos | type `PRIVATE_MAC_PREFIX`. |
1058 | 9c98c6fc | Christos Stavrakakis | |
1059 | 4573511a | Christos Stavrakakis | IPv4 addresses |
1060 | 4573511a | Christos Stavrakakis | ************** |
1061 | 4573511a | Christos Stavrakakis | |
1062 | 4573511a | Christos Stavrakakis | An allocation pool of IPv4 addresses is automatically created for every network |
1063 | 9a1b6564 | Christos Stavrakakis | with an IPv4 subnet. By default, the allocation pool contains the range of IP |
1064 | 9a1b6564 | Christos Stavrakakis | addresses that are included in the subnet, except from the gateway and the |
1065 | 9a1b6564 | Christos Stavrakakis | broadcast address of the network. The range of IP addresses can be restricted |
1066 | 9a1b6564 | Christos Stavrakakis | using the `--allocation-pool` option of `snf-manage network-create` command. |
1067 | 9a1b6564 | Christos Stavrakakis | The admin can externally reserve IP addresses to exclude them from automatic |
1068 | 4573511a | Christos Stavrakakis | allocation with the `--add-reserved-ips` option of `snf-manage network-modify` |
1069 | 9a1b6564 | Christos Stavrakakis | command. For example the following command will reserve two IP addresses from |
1070 | 9a1b6564 | Christos Stavrakakis | network with ID `42`: |
1071 | 9c98c6fc | Christos Stavrakakis | |
1072 | 4573511a | Christos Stavrakakis | .. code-block:: console |
1073 | 4573511a | Christos Stavrakakis | |
1074 | 4573511a | Christos Stavrakakis | snf-manage network-modify --add-reserved-ips=10.0.0.21,10.0.0.22 42 |
1075 | 4573511a | Christos Stavrakakis | |
1076 | 4573511a | Christos Stavrakakis | .. warning:: Externally reserving IP addresses is also available at the Ganeti. |
1077 | 4573511a | Christos Stavrakakis | However, when using Cyclades with multiple Ganeti backends, the handling of |
1078 | 4573511a | Christos Stavrakakis | IP pools must be performed from Cyclades! |
1079 | 4573511a | Christos Stavrakakis | |
1080 | 4573511a | Christos Stavrakakis | Bridges |
1081 | 4573511a | Christos Stavrakakis | ******* |
1082 | 4573511a | Christos Stavrakakis | |
1083 | 4573511a | Christos Stavrakakis | As already mentioned Cyclades use a pool of Bridges that must correspond |
1084 | 4573511a | Christos Stavrakakis | to Physical VLAN at the Ganeti level. A bridge from the pool is assigned to |
1085 | 4573511a | Christos Stavrakakis | each network of flavor `PHYSICAL_VLAN`. Creation of this pool is done |
1086 | 4573511a | Christos Stavrakakis | using `snf-manage pool-create` command. For example the following command |
1087 | 4573511a | Christos Stavrakakis | will create a pool containing the brdiges from `prv1` to `prv21`. |
1088 | 90c74332 | Christos Stavrakakis | |
1089 | 9c98c6fc | Christos Stavrakakis | .. code-block:: console |
1090 | 9c98c6fc | Christos Stavrakakis | |
1091 | 9c98c6fc | Christos Stavrakakis | # snf-manage pool-create --type=bridge --base=prv --size=20 |
1092 | 9c98c6fc | Christos Stavrakakis | |
1093 | 9c98c6fc | Christos Stavrakakis | You can verify the creation of the pool, and check its contents by running: |
1094 | 90c74332 | Christos Stavrakakis | |
1095 | 9c98c6fc | Christos Stavrakakis | .. code-block:: console |
1096 | 9c98c6fc | Christos Stavrakakis | |
1097 | 9c98c6fc | Christos Stavrakakis | # snf-manage pool-list |
1098 | 9c98c6fc | Christos Stavrakakis | # snf-manage pool-show --type=bridge 1 |
1099 | 9c98c6fc | Christos Stavrakakis | |
1100 | 4573511a | Christos Stavrakakis | Finally you can use the `pool-modify` management command in order to externally |
1101 | 4573511a | Christos Stavrakakis | reserve the values from pool, extend or shrink the pool if possible. |
1102 | 4573511a | Christos Stavrakakis | |
1103 | 4573511a | Christos Stavrakakis | MAC Prefixes |
1104 | 4573511a | Christos Stavrakakis | ************ |
1105 | 4573511a | Christos Stavrakakis | |
1106 | 4573511a | Christos Stavrakakis | Cyclades also use a pool of MAC prefixes to assign to networks of flavor |
1107 | 4573511a | Christos Stavrakakis | `MAC_FILTERED`. Handling of this pool is done exactly as with pool of bridges, |
1108 | 4573511a | Christos Stavrakakis | except that the type option must be set to mac-prefix: |
1109 | 90c74332 | Christos Stavrakakis | |
1110 | 9c98c6fc | Christos Stavrakakis | .. code-block:: console |
1111 | 9c98c6fc | Christos Stavrakakis | |
1112 | 9c98c6fc | Christos Stavrakakis | # snf-manage pool-create --type=mac-prefix --base=aa:00:0 --size=65536 |
1113 | 9c98c6fc | Christos Stavrakakis | |
1114 | 4573511a | Christos Stavrakakis | The above command will create a pool of MAC prefixes from ``aa:00:1`` to |
1115 | 4573511a | Christos Stavrakakis | ``b9:ff:f``. The MAC prefix pool is responsible for providing only unicast and |
1116 | 4573511a | Christos Stavrakakis | locally administered MAC addresses, so many of these prefixes will be |
1117 | 4573511a | Christos Stavrakakis | externally reserved, to exclude from allocation. |
1118 | 4573511a | Christos Stavrakakis | |
1119 | 0a3027c3 | Christos Stavrakakis | Quotas |
1120 | 0a3027c3 | Christos Stavrakakis | ~~~~~~ |
1121 | 0a3027c3 | Christos Stavrakakis | |
1122 | 0a3027c3 | Christos Stavrakakis | Handling of quotas for Cyclades resources is powered by Astakos quota |
1123 | 0a3027c3 | Christos Stavrakakis | mechanism. During registration of Cyclades service to Astakos, the Cyclades |
1124 | 0a3027c3 | Christos Stavrakakis | resources are also imported to Astakos for accounting and presentation. |
1125 | 0a3027c3 | Christos Stavrakakis | |
1126 | 0a3027c3 | Christos Stavrakakis | Upon a request that will result in a resource creation or removal, Cyclades |
1127 | 0a3027c3 | Christos Stavrakakis | will communicate with Astakos to ensure that user quotas are within limits and |
1128 | 0a3027c3 | Christos Stavrakakis | update the corresponding usage. If a limit is reached, the request will be |
1129 | 0a3027c3 | Christos Stavrakakis | denied with an `overLimit(413)` fault. |
1130 | 4573511a | Christos Stavrakakis | |
1131 | 0a3027c3 | Christos Stavrakakis | The resources that are exported by Cyclades are the following: |
1132 | 0768a1df | Christos Stavrakakis | |
1133 | 0a3027c3 | Christos Stavrakakis | * `cyclades.vm`: Number of virtual machines |
1134 | 0a3027c3 | Christos Stavrakakis | * `cyclades.total_cpu`: Number of virtual machine processors |
1135 | 0a3027c3 | Christos Stavrakakis | * `cyclades.cpu`: Number of virtual machine processors of running VMs |
1136 | 0a3027c3 | Christos Stavrakakis | * `cyclades.total_ram`: Virtual machine memory size |
1137 | 0a3027c3 | Christos Stavrakakis | * `cyclades.ram`: Virtual machine memory size of running VMs |
1138 | 0a3027c3 | Christos Stavrakakis | * `cyclades.disk`: Virtual machine disk size |
1139 | 0a3027c3 | Christos Stavrakakis | * `cyclades.floating_ip`: Number of floating IP addresses |
1140 | 0a3027c3 | Christos Stavrakakis | * `cyclades.network.private`: Number of private virtual networks |
1141 | 426d4ae3 | Constantinos Venetsanopoulos | |
1142 | eab73849 | Constantinos Venetsanopoulos | Cyclades advanced operations |
1143 | eab73849 | Constantinos Venetsanopoulos | ---------------------------- |
1144 | eab73849 | Constantinos Venetsanopoulos | |
1145 | 0a3027c3 | Christos Stavrakakis | Reconciliation mechanism |
1146 | 0a3027c3 | Christos Stavrakakis | ~~~~~~~~~~~~~~~~~~~~~~~~ |
1147 | 0a3027c3 | Christos Stavrakakis | |
1148 | 0a3027c3 | Christos Stavrakakis | Cyclades - Ganeti reconciliation |
1149 | 0a3027c3 | Christos Stavrakakis | ```````````````````````````````` |
1150 | 0a3027c3 | Christos Stavrakakis | |
1151 | 0a3027c3 | Christos Stavrakakis | On certain occasions, such as a Ganeti or RabbitMQ failure, the state of |
1152 | 0a3027c3 | Christos Stavrakakis | Cyclades database may differ from the real state of VMs and networks in the |
1153 | 0a3027c3 | Christos Stavrakakis | Ganeti backends. The reconciliation process is designed to synchronize the |
1154 | 0a3027c3 | Christos Stavrakakis | state of the Cyclades DB with Ganeti. There are two management commands for |
1155 | 0a3027c3 | Christos Stavrakakis | reconciling VMs and Networks that will detect stale, orphans and out-of-sync |
1156 | 0a3027c3 | Christos Stavrakakis | VMs and networks. To fix detected inconsistencies, use the `--fix-all`. |
1157 | 0a3027c3 | Christos Stavrakakis | |
1158 | 0a3027c3 | Christos Stavrakakis | .. code-block:: console |
1159 | 0a3027c3 | Christos Stavrakakis | |
1160 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-servers |
1161 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-servers --fix-all |
1162 | 0a3027c3 | Christos Stavrakakis | |
1163 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-networks |
1164 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-networks --fix-all |
1165 | 0a3027c3 | Christos Stavrakakis | |
1166 | 0a3027c3 | Christos Stavrakakis | Please see ``snf-manage reconcile-servers --help`` and ``snf-manage |
1167 | 0a3027c3 | Christos Stavrakakis | reconcile--networks --help`` for all the details. |
1168 | 0a3027c3 | Christos Stavrakakis | |
1169 | 0a3027c3 | Christos Stavrakakis | |
1170 | 0a3027c3 | Christos Stavrakakis | Cyclades - Astakos reconciliation |
1171 | 0a3027c3 | Christos Stavrakakis | ````````````````````````````````` |
1172 | 0a3027c3 | Christos Stavrakakis | |
1173 | 0a3027c3 | Christos Stavrakakis | As already mentioned, Cyclades communicates with Astakos for resource |
1174 | 0a3027c3 | Christos Stavrakakis | accounting and quota enforcement. In rare cases, e.g. unexpected |
1175 | 0a3027c3 | Christos Stavrakakis | failures, the two services may get unsynchronized. For this reason there |
1176 | 0a3027c3 | Christos Stavrakakis | are the `reconcile-commissions-cyclades` and `reconcile-resources-cyclades` |
1177 | 0a3027c3 | Christos Stavrakakis | command that will synchronize the state of the two services. The first |
1178 | 0a3027c3 | Christos Stavrakakis | command will detect any pending commissions, while the second command will |
1179 | 0a3027c3 | Christos Stavrakakis | detect that the usage that is reported by Astakos is correct. |
1180 | 0a3027c3 | Christos Stavrakakis | To fix detected inconsistencies, use the `--fix` option. |
1181 | 0a3027c3 | Christos Stavrakakis | |
1182 | 0a3027c3 | Christos Stavrakakis | .. code-block:: console |
1183 | 0a3027c3 | Christos Stavrakakis | |
1184 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-commissions-cyclades |
1185 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-commissions-cyclades --fix |
1186 | 0a3027c3 | Christos Stavrakakis | |
1187 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-resources-cyclades |
1188 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-resources-cyclades --fix |
1189 | 0a3027c3 | Christos Stavrakakis | |
1190 | 0a3027c3 | Christos Stavrakakis | |
1191 | 0a3027c3 | Christos Stavrakakis | Cyclades resources reconciliation |
1192 | 0a3027c3 | Christos Stavrakakis | ````````````````````````````````` |
1193 | 0a3027c3 | Christos Stavrakakis | |
1194 | 0a3027c3 | Christos Stavrakakis | Reconciliation of pools will check the consistency of available pools by |
1195 | 0a3027c3 | Christos Stavrakakis | checking that the values from each pool are not used more than once, and also |
1196 | 0a3027c3 | Christos Stavrakakis | that the only reserved values in a pool are the ones used. Pool reconciliation |
1197 | 0a3027c3 | Christos Stavrakakis | will check pools of bridges, MAC prefixes, and IPv4 addresses for all networks. |
1198 | 0a3027c3 | Christos Stavrakakis | To fix detected inconsistencies, use the `--fix` option. |
1199 | 0a3027c3 | Christos Stavrakakis | |
1200 | 0a3027c3 | Christos Stavrakakis | |
1201 | 0a3027c3 | Christos Stavrakakis | .. code-block:: console |
1202 | 0a3027c3 | Christos Stavrakakis | |
1203 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-pools |
1204 | 0a3027c3 | Christos Stavrakakis | $ snf-manage reconcile-pools --fix |
1205 | 0a3027c3 | Christos Stavrakakis | |
1206 | 62c0a9e1 | Stratos Psomadakis | .. _admin-guide-stats: |
1207 | 62c0a9e1 | Stratos Psomadakis | |
1208 | 62c0a9e1 | Stratos Psomadakis | VM stats collecting |
1209 | 62c0a9e1 | Stratos Psomadakis | ~~~~~~~~~~~~~~~~~~~ |
1210 | 62c0a9e1 | Stratos Psomadakis | |
1211 | 62c0a9e1 | Stratos Psomadakis | snf-cyclades-gtools comes with a collectd plugin to collect CPU and network |
1212 | 62c0a9e1 | Stratos Psomadakis | stats for Ganeti VMs and an example collectd configuration. snf-stats-app is a |
1213 | 62c0a9e1 | Stratos Psomadakis | Django (snf-webproject) app that serves the VM stats graphs by reading the VM |
1214 | 62c0a9e1 | Stratos Psomadakis | stats (from RRD files) and serves graphs. |
1215 | 62c0a9e1 | Stratos Psomadakis | |
1216 | 62c0a9e1 | Stratos Psomadakis | The snf-stats-app was originally written by `GRNET NOC <http://noc.grnet.gr>`_ |
1217 | 62c0a9e1 | Stratos Psomadakis | as a WSGI Python app and was ported to a Synnefo (snf-webproject) app. |
1218 | 62c0a9e1 | Stratos Psomadakis | |
1219 | 62c0a9e1 | Stratos Psomadakis | snf-stats-app configuration |
1220 | 62c0a9e1 | Stratos Psomadakis | ``````````````````````````` |
1221 | 62c0a9e1 | Stratos Psomadakis | |
1222 | 62c0a9e1 | Stratos Psomadakis | The snf-stats-app node should have collectd installed. The collectd |
1223 | 62c0a9e1 | Stratos Psomadakis | configuration should enable the network plugin, assuming the server role, and |
1224 | 62c0a9e1 | Stratos Psomadakis | the RRD plugin / backend, to store the incoming stats. Your |
1225 | 62c0a9e1 | Stratos Psomadakis | ``/etc/collectd/collectd.conf`` should look like: |
1226 | 62c0a9e1 | Stratos Psomadakis | |
1227 | 62c0a9e1 | Stratos Psomadakis | .. code-block:: console |
1228 | 62c0a9e1 | Stratos Psomadakis | |
1229 | 62c0a9e1 | Stratos Psomadakis | FQDNLookup true |
1230 | 62c0a9e1 | Stratos Psomadakis | LoadPlugin syslog |
1231 | 62c0a9e1 | Stratos Psomadakis | <Plugin syslog> |
1232 | 62c0a9e1 | Stratos Psomadakis | LogLevel info |
1233 | 62c0a9e1 | Stratos Psomadakis | </Plugin> |
1234 | 62c0a9e1 | Stratos Psomadakis | |
1235 | 62c0a9e1 | Stratos Psomadakis | LoadPlugin network |
1236 | 62c0a9e1 | Stratos Psomadakis | LoadPlugin rrdtool |
1237 | 62c0a9e1 | Stratos Psomadakis | <Plugin network> |
1238 | 62c0a9e1 | Stratos Psomadakis | TimeToLive 128 |
1239 | 62c0a9e1 | Stratos Psomadakis | <Listen "okeanos.io" "25826"> |
1240 | 62c0a9e1 | Stratos Psomadakis | SecurityLevel "Sign" |
1241 | 62c0a9e1 | Stratos Psomadakis | AuthFile "/etc/collectd/passwd" |
1242 | 62c0a9e1 | Stratos Psomadakis | </Listen> |
1243 | 62c0a9e1 | Stratos Psomadakis | |
1244 | 62c0a9e1 | Stratos Psomadakis | ReportStats false |
1245 | 62c0a9e1 | Stratos Psomadakis | MaxPacketSize 65535 |
1246 | 62c0a9e1 | Stratos Psomadakis | </Plugin> |
1247 | 62c0a9e1 | Stratos Psomadakis | |
1248 | 62c0a9e1 | Stratos Psomadakis | |
1249 | 62c0a9e1 | Stratos Psomadakis | <Plugin rrdtool> |
1250 | 62c0a9e1 | Stratos Psomadakis | DataDir "/var/lib/collectd/rrd" |
1251 | 62c0a9e1 | Stratos Psomadakis | CacheTimeout 120 |
1252 | 62c0a9e1 | Stratos Psomadakis | CacheFlush 900 |
1253 | 62c0a9e1 | Stratos Psomadakis | WritesPerSecond 30 |
1254 | 62c0a9e1 | Stratos Psomadakis | RandomTimeout 0 |
1255 | 62c0a9e1 | Stratos Psomadakis | </Plugin> |
1256 | 62c0a9e1 | Stratos Psomadakis | |
1257 | 62c0a9e1 | Stratos Psomadakis | Include "/etc/collectd/filters.conf" |
1258 | 62c0a9e1 | Stratos Psomadakis | Include "/etc/collectd/thresholds.conf" |
1259 | 62c0a9e1 | Stratos Psomadakis | |
1260 | 62c0a9e1 | Stratos Psomadakis | |
1261 | 62c0a9e1 | Stratos Psomadakis | An example collectd config file is provided in |
1262 | 62c0a9e1 | Stratos Psomadakis | ``/usr/share/doc/snf-stats-app/examples/stats-colletcd.conf``. |
1263 | 62c0a9e1 | Stratos Psomadakis | |
1264 | 62c0a9e1 | Stratos Psomadakis | The recommended deployment is to run snf-stats-app using gunicorn with an |
1265 | 62c0a9e1 | Stratos Psomadakis | Apache2 or nginx reverse proxy (using the same configuration as the other |
1266 | 62c0a9e1 | Stratos Psomadakis | Synnefo services / apps). An example gunicorn config file is provided in |
1267 | 62c0a9e1 | Stratos Psomadakis | ``/usr/share/doc/snf-stats-app/examples/stats.gunicorn``. |
1268 | 62c0a9e1 | Stratos Psomadakis | |
1269 | 62c0a9e1 | Stratos Psomadakis | Make sure to edit the settings under |
1270 | 62c0a9e1 | Stratos Psomadakis | ``/etc/synnefo/20-snf-stats-app-settings.conf`` to match your deployment. |
1271 | 62c0a9e1 | Stratos Psomadakis | More specifically, you should change the ``STATS_BASE_URL`` setting (refer |
1272 | 62c0a9e1 | Stratos Psomadakis | to previous documentation on the BASE_URL settings used by the other Synnefo |
1273 | 62c0a9e1 | Stratos Psomadakis | services / apps) and the ``RRD_PREFIX`` and ``GRAPH_PREFIX`` settings. |
1274 | 62c0a9e1 | Stratos Psomadakis | |
1275 | 62c0a9e1 | Stratos Psomadakis | You should also set the ``STATS_SECRET_KEY`` to a random string and make sure |
1276 | 62c0a9e1 | Stratos Psomadakis | it's the same at the ``CYCLADES_STATS_SECRET_KEY`` on the Cyclades host (see |
1277 | 62c0a9e1 | Stratos Psomadakis | below). |
1278 | 62c0a9e1 | Stratos Psomadakis | |
1279 | 62c0a9e1 | Stratos Psomadakis | ``RRD_PREFIX`` is the directory where collectd stores the RRD files. The |
1280 | 62c0a9e1 | Stratos Psomadakis | default setting matches the default RRD directory for the collectd RRDtool |
1281 | 62c0a9e1 | Stratos Psomadakis | plugin. In a more complex setup, the collectd daemon could run on a separate |
1282 | 62c0a9e1 | Stratos Psomadakis | host and export the RRD directory to the snf-stats-app node via e.g. NFS. |
1283 | 62c0a9e1 | Stratos Psomadakis | |
1284 | 62c0a9e1 | Stratos Psomadakis | ``GRAPH_PREFIX`` is the directory where collectd stores the resulting |
1285 | 62c0a9e1 | Stratos Psomadakis | stats graphs. You should create it manually, in case it doesn't exist. |
1286 | 62c0a9e1 | Stratos Psomadakis | |
1287 | 62c0a9e1 | Stratos Psomadakis | .. code-block:: |
1288 | 62c0a9e1 | Stratos Psomadakis | |
1289 | 62c0a9e1 | Stratos Psomadakis | # mkdir /var/cache/snf-stats-app/ |
1290 | 62c0a9e1 | Stratos Psomadakis | # chown www-data:wwwdata /var/cache/snf-stats-app/ |
1291 | 62c0a9e1 | Stratos Psomadakis | |
1292 | 62c0a9e1 | Stratos Psomadakis | The snf-stats-app will typically run as the ``www-data`` user. In that case, |
1293 | 62c0a9e1 | Stratos Psomadakis | make sure that the ``www-data`` user should have read access to the |
1294 | 62c0a9e1 | Stratos Psomadakis | ``RRD_PREFIX`` directory and read / write access to the ``GRAPH_PREFIX`` |
1295 | 62c0a9e1 | Stratos Psomadakis | directory. |
1296 | 62c0a9e1 | Stratos Psomadakis | |
1297 | 62c0a9e1 | Stratos Psomadakis | snf-stats-app, based on the ``STATS_BASE_URL`` setting will export the |
1298 | 62c0a9e1 | Stratos Psomadakis | following URL 'endpoints`: |
1299 | 62c0a9e1 | Stratos Psomadakis | * CPU stats bar: ``STATS_BASE_URL``/v1.0/cpu-bar/<encrypted VM hostname> |
1300 | 62c0a9e1 | Stratos Psomadakis | * Network stats bar: ``STATS_BASE_URL``/v1.0/net-bar/<encrypted VM hostname> |
1301 | 62c0a9e1 | Stratos Psomadakis | * CPU stats daily graph: ``STATS_BASE_URL``/v1.0/cpu-ts/<encrypted VM hostname> |
1302 | 62c0a9e1 | Stratos Psomadakis | * Network stats daily graph: ``STATS_BASE_URL``/v1.0/net-ts/<encrypted VM hostname> |
1303 | 62c0a9e1 | Stratos Psomadakis | * CPU stats weekly graph: ``STATS_BASE_URL``/v1.0/cpu-ts-w/<encrypted VM hostname> |
1304 | 62c0a9e1 | Stratos Psomadakis | * Network stats weekly graph: ``STATS_BASE_URL``/v1.0/net-ts-w/<encrypted VM hostname> |
1305 | 62c0a9e1 | Stratos Psomadakis | |
1306 | 62c0a9e1 | Stratos Psomadakis | You can verify that these endpoints are exported by issuing: |
1307 | 62c0a9e1 | Stratos Psomadakis | |
1308 | 62c0a9e1 | Stratos Psomadakis | .. code-block:: |
1309 | 62c0a9e1 | Stratos Psomadakis | |
1310 | 62c0a9e1 | Stratos Psomadakis | # snf-manage show_urls |
1311 | 62c0a9e1 | Stratos Psomadakis | |
1312 | 62c0a9e1 | Stratos Psomadakis | snf-cyclades-gtools configuration |
1313 | 62c0a9e1 | Stratos Psomadakis | ````````````````````````````````` |
1314 | 62c0a9e1 | Stratos Psomadakis | |
1315 | 62c0a9e1 | Stratos Psomadakis | To enable VM stats collecting, you will need to: |
1316 | 62c0a9e1 | Stratos Psomadakis | * Install collectd on the every Ganeti (VM-capable) node. |
1317 | 62c0a9e1 | Stratos Psomadakis | * Enable the Ganeti stats plugin in your collectd configuration. This can be |
1318 | 62c0a9e1 | Stratos Psomadakis | achived by either copying the example collectd conf file that comes with |
1319 | 62c0a9e1 | Stratos Psomadakis | snf-cyclades-gtools |
1320 | 62c0a9e1 | Stratos Psomadakis | (``/usr/share/doc/snf-cyclades-gtools/examples/ganeti-stats-collectd.conf``) |
1321 | 62c0a9e1 | Stratos Psomadakis | or by adding the following line to your existing (or default) collectd |
1322 | 62c0a9e1 | Stratos Psomadakis | conf file: |
1323 | 62c0a9e1 | Stratos Psomadakis | |
1324 | 62c0a9e1 | Stratos Psomadakis | Include /etc/collectd/ganeti-stats.conf |
1325 | 0019cd7d | Christos Stavrakakis | |
1326 | 62c0a9e1 | Stratos Psomadakis | In the latter case, make sure to configure collectd to send the collected |
1327 | 62c0a9e1 | Stratos Psomadakis | stats to your collectd server (via the network plugin). For more details on |
1328 | 62c0a9e1 | Stratos Psomadakis | how to do this, check the collectd example config file provided by the |
1329 | 0019cd7d | Christos Stavrakakis | package and the collectd documentation. |
1330 | 62c0a9e1 | Stratos Psomadakis | |
1331 | 62c0a9e1 | Stratos Psomadakis | snf-cyclades-app configuration |
1332 | 62c0a9e1 | Stratos Psomadakis | `````````````````````````````` |
1333 | 62c0a9e1 | Stratos Psomadakis | |
1334 | 62c0a9e1 | Stratos Psomadakis | At this point, stats collecting should be enabled and working. You can check |
1335 | 62c0a9e1 | Stratos Psomadakis | that everything is ok by checking the contents of ``/var/lib/collectd/rrd/`` |
1336 | 62c0a9e1 | Stratos Psomadakis | directory (it will gradually get populated with directories containing RRD |
1337 | 62c0a9e1 | Stratos Psomadakis | files / stats for every Synnefo instances). |
1338 | 62c0a9e1 | Stratos Psomadakis | |
1339 | 62c0a9e1 | Stratos Psomadakis | You should also check that gunicorn and Apache2 are configured correctly by |
1340 | 62c0a9e1 | Stratos Psomadakis | accessing the graph URLs for a VM (whose stats have been populated in |
1341 | 62c0a9e1 | Stratos Psomadakis | ``/var/lib/collectd/rrd``). |
1342 | 62c0a9e1 | Stratos Psomadakis | |
1343 | 62c0a9e1 | Stratos Psomadakis | Cyclades uses the ``CYCLADES_STATS_SECRET_KEY`` setting in |
1344 | 62c0a9e1 | Stratos Psomadakis | ``20-snf-cyclades-app`` to encrypt the instance hostname in the stats graph |
1345 | 62c0a9e1 | Stratos Psomadakis | URL. This settings should be set to a random value and match the |
1346 | 62c0a9e1 | Stratos Psomadakis | ``STATS_SECRET_KEY`` on the Stats host. |
1347 | 62c0a9e1 | Stratos Psomadakis | |
1348 | 62c0a9e1 | Stratos Psomadakis | Cyclades (snf-cyclades-app) fetches the stat graphs for VMs based on four |
1349 | 62c0a9e1 | Stratos Psomadakis | settings in ``20-snf-cyclades-app-api.conf``. The settings are: |
1350 | 62c0a9e1 | Stratos Psomadakis | |
1351 | 62c0a9e1 | Stratos Psomadakis | * CPU_BAR_GRAPH_URL = 'https://stats.host/stats/v1.0/cpu-bar/%s' |
1352 | 62c0a9e1 | Stratos Psomadakis | * CPU_TIMESERIES_GRAPH_URL = 'https://stats.host/stats/v1.0/cpu-ts/%s' |
1353 | 62c0a9e1 | Stratos Psomadakis | * NET_BAR_GRAPH_URL = 'https://stats.host/stats/v1.0/net-bar/%s' |
1354 | 62c0a9e1 | Stratos Psomadakis | * NET_TIMESERIES_GRAPH_URL = 'https://stats.host/stats/v1.0/net-ts/%s' |
1355 | 62c0a9e1 | Stratos Psomadakis | |
1356 | 62c0a9e1 | Stratos Psomadakis | Make sure that you change this settings to match your ``STATS_BASE_URL`` |
1357 | 62c0a9e1 | Stratos Psomadakis | (and generally the Apache2 / gunicorn deployment on your stats host). |
1358 | 62c0a9e1 | Stratos Psomadakis | |
1359 | 62c0a9e1 | Stratos Psomadakis | Cyclades will pass these URLs to the Cyclades UI and the user's browser will |
1360 | 62c0a9e1 | Stratos Psomadakis | fetch them when needed. |
1361 | 62c0a9e1 | Stratos Psomadakis | |
1362 | eab73849 | Constantinos Venetsanopoulos | |
1363 | 2467655e | Christos Stavrakakis | Helpdesk |
1364 | 2467655e | Christos Stavrakakis | -------- |
1365 | 2467655e | Christos Stavrakakis | |
1366 | 2467655e | Christos Stavrakakis | Helpdesk application provides the ability to view the virtual servers and |
1367 | 2467655e | Christos Stavrakakis | networks of all users, along with the ability to perform some basic actions |
1368 | 2467655e | Christos Stavrakakis | like administratively suspending a server. You can perform look-ups by |
1369 | 2467655e | Christos Stavrakakis | user UUID or email, by server ID (vm-$id) or by an IPv4 address. |
1370 | 2467655e | Christos Stavrakakis | |
1371 | 2467655e | Christos Stavrakakis | If you want to activate the helpdesk application you can set to `True` the |
1372 | 2467655e | Christos Stavrakakis | `HELPDESK_ENABLED` setting. Access to helpdesk views (under |
1373 | 2467655e | Christos Stavrakakis | `$BASE_URL/helpdesk`) is only to allowed to users that belong to Astakos |
1374 | 2467655e | Christos Stavrakakis | groups defined in the `HELPDESK_PERMITTED_GROUPS` setting, which by default |
1375 | 2467655e | Christos Stavrakakis | contains the `helpdesk` group. For example, to allow <user_id> |
1376 | 2467655e | Christos Stavrakakis | to access helpdesk view, you should run the following command in the Astakos |
1377 | 2467655e | Christos Stavrakakis | node: |
1378 | 2467655e | Christos Stavrakakis | |
1379 | 2467655e | Christos Stavrakakis | .. code-block:: console |
1380 | 2467655e | Christos Stavrakakis | |
1381 | 2467655e | Christos Stavrakakis | snf-manage group-add helpdesk |
1382 | 2467655e | Christos Stavrakakis | snf-manage user-modify --add-group=helpdesk <user_id> |
1383 | 2467655e | Christos Stavrakakis | |
1384 | 2467655e | Christos Stavrakakis | |
1385 | 426d4ae3 | Constantinos Venetsanopoulos | Cyclades internals |
1386 | 426d4ae3 | Constantinos Venetsanopoulos | ------------------ |
1387 | 426d4ae3 | Constantinos Venetsanopoulos | |
1388 | 426d4ae3 | Constantinos Venetsanopoulos | Asynchronous communication with Ganeti backends |
1389 | 426d4ae3 | Constantinos Venetsanopoulos | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
1390 | 426d4ae3 | Constantinos Venetsanopoulos | Synnefo uses Google Ganeti backends for VM cluster management. In order for |
1391 | 426d4ae3 | Constantinos Venetsanopoulos | Cyclades to be able to handle thousands of user requests, Cyclades and Ganeti |
1392 | 426d4ae3 | Constantinos Venetsanopoulos | communicate asynchronously. Briefly, requests are submitted to Ganeti through |
1393 | 426d4ae3 | Constantinos Venetsanopoulos | Ganeti's RAPI/HTTP interface, and then asynchronous notifications about the |
1394 | 426d4ae3 | Constantinos Venetsanopoulos | progress of Ganeti jobs are being created and pushed upwards to Cyclades. The |
1395 | 426d4ae3 | Constantinos Venetsanopoulos | architecture and communication with a Ganeti backend is shown in the graph |
1396 | 426d4ae3 | Constantinos Venetsanopoulos | below: |
1397 | 426d4ae3 | Constantinos Venetsanopoulos | |
1398 | 426d4ae3 | Constantinos Venetsanopoulos | .. image:: images/cyclades-ganeti-communication.png |
1399 | 9c9525e3 | Christos Stavrakakis | :width: 40% |
1400 | 426d4ae3 | Constantinos Venetsanopoulos | :target: _images/cyclades-ganeti-communication.png |
1401 | 426d4ae3 | Constantinos Venetsanopoulos | |
1402 | 426d4ae3 | Constantinos Venetsanopoulos | The Cyclades API server is responsible for handling user requests. Read-only |
1403 | 426d4ae3 | Constantinos Venetsanopoulos | requests are directly served by looking up the Cyclades DB. If the request |
1404 | 426d4ae3 | Constantinos Venetsanopoulos | needs an action in the Ganeti backend, Cyclades submit jobs to the Ganeti |
1405 | 426d4ae3 | Constantinos Venetsanopoulos | master using the `Ganeti RAPI interface |
1406 | 426d4ae3 | Constantinos Venetsanopoulos | <http://docs.ganeti.org/ganeti/2.2/html/rapi.html>`_. |
1407 | 426d4ae3 | Constantinos Venetsanopoulos | |
1408 | 5135245b | Christos Stavrakakis | While Ganeti executes the job, `snf-ganeti-eventd`, and `snf-progress-monitor` |
1409 | 5135245b | Christos Stavrakakis | are monitoring the progress of the job and send corresponding messages to the |
1410 | 5135245b | Christos Stavrakakis | RabbitMQ servers. These components are part of `snf-cyclades-gtools` and must |
1411 | 5135245b | Christos Stavrakakis | be installed on all Ganeti nodes. Specially: |
1412 | 426d4ae3 | Constantinos Venetsanopoulos | |
1413 | 426d4ae3 | Constantinos Venetsanopoulos | * *snf-ganeti-eventd* sends messages about operations affecting the operating |
1414 | 426d4ae3 | Constantinos Venetsanopoulos | state of instances and networks. Works by monitoring the Ganeti job queue. |
1415 | 426d4ae3 | Constantinos Venetsanopoulos | * *snf-progress_monitor* sends messages about the progress of the Image deployment |
1416 | 426d4ae3 | Constantinos Venetsanopoulos | phase which is done by the Ganeti OS Definition `snf-image`. |
1417 | 426d4ae3 | Constantinos Venetsanopoulos | |
1418 | 426d4ae3 | Constantinos Venetsanopoulos | Finally, `snf-dispatcher` consumes messages from the RabbitMQ queues, processes |
1419 | 426d4ae3 | Constantinos Venetsanopoulos | these messages and properly updates the state of the Cyclades DB. Subsequent |
1420 | 426d4ae3 | Constantinos Venetsanopoulos | requests to the Cyclades API, will retrieve the updated state from the DB. |
1421 | 426d4ae3 | Constantinos Venetsanopoulos | |
1422 | 426d4ae3 | Constantinos Venetsanopoulos | |
1423 | f936cac5 | Constantinos Venetsanopoulos | List of all Synnefo components |
1424 | f936cac5 | Constantinos Venetsanopoulos | ============================== |
1425 | f936cac5 | Constantinos Venetsanopoulos | |
1426 | f936cac5 | Constantinos Venetsanopoulos | They are also available from our apt repository: ``apt.dev.grnet.gr`` |
1427 | f936cac5 | Constantinos Venetsanopoulos | |
1428 | f936cac5 | Constantinos Venetsanopoulos | * `snf-common <http://www.synnefo.org/docs/snf-common/latest/index.html>`_ |
1429 | f936cac5 | Constantinos Venetsanopoulos | * `snf-webproject <http://www.synnefo.org/docs/snf-webproject/latest/index.html>`_ |
1430 | f936cac5 | Constantinos Venetsanopoulos | * `snf-astakos-app <http://www.synnefo.org/docs/astakos/latest/index.html>`_ |
1431 | f936cac5 | Constantinos Venetsanopoulos | * `snf-pithos-backend <http://www.synnefo.org/docs/pithos/latest/backends.html>`_ |
1432 | f936cac5 | Constantinos Venetsanopoulos | * `snf-pithos-app <http://www.synnefo.org/docs/pithos/latest/index.html>`_ |
1433 | f936cac5 | Constantinos Venetsanopoulos | * `snf-pithos-webclient <http://www.synnefo.org/docs/pithos-webclient/latest/index.html>`_ |
1434 | f936cac5 | Constantinos Venetsanopoulos | * `snf-cyclades-app <http://www.synnefo.org/docs/snf-cyclades-app/latest/index.html>`_ |
1435 | f936cac5 | Constantinos Venetsanopoulos | * `snf-cyclades-gtools <http://www.synnefo.org/docs/snf-cyclades-gtools/latest/index.html>`_ |
1436 | f936cac5 | Constantinos Venetsanopoulos | * `astakosclient <http://www.synnefo.org/docs/astakosclient/latest/index.html>`_ |
1437 | f936cac5 | Constantinos Venetsanopoulos | * `snf-vncauthproxy <https://code.grnet.gr/projects/vncauthproxy>`_ |
1438 | f936cac5 | Constantinos Venetsanopoulos | * `snf-image <http://www.synnefo.org/docs/snf-image/latest/index.html/>`_ |
1439 | f936cac5 | Constantinos Venetsanopoulos | * `snf-image-creator <http://www.synnefo.org/docs/snf-image-creator/latest/index.html>`_ |
1440 | f936cac5 | Constantinos Venetsanopoulos | * `snf-occi <http://www.synnefo.org/docs/snf-occi/latest/index.html>`_ |
1441 | f936cac5 | Constantinos Venetsanopoulos | * `snf-cloudcms <http://www.synnefo.org/docs/snf-cloudcms/latest/index.html>`_ |
1442 | f936cac5 | Constantinos Venetsanopoulos | * `nfdhcpd <https://code.grnet.gr/projects/nfdhcpd>`_ |
1443 | f936cac5 | Constantinos Venetsanopoulos | |
1444 | f936cac5 | Constantinos Venetsanopoulos | |
1445 | e81ad3e5 | Constantinos Venetsanopoulos | Synnefo management commands ("snf-manage") |
1446 | e81ad3e5 | Constantinos Venetsanopoulos | ========================================== |
1447 | e81ad3e5 | Constantinos Venetsanopoulos | |
1448 | e81ad3e5 | Constantinos Venetsanopoulos | Each Synnefo service, Astakos, Pithos and Cyclades are controlled by the |
1449 | e81ad3e5 | Constantinos Venetsanopoulos | administrator using the "snf-manage" admin tool. This tool is an extension of |
1450 | e81ad3e5 | Constantinos Venetsanopoulos | the Django command-line management utility. It is run on the host that runs |
1451 | e81ad3e5 | Constantinos Venetsanopoulos | each service and provides different types of commands depending the services |
1452 | e81ad3e5 | Constantinos Venetsanopoulos | running on the host. If you are running more than one service on the same host |
1453 | e81ad3e5 | Constantinos Venetsanopoulos | "snf-manage" adds all the corresponding commands for each service dynamically, |
1454 | e81ad3e5 | Constantinos Venetsanopoulos | providing a unified admin environment. |
1455 | e81ad3e5 | Constantinos Venetsanopoulos | |
1456 | e81ad3e5 | Constantinos Venetsanopoulos | To run "snf-manage" you just type: |
1457 | e81ad3e5 | Constantinos Venetsanopoulos | |
1458 | e81ad3e5 | Constantinos Venetsanopoulos | .. code-block:: console |
1459 | e81ad3e5 | Constantinos Venetsanopoulos | |
1460 | e81ad3e5 | Constantinos Venetsanopoulos | # snf-manage <command> [arguments] |
1461 | e81ad3e5 | Constantinos Venetsanopoulos | |
1462 | e81ad3e5 | Constantinos Venetsanopoulos | on the corresponding host that runs the service. For example, if you have all |
1463 | e81ad3e5 | Constantinos Venetsanopoulos | services running on different physical hosts you would do: |
1464 | e81ad3e5 | Constantinos Venetsanopoulos | |
1465 | e81ad3e5 | Constantinos Venetsanopoulos | .. code-block:: console |
1466 | e81ad3e5 | Constantinos Venetsanopoulos | |
1467 | e81ad3e5 | Constantinos Venetsanopoulos | root@astakos-host # snf-manage <astakos-command> [argument] |
1468 | e81ad3e5 | Constantinos Venetsanopoulos | root@pithos-host # snf-manage <pithos-command> [argument] |
1469 | e81ad3e5 | Constantinos Venetsanopoulos | root@cyclades-host # snf-manage <cyclades-command> [argument] |
1470 | e81ad3e5 | Constantinos Venetsanopoulos | |
1471 | e81ad3e5 | Constantinos Venetsanopoulos | If you have all services running on the same host you would do: |
1472 | e81ad3e5 | Constantinos Venetsanopoulos | |
1473 | e81ad3e5 | Constantinos Venetsanopoulos | .. code-block:: console |
1474 | e81ad3e5 | Constantinos Venetsanopoulos | |
1475 | e81ad3e5 | Constantinos Venetsanopoulos | root@synnefo-host # snf-manage <{astakos,pithos,cyclades}-command> [argument] |
1476 | e81ad3e5 | Constantinos Venetsanopoulos | |
1477 | e81ad3e5 | Constantinos Venetsanopoulos | Note that you cannot execute a service's command on a host that is not running |
1478 | e81ad3e5 | Constantinos Venetsanopoulos | this service. For example, the following will return an error if Astakos and |
1479 | e81ad3e5 | Constantinos Venetsanopoulos | Cyclades are installed on different physical hosts: |
1480 | e81ad3e5 | Constantinos Venetsanopoulos | |
1481 | e81ad3e5 | Constantinos Venetsanopoulos | .. code-block:: console |
1482 | e81ad3e5 | Constantinos Venetsanopoulos | |
1483 | e81ad3e5 | Constantinos Venetsanopoulos | root@astakos-host # snf-manage <cyclades-command> [argument] |
1484 | e81ad3e5 | Constantinos Venetsanopoulos | Unknown command: 'cyclades-command' |
1485 | e81ad3e5 | Constantinos Venetsanopoulos | Type 'snf-manage help' for usage. |
1486 | e81ad3e5 | Constantinos Venetsanopoulos | |
1487 | e81ad3e5 | Constantinos Venetsanopoulos | This is the complete list of "snf-manage" commands for each service. |
1488 | e81ad3e5 | Constantinos Venetsanopoulos | |
1489 | e81ad3e5 | Constantinos Venetsanopoulos | Astakos snf-manage commands |
1490 | e81ad3e5 | Constantinos Venetsanopoulos | --------------------------- |
1491 | e81ad3e5 | Constantinos Venetsanopoulos | |
1492 | e81ad3e5 | Constantinos Venetsanopoulos | ============================ =========================== |
1493 | e81ad3e5 | Constantinos Venetsanopoulos | Name Description |
1494 | e81ad3e5 | Constantinos Venetsanopoulos | ============================ =========================== |
1495 | e81ad3e5 | Constantinos Venetsanopoulos | fix-superusers Transform superusers created by syncdb into AstakosUser instances |
1496 | 5e1ea6f7 | Giorgos Korfiatis | cleanup-full Cleanup sessions and session catalog |
1497 | a4451f59 | Giorgos Korfiatis | commission-list List pending commissions |
1498 | a4451f59 | Giorgos Korfiatis | commission-show Show details for a pending commission |
1499 | 252eef38 | Giorgos Korfiatis | component-add Register a component |
1500 | 252eef38 | Giorgos Korfiatis | component-list List components |
1501 | 252eef38 | Giorgos Korfiatis | component-modify Modify component attributes |
1502 | 6ef1e2eb | Giorgos Korfiatis | component-show Show component details |
1503 | e81ad3e5 | Constantinos Venetsanopoulos | project-control Manage projects and applications |
1504 | e81ad3e5 | Constantinos Venetsanopoulos | project-list List projects |
1505 | e81ad3e5 | Constantinos Venetsanopoulos | project-show Show project details |
1506 | a69ad12b | Giorgos Korfiatis | quota-list List user quota |
1507 | a69ad12b | Giorgos Korfiatis | quota-verify Check the integrity of user quota |
1508 | e81ad3e5 | Constantinos Venetsanopoulos | reconcile-resources-astakos Reconcile resource usage of Quotaholder with Astakos DB |
1509 | e81ad3e5 | Constantinos Venetsanopoulos | resource-list List resources |
1510 | 5e1ea6f7 | Giorgos Korfiatis | resource-modify Modify a resource's default base quota and boolean flags |
1511 | 90e7da53 | Giorgos Korfiatis | service-export-astakos Export Astakos services and resources in JSON format |
1512 | bd1f667b | Giorgos Korfiatis | service-import Register services |
1513 | e81ad3e5 | Constantinos Venetsanopoulos | service-list List services |
1514 | 5e1ea6f7 | Giorgos Korfiatis | service-show Show service details |
1515 | e81ad3e5 | Constantinos Venetsanopoulos | term-add Add approval terms |
1516 | e81ad3e5 | Constantinos Venetsanopoulos | user-activation-send Send user activation |
1517 | e81ad3e5 | Constantinos Venetsanopoulos | user-add Add user |
1518 | 9577d199 | Kostas Papadimitriou | authpolicy-add Create a new authentication provider policy profile |
1519 | 9577d199 | Kostas Papadimitriou | authpolicy-list List existing authentication provider policy profiles |
1520 | 9577d199 | Kostas Papadimitriou | authpolicy-remove Remove an authentication provider policy |
1521 | 9577d199 | Kostas Papadimitriou | authpolicy-set Assign an existing authentication provider policy profile to a user or group |
1522 | 9577d199 | Kostas Papadimitriou | authpolicy-show Show authentication provider profile details |
1523 | 9577d199 | Kostas Papadimitriou | group-add Create a group with the given name |
1524 | 9577d199 | Kostas Papadimitriou | group-list List available groups |
1525 | e81ad3e5 | Constantinos Venetsanopoulos | user-list List users |
1526 | e81ad3e5 | Constantinos Venetsanopoulos | user-modify Modify user |
1527 | e81ad3e5 | Constantinos Venetsanopoulos | user-show Show user details |
1528 | 5547485e | Sofia Papagiannaki | oauth2-client-add Create an oauth2 client |
1529 | 5547485e | Sofia Papagiannaki | oauth2-client-list List oauth2 clients |
1530 | 5547485e | Sofia Papagiannaki | oauth2-client-remove Remove an oauth2 client along with its registered redirect urls |
1531 | e81ad3e5 | Constantinos Venetsanopoulos | ============================ =========================== |
1532 | e81ad3e5 | Constantinos Venetsanopoulos | |
1533 | e81ad3e5 | Constantinos Venetsanopoulos | Pithos snf-manage commands |
1534 | e81ad3e5 | Constantinos Venetsanopoulos | -------------------------- |
1535 | e81ad3e5 | Constantinos Venetsanopoulos | |
1536 | e81ad3e5 | Constantinos Venetsanopoulos | ============================ =========================== |
1537 | e81ad3e5 | Constantinos Venetsanopoulos | Name Description |
1538 | e81ad3e5 | Constantinos Venetsanopoulos | ============================ =========================== |
1539 | 3506f6a0 | Sofia Papagiannaki | reconcile-commissions-pithos Display unresolved commissions and trigger their recovery |
1540 | 90e7da53 | Giorgos Korfiatis | service-export-pithos Export Pithos services and resources in JSON format |
1541 | 3506f6a0 | Sofia Papagiannaki | reconcile-resources-pithos Detect unsynchronized usage between Astakos and Pithos DB resources and synchronize them if specified so. |
1542 | c598a8a7 | Sofia Papagiannaki | file-show Display object information |
1543 | e81ad3e5 | Constantinos Venetsanopoulos | ============================ =========================== |
1544 | e81ad3e5 | Constantinos Venetsanopoulos | |
1545 | e81ad3e5 | Constantinos Venetsanopoulos | Cyclades snf-manage commands |
1546 | e81ad3e5 | Constantinos Venetsanopoulos | ---------------------------- |
1547 | e81ad3e5 | Constantinos Venetsanopoulos | |
1548 | bf57a264 | Christos Stavrakakis | ============================== =========================== |
1549 | bf57a264 | Christos Stavrakakis | Name Description |
1550 | bf57a264 | Christos Stavrakakis | ============================== =========================== |
1551 | bf57a264 | Christos Stavrakakis | backend-add Add a new Ganeti backend |
1552 | bf57a264 | Christos Stavrakakis | backend-list List backends |
1553 | bf57a264 | Christos Stavrakakis | backend-modify Modify a backend |
1554 | bf57a264 | Christos Stavrakakis | backend-update-status Update backend statistics for instance allocation |
1555 | bf57a264 | Christos Stavrakakis | backend-remove Remove a Ganeti backend |
1556 | d14155e3 | Giorgos Korfiatis | enforce-resources-cyclades Check and fix quota violations for Cyclades resources |
1557 | bf57a264 | Christos Stavrakakis | server-create Create a new server |
1558 | bf57a264 | Christos Stavrakakis | server-show Show server details |
1559 | bf57a264 | Christos Stavrakakis | server-list List servers |
1560 | bf57a264 | Christos Stavrakakis | server-modify Modify a server |
1561 | bf57a264 | Christos Stavrakakis | server-import Import an existing Ganeti VM into synnefo |
1562 | bf57a264 | Christos Stavrakakis | server-inspect Inspect a server in DB and Ganeti |
1563 | bf57a264 | Christos Stavrakakis | network-create Create a new network |
1564 | bf57a264 | Christos Stavrakakis | network-list List networks |
1565 | bf57a264 | Christos Stavrakakis | network-modify Modify a network |
1566 | bf57a264 | Christos Stavrakakis | network-inspect Inspect network state in DB and Ganeti |
1567 | bf57a264 | Christos Stavrakakis | network-remove Delete a network |
1568 | bf57a264 | Christos Stavrakakis | flavor-create Create a new flavor |
1569 | bf57a264 | Christos Stavrakakis | flavor-list List flavors |
1570 | bf57a264 | Christos Stavrakakis | flavor-modify Modify a flavor |
1571 | bf57a264 | Christos Stavrakakis | image-list List images |
1572 | bf57a264 | Christos Stavrakakis | image-show Show image details |
1573 | bf57a264 | Christos Stavrakakis | pool-create Create a bridge or mac-prefix pool |
1574 | bf57a264 | Christos Stavrakakis | pool-show Show pool details |
1575 | bf57a264 | Christos Stavrakakis | pool-list List pools |
1576 | bf57a264 | Christos Stavrakakis | pool-modify Modify a pool |
1577 | bf57a264 | Christos Stavrakakis | pool-remove Delete a pool |
1578 | f61f3fa7 | Christos Stavrakakis | port-create Create a port connecting a server to a network |
1579 | f61f3fa7 | Christos Stavrakakis | port-inspect Inspect the state of a port in DB and Ganeti |
1580 | f61f3fa7 | Christos Stavrakakis | port-list List ports |
1581 | f61f3fa7 | Christos Stavrakakis | port-remove Delete a port |
1582 | f61f3fa7 | Christos Stavrakakis | floating-ip-create Create a new floating IP |
1583 | f61f3fa7 | Christos Stavrakakis | floating-ip-attach Attach a floating IP to a server |
1584 | 6d86f5b3 | Christos Stavrakakis | floating-ip-detach Detach a floating IP from a server |
1585 | f61f3fa7 | Christos Stavrakakis | floating-ip-list List floating IPs |
1586 | f61f3fa7 | Christos Stavrakakis | floating-ip-remove Delete a floating IP |
1587 | bf57a264 | Christos Stavrakakis | queue-inspect Inspect the messages of a RabbitMQ queue |
1588 | bf57a264 | Christos Stavrakakis | queue-retry Resend messages from Dead Letter queues to original exchanges |
1589 | 90e7da53 | Giorgos Korfiatis | service-export-cyclades Export Cyclades services and resources in JSON format |
1590 | aab200c6 | Dionysis Grigoropoulos | subnet-create Create a subnet |
1591 | aab200c6 | Dionysis Grigoropoulos | subnet-inspect Inspect a subnet in DB |
1592 | aab200c6 | Dionysis Grigoropoulos | subnet-list List subnets |
1593 | aab200c6 | Dionysis Grigoropoulos | subnet-modify Modify a subnet |
1594 | bf57a264 | Christos Stavrakakis | reconcile-servers Reconcile servers of Synnefo DB with state of Ganeti backend |
1595 | bf57a264 | Christos Stavrakakis | reconcile-networks Reconcile networks of Synnefo DB with state of Ganeti backend |
1596 | bf57a264 | Christos Stavrakakis | reconcile-pools Check consistency of pool resources |
1597 | bf57a264 | Christos Stavrakakis | reconcile-commissions-cyclades Detect and resolve pending commissions to Quotaholder |
1598 | bf57a264 | Christos Stavrakakis | reconcile-resources-cyclades Reconcile resource usage of Astakos with Cyclades DB. |
1599 | bf57a264 | Christos Stavrakakis | ============================== =========================== |
1600 | e81ad3e5 | Constantinos Venetsanopoulos | |
1601 | 44cc2a6a | Constantinos Venetsanopoulos | |
1602 | 11716a83 | Giorgos Korfiatis | Astakos helper scripts |
1603 | 11716a83 | Giorgos Korfiatis | ====================== |
1604 | 11716a83 | Giorgos Korfiatis | |
1605 | 11716a83 | Giorgos Korfiatis | Astakos includes two scripts to facilitate the installation procedure. |
1606 | 11716a83 | Giorgos Korfiatis | Running: |
1607 | 11716a83 | Giorgos Korfiatis | |
1608 | 11716a83 | Giorgos Korfiatis | .. code-block:: console |
1609 | 11716a83 | Giorgos Korfiatis | |
1610 | b4109758 | Giorgos Korfiatis | snf-component-register [<component_name>] |
1611 | 11716a83 | Giorgos Korfiatis | |
1612 | 11716a83 | Giorgos Korfiatis | automates the registration of the standard Synnefo components (astakos, |
1613 | 11716a83 | Giorgos Korfiatis | cyclades, and pithos) in astakos database. It internally uses the script: |
1614 | 11716a83 | Giorgos Korfiatis | |
1615 | 11716a83 | Giorgos Korfiatis | .. code-block:: console |
1616 | 11716a83 | Giorgos Korfiatis | |
1617 | 11716a83 | Giorgos Korfiatis | snf-service-export <component_name> <base_url> |
1618 | 11716a83 | Giorgos Korfiatis | |
1619 | 11716a83 | Giorgos Korfiatis | which simulates the export of service and resource definitions of the |
1620 | 11716a83 | Giorgos Korfiatis | standard Synnefo components. |
1621 | 11716a83 | Giorgos Korfiatis | |
1622 | 44cc2a6a | Constantinos Venetsanopoulos | |
1623 | 3506f6a0 | Sofia Papagiannaki | Pithos managing accounts |
1624 | 3506f6a0 | Sofia Papagiannaki | ======================== |
1625 | 3506f6a0 | Sofia Papagiannaki | |
1626 | 3506f6a0 | Sofia Papagiannaki | Pithos provides a utility tool for managing accounts. |
1627 | 3506f6a0 | Sofia Papagiannaki | To run you just type: |
1628 | 3506f6a0 | Sofia Papagiannaki | |
1629 | 3506f6a0 | Sofia Papagiannaki | .. code-block:: console |
1630 | 3506f6a0 | Sofia Papagiannaki | |
1631 | 3506f6a0 | Sofia Papagiannaki | # pithos-manage-accounts <command> [arguments] |
1632 | 3506f6a0 | Sofia Papagiannaki | |
1633 | 3506f6a0 | Sofia Papagiannaki | This is the list of the available commands: |
1634 | 3506f6a0 | Sofia Papagiannaki | |
1635 | 3506f6a0 | Sofia Papagiannaki | ============================ =========================== |
1636 | 3506f6a0 | Sofia Papagiannaki | Name Description |
1637 | 3506f6a0 | Sofia Papagiannaki | ============================ =========================== |
1638 | 3506f6a0 | Sofia Papagiannaki | delete Remove an account from the Pithos DB |
1639 | 3506f6a0 | Sofia Papagiannaki | export-quota Export account quota in a file |
1640 | 3506f6a0 | Sofia Papagiannaki | list List existing/dublicate accounts |
1641 | 3506f6a0 | Sofia Papagiannaki | merge Move an account contents in another account |
1642 | 3506f6a0 | Sofia Papagiannaki | set-container-quota Set container quota for all or a specific account |
1643 | 3506f6a0 | Sofia Papagiannaki | ============================ =========================== |
1644 | 3506f6a0 | Sofia Papagiannaki | |
1645 | e81ad3e5 | Constantinos Venetsanopoulos | |
1646 | bc055d09 | Constantinos Venetsanopoulos | The "kamaki" API client |
1647 | eab73849 | Constantinos Venetsanopoulos | ======================= |
1648 | bc055d09 | Constantinos Venetsanopoulos | |
1649 | bc055d09 | Constantinos Venetsanopoulos | To upload, register or modify an image you will need the **kamaki** tool. |
1650 | bc055d09 | Constantinos Venetsanopoulos | Before proceeding make sure that it is configured properly. Verify that |
1651 | dd04efac | Stavros Sachtouris | *image.url*, *file.url*, *user.url* and *token* are set as needed: |
1652 | bc055d09 | Constantinos Venetsanopoulos | |
1653 | bc055d09 | Constantinos Venetsanopoulos | .. code-block:: console |
1654 | bc055d09 | Constantinos Venetsanopoulos | |
1655 | bc055d09 | Constantinos Venetsanopoulos | $ kamaki config list |
1656 | bc055d09 | Constantinos Venetsanopoulos | |
1657 | 73ebcd68 | Constantinos Venetsanopoulos | To change a setting use ``kamaki config set``: |
1658 | bc055d09 | Constantinos Venetsanopoulos | |
1659 | bc055d09 | Constantinos Venetsanopoulos | .. code-block:: console |
1660 | bc055d09 | Constantinos Venetsanopoulos | |
1661 | 73ebcd68 | Constantinos Venetsanopoulos | $ kamaki config set image.url https://cyclades.example.com/image |
1662 | dd04efac | Stavros Sachtouris | $ kamaki config set file.url https://pithos.example.com/v1 |
1663 | dd04efac | Stavros Sachtouris | $ kamaki config set user.url https://accounts.example.com |
1664 | bc055d09 | Constantinos Venetsanopoulos | $ kamaki config set token ... |
1665 | bc055d09 | Constantinos Venetsanopoulos | |
1666 | c0d88cf3 | Constantinos Venetsanopoulos | To test that everything works, try authenticating the current account with |
1667 | c0d88cf3 | Constantinos Venetsanopoulos | kamaki: |
1668 | dd04efac | Stavros Sachtouris | |
1669 | dd04efac | Stavros Sachtouris | .. code-block:: console |
1670 | dd04efac | Stavros Sachtouris | |
1671 | dd04efac | Stavros Sachtouris | $ kamaki user authenticate |
1672 | dd04efac | Stavros Sachtouris | |
1673 | c0d88cf3 | Constantinos Venetsanopoulos | This will output user information. |
1674 | dd04efac | Stavros Sachtouris | |
1675 | bc055d09 | Constantinos Venetsanopoulos | Upload Image |
1676 | bc055d09 | Constantinos Venetsanopoulos | ------------ |
1677 | bc055d09 | Constantinos Venetsanopoulos | |
1678 | c0d88cf3 | Constantinos Venetsanopoulos | By convention, images are stored in a container called ``images``. Check if the |
1679 | c0d88cf3 | Constantinos Venetsanopoulos | container exists, by listing all containers in your account: |
1680 | bc055d09 | Constantinos Venetsanopoulos | |
1681 | bc055d09 | Constantinos Venetsanopoulos | .. code-block:: console |
1682 | bc055d09 | Constantinos Venetsanopoulos | |
1683 | dd04efac | Stavros Sachtouris | $ kamaki file list |
1684 | bc055d09 | Constantinos Venetsanopoulos | |
1685 | dd04efac | Stavros Sachtouris | If the container ``images`` does not exist, create it: |
1686 | bc055d09 | Constantinos Venetsanopoulos | |
1687 | bc055d09 | Constantinos Venetsanopoulos | .. code-block:: console |
1688 | bc055d09 | Constantinos Venetsanopoulos | |
1689 | dd04efac | Stavros Sachtouris | $ kamaki file create images |
1690 | bc055d09 | Constantinos Venetsanopoulos | |
1691 | c0d88cf3 | Constantinos Venetsanopoulos | You are now ready to upload an image to container ``images``. You can upload it |
1692 | e5d8df8c | Constantinos Venetsanopoulos | with a Pithos client, or use kamaki directly: |
1693 | bc055d09 | Constantinos Venetsanopoulos | |
1694 | bc055d09 | Constantinos Venetsanopoulos | .. code-block:: console |
1695 | bc055d09 | Constantinos Venetsanopoulos | |
1696 | dd04efac | Stavros Sachtouris | $ kamaki file upload ubuntu.iso images |
1697 | bc055d09 | Constantinos Venetsanopoulos | |
1698 | e5d8df8c | Constantinos Venetsanopoulos | You can use any Pithos client to verify that the image was uploaded correctly, |
1699 | c0d88cf3 | Constantinos Venetsanopoulos | or you can list the contents of the container with kamaki: |
1700 | bc055d09 | Constantinos Venetsanopoulos | |
1701 | dd04efac | Stavros Sachtouris | .. code-block:: console |
1702 | dd04efac | Stavros Sachtouris | |
1703 | dd04efac | Stavros Sachtouris | $ kamaki file list images |
1704 | bc055d09 | Constantinos Venetsanopoulos | |
1705 | bc055d09 | Constantinos Venetsanopoulos | The full Pithos URL for the previous example will be |
1706 | c0d88cf3 | Constantinos Venetsanopoulos | ``pithos://u53r-un1qu3-1d/images/ubuntu.iso`` where ``u53r-un1qu3-1d`` is the |
1707 | c0d88cf3 | Constantinos Venetsanopoulos | unique user id (uuid). |
1708 | bc055d09 | Constantinos Venetsanopoulos | |
1709 | bc055d09 | Constantinos Venetsanopoulos | Register Image |
1710 | bc055d09 | Constantinos Venetsanopoulos | -------------- |
1711 | bc055d09 | Constantinos Venetsanopoulos | |
1712 | e5d8df8c | Constantinos Venetsanopoulos | To register an image you will need to use the full Pithos URL. To register as |
1713 | bc055d09 | Constantinos Venetsanopoulos | a public image the one from the previous example use: |
1714 | bc055d09 | Constantinos Venetsanopoulos | |
1715 | bc055d09 | Constantinos Venetsanopoulos | .. code-block:: console |
1716 | bc055d09 | Constantinos Venetsanopoulos | |
1717 | dd04efac | Stavros Sachtouris | $ kamaki image register Ubuntu pithos://u53r-un1qu3-1d/images/ubuntu.iso --public |
1718 | bc055d09 | Constantinos Venetsanopoulos | |
1719 | bc055d09 | Constantinos Venetsanopoulos | The ``--public`` flag is important, if missing the registered image will not |
1720 | dd04efac | Stavros Sachtouris | be listed by ``kamaki image list``. |
1721 | bc055d09 | Constantinos Venetsanopoulos | |
1722 | dd04efac | Stavros Sachtouris | Use ``kamaki image register`` with no arguments to see a list of available |
1723 | bc055d09 | Constantinos Venetsanopoulos | options. A more complete example would be the following: |
1724 | bc055d09 | Constantinos Venetsanopoulos | |
1725 | bc055d09 | Constantinos Venetsanopoulos | .. code-block:: console |
1726 | bc055d09 | Constantinos Venetsanopoulos | |
1727 | dd04efac | Stavros Sachtouris | $ kamaki image register Ubuntu pithos://u53r-un1qu3-1d/images/ubuntu.iso \ |
1728 | bc055d09 | Constantinos Venetsanopoulos | --public --disk-format diskdump --property kernel=3.1.2 |
1729 | bc055d09 | Constantinos Venetsanopoulos | |
1730 | bc055d09 | Constantinos Venetsanopoulos | To verify that the image was registered successfully use: |
1731 | bc055d09 | Constantinos Venetsanopoulos | |
1732 | bc055d09 | Constantinos Venetsanopoulos | .. code-block:: console |
1733 | bc055d09 | Constantinos Venetsanopoulos | |
1734 | dd04efac | Stavros Sachtouris | $ kamaki image list --name-like=ubuntu |
1735 | bc055d09 | Constantinos Venetsanopoulos | |
1736 | eab73849 | Constantinos Venetsanopoulos | |
1737 | eab73849 | Constantinos Venetsanopoulos | Miscellaneous |
1738 | eab73849 | Constantinos Venetsanopoulos | ============= |
1739 | eab73849 | Constantinos Venetsanopoulos | |
1740 | 08ad5b01 | Constantinos Venetsanopoulos | .. _branding: |
1741 | 9c2edbf1 | Olga Brani | |
1742 | 42e767d4 | Olga Brani | Branding |
1743 | 08ad5b01 | Constantinos Venetsanopoulos | -------- |
1744 | 9c2edbf1 | Olga Brani | |
1745 | 08ad5b01 | Constantinos Venetsanopoulos | Since Synnefo v0.14, you are able to adapt the Astakos, Pithos and Cyclades Web |
1746 | 08ad5b01 | Constantinos Venetsanopoulos | UI to your company’s visual identity. This is possible using the snf-branding |
1747 | 08ad5b01 | Constantinos Venetsanopoulos | component, which is automatically installed on the nodes running the API |
1748 | 0019cd7d | Christos Stavrakakis | servers for Astakos, Pithos and Cyclades. |
1749 | 9c2edbf1 | Olga Brani | |
1750 | 9c2edbf1 | Olga Brani | Configuration |
1751 | 9c2edbf1 | Olga Brani | ~~~~~~~~~~~~~ |
1752 | 9c2edbf1 | Olga Brani | |
1753 | 77186edf | Kostas Papadimitriou | This can be done by modifing the settings provided by the snf-branding component |
1754 | 77186edf | Kostas Papadimitriou | to match your service identity. The settings for the snf-branding application |
1755 | 77186edf | Kostas Papadimitriou | can be found inside the configuration file ``/etc/synnefo/15-snf-branding.conf`` |
1756 | 77186edf | Kostas Papadimitriou | on the nodes that have Astakos, Pithos and Cyclades installed. |
1757 | 9c2edbf1 | Olga Brani | |
1758 | 08ad5b01 | Constantinos Venetsanopoulos | By default, the global service name is "Synnefo" and the company name is |
1759 | 08ad5b01 | Constantinos Venetsanopoulos | "GRNET". These names and their respective logos and URLs are used throughout |
1760 | 08ad5b01 | Constantinos Venetsanopoulos | the Astakos, Pithos and Cyclades UI. |
1761 | 9c2edbf1 | Olga Brani | |
1762 | 08ad5b01 | Constantinos Venetsanopoulos | **Names and URLs:** |
1763 | 9c2edbf1 | Olga Brani | |
1764 | 08ad5b01 | Constantinos Venetsanopoulos | The first group of branding customization refers to the service's and company's |
1765 | 08ad5b01 | Constantinos Venetsanopoulos | information. |
1766 | 9c2edbf1 | Olga Brani | |
1767 | 08ad5b01 | Constantinos Venetsanopoulos | You can overwrite the company and the service name and URL respectively by |
1768 | 08ad5b01 | Constantinos Venetsanopoulos | uncommenting and setting the following: |
1769 | 9c2edbf1 | Olga Brani | |
1770 | 77186edf | Kostas Papadimitriou | .. code-block:: python |
1771 | 0019cd7d | Christos Stavrakakis | |
1772 | 77186edf | Kostas Papadimitriou | # setting used in Astakos Dashboard/Projects pages |
1773 | 77186edf | Kostas Papadimitriou | BRANDING_SERVICE_NAME = 'My cloud' |
1774 | 77186edf | Kostas Papadimitriou | BRANDING_SERVICE_URL = 'http://www.mycloud.synnefo.org/' |
1775 | 9c2edbf1 | Olga Brani | |
1776 | 0019cd7d | Christos Stavrakakis | # settings used in Astakos, Pithos, Cyclades footer only if |
1777 | 77186edf | Kostas Papadimitriou | # BRANDING_SHOW_COPYRIGHT is set to True |
1778 | 77186edf | Kostas Papadimitriou | BRANDING_SHOW_COPYRIGHT = True |
1779 | 77186edf | Kostas Papadimitriou | BRANDING_COMPANY_NAME = 'Company LTD' |
1780 | 77186edf | Kostas Papadimitriou | BRANDING_COMPANY_URL = 'https://www.company-ltd.synnefo.org/' |
1781 | 9c2edbf1 | Olga Brani | |
1782 | 9c2edbf1 | Olga Brani | |
1783 | 97a096f1 | Olga Brani | **Copyright and footer options:** |
1784 | 9c2edbf1 | Olga Brani | |
1785 | 08ad5b01 | Constantinos Venetsanopoulos | By default, no Copyright message is shown in the UI footer. If you want to make |
1786 | 08ad5b01 | Constantinos Venetsanopoulos | it visible in the footer of Astakos, Pithos and Cyclades UI, you can uncomment |
1787 | 77186edf | Kostas Papadimitriou | and set to ``True`` the ``BRANDING_SHOW_COPYRIGHT`` setting: |
1788 | 9c2edbf1 | Olga Brani | |
1789 | 77186edf | Kostas Papadimitriou | .. code-block:: python |
1790 | 9c2edbf1 | Olga Brani | |
1791 | 9c2edbf1 | Olga Brani | #BRANDING_SHOW_COPYRIGHT = False |
1792 | 9c2edbf1 | Olga Brani | |
1793 | 77186edf | Kostas Papadimitriou | Copyright message defaults to 'Copyright (c) 2011-<current_year> |
1794 | 08ad5b01 | Constantinos Venetsanopoulos | <BRANDING_COMPANY_NAME>.' but you can overwrite it to a completely custom one by |
1795 | 08ad5b01 | Constantinos Venetsanopoulos | setting the following option: |
1796 | 9c2edbf1 | Olga Brani | |
1797 | 77186edf | Kostas Papadimitriou | .. code-block:: python |
1798 | 77186edf | Kostas Papadimitriou | |
1799 | 77186edf | Kostas Papadimitriou | BRANDING_COPYRIGHT_MESSAGE = 'Copyright (c) 2011-2013 GRNET' |
1800 | 9c2edbf1 | Olga Brani | |
1801 | 0019cd7d | Christos Stavrakakis | If you want to include a custom message in the footer, you can uncomment and |
1802 | 0019cd7d | Christos Stavrakakis | set the ``BRANDING_FOOTER_EXTRA_MESSAGE`` setting. You can use html markup. |
1803 | 0019cd7d | Christos Stavrakakis | Your custom message will appear above Copyright message at the Compute |
1804 | 97a096f1 | Olga Brani | templates and the Dashboard UI. |
1805 | 97a096f1 | Olga Brani | |
1806 | 97a096f1 | Olga Brani | .. code-block:: python |
1807 | 97a096f1 | Olga Brani | |
1808 | 97a096f1 | Olga Brani | #BRANDING_FOOTER_EXTRA_MESSAGE = '' |
1809 | 97a096f1 | Olga Brani | |
1810 | 9c2edbf1 | Olga Brani | |
1811 | 9c2edbf1 | Olga Brani | **Images:** |
1812 | 9c2edbf1 | Olga Brani | |
1813 | 08ad5b01 | Constantinos Venetsanopoulos | The Astakos, Pithos and Cyclades Web UI has some logos and images. |
1814 | 0019cd7d | Christos Stavrakakis | |
1815 | 9c2edbf1 | Olga Brani | The branding-related images are presented in the following table: |
1816 | 9c2edbf1 | Olga Brani | |
1817 | 9c2edbf1 | Olga Brani | =============== ============================ ========= |
1818 | 9c2edbf1 | Olga Brani | Image Name/extension convention Usage |
1819 | 9c2edbf1 | Olga Brani | =============== ============================ ========= |
1820 | 9c2edbf1 | Olga Brani | Favicon favicon.ico Favicon for all services |
1821 | 9c2edbf1 | Olga Brani | Dashboard logo dashboard_logo.png Visible in all Astakos UI pages |
1822 | 9c2edbf1 | Olga Brani | Compute logo compute_logo.png Visible in all Cyclades UI pages |
1823 | 08ad5b01 | Constantinos Venetsanopoulos | Console logo console_logo.png Visible in the Cyclades Console Window |
1824 | 08ad5b01 | Constantinos Venetsanopoulos | Storage logo storage_logo.png Visible in all Pithos UI pages |
1825 | 9c2edbf1 | Olga Brani | =============== ============================ ========= |
1826 | 9c2edbf1 | Olga Brani | |
1827 | 0019cd7d | Christos Stavrakakis | There are two methods available for replacing all, or individual, |
1828 | 263cb456 | Olga Brani | branding-related images: |
1829 | 9c2edbf1 | Olga Brani | |
1830 | 77186edf | Kostas Papadimitriou | 1. Create a new directory inside ``/usr/share/synnefo/static/`` (e.g. |
1831 | 77186edf | Kostas Papadimitriou | ``mybranding``) and place there some or all of your images. |
1832 | 9c2edbf1 | Olga Brani | |
1833 | 08ad5b01 | Constantinos Venetsanopoulos | If you want to replace all of your images, keep the name/extension |
1834 | 77186edf | Kostas Papadimitriou | conventions as indicated in the above table and change the |
1835 | 77186edf | Kostas Papadimitriou | ``BRANDING_IMAGE_MEDIA_URL`` setting accordingly: |
1836 | 9c2edbf1 | Olga Brani | |
1837 | 77186edf | Kostas Papadimitriou | .. code-block:: python |
1838 | 0019cd7d | Christos Stavrakakis | |
1839 | 77186edf | Kostas Papadimitriou | # using relative path |
1840 | 0019cd7d | Christos Stavrakakis | BRANDING_IMAGE_MEDIA_URL= '/static/mybranding/images/' |
1841 | 9c2edbf1 | Olga Brani | |
1842 | 77186edf | Kostas Papadimitriou | # or if you already host them in a separate domain (e.g. cdn) |
1843 | 77186edf | Kostas Papadimitriou | BRANDING_IMAGE_MEDIA_URL= 'https://cdn.synnefo.org/branding/images/' |
1844 | 9c2edbf1 | Olga Brani | |
1845 | 9c2edbf1 | Olga Brani | |
1846 | 08ad5b01 | Constantinos Venetsanopoulos | If you wish to replace individual images, **do not uncomment** |
1847 | 08ad5b01 | Constantinos Venetsanopoulos | ``BRANDING_IMAGE_MEDIA_URL``, but instead provide a relative path, pointing to |
1848 | 08ad5b01 | Constantinos Venetsanopoulos | the file inside your directory for each ``BRANDING_<image>_URL`` that you wish |
1849 | 08ad5b01 | Constantinos Venetsanopoulos | to replace. |
1850 | 9c2edbf1 | Olga Brani | |
1851 | 0019cd7d | Christos Stavrakakis | 2. Upload some or all of your images to a server and replace each |
1852 | 08ad5b01 | Constantinos Venetsanopoulos | ``BRANDING_<image>_URL`` with the absolute url of the image (i.e. |
1853 | 77186edf | Kostas Papadimitriou | ``BRANDING_DASHBOARD_URL = 'https://www.synnefo.com/images/my_dashboard.jpg'``). |
1854 | 9c2edbf1 | Olga Brani | |
1855 | 0019cd7d | Christos Stavrakakis | Note that the alternative text for each image tag inside html documents is |
1856 | 08ad5b01 | Constantinos Venetsanopoulos | alt=“BRANDING_SERVICE_NAME {Dashboard, Compute. Console, Storage}” respectively. |
1857 | 9c2edbf1 | Olga Brani | |
1858 | 42e767d4 | Olga Brani | .. note:: Retina optimized images: |
1859 | 9c2edbf1 | Olga Brani | |
1860 | 0019cd7d | Christos Stavrakakis | Synnefo UI is optimized for Retina displays. As far as images are concerned, |
1861 | 08ad5b01 | Constantinos Venetsanopoulos | `retina.js <http://retinajs.com/>`_ is used. |
1862 | 9c2edbf1 | Olga Brani | |
1863 | 0019cd7d | Christos Stavrakakis | Retina.js checks each image on a page to see if there is a high-resolution |
1864 | 0019cd7d | Christos Stavrakakis | version of that image on your server. If a high-resolution variant exists, |
1865 | 08ad5b01 | Constantinos Venetsanopoulos | the script will swap in that image in-place. |
1866 | 9c2edbf1 | Olga Brani | |
1867 | 08ad5b01 | Constantinos Venetsanopoulos | The script assumes you use `Apple's prescribed high-resolution modifier (@2x) |
1868 | 08ad5b01 | Constantinos Venetsanopoulos | <http://developer.apple.com/library/ios/#documentation/2DDrawing/Conceptual/ |
1869 | 08ad5b01 | Constantinos Venetsanopoulos | DrawingPrintingiOS/SupportingHiResScreensInViews/SupportingHiResScreensInViews |
1870 | 0019cd7d | Christos Stavrakakis | .html#//apple_ref/doc/uid/TP40010156-CH15-SW1>`_ to denote high-resolution |
1871 | 08ad5b01 | Constantinos Venetsanopoulos | image variants on your server. |
1872 | 9c2edbf1 | Olga Brani | |
1873 | 0019cd7d | Christos Stavrakakis | For each of the images that you wish the script to replace, you must have a |
1874 | 0019cd7d | Christos Stavrakakis | high-resolution variant in the same folder named correctly and it will be |
1875 | 0019cd7d | Christos Stavrakakis | detected automatically. For example if your image is in <my_directory> and is |
1876 | 0019cd7d | Christos Stavrakakis | named "my_image.jpg" the script will look in the same directory for an image |
1877 | 08ad5b01 | Constantinos Venetsanopoulos | named "my_image@2x.jpg". |
1878 | 9c2edbf1 | Olga Brani | |
1879 | 0019cd7d | Christos Stavrakakis | In case that you don’t want to use a high-resolution image, the |
1880 | 08ad5b01 | Constantinos Venetsanopoulos | normal-resolution image will be visible. |
1881 | 9c2edbf1 | Olga Brani | |
1882 | 08ad5b01 | Constantinos Venetsanopoulos | More branding |
1883 | 08ad5b01 | Constantinos Venetsanopoulos | ~~~~~~~~~~~~~ |
1884 | 9c2edbf1 | Olga Brani | |
1885 | 08ad5b01 | Constantinos Venetsanopoulos | Although, it is not 100% branding-related, further verbal customization is |
1886 | 0019cd7d | Christos Stavrakakis | feasible. |
1887 | 9c2edbf1 | Olga Brani | |
1888 | 9c2edbf1 | Olga Brani | **EMAILS** |
1889 | 9c2edbf1 | Olga Brani | |
1890 | 77186edf | Kostas Papadimitriou | The output of all email `*`.txt files will be already customized to contain your |
1891 | 77186edf | Kostas Papadimitriou | company and service names but you can further alter their content if you feel it |
1892 | 0019cd7d | Christos Stavrakakis | best fits your needs as simple as creasynnefo template. |
1893 | 017b7d20 | Olga Brani | |
1894 | 0019cd7d | Christos Stavrakakis | In order to overwrite one or more email-templates you need to place your |
1895 | 77186edf | Kostas Papadimitriou | modified <email-file>.txt files respecting the following structure: |
1896 | 0019cd7d | Christos Stavrakakis | |
1897 | 77186edf | Kostas Papadimitriou | **/etc/synnefo/templates/** |
1898 | 77186edf | Kostas Papadimitriou | **im/** |
1899 | 017b7d20 | Olga Brani | | activation_email.txt |
1900 | 017b7d20 | Olga Brani | | email.txt |
1901 | 017b7d20 | Olga Brani | | invitation.txt |
1902 | 017b7d20 | Olga Brani | | switch_accounts_email.txt |
1903 | 017b7d20 | Olga Brani | | welcome_email.txt |
1904 | 77186edf | Kostas Papadimitriou | **projects/** |
1905 | 017b7d20 | Olga Brani | | project_approval_notification.txt |
1906 | 0019cd7d | Christos Stavrakakis | | project_denial_notification.txt |
1907 | 017b7d20 | Olga Brani | | project_membership_change_notification.txt |
1908 | 017b7d20 | Olga Brani | | project_membership_enroll_notification.txt |
1909 | 017b7d20 | Olga Brani | | project_membership_leave_request_notification.txt |
1910 | 017b7d20 | Olga Brani | | project_membership_request_notification.txt |
1911 | 017b7d20 | Olga Brani | | project_suspension_notification.txt |
1912 | 017b7d20 | Olga Brani | | project_termination_notification.txt |
1913 | 77186edf | Kostas Papadimitriou | **registration/** |
1914 | 017b7d20 | Olga Brani | | email_change_email.txt |
1915 | 017b7d20 | Olga Brani | | password_email.txt |
1916 | 017b7d20 | Olga Brani | |
1917 | 017b7d20 | Olga Brani | Feel free to omit any of the above files you do not wish to overwrite. |
1918 | 017b7d20 | Olga Brani | |
1919 | 0019cd7d | Christos Stavrakakis | Below is a list of all emails sent by Synnefo to users along with a short |
1920 | 9c2edbf1 | Olga Brani | description and a link to their content: |
1921 | 9c2edbf1 | Olga Brani | |
1922 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/email.txt`` |
1923 | 08ad5b01 | Constantinos Venetsanopoulos | Base email template. Contains a contact email and a “thank you” message. |
1924 | 08ad5b01 | Constantinos Venetsanopoulos | (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/email.txt>`_) |
1925 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/activation_email.txt`` Email sent to |
1926 | 08ad5b01 | Constantinos Venetsanopoulos | user that prompts him/her to click on a link provided to activate the account. |
1927 | 08ad5b01 | Constantinos Venetsanopoulos | Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/activation_email.txt>`_) |
1928 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/invitation.txt`` Email sent to an |
1929 | 08ad5b01 | Constantinos Venetsanopoulos | invited user. He/she has to click on a link provided to activate the account. |
1930 | 08ad5b01 | Constantinos Venetsanopoulos | Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/invitation.txt>`_) |
1931 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/switch_accounts_email.txt`` Email |
1932 | 08ad5b01 | Constantinos Venetsanopoulos | sent to user upon his/her request to associate this email address with a |
1933 | 08ad5b01 | Constantinos Venetsanopoulos | shibboleth account. He/she has to click on a link provided to activate the |
1934 | 08ad5b01 | Constantinos Venetsanopoulos | association. Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/switch_accounts_email.txt>`_) |
1935 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/welcome_email.txt`` Email sent to |
1936 | 08ad5b01 | Constantinos Venetsanopoulos | inform the user that his/ her account has been activated. Extends “email.txt” |
1937 | 08ad5b01 | Constantinos Venetsanopoulos | (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/welcome_email.txt>`_) |
1938 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/registration/email_change_email.txt`` |
1939 | 08ad5b01 | Constantinos Venetsanopoulos | Email sent to user when he/she has requested new email address assignment. The |
1940 | 08ad5b01 | Constantinos Venetsanopoulos | user has to click on a link provided to validate this action. Extends |
1941 | 08ad5b01 | Constantinos Venetsanopoulos | “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/registration/email_change_email.txt>`_) |
1942 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/registration/password_email.txt`` Email |
1943 | 08ad5b01 | Constantinos Venetsanopoulos | sent for resetting password purpose. The user has to click on a link provided |
1944 | 08ad5b01 | Constantinos Venetsanopoulos | to validate this action. Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/registration/password_email.txt>`_) |
1945 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/projects/project_approval_notification.txt`` |
1946 | 08ad5b01 | Constantinos Venetsanopoulos | Informs the project owner that his/her project has been approved. Extends |
1947 | 08ad5b01 | Constantinos Venetsanopoulos | “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/projects/project_approval_notification.txt>`_) |
1948 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/projects/project_denial_notification.txt`` |
1949 | 08ad5b01 | Constantinos Venetsanopoulos | Informs the project owner that his/her project application has been denied |
1950 | 08ad5b01 | Constantinos Venetsanopoulos | explaining the reasons. Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/projects/project_denial_notification.txt>`_) |
1951 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/projects/project_membership_change_notification.txt`` |
1952 | 08ad5b01 | Constantinos Venetsanopoulos | An email is sent to a user containing information about his project membership |
1953 | 08ad5b01 | Constantinos Venetsanopoulos | (whether he has been accepted, rejected or removed). Extends “email.txt” (`Link |
1954 | 08ad5b01 | Constantinos Venetsanopoulos | <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/projects/project_membership_change_notification.txt>`_) |
1955 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/projects/project_membership_enroll_notification.txt`` |
1956 | 08ad5b01 | Constantinos Venetsanopoulos | Informs a user that he/she has been enrolled to a project. Extends |
1957 | 08ad5b01 | Constantinos Venetsanopoulos | “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/projects/project_membership_enroll_notification.txt>`_) |
1958 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/projects/project_membership_leave_request_notification.txt`` |
1959 | 08ad5b01 | Constantinos Venetsanopoulos | An email is sent to the project owner to make him aware of a user having |
1960 | 08ad5b01 | Constantinos Venetsanopoulos | requested to leave his project. Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/projects/project_membership_leave_request_notification.txt>`_) |
1961 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/projects/project_membership_request_notification.txt`` |
1962 | 08ad5b01 | Constantinos Venetsanopoulos | An email is sent to the project owner to make him/her aware of a user having |
1963 | 08ad5b01 | Constantinos Venetsanopoulos | requested to join his project. Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/projects/project_membership_request_notification.txt>`_) |
1964 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/projects/project_suspension_notification.txt`` |
1965 | 08ad5b01 | Constantinos Venetsanopoulos | An email is sent to the project owner to make him/her aware of his/her project |
1966 | 08ad5b01 | Constantinos Venetsanopoulos | having been suspended. Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/projects/project_suspension_notification.txt>`_) |
1967 | 08ad5b01 | Constantinos Venetsanopoulos | * ``snf-astakos-app/astakos/im/templates/im/projects/project_termination_notification.txt`` |
1968 | 08ad5b01 | Constantinos Venetsanopoulos | An email is sent to the project owner to make him/her aware of his/her project |
1969 | 08ad5b01 | Constantinos Venetsanopoulos | having been terminated. Extends “email.txt” (`Link <https://code.grnet.gr/projects/synnefo/repository/revisions/master/changes/snf-astakos-app/astakos/im/templates/im/projects/project_termination_notification.txt>`_) |
1970 | 9c2edbf1 | Olga Brani | |
1971 | 9c2edbf1 | Olga Brani | .. warning:: Django templates language: |
1972 | 9c2edbf1 | Olga Brani | |
1973 | 0019cd7d | Christos Stavrakakis | If you choose to overwrite these email templates, be mindful of the necessary |
1974 | 0019cd7d | Christos Stavrakakis | information contained in django template variables that must not be omitted, |
1975 | 0019cd7d | Christos Stavrakakis | such as the activation link for activating one’s account and many more. |
1976 | 263cb456 | Olga Brani | These variables are contained into {{}} inside the templates. |
1977 | 9c2edbf1 | Olga Brani | |
1978 | 9c2edbf1 | Olga Brani | |
1979 | 9b659162 | Christos Stavrakakis | .. RabbitMQ |
1980 | a1c707c9 | Constantinos Venetsanopoulos | |
1981 | 9b659162 | Christos Stavrakakis | RabbitMQ Broker |
1982 | 9b659162 | Christos Stavrakakis | --------------- |
1983 | 9b659162 | Christos Stavrakakis | |
1984 | 9b659162 | Christos Stavrakakis | Queue nodes run the RabbitMQ sofware, which provides AMQP functionality. To |
1985 | 9b659162 | Christos Stavrakakis | guarantee high-availability, more than one Queue nodes should be deployed, each |
1986 | 9b659162 | Christos Stavrakakis | of them belonging to the same `RabbitMQ cluster |
1987 | a1c707c9 | Constantinos Venetsanopoulos | <http://www.rabbitmq.com/clustering.html>`_. Synnefo uses the RabbitMQ |
1988 | a1c707c9 | Constantinos Venetsanopoulos | active/active `High Available Queues <http://www.rabbitmq.com/ha.html>`_ which |
1989 | a1c707c9 | Constantinos Venetsanopoulos | are mirrored between two nodes within a RabbitMQ cluster. |
1990 | a1c707c9 | Constantinos Venetsanopoulos | |
1991 | a1c707c9 | Constantinos Venetsanopoulos | The RabbitMQ nodes that form the cluster, are declared to Synnefo through the |
1992 | a1c707c9 | Constantinos Venetsanopoulos | `AMQP_HOSTS` setting. Each time a Synnefo component needs to connect to |
1993 | a1c707c9 | Constantinos Venetsanopoulos | RabbitMQ, one of these nodes is chosen in a random way. The client that Synnefo |
1994 | a1c707c9 | Constantinos Venetsanopoulos | uses to connect to RabbitMQ, handles connection failures transparently and |
1995 | a1c707c9 | Constantinos Venetsanopoulos | tries to reconnect to a different node. As long as one of these nodes are up |
1996 | a1c707c9 | Constantinos Venetsanopoulos | and running, functionality of Synnefo should not be downgraded by the RabbitMQ |
1997 | a1c707c9 | Constantinos Venetsanopoulos | node failures. |
1998 | 9b659162 | Christos Stavrakakis | |
1999 | 9b659162 | Christos Stavrakakis | All the queues that are being used are declared as durable, meaning that |
2000 | a1c707c9 | Constantinos Venetsanopoulos | messages are persistently stored to RabbitMQ, until they get successfully |
2001 | a1c707c9 | Constantinos Venetsanopoulos | processed by a client. |
2002 | 9b659162 | Christos Stavrakakis | |
2003 | 9b659162 | Christos Stavrakakis | Currently, RabbitMQ is used by the following components: |
2004 | 9b659162 | Christos Stavrakakis | |
2005 | 5135245b | Christos Stavrakakis | * `snf-ganeti-eventd` and `snf-progress-monitor`: |
2006 | 9b659162 | Christos Stavrakakis | These components send messages concerning the status and progress of |
2007 | 9b659162 | Christos Stavrakakis | jobs in the Ganeti backend. |
2008 | a1c707c9 | Constantinos Venetsanopoulos | * `snf-dispatcher`: This daemon, consumes the messages that are sent from |
2009 | a1c707c9 | Constantinos Venetsanopoulos | the above components, and updates the Cyclades DB accordingly. |
2010 | 9b659162 | Christos Stavrakakis | |
2011 | e4404297 | Christos Stavrakakis | |
2012 | 9b659162 | Christos Stavrakakis | Installation |
2013 | 301294a9 | Constantinos Venetsanopoulos | ~~~~~~~~~~~~ |
2014 | 301294a9 | Constantinos Venetsanopoulos | |
2015 | a1c707c9 | Constantinos Venetsanopoulos | Please check the RabbitMQ documentation which covers extensively the |
2016 | a1c707c9 | Constantinos Venetsanopoulos | `installation of RabbitMQ server <http://www.rabbitmq.com/download.html>`_ and |
2017 | a1c707c9 | Constantinos Venetsanopoulos | the setup of a `RabbitMQ cluster <http://www.rabbitmq.com/clustering.html>`_. |
2018 | a1c707c9 | Constantinos Venetsanopoulos | Also, check out the `web management plugin |
2019 | a1c707c9 | Constantinos Venetsanopoulos | <http://www.rabbitmq.com/management.html>`_ that can be useful for managing and |
2020 | a1c707c9 | Constantinos Venetsanopoulos | monitoring RabbitMQ. |
2021 | 9b659162 | Christos Stavrakakis | |
2022 | 9b659162 | Christos Stavrakakis | For a basic installation of RabbitMQ on two nodes (node1 and node2) you can do |
2023 | a1c707c9 | Constantinos Venetsanopoulos | the following: |
2024 | 9b659162 | Christos Stavrakakis | |
2025 | a1c707c9 | Constantinos Venetsanopoulos | On both nodes, install rabbitmq-server and create a Synnefo user: |
2026 | 9b659162 | Christos Stavrakakis | |
2027 | 9b659162 | Christos Stavrakakis | .. code-block:: console |
2028 | 9b659162 | Christos Stavrakakis | |
2029 | 9b659162 | Christos Stavrakakis | $ apt-get install rabbitmq-server |
2030 | 9b659162 | Christos Stavrakakis | $ rabbitmqctl add_user synnefo "example_pass" |
2031 | 9b659162 | Christos Stavrakakis | $ rabbitmqctl set_permissions synnefo ".*" ".*" ".*" |
2032 | 9b659162 | Christos Stavrakakis | |
2033 | a1c707c9 | Constantinos Venetsanopoulos | Also guarantee that both nodes share the same cookie, by running: |
2034 | 9b659162 | Christos Stavrakakis | |
2035 | 9b659162 | Christos Stavrakakis | .. code-block:: console |
2036 | 9b659162 | Christos Stavrakakis | |
2037 | 9b659162 | Christos Stavrakakis | $ scp node1:/var/lib/rabbitmq/.erlang.cookie node2:/var/lib/rabbitmq/.erlang.cookie |
2038 | 9b659162 | Christos Stavrakakis | |
2039 | 9b659162 | Christos Stavrakakis | and restart the nodes: |
2040 | 9b659162 | Christos Stavrakakis | |
2041 | 9b659162 | Christos Stavrakakis | .. code-block:: console |
2042 | 9b659162 | Christos Stavrakakis | |
2043 | 9b659162 | Christos Stavrakakis | $ /etc/init.d/rabbitmq-server restart |
2044 | 9b659162 | Christos Stavrakakis | |
2045 | 9b659162 | Christos Stavrakakis | |
2046 | 9b659162 | Christos Stavrakakis | To setup the RabbitMQ cluster run: |
2047 | 9b659162 | Christos Stavrakakis | |
2048 | 9b659162 | Christos Stavrakakis | .. code-block:: console |
2049 | 9b659162 | Christos Stavrakakis | |
2050 | 9b659162 | Christos Stavrakakis | root@node2: rabbitmqctl stop_app |
2051 | 9b659162 | Christos Stavrakakis | root@node2: rabbitmqctl reset |
2052 | 9b659162 | Christos Stavrakakis | root@node2: rabbitmqctl cluster rabbit@node1 rabbit@node2 |
2053 | 9b659162 | Christos Stavrakakis | root@node2: rabbitmqctl start_app |
2054 | 9b659162 | Christos Stavrakakis | |
2055 | 9b659162 | Christos Stavrakakis | You can verify that the cluster is set up correctly by running: |
2056 | 9b659162 | Christos Stavrakakis | |
2057 | 9b659162 | Christos Stavrakakis | .. code-block:: console |
2058 | 9b659162 | Christos Stavrakakis | |
2059 | 9b659162 | Christos Stavrakakis | root@node2: rabbitmqctl cluster_status |
2060 | 9b659162 | Christos Stavrakakis | |
2061 | 9b659162 | Christos Stavrakakis | |
2062 | bc055d09 | Constantinos Venetsanopoulos | Logging |
2063 | bc055d09 | Constantinos Venetsanopoulos | ------- |
2064 | bc055d09 | Constantinos Venetsanopoulos | |
2065 | bc055d09 | Constantinos Venetsanopoulos | Logging in Synnefo is using Python's logging module. The module is configured |
2066 | bc055d09 | Constantinos Venetsanopoulos | using dictionary configuration, whose format is described here: |
2067 | bc055d09 | Constantinos Venetsanopoulos | |
2068 | bc055d09 | Constantinos Venetsanopoulos | http://docs.python.org/release/2.7.1/library/logging.html#logging-config-dictschema |
2069 | bc055d09 | Constantinos Venetsanopoulos | |
2070 | 4be65f1f | Christos Stavrakakis | The logging configuration dictionary is defined in |
2071 | a1c707c9 | Constantinos Venetsanopoulos | ``/etc/synnefo/10-snf-webproject-logging.conf`` |
2072 | bc055d09 | Constantinos Venetsanopoulos | |
2073 | 6d8a47d0 | Christos Stavrakakis | The administrator can have logging control by modifying the ``LOGGING_SETUP`` |
2074 | 6d8a47d0 | Christos Stavrakakis | dictionary, and defining subloggers with different handlers and log levels. |
2075 | bc055d09 | Constantinos Venetsanopoulos | |
2076 | d189d11c | Constantinos Venetsanopoulos | |
2077 | 21d3d487 | Constantinos Venetsanopoulos | .. _scale-up: |
2078 | 21d3d487 | Constantinos Venetsanopoulos | |
2079 | bc055d09 | Constantinos Venetsanopoulos | Scaling up to multiple nodes |
2080 | bc055d09 | Constantinos Venetsanopoulos | ============================ |
2081 | bc055d09 | Constantinos Venetsanopoulos | |
2082 | 301294a9 | Constantinos Venetsanopoulos | Here we will describe how should a large scale Synnefo deployment look like. Make |
2083 | 301294a9 | Constantinos Venetsanopoulos | sure you are familiar with Synnefo and Ganeti before proceeding with this section. |
2084 | 301294a9 | Constantinos Venetsanopoulos | This means you should at least have already set up successfully a working Synnefo |
2085 | ff6ba888 | Constantinos Venetsanopoulos | deployment as described in the :ref:`Admin's Installation Guide |
2086 | 301294a9 | Constantinos Venetsanopoulos | <quick-install-admin-guide>` and also read the Administrator's Guide until this |
2087 | 301294a9 | Constantinos Venetsanopoulos | section. |
2088 | 2f6143c9 | Constantinos Venetsanopoulos | |
2089 | 301294a9 | Constantinos Venetsanopoulos | Graph of a scale-out Synnefo deployment |
2090 | 301294a9 | Constantinos Venetsanopoulos | --------------------------------------- |
2091 | 2f6143c9 | Constantinos Venetsanopoulos | |
2092 | 301294a9 | Constantinos Venetsanopoulos | Each box in the following graph corresponds to a distinct physical node: |
2093 | 2f6143c9 | Constantinos Venetsanopoulos | |
2094 | 301294a9 | Constantinos Venetsanopoulos | .. image:: images/synnefo-arch2-roles.png |
2095 | 301294a9 | Constantinos Venetsanopoulos | :width: 100% |
2096 | 301294a9 | Constantinos Venetsanopoulos | :target: _images/synnefo-arch2-roles.png |
2097 | 301294a9 | Constantinos Venetsanopoulos | |
2098 | 301294a9 | Constantinos Venetsanopoulos | The above graph is actually the same with the one at the beginning of this |
2099 | 301294a9 | Constantinos Venetsanopoulos | :ref:`guide <admin-guide>`, with the only difference that here we show the |
2100 | 301294a9 | Constantinos Venetsanopoulos | Synnefo roles of each physical node. These roles are described in the |
2101 | 301294a9 | Constantinos Venetsanopoulos | following section. |
2102 | 301294a9 | Constantinos Venetsanopoulos | |
2103 | 21d3d487 | Constantinos Venetsanopoulos | .. _physical-node-roles: |
2104 | 21d3d487 | Constantinos Venetsanopoulos | |
2105 | 301294a9 | Constantinos Venetsanopoulos | Physical Node roles |
2106 | 301294a9 | Constantinos Venetsanopoulos | ------------------- |
2107 | 301294a9 | Constantinos Venetsanopoulos | |
2108 | 301294a9 | Constantinos Venetsanopoulos | As appears in the previous graph, a scale-out Synnefo deployment consists of |
2109 | 301294a9 | Constantinos Venetsanopoulos | multiple physical nodes that have the following roles: |
2110 | 301294a9 | Constantinos Venetsanopoulos | |
2111 | 301294a9 | Constantinos Venetsanopoulos | * **WEBSERVER**: A web server running in front of gunicorn (e.g.: Apache, nginx) |
2112 | 301294a9 | Constantinos Venetsanopoulos | * **ASTAKOS**: The Astakos application (gunicorn) |
2113 | 301294a9 | Constantinos Venetsanopoulos | * **ASTAKOS_DB**: The Astakos database (postgresql) |
2114 | 301294a9 | Constantinos Venetsanopoulos | * **PITHOS**: The Pithos application (gunicorn) |
2115 | 301294a9 | Constantinos Venetsanopoulos | * **PITHOS_DB**: The Pithos database (postgresql) |
2116 | 301294a9 | Constantinos Venetsanopoulos | * **CYCLADES**: The Cyclades application (gunicorn) |
2117 | 301294a9 | Constantinos Venetsanopoulos | * **CYCLADES_DB**: The Cyclades database (postgresql) |
2118 | 301294a9 | Constantinos Venetsanopoulos | * **MQ**: The message queue (RabbitMQ) |
2119 | 301294a9 | Constantinos Venetsanopoulos | * **GANETI_MASTER**: The Ganeti master of a Ganeti cluster |
2120 | 301294a9 | Constantinos Venetsanopoulos | * **GANETI_NODE** : A VM-capable Ganeti node of a Ganeti cluster |
2121 | 2f6143c9 | Constantinos Venetsanopoulos | |
2122 | 301294a9 | Constantinos Venetsanopoulos | You will probably also have: |
2123 | 2f6143c9 | Constantinos Venetsanopoulos | |
2124 | 301294a9 | Constantinos Venetsanopoulos | * **CMS**: The CMS used as a frotend portal for the Synnefo services |
2125 | 21d3d487 | Constantinos Venetsanopoulos | * **NS**: A nameserver serving all other Synnefo nodes and resolving Synnefo FQDNs |
2126 | 301294a9 | Constantinos Venetsanopoulos | * **CLIENT**: A machine that runs the Synnefo clients (e.g.: kamaki, Web UI), |
2127 | 301294a9 | Constantinos Venetsanopoulos | most of the times, the end user's local machine |
2128 | 301294a9 | Constantinos Venetsanopoulos | |
2129 | 301294a9 | Constantinos Venetsanopoulos | From this point we will also refer to the following groups of roles: |
2130 | 301294a9 | Constantinos Venetsanopoulos | |
2131 | 301294a9 | Constantinos Venetsanopoulos | * **SYNNEFO**: [ **ASTAKOS**, **ASTAKOS_DB**, **PITHOS**, **PITHOS_DB**, **CYCLADES**, **CYCLADES_DB**, **MQ**, **CMS**] |
2132 | 301294a9 | Constantinos Venetsanopoulos | * **G_BACKEND**: [**GANETI_MASTER**, **GANETI_NODE**] |
2133 | 301294a9 | Constantinos Venetsanopoulos | |
2134 | 301294a9 | Constantinos Venetsanopoulos | Of course, when deploying Synnefo you can combine multiple of the above roles on a |
2135 | 301294a9 | Constantinos Venetsanopoulos | single physical node, but if you are trying to scale out, the above separation |
2136 | 301294a9 | Constantinos Venetsanopoulos | gives you significant advantages. |
2137 | 301294a9 | Constantinos Venetsanopoulos | |
2138 | 301294a9 | Constantinos Venetsanopoulos | So, in the next section we will take a look on what components you will have to |
2139 | 301294a9 | Constantinos Venetsanopoulos | install on each physical node depending on its Synnefo role. We assume the graph's |
2140 | 301294a9 | Constantinos Venetsanopoulos | architecture. |
2141 | 301294a9 | Constantinos Venetsanopoulos | |
2142 | 301294a9 | Constantinos Venetsanopoulos | Components for each role |
2143 | 301294a9 | Constantinos Venetsanopoulos | ------------------------ |
2144 | 2f6143c9 | Constantinos Venetsanopoulos | |
2145 | 301294a9 | Constantinos Venetsanopoulos | When deploying Synnefo in large scale, you need to install different Synnefo |
2146 | 301294a9 | Constantinos Venetsanopoulos | or/and third party components on different physical nodes according to their |
2147 | 301294a9 | Constantinos Venetsanopoulos | Synnefo role, as stated in the previous section. |
2148 | 301294a9 | Constantinos Venetsanopoulos | |
2149 | 301294a9 | Constantinos Venetsanopoulos | Specifically: |
2150 | 301294a9 | Constantinos Venetsanopoulos | |
2151 | 301294a9 | Constantinos Venetsanopoulos | Role **WEBSERVER** |
2152 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `None` |
2153 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: Apache |
2154 | 301294a9 | Constantinos Venetsanopoulos | Role **ASTAKOS** |
2155 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `snf-webproject`, `snf-astakos-app` |
2156 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: Django, Gunicorn |
2157 | 301294a9 | Constantinos Venetsanopoulos | Role **ASTAKOS_DB** |
2158 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `None` |
2159 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: PostgreSQL |
2160 | 301294a9 | Constantinos Venetsanopoulos | Role **PITHOS** |
2161 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `snf-webproject`, `snf-pithos-app`, `snf-pithos-webclient` |
2162 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: Django, Gunicorn |
2163 | 301294a9 | Constantinos Venetsanopoulos | Role **PITHOS_DB** |
2164 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `None` |
2165 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: PostgreSQL |
2166 | 301294a9 | Constantinos Venetsanopoulos | Role **CYCLADES** |
2167 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `snf-webproject`, `snf-cyclades-app`, `snf-vncauthproxy` |
2168 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: Django Gunicorn |
2169 | 301294a9 | Constantinos Venetsanopoulos | Role **CYCLADES_DB** |
2170 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `None` |
2171 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: PostgreSQL |
2172 | 301294a9 | Constantinos Venetsanopoulos | Role **MQ** |
2173 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `None` |
2174 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: RabbitMQ |
2175 | 301294a9 | Constantinos Venetsanopoulos | Role **GANETI_MASTER** |
2176 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `snf-cyclades-gtools` |
2177 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: Ganeti |
2178 | 301294a9 | Constantinos Venetsanopoulos | Role **GANETI_NODE** |
2179 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `snf-cyclades-gtools`, `snf-network`, `snf-image`, `nfdhcpd` |
2180 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: Ganeti |
2181 | 301294a9 | Constantinos Venetsanopoulos | Role **CMS** |
2182 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `snf-webproject`, `snf-cloudcms` |
2183 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: Django, Gunicorn |
2184 | 301294a9 | Constantinos Venetsanopoulos | Role **NS** |
2185 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `None` |
2186 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: BIND |
2187 | 301294a9 | Constantinos Venetsanopoulos | Role **CLIENT** |
2188 | 301294a9 | Constantinos Venetsanopoulos | * Synnefo components: `kamaki`, `snf-image-creator` |
2189 | 301294a9 | Constantinos Venetsanopoulos | * 3rd party components: `None` |
2190 | 301294a9 | Constantinos Venetsanopoulos | |
2191 | 301294a9 | Constantinos Venetsanopoulos | Example scale out installation |
2192 | 301294a9 | Constantinos Venetsanopoulos | ------------------------------ |
2193 | 301294a9 | Constantinos Venetsanopoulos | |
2194 | 301294a9 | Constantinos Venetsanopoulos | In this section we describe an example of a medium scale installation which |
2195 | 301294a9 | Constantinos Venetsanopoulos | combines multiple roles on 10 different physical nodes. We also provide a |
2196 | 301294a9 | Constantinos Venetsanopoulos | :ref:`guide <i-synnefo>` to help with such an install. |
2197 | 301294a9 | Constantinos Venetsanopoulos | |
2198 | 301294a9 | Constantinos Venetsanopoulos | We assume that we have the following 10 physical nodes with the corresponding |
2199 | 301294a9 | Constantinos Venetsanopoulos | roles: |
2200 | 301294a9 | Constantinos Venetsanopoulos | |
2201 | 301294a9 | Constantinos Venetsanopoulos | Node1: |
2202 | 301294a9 | Constantinos Venetsanopoulos | **WEBSERVER**, **ASTAKOS** |
2203 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2204 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apt <i-apt>` |
2205 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`gunicorn <i-gunicorn>` |
2206 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apache <i-apache>` |
2207 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-webproject <i-webproject>` |
2208 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-astakos-app <i-astakos>` |
2209 | 301294a9 | Constantinos Venetsanopoulos | Node2: |
2210 | 301294a9 | Constantinos Venetsanopoulos | **WEBSERVER**, **PITHOS** |
2211 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2212 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apt <i-apt>` |
2213 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`gunicorn <i-gunicorn>` |
2214 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apache <i-apache>` |
2215 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-webproject <i-webproject>` |
2216 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-pithos-app <i-pithos>` |
2217 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-pithos-webclient <i-pithos>` |
2218 | 301294a9 | Constantinos Venetsanopoulos | Node3: |
2219 | 301294a9 | Constantinos Venetsanopoulos | **WEBSERVER**, **CYCLADES** |
2220 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2221 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apt <i-apt>` |
2222 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`gunicorn <i-gunicorn>` |
2223 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apache <i-apache>` |
2224 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-webproject <i-webproject>` |
2225 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-cyclades-app <i-cyclades>` |
2226 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-vncauthproxy <i-cyclades>` |
2227 | 301294a9 | Constantinos Venetsanopoulos | Node4: |
2228 | 301294a9 | Constantinos Venetsanopoulos | **WEBSERVER**, **CMS** |
2229 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2230 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apt <i-apt>` |
2231 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`gunicorn <i-gunicorn>` |
2232 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apache <i-apache>` |
2233 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-webproject <i-webproject>` |
2234 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-cloudcms <i-cms>` |
2235 | 301294a9 | Constantinos Venetsanopoulos | Node5: |
2236 | 301294a9 | Constantinos Venetsanopoulos | **ASTAKOS_DB**, **PITHOS_DB**, **CYCLADES_DB** |
2237 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2238 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apt <i-apt>` |
2239 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`postgresql <i-db>` |
2240 | 301294a9 | Constantinos Venetsanopoulos | Node6: |
2241 | 301294a9 | Constantinos Venetsanopoulos | **MQ** |
2242 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2243 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apt <i-apt>` |
2244 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`rabbitmq <i-mq>` |
2245 | 301294a9 | Constantinos Venetsanopoulos | Node7: |
2246 | 301294a9 | Constantinos Venetsanopoulos | **GANETI_MASTER**, **GANETI_NODE** |
2247 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2248 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apt <i-apt>` |
2249 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`general <i-backends>` |
2250 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`ganeti <i-ganeti>` |
2251 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-cyclades-gtools <i-gtools>` |
2252 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-network <i-network>` |
2253 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-image <i-image>` |
2254 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`nfdhcpd <i-network>` |
2255 | 301294a9 | Constantinos Venetsanopoulos | Node8: |
2256 | 301294a9 | Constantinos Venetsanopoulos | **GANETI_NODE** |
2257 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2258 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`apt <i-apt>` |
2259 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`general <i-backends>` |
2260 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`ganeti <i-ganeti>` |
2261 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-cyclades-gtools <i-gtools>` |
2262 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-network <i-network>` |
2263 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`snf-image <i-image>` |
2264 | 301294a9 | Constantinos Venetsanopoulos | * :ref:`nfdhcpd <i-network>` |
2265 | 301294a9 | Constantinos Venetsanopoulos | Node9: |
2266 | 301294a9 | Constantinos Venetsanopoulos | **GANETI_NODE** |
2267 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2268 | 301294a9 | Constantinos Venetsanopoulos | `Same as Node8` |
2269 | 301294a9 | Constantinos Venetsanopoulos | Node10: |
2270 | 301294a9 | Constantinos Venetsanopoulos | **GANETI_NODE** |
2271 | 301294a9 | Constantinos Venetsanopoulos | Guide sections: |
2272 | 301294a9 | Constantinos Venetsanopoulos | `Same as Node8` |
2273 | 301294a9 | Constantinos Venetsanopoulos | |
2274 | 301294a9 | Constantinos Venetsanopoulos | All sections: :ref:`Scale out Guide <i-synnefo>` |
2275 | 547c78f6 | Constantinos Venetsanopoulos | |
2276 | bc055d09 | Constantinos Venetsanopoulos | |
2277 | bbcd3dd1 | Constantinos Venetsanopoulos | Upgrade Notes |
2278 | bbcd3dd1 | Constantinos Venetsanopoulos | ============= |
2279 | bc055d09 | Constantinos Venetsanopoulos | |
2280 | 457fe4fc | Georgios D. Tsoukalas | .. toctree:: |
2281 | 457fe4fc | Georgios D. Tsoukalas | :maxdepth: 1 |
2282 | 457fe4fc | Georgios D. Tsoukalas | |
2283 | 1cd3daa1 | Constantinos Venetsanopoulos | v0.12 -> v0.13 <upgrade/upgrade-0.13> |
2284 | 09974606 | Georgios D. Tsoukalas | v0.13 -> v0.14 <upgrade/upgrade-0.14> |
2285 | 15151f83 | Christos Stavrakakis | v0.14 -> v0.14.2 <upgrade/upgrade-0.14.2> |
2286 | 0d14df99 | Christos Stavrakakis | v0.14.5 -> v0.14.6 <upgrade/upgrade-0.14.6> |
2287 | d3840a05 | Constantinos Venetsanopoulos | v0.14.7 -> v0.14.8 <upgrade/upgrade-0.14.8> |
2288 | 0ab857d0 | Constantinos Venetsanopoulos | v0.14.9 -> v0.14.10 <upgrade/upgrade-0.14.10> |
2289 | 774f683b | Giorgos Korfiatis | v0.14 -> v0.15 <upgrade/upgrade-0.15> |
2290 | 457fe4fc | Georgios D. Tsoukalas | |
2291 | bbcd3dd1 | Constantinos Venetsanopoulos | |
2292 | 3045e739 | Constantinos Venetsanopoulos | Changelog, NEWS |
2293 | bbcd3dd1 | Constantinos Venetsanopoulos | =============== |
2294 | bbcd3dd1 | Constantinos Venetsanopoulos | |
2295 | 15151f83 | Christos Stavrakakis | |
2296 | 9a80de55 | Christos Stavrakakis | * v0.14.10 :ref:`Changelog <Changelog-0.14.10>`, :ref:`NEWS <NEWS-0.14.10>` |
2297 | 033321fb | Christos Stavrakakis | * v0.14.9 :ref:`Changelog <Changelog-0.14.9>`, :ref:`NEWS <NEWS-0.14.9>` |
2298 | 833880fd | Christos Stavrakakis | * v0.14.8 :ref:`Changelog <Changelog-0.14.8>`, :ref:`NEWS <NEWS-0.14.8>` |
2299 | 833880fd | Christos Stavrakakis | * v0.14.7 :ref:`Changelog <Changelog-0.14.7>`, :ref:`NEWS <NEWS-0.14.7>` |
2300 | 7a59cb8f | Christos Stavrakakis | * v0.14.6 :ref:`Changelog <Changelog-0.14.6>`, :ref:`NEWS <NEWS-0.14.6>` |
2301 | d6a19bac | Christos Stavrakakis | * v0.14.5 :ref:`Changelog <Changelog-0.14.5>`, :ref:`NEWS <NEWS-0.14.5>` |
2302 | 38be3b6e | Christos Stavrakakis | * v0.14.4 :ref:`Changelog <Changelog-0.14.4>`, :ref:`NEWS <NEWS-0.14.4>` |
2303 | cda13b21 | Christos Stavrakakis | * v0.14.3 :ref:`Changelog <Changelog-0.14.3>`, :ref:`NEWS <NEWS-0.14.3>` |
2304 | 15151f83 | Christos Stavrakakis | * v0.14.2 :ref:`Changelog <Changelog-0.14.2>`, :ref:`NEWS <NEWS-0.14.2>` |
2305 | a0f672f1 | Stratos Psomadakis | * v0.14 :ref:`Changelog <Changelog-0.14>`, :ref:`NEWS <NEWS-0.14>` |
2306 | bbcd3dd1 | Constantinos Venetsanopoulos | * v0.13 :ref:`Changelog <Changelog-0.13>`, :ref:`NEWS <NEWS-0.13>` |