root / Changelog @ 381a548c
History | View | Annotate | Download (17.9 kB)
1 |
.. _Changelog: |
---|---|
2 |
|
3 |
Unified Changelog file for Synnefo versions >= 0.13 |
4 |
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
5 |
|
6 |
Since v0.13 most of the Synnefo components have been merged into a single |
7 |
repository and have aligned versions. |
8 |
|
9 |
v0.14next |
10 |
========= |
11 |
|
12 |
Released: UNRELEASED |
13 |
|
14 |
Synnefo-wide |
15 |
------------ |
16 |
|
17 |
* Integrate Pithos tests in continuous integration. |
18 |
|
19 |
* Change astakosclient to accept AUTH_URL instead of BASE_URL |
20 |
ASTAKOS_BASE_URL settings has been removed from Pithos and Cyclades |
21 |
and has been replaced with ASTAKOS_AUTH_URL. Both Pithos and Cyclades |
22 |
proxy the Astakos services under ASTAKOS_PROXY_PREFIX path. |
23 |
ASTAKOS_PROXY_PREFIX by default has a value of '_astakos'. |
24 |
More specifically, Astakos' identity service is proxied under |
25 |
'_astakos/identity', Astakos' account service is under '_astakos/account' |
26 |
and Astakos' ui service is under '_astakos/ui'. |
27 |
|
28 |
Astakos |
29 |
------- |
30 |
|
31 |
* Changes in project schema: |
32 |
|
33 |
* A Project entry is created when submitting an application for a new |
34 |
project, rather than on approval. Its state is dependent on the state |
35 |
of its `reference' application (current definition). Lock Project rather |
36 |
than Chain (the latter is semantically obsolete). |
37 |
|
38 |
* Project states "Active - Pending" and "Suspended - Pending" have been |
39 |
removed. In management command `project-list', the existence of a pending |
40 |
modification is indicated by a non-blank `Pending AppID'. |
41 |
|
42 |
* Improve recording of project, application, and membership actions. |
43 |
|
44 |
* Implement API calls for projects. |
45 |
|
46 |
* Store the base URL of a component. Deployer should provide it when adding |
47 |
a new component. Service endpoints originating from a component are |
48 |
expected to match its base URL; otherwise, a warning is issued. |
49 |
Re-registration with `snf-component-register' affects both the base and |
50 |
the ui URL. |
51 |
|
52 |
* Remove API call GET /account/v1.0/authenticate in favor of |
53 |
POST /identity/v2.0/tokens. |
54 |
|
55 |
* Management commands: |
56 |
* Introduced new commands: |
57 |
* component-show |
58 |
* Changed commands: |
59 |
* component-add got options --base-url and --ui-url |
60 |
|
61 |
Cyclades |
62 |
-------- |
63 |
|
64 |
* Implement Floating IP addresses, which are addresses that can be dynamically |
65 |
added and removed to a running server. |
66 |
|
67 |
* Implement the 'os-floating-ips' and 'os-floating-ip-pools' API extensions. |
68 |
* Implement 'snf-manage floating-ip-list' management command. |
69 |
* Add 'floating_ip_pool' attribute to networks. Such networks must exist to |
70 |
all Ganeti backends. |
71 |
|
72 |
* Speed up server reconciliation, by performing parallel reconciliation for |
73 |
each backend. |
74 |
* Implement IPv6 only networks. |
75 |
* Implement 'resize' server action. |
76 |
|
77 |
* Implement the 'resize' server action, to change the flavor of a server. |
78 |
Only 'cpu' and 'memory' resizing is supported. |
79 |
|
80 |
* Compute quotas for CPU and memory of running vms. |
81 |
* Obsolete PUBLIC_USE_POOL setting, since Cyclades manages IP pool for all |
82 |
type of networks. |
83 |
* Extend servers info API response with 'SNF:fqdn' attribute, and introduce |
84 |
CYCLADES_SERVERS_FQDN to set the template for servers FDQN. |
85 |
* Extend servers info API response with 'SNF:port_forwarding' attribute, |
86 |
describing port fowarding rules (DNAT) that are applied to vms. The |
87 |
description of such rules is done via the new CYCLADES_PORT_FORWARDING |
88 |
setting. |
89 |
* Change --dhcp option of network management commands from a flag to a boolean |
90 |
value, e.g. --dhcp=True |
91 |
* Remove 'ARCHIPELAGO_BACKENDS' setting used to distinquish between backends |
92 |
that hosted only archipelago backends. Instead allocation is based on which |
93 |
disk-templates are enabled in each backend. |
94 |
* Implement 'snf-manage server-remove' management command. |
95 |
* Move reconciliation of IP pools from 'reconcile-networks' to |
96 |
'reconcile-pools'. The IP pool reconciliation does not reconcile the IP |
97 |
pools with Ganeti. Instead it checks if the pool is consistent with the |
98 |
IPs that are used by instances. |
99 |
* Do not automatically release externally reserved IPs if they are released |
100 |
from a Ganeti backend. Management of externally reserved IPs must be |
101 |
performed from Cyclades with 'network-modify' command. |
102 |
|
103 |
Pithos |
104 |
------ |
105 |
|
106 |
* Refactor metadata schema (table attributes) in Pithos DB to speedup current |
107 |
objects by domain attribute. This is used by Plankton for listing VM images. |
108 |
|
109 |
* Enforce container-level atomicity in (most) Pithos API calls. |
110 |
|
111 |
|
112 |
.. _Changelog-0.14.7: |
113 |
|
114 |
v0.14.7 |
115 |
======= |
116 |
|
117 |
Released: Wed Sep 18 17:50:12 EEST 2013 |
118 |
|
119 |
Cyclades |
120 |
-------- |
121 |
|
122 |
* Fix bug in helpdesk view |
123 |
|
124 |
.. _Changelog-0.14.6: |
125 |
|
126 |
v0.14.6 |
127 |
======= |
128 |
|
129 |
Released: Wed Sep 18 16:18:58 EEST 2013 |
130 |
|
131 |
Pithos |
132 |
------ |
133 |
|
134 |
* Substitute the PITHOS_BACKEND_QUOTA setting with two |
135 |
distinct settings: PITHOS_BACKEND_ACCOUNT_QUOTA & |
136 |
PITHOS_BACKEND_CONTAINER_QUOTA |
137 |
* Set PITHOS_BACKEND_CONTAINER_QUOTA default value to 0 (unlimited) |
138 |
* Fix bug that resulted in DB deadlocks. |
139 |
|
140 |
Cyclades |
141 |
-------- |
142 |
|
143 |
* Fix bug in snf-dispatcher that resulted in servers to be deleted from the |
144 |
DB even if the corresponding Ganeti job failed. |
145 |
|
146 |
Branding |
147 |
-------- |
148 |
|
149 |
* Add new BRANDING_FOOTER_EXTRA_MESSAGE setting. |
150 |
|
151 |
|
152 |
.. _Changelog-0.14.5: |
153 |
|
154 |
v0.14.5 |
155 |
======= |
156 |
|
157 |
Released: Wed Aug 7 11:19:49 EEST 2013 |
158 |
|
159 |
Pithos |
160 |
------ |
161 |
|
162 |
* Fix security issue with handling Pithos versions. |
163 |
|
164 |
|
165 |
.. _Changelog-0.14.4: |
166 |
|
167 |
v0.14.4 |
168 |
======= |
169 |
|
170 |
Released: Mon Jul 29 12:24:22 EEST 2013 |
171 |
|
172 |
Pithos |
173 |
------ |
174 |
|
175 |
* Fix bug in reconcile resources management command. |
176 |
|
177 |
|
178 |
.. _Changelog-0.14.3: |
179 |
|
180 |
v0.14.3 |
181 |
======= |
182 |
|
183 |
Released: Thu Jul 25 12:22:47 EEST 2013 |
184 |
|
185 |
Synnefo-wide |
186 |
------------ |
187 |
|
188 |
* Use the SYNNEFO_TRACE environmental variable to control whether the greenlet |
189 |
tracing code will get loaded or not. |
190 |
* Split the HIDDEN_COOKIES setting in HIDDEN_HEADERS and HIDDEN_COOKIES, and |
191 |
add the MAIL_MAX_LEN setting, to limit the mail size for unhandled |
192 |
exceptions. |
193 |
|
194 |
|
195 |
.. _Changelog-0.14.2: |
196 |
|
197 |
Released: Fri Jul 12 13:13:32 EEST 2013 |
198 |
|
199 |
v0.14.2 |
200 |
======= |
201 |
|
202 |
Cyclades |
203 |
-------- |
204 |
|
205 |
* Add new setting PITHOS_BACKEND_POOL_SIZE, which configures the size |
206 |
of the pool of Pithos backends that are used by plankton. |
207 |
|
208 |
|
209 |
.. _Changelog-0.14: |
210 |
|
211 |
v0.14 |
212 |
===== |
213 |
|
214 |
Released: Tue Jun 25 14:01:19 EEST 2013 |
215 |
|
216 |
Synnefo-wide |
217 |
------------ |
218 |
|
219 |
* Create 'snf_django' Python package to hold common code for all Synnefo |
220 |
components. |
221 |
|
222 |
* Create a JSON-exportable definition document for each Synnefo Components |
223 |
(Astakos, Cyclades, Pithos, etc.) that consolidates APIs (services), |
224 |
resources, and other standardized properties (e.g. default URL prefixes). |
225 |
|
226 |
* Standardize URLs for Synnefo Components, impose structure and naming |
227 |
conventions to related settings. Make each component deployable under |
228 |
a user-configurable <COMPONENT>_BASE_URL. Each API (compute, image, etc.) |
229 |
is deployable under a developer-configurable prefix beneath BASE_URL. |
230 |
|
231 |
* Deprecate CLOUDBAR_ACTIVE_SERVICE setting from all apps. |
232 |
|
233 |
* Common synnefo 404/500 templates (located in snf-webproject) |
234 |
|
235 |
Astakos |
236 |
------- |
237 |
|
238 |
* Redesign of the accounting system (quotaholder) and integration into |
239 |
Astakos. |
240 |
|
241 |
* Simplified the quotaholder model; removed tables Entity and Policy; now |
242 |
table Holding contains limit and usage for every holding. |
243 |
* Extended table Holding, so that we can keep track of quota for every |
244 |
valid combination of holder (e.g. user), resource, and source (e.g. the |
245 |
default system or some specific project). |
246 |
* Refactored code for issuing and resolving commissions for robustness; |
247 |
added a 'force' option to bypass the upper limit check when issuing a |
248 |
commission. |
249 |
* Simplified syncing to the quotaholder; removed fields from models |
250 |
Project and ProjectMembership, previously needed for syncing; removed |
251 |
state PROJECT_DEACTIVATED from ProjectMembership. |
252 |
* Removed settings ASTAKOS_QUOTAHOLDER_URL, ASTAKOS_QUOTAHOLDER_TOKEN, |
253 |
and ASTAKOS_QUOTAHOLDER_POOLSIZE. |
254 |
|
255 |
* API-related changes: |
256 |
|
257 |
* Implemented API calls for quota, resources, and commissions. |
258 |
* Moved all API calls under '/account/v1.0'. |
259 |
* Implemented the keystone API call POST /tokens under '/identity/v2.0'. |
260 |
|
261 |
* Service and resource specification and handling: |
262 |
|
263 |
* Specified a format for defining services along with the API endpoints |
264 |
and the resources they expose. Migrated internal resource name by |
265 |
prefixing it with service name (e.g. 'vm' becomes 'cyclades.vm'); |
266 |
renamed registered service 'pithos+' to 'pithos'. |
267 |
* Specified a procedure to register a Synnefo component, its services and |
268 |
their resources in astakos and set the resources' default base quota |
269 |
limit. Removed resource definitions from settings. |
270 |
* Moved service and resource presentation data out of the respective db |
271 |
models into a separate file of UI constants. |
272 |
|
273 |
* Converted the limit on pending applications from a setting to a quotable |
274 |
resource. Converted the related user setting to a user-specific base quota |
275 |
limit. Deprecated model UserSetting; removed setting |
276 |
ASTAKOS_PENDING_APPLICATION_LIMIT. |
277 |
|
278 |
* Changes in locking strategy: |
279 |
|
280 |
* Lock only project's chain for all project operations; lock user before |
281 |
syncing to quotaholder. |
282 |
* When locking multiple rows (e.g. users or holdings) include an ORDER BY |
283 |
clause in the query to impose ordering on locking. |
284 |
|
285 |
* Changes in views: |
286 |
|
287 |
* Replaced custom transaction context with a simple decorator for managing |
288 |
transactions and a context 'ExceptionHandler', which logs and suppresses |
289 |
exceptions |
290 |
|
291 |
* Added fine grain user auth provider's policies. |
292 |
|
293 |
* Administrator can override default auth provider policies to a specific |
294 |
user or group of users. |
295 |
* Optionally a user can be assigned to a list of groups, based on the |
296 |
authentication method he choosed to signup. |
297 |
|
298 |
* Removed explicit handling of SMTP errors on each email delivery. Exceptions |
299 |
are now propagated to base django exception handler. |
300 |
|
301 |
* Email used in html/email tempaltes which prompt user to contact for service |
302 |
support prompts is now defined in ``CONTACT_EMAIL`` setting introduced in |
303 |
snf-common settings. |
304 |
|
305 |
* Improvements in user activation flow |
306 |
|
307 |
* User moderation now takes place after the user has verified his email |
308 |
address. |
309 |
* User model enriched with additional user state fields |
310 |
* Split activation email from moderation process. Administrator is required |
311 |
to moderate user explicitly using the `user-modify --accept` or |
312 |
`user-modify --reject` commands. |
313 |
* Improved logging throught out user activation procedures. |
314 |
|
315 |
* Remove deprecated AstakosUser model fields: `provider`, |
316 |
`third_party_identifier` |
317 |
|
318 |
* Allow override of authentication provider messages using the following |
319 |
format in setting names: ``ASTAKOS_<PROVIDER_MODULE>_<MSGID>_MSG`` |
320 |
|
321 |
* Cloudbar automatically tries to identify the active service based on window |
322 |
location. |
323 |
|
324 |
* Removing authentication provider view is now CSRF protected. |
325 |
|
326 |
* New `API access` view, containing useful information to users on how to |
327 |
access available Synnefo services API's. |
328 |
|
329 |
* Remove of ASTAKOS_*_EMAIL_SUBJECT settings. All email subjects are now |
330 |
defined in astakos.im.messages module. Overriding default values can be |
331 |
achieved using custom gettext files or using astakos messages settings:: |
332 |
|
333 |
#change of greeting email subject |
334 |
ASTAKOS_GREETING_EMAIL_SUBJECT_MESSAGE = 'Welcome to my cloud' |
335 |
|
336 |
* Remove ``ASTAKOS_ACTIVATION_REDIRECT_URL`` and ``ASTAKOS_LOGIN_SUCCESS_URL`` |
337 |
from astakos .conf file. Settings are dynamically computed based on |
338 |
``ASTAKOS_BASE_URL``. |
339 |
|
340 |
* Management commands: |
341 |
|
342 |
* Introduced new commands: |
343 |
* authpolicy-{add, list, remove, set, show} |
344 |
* group-{add, list} |
345 |
* component-{add, list, modify, remove} |
346 |
* reconcile-resources-astakos |
347 |
* resource-{export-astakos, import, modify} |
348 |
* service-{export-astakos, import, show} |
349 |
* Renamed commands: |
350 |
* astakos-quota to quota |
351 |
* user-update to user-modify |
352 |
* full-cleanup to cleanup-full |
353 |
* Removed commands: |
354 |
* astakos-init |
355 |
* invitation-{details, list} |
356 |
* project-sync |
357 |
* resource-{add, remove} |
358 |
* service-{add, remove, token-renew, update} |
359 |
* user-invite |
360 |
* user-set-initial-quota (integrated its functionality in user-modify and quota) |
361 |
* Added quota and project-related information in user-show command; added |
362 |
membership information in project-show. |
363 |
|
364 |
Cyclades |
365 |
-------- |
366 |
|
367 |
* Make 'type' attribute required for network create API request. |
368 |
* Networks not created to all Ganeti backends upon creation, they are instead |
369 |
created to a backend only when a VM connects to the network. |
370 |
* Add 'CYCLADES_ASTAKOSCLIENT_POOLSIZE' setting which tunes the size of the |
371 |
http connection pool to astakos. |
372 |
* Remove 'CYCLADES_USER_CATALOG_URL' and 'CYCLADES_USER_FEEDBACK_URL' settings |
373 |
* Remove CYCLADES_USE_QUOTAHOLDER, CYCLADES_QUOTAHOLDER_TOKEN, |
374 |
CYCLADES_QUOTAHOLDER_URL, CYCLADES_QUOTAHOLDER_POOLSIZE settings |
375 |
* Rename 'cyclades-usage-verify' management command to |
376 |
'reconcile-resources-cyclades'. Also, remove 'cyclades-usage-reset' command, |
377 |
which is equivalent to 'reconcile-resources-cyclades --fix'. |
378 |
* Rename 'cyclades-reconcile-commissions' management command to |
379 |
'reconcile-commissions-cyclades'. |
380 |
* Remove obsolete 'MAX_VMS_PER_USER', 'MAX_NETWORKS_PER_USER', |
381 |
"VMS_USER_QUOTA" and "NETWORKS_USER_QUOTA" settings, since their usage |
382 |
is covered by Quotaholder. |
383 |
* Remove obsolete setting 'API_ROOT_URL', since it is being covered by |
384 |
the use of CYCLADES_BASE_URL* Remove obsolete setting 'API_ROOT_URL', since |
385 |
it is being covered by 'CYCLADES_BASE_URL'. |
386 |
* Remove obsolete settings GANETI_DISK_TEMPLATES and |
387 |
DEFAULT_GANETI_DISK_TEMPLATE |
388 |
|
389 |
Cyclades helpdesk |
390 |
----------------- |
391 |
|
392 |
* Additional start/stop vm action |
393 |
* Display extend backend info in vm's view |
394 |
* Fixed IP lookup |
395 |
|
396 |
Pithos |
397 |
------ |
398 |
|
399 |
* Remove PITHOS_AUTHENTICATION_USERS setting, which was used to override |
400 |
astakos users. |
401 |
* Remove 'PITHOS_USER_CATALOG_URL', 'PITHOS_USER_FEEDBACK_URL' and |
402 |
'PITHOS_USER_LOGIN_URL' settings. |
403 |
* Remove PITHOS_USE_QUOTAHOLDER, PITHOS_QUOTAHOLDER_URL, |
404 |
PITHOS_QUOTAHOLDER_TOKEN and PITHOS_ASTAKOSCLIENT_POOLSIZE |
405 |
|
406 |
Tools |
407 |
----- |
408 |
|
409 |
|
410 |
.. _Changelog-0.13: |
411 |
|
412 |
v0.13 |
413 |
===== |
414 |
|
415 |
Released: Wed Apr 10 18:52:50 EEST 2013 |
416 |
|
417 |
In v0.13 the code was very heavily refactored for increased uniformity since |
418 |
most of the Synnefo components have been merged into a single repository. Thus, |
419 |
**just for this version** we will not document a complete Changelog (features, |
420 |
fixes, improvements, issues, setting changes), but rather just copy from the |
421 |
`NEWS` file with minor additions wherever needed. |
422 |
|
423 |
Synnefo-wide |
424 |
------------ |
425 |
|
426 |
* Support for pooling throughout Synnefo |
427 |
|
428 |
* Pooled Django DB connections, Pithos backend connections, HTTP |
429 |
connections using single `objpool` package |
430 |
|
431 |
* Improved management commands |
432 |
|
433 |
* Unified codebase for output of tables in JSON, CSV |
434 |
|
435 |
* Bring most of Synnefo code inside a single, unified repository |
436 |
|
437 |
* support automatic Python and Debian package builds for individual commits |
438 |
* with automatic version generation |
439 |
|
440 |
* Overhauling of Synnefo settings: renames and refactoring, for increased |
441 |
uniformity (in progress) |
442 |
* Deployment: Standardize on gunicorn, with gevent-based workers |
443 |
and use of Green threads throughout Synnefo |
444 |
* Documentation: New scale-out guide, with distinct node roles, |
445 |
for mass Synnefo deployments |
446 |
|
447 |
Astakos |
448 |
------- |
449 |
|
450 |
* Support multiple authentication methods |
451 |
|
452 |
* Classic (username/password), Shibboleth, LDAP/Active Directory, |
453 |
Google, Twitter, LinkedIn |
454 |
* Users can enable/disable auth methods, and switch between them |
455 |
|
456 |
* Introduce a UUID as a global identifier for users, throughout Synnefo |
457 |
|
458 |
* The UUID remains constant as the user enables/disables login methods |
459 |
|
460 |
* Allow users to modify their email address freely |
461 |
* Per-user, per-resource accounting mechanism (quotaholder) |
462 |
* Full quota support, with per-user, per-resource quotas, based on quotaholder |
463 |
* Projects: Users can create and join Projects |
464 |
|
465 |
* Projects grant extra resources to their members |
466 |
|
467 |
* UI Enhancements for quotas and projects |
468 |
|
469 |
* distinct Usage tab, showing usage of individual resources |
470 |
* Project management UI |
471 |
* New Overview page |
472 |
|
473 |
* refactored/improved /login endpoint used by desktop/mobile clients. |
474 |
* endpoint url is now exposed by `weblogin` service |
475 |
* clients should use unauthenticated identity/tokens api to resolve the |
476 |
endpoint url |
477 |
* view only allows redirects to `pithos://` scheme urls |
478 |
* removed uuid from redirect parameters. Client should use authenticated |
479 |
request to identity/tokens to retrieve user uuid. |
480 |
|
481 |
|
482 |
Cyclades |
483 |
-------- |
484 |
|
485 |
* Commission resources on quotaholder/Astakos |
486 |
* Support mass creation of flavors |
487 |
* Support for the ExtStorage disk template in Ganeti |
488 |
* Query and report quotas in the UI |
489 |
* Pass VM configuration parameters over a VM-side API (`vmapi`) |
490 |
|
491 |
* Do not pass sensitive data as Ganeti OS parameters |
492 |
* Keep sensitive data in memory caches (memcached) and |
493 |
never allow them to hit the disk |
494 |
|
495 |
* Display additional backend information in helpdesk machines list |
496 |
* Allow helpdesk users to search for an account using a known machine id |
497 |
* Helpdesk actions are now logged using the synnefo's common login |
498 |
infrastructure |
499 |
|
500 |
UI |
501 |
^^ |
502 |
* Removed feedback endpoint. Feedback requests delegate to astakos feedback |
503 |
service. ``FEEDBACK_CONTACTS``, ``FEEDBACK_EMAIL_FROM`` settings removed, |
504 |
and no longer used. |
505 |
* ``UI_LOGIN_URL``, ``UI_GLANCE_URL``, ``COMPUTE_URL`` settings no longer |
506 |
required to be set and are dynamically computed based on ``ASTAKOS_BASE_URL`` |
507 |
and ``CYCLADES_BASE_URL`` settings. |
508 |
* File group is no longer included in ssh keys personality metadata sent in |
509 |
create vm calls. |
510 |
|
511 |
|
512 |
Pithos |
513 |
------ |
514 |
|
515 |
* Support storage of blocks on a RADOS backend, for Archipelago |
516 |
|
517 |
* new settings: |
518 |
PITHOS_RADOS_STORAGE, PITHOS_RADOS_POOL_BLOCKS, PITHOS_RADOS_POOL_MAPS |
519 |
|
520 |
* X-Object-Public now contains full url (domain + proper component prefix + |
521 |
file path) |
522 |
|
523 |
* Rewritten support for public URLs, with admin-selectable length |
524 |
|
525 |
* new settings: |
526 |
PITHOS_PUBLIC_URL_SECURITY, PITHOS_PUBLIC_URL_ALPHABET |
527 |
|
528 |
* Enable pithos backend to use external quotaholder component |
529 |
|
530 |
* new settings: |
531 |
PITHOS_USE_QUOTAHOLDER, PITHOS_QUOTAHOLDER_URL, PITHOS_QUOTAHOLDER_TOKEN, |
532 |
PITHOS_QUOTAHOLDER_POOLSIZE |
533 |
|
534 |
* Moderated version debiting mechanism |
535 |
|
536 |
* new setting: |
537 |
PITHOS_BACKEND_FREE_VERSIONING |
538 |
|
539 |
* Proxy Astakos user-visible services |
540 |
|
541 |
* new settings: |
542 |
PITHOS_PROXY_USER_SERVICES, PITHOS_USER_CATALOG_URL, |
543 |
PITHOS_USER_FEEDBACK_URL, PITHOS_USER_LOGIN_URL |
544 |
|
545 |
Tools |
546 |
----- |
547 |
|
548 |
* Extend snf-burnin to include testing of Pithos functionality |