Statistics
| Branch: | Tag: | Revision:

root / Changelog @ 4fad2b3f

History | View | Annotate | Download (20.1 kB)

1
.. _Changelog:
2

    
3
Unified Changelog file for Synnefo versions >= 0.13
4
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
5

    
6
Since v0.13 most of the Synnefo components have been merged into a single
7
repository and have aligned versions.
8

    
9
v0.14next
10
=========
11

    
12
Released: UNRELEASED
13

    
14
Synnefo-wide
15
------------
16

    
17
* Integrate Pithos tests in continuous integration.
18

    
19
* Change astakosclient to accept AUTH_URL instead of BASE_URL
20
	ASTAKOS_BASE_URL settings has been removed from Pithos and Cyclades
21
	and has been replaced with ASTAKOS_AUTH_URL. Both Pithos and Cyclades
22
	proxy the Astakos services under ASTAKOS_PROXY_PREFIX path.
23
	ASTAKOS_PROXY_PREFIX by default has a value of '_astakos'.
24
	More specifically, Astakos' identity service is proxied under
25
	'_astakos/identity', Astakos' account service is under '_astakos/account'
26
	and Astakos' ui service is under '_astakos/ui'.
27

    
28
Astakos
29
-------
30

    
31
* Changes in project schema:
32

    
33
  * A Project entry is created when submitting an application for a new
34
    project, rather than on approval. Its state is dependent on the state
35
    of its `reference' application (current definition). Lock Project rather
36
    than Chain (the latter is semantically obsolete).
37

    
38
  * Project states "Active - Pending" and "Suspended - Pending" have been
39
    removed. In management command `project-list', the existence of a pending
40
    modification is indicated by a non-blank `Pending AppID'.
41

    
42
  * Improve recording of project, application, and membership actions.
43

    
44
* Implement API calls for projects.
45

    
46
* Store the base URL of a component. Deployer should provide it when adding
47
  a new component. Service endpoints originating from a component are
48
  expected to match its base URL; otherwise, a warning is issued.
49
  Re-registration with `snf-component-register' affects both the base and
50
  the ui URL.
51

    
52
* Remove API call GET /account/v1.0/authenticate in favor of
53
  POST /identity/v2.0/tokens.
54

    
55
* Export basic statistics about Astakos service from '/admin/stats/detail' API
56
  endpoint. Access to this endpoint is only allowed to users that belong to
57
  the Astakos groups that are defined in the
58
  'ASTAKOS_ADMIN_STATS_PERMITTED_GROUPS' setting. Statistics are also availble
59
  from 'snf-manage stats-astakos' management command.
60

    
61
* Management commands:
62
  * Introduced new commands:
63
     * component-show
64
  * Changed commands:
65
     * component-add got options --base-url and --ui-url
66

    
67
Cyclades
68
--------
69

    
70
* Implement Floating IP addresses, which are addresses that can be dynamically
71
  added and removed to a running server.
72

    
73
  * Implement the 'os-floating-ips' and 'os-floating-ip-pools' API extensions.
74
  * Implement 'snf-manage floating-ip-list' management command.
75
  * Add 'floating_ip_pool' attribute to networks. Such networks must exist to
76
    all Ganeti backends.
77

    
78
* Speed up server reconciliation, by performing parallel reconciliation for
79
  each backend.
80
* Implement IPv6 only networks.
81
* Implement 'resize' server action.
82

    
83
  * Implement the 'resize' server action, to change the flavor of a server.
84
  Only 'cpu' and 'memory' resizing is supported.
85

    
86
* Compute quotas for CPU and memory of running vms.
87
* Obsolete PUBLIC_USE_POOL setting, since Cyclades manages IP pool for all
88
  type of networks.
89
* Extend servers info API response with 'SNF:fqdn' attribute, and introduce
90
  CYCLADES_SERVERS_FQDN to set the template for servers FDQN.
91
* Extend servers info API response with 'SNF:port_forwarding' attribute,
92
  describing port fowarding rules (DNAT) that are applied to vms. The
93
  description of such rules is done via the new CYCLADES_PORT_FORWARDING
94
  setting.
95
* Change --dhcp option of network management commands from a flag to a boolean
96
  value, e.g. --dhcp=True
97
* Remove 'ARCHIPELAGO_BACKENDS' setting used to distinquish between backends
98
  that hosted only archipelago backends. Instead allocation is based on which
99
  disk-templates are enabled in each backend.
100
* Implement 'snf-manage server-remove' management command.
101
* Move reconciliation of IP pools from 'reconcile-networks' to
102
  'reconcile-pools'. The IP pool reconciliation does not reconcile the IP
103
  pools with Ganeti. Instead it checks if the pool is consistent with the
104
  IPs that are used by instances.
105
* Do not automatically release externally reserved IPs if they are released
106
  from a Ganeti backend. Management of externally reserved IPs must be
107
  performed from Cyclades with 'network-modify' command.
108
* Export basic statistics about Cyclades Service from '/admin/stats/detail'
109
  API endpoint. Access to this endpoint is only allowed to users that belong
110
  to the Astakos groups that are defined in the 'ADMIN_STATS_PERMITTED_GROUPS'
111
  setting.  Statistics are also availble from 'snf-manage stats-cyclades'
112
  management command.
113

    
114
Pithos
115
------
116

    
117
* Refactor metadata schema (table attributes) in Pithos DB to speedup current
118
objects by domain attribute. This is used by Plankton for listing VM images.
119

    
120
* Enforce container-level atomicity in (most) Pithos API calls.
121

    
122
.. _Changelog-0.14.10:
123

    
124
v0.14.10
125
=======
126

    
127
Released: UNRELEASED
128

    
129
Cyclades
130
-------
131

    
132
* This is the first release to support Ganeti 2.8. Support for older versions
133
  of Ganeti is dropped.
134
* Use Ganeti opportunistic locking to achive parallelized instance creations
135
  in the same backend. Add setting 'GANETI_USE_OPPORTUNISTIC_LOCKING' to
136
  enable the use of this feature.
137
* Fix warning message while getting object permissions to appear only when
138
  path is None and the object has permissions
139

    
140
.. _Changelog-0.14.9:
141

    
142
v0.14.9
143
=======
144

    
145
Released: Mon Nov 11 12:13:31 EET 2013
146

    
147
* Astakos: Fix minor problems with logging in the Astakos module, which could
148
  lead to unexpected exceptions
149

    
150
.. _Changelog-0.14.8:
151

    
152
v0.14.8
153
=======
154

    
155
Released: Fri Nov  8 17:25:08 EET 2013
156

    
157
Synnefo-wide
158
------------
159

    
160
* This is the first release to support Debian Wheezy along with Squeeze. You
161
  can mix and match nodes freely.
162
* Update Django dependency to Django>=1.2,<1.5. Django 1.4.5 is available for
163
  Squeeze through squeeze-backports.
164
* Since this version, Synnefo ships an example Gunicorn configuration file
165
  that is automatically installed at ``/etc/gunicorn.d/synnefo.example``.
166

    
167
Cyclades
168
--------
169

    
170
* On VM creation, pass the hashmap of the image (pithosmap://) instead of the
171
  image URL (pithos://). Access to the Pithos DB by Ganeti nodes is no longer
172
  required.
173
* Workaround race between server creation and server deletion. This will be
174
  fixed properly by updating Ganeti to support the 'depends' attribute for
175
  OP_INSTANCE_REMOVE.
176

    
177
Astakos
178
-------
179

    
180
* For Shibboleth logins, store all attributes along with the user in the DB.
181

    
182
.. _Changelog-0.14.7:
183

    
184
v0.14.7
185
=======
186

    
187
Released: Wed Sep 18 17:50:12 EEST 2013
188

    
189
Cyclades
190
--------
191

    
192
* Fix bug in helpdesk view
193

    
194
.. _Changelog-0.14.6:
195

    
196
v0.14.6
197
=======
198

    
199
Released: Wed Sep 18 16:18:58 EEST 2013
200

    
201
Pithos
202
------
203

    
204
* Substitute the PITHOS_BACKEND_QUOTA setting with two
205
  distinct settings: PITHOS_BACKEND_ACCOUNT_QUOTA &
206
  PITHOS_BACKEND_CONTAINER_QUOTA
207
* Set PITHOS_BACKEND_CONTAINER_QUOTA default value to 0 (unlimited)
208
* Fix bug that resulted in DB deadlocks.
209

    
210
Cyclades
211
--------
212

    
213
* Fix bug in snf-dispatcher that resulted in servers to be deleted from the
214
  DB even if the corresponding Ganeti job failed.
215

    
216
Branding
217
--------
218

    
219
* Add new BRANDING_FOOTER_EXTRA_MESSAGE setting.
220

    
221

    
222
.. _Changelog-0.14.5:
223

    
224
v0.14.5
225
=======
226

    
227
Released: Wed Aug  7 11:19:49 EEST 2013
228

    
229
Pithos
230
------
231

    
232
* Fix security issue with handling Pithos versions.
233

    
234

    
235
.. _Changelog-0.14.4:
236

    
237
v0.14.4
238
=======
239

    
240
Released: Mon Jul 29 12:24:22 EEST 2013
241

    
242
Pithos
243
------
244

    
245
* Fix bug in reconcile resources management command.
246

    
247

    
248
.. _Changelog-0.14.3:
249

    
250
v0.14.3
251
=======
252

    
253
Released: Thu Jul 25 12:22:47 EEST 2013
254

    
255
Synnefo-wide
256
------------
257

    
258
* Use the SYNNEFO_TRACE environmental variable to control whether the greenlet
259
  tracing code will get loaded or not.
260
* Split the HIDDEN_COOKIES setting in HIDDEN_HEADERS and HIDDEN_COOKIES, and
261
  add the MAIL_MAX_LEN setting, to limit the mail size for unhandled
262
  exceptions.
263

    
264

    
265
.. _Changelog-0.14.2:
266

    
267
Released: Fri Jul 12 13:13:32 EEST 2013
268

    
269
v0.14.2
270
=======
271

    
272
Cyclades
273
--------
274

    
275
* Add new setting PITHOS_BACKEND_POOL_SIZE, which configures the size
276
  of the pool of Pithos backends that are used by plankton.
277

    
278

    
279
.. _Changelog-0.14:
280

    
281
v0.14
282
=====
283

    
284
Released: Tue Jun 25 14:01:19 EEST 2013
285

    
286
Synnefo-wide
287
------------
288

    
289
* Create 'snf_django' Python package to hold common code for all Synnefo
290
  components.
291

    
292
* Create a JSON-exportable definition document for each Synnefo Components
293
  (Astakos, Cyclades, Pithos, etc.) that consolidates APIs (services),
294
  resources, and other standardized properties (e.g. default URL prefixes).
295

    
296
* Standardize URLs for Synnefo Components, impose structure and naming
297
  conventions to related settings. Make each component deployable under
298
  a user-configurable <COMPONENT>_BASE_URL. Each API (compute, image, etc.)
299
  is deployable under a developer-configurable prefix beneath BASE_URL.
300

    
301
* Deprecate CLOUDBAR_ACTIVE_SERVICE setting from all apps. 
302

    
303
* Common synnefo 404/500 templates (located in snf-webproject)
304

    
305
Astakos
306
-------
307

    
308
* Redesign of the accounting system (quotaholder) and integration into
309
  Astakos.
310

    
311
  * Simplified the quotaholder model; removed tables Entity and Policy; now
312
    table Holding contains limit and usage for every holding.
313
  * Extended table Holding, so that we can keep track of quota for every
314
    valid combination of holder (e.g. user), resource, and source (e.g. the
315
    default system or some specific project).
316
  * Refactored code for issuing and resolving commissions for robustness;
317
    added a 'force' option to bypass the upper limit check when issuing a
318
    commission.
319
  * Simplified syncing to the quotaholder; removed fields from models
320
    Project and ProjectMembership, previously needed for syncing; removed
321
    state PROJECT_DEACTIVATED from ProjectMembership.
322
  * Removed settings ASTAKOS_QUOTAHOLDER_URL, ASTAKOS_QUOTAHOLDER_TOKEN,
323
    and ASTAKOS_QUOTAHOLDER_POOLSIZE.
324

    
325
* API-related changes:
326

    
327
  * Implemented API calls for quota, resources, and commissions.
328
  * Moved all API calls under '/account/v1.0'.
329
  * Implemented the keystone API call POST /tokens under '/identity/v2.0'.
330

    
331
* Service and resource specification and handling:
332

    
333
  * Specified a format for defining services along with the API endpoints
334
    and the resources they expose. Migrated internal resource name by
335
    prefixing it with service name (e.g. 'vm' becomes 'cyclades.vm');
336
    renamed registered service 'pithos+' to 'pithos'.
337
  * Specified a procedure to register a Synnefo component, its services and
338
    their resources in astakos and set the resources' default base quota
339
    limit. Removed resource definitions from settings.
340
  * Moved service and resource presentation data out of the respective db
341
    models into a separate file of UI constants.
342

    
343
* Converted the limit on pending applications from a setting to a quotable
344
  resource. Converted the related user setting to a user-specific base quota
345
  limit. Deprecated model UserSetting; removed setting
346
  ASTAKOS_PENDING_APPLICATION_LIMIT.
347

    
348
* Changes in locking strategy:
349

    
350
  * Lock only project's chain for all project operations; lock user before
351
    syncing to quotaholder.
352
  * When locking multiple rows (e.g. users or holdings) include an ORDER BY
353
    clause in the query to impose ordering on locking.
354

    
355
* Changes in views:
356

    
357
  * Replaced custom transaction context with a simple decorator for managing
358
    transactions and a context 'ExceptionHandler', which logs and suppresses
359
    exceptions
360

    
361
* Added fine grain user auth provider's policies.
362

    
363
  * Administrator can override default auth provider policies to a specific 
364
    user or group of users.
365
  * Optionally a user can be assigned to a list of groups, based on the
366
    authentication method he choosed to signup.
367

    
368
* Removed explicit handling of SMTP errors on each email delivery. Exceptions 
369
  are now propagated to base django exception handler.
370

    
371
* Email used in html/email tempaltes which prompt user to contact for service 
372
  support prompts is now defined in ``CONTACT_EMAIL`` setting introduced in 
373
  snf-common settings.
374

    
375
* Improvements in user activation flow
376

    
377
  * User moderation now takes place after the user has verified his email
378
    address.
379
  * User model enriched with additional user state fields
380
  * Split activation email from moderation process. Administrator is required 
381
    to moderate user explicitly using the `user-modify --accept` or
382
    `user-modify --reject` commands.
383
  * Improved logging throught out user activation procedures.
384

    
385
* Remove deprecated AstakosUser model fields: `provider`,
386
  `third_party_identifier`
387

    
388
* Allow override of authentication provider messages using the following 
389
  format in setting names: ``ASTAKOS_<PROVIDER_MODULE>_<MSGID>_MSG``
390

    
391
* Cloudbar automatically tries to identify the active service based on window 
392
  location.
393

    
394
* Removing authentication provider view is now CSRF protected.
395

    
396
* New `API access` view, containing useful information to users on how to 
397
  access available Synnefo services API's.
398

    
399
* Remove of ASTAKOS_*_EMAIL_SUBJECT settings. All email subjects are now 
400
  defined in astakos.im.messages module. Overriding default values can be 
401
  achieved using custom gettext files or using astakos messages settings::
402
	
403
	#change of greeting email subject
404
  	ASTAKOS_GREETING_EMAIL_SUBJECT_MESSAGE = 'Welcome to my cloud'
405

    
406
* Remove ``ASTAKOS_ACTIVATION_REDIRECT_URL`` and ``ASTAKOS_LOGIN_SUCCESS_URL`` 
407
  from astakos .conf file. Settings are dynamically computed based on 
408
  ``ASTAKOS_BASE_URL``.
409

    
410
* Management commands:
411

    
412
  * Introduced new commands:
413
     * authpolicy-{add, list, remove, set, show}
414
     * group-{add, list}
415
     * component-{add, list, modify, remove}
416
     * reconcile-resources-astakos
417
     * resource-{export-astakos, import, modify}
418
     * service-{export-astakos, import, show}
419
  * Renamed commands:
420
     * astakos-quota to quota
421
     * user-update to user-modify
422
     * full-cleanup to cleanup-full
423
  * Removed commands:
424
     * astakos-init
425
     * invitation-{details, list}
426
     * project-sync
427
     * resource-{add, remove}
428
     * service-{add, remove, token-renew, update}
429
     * user-invite
430
     * user-set-initial-quota (integrated its functionality in user-modify and quota)
431
  * Added quota and project-related information in user-show command; added
432
    membership information in project-show.
433

    
434
Cyclades
435
--------
436

    
437
* Make 'type' attribute required for network create API request.
438
* Networks not created to all Ganeti backends upon creation, they are instead
439
  created to a backend only when a VM connects to the network.
440
* Add 'CYCLADES_ASTAKOSCLIENT_POOLSIZE' setting which tunes the size of the
441
  http connection pool to astakos.
442
* Remove 'CYCLADES_USER_CATALOG_URL' and 'CYCLADES_USER_FEEDBACK_URL' settings
443
* Remove CYCLADES_USE_QUOTAHOLDER, CYCLADES_QUOTAHOLDER_TOKEN,
444
  CYCLADES_QUOTAHOLDER_URL, CYCLADES_QUOTAHOLDER_POOLSIZE settings
445
* Rename 'cyclades-usage-verify' management command to
446
  'reconcile-resources-cyclades'. Also, remove 'cyclades-usage-reset' command,
447
  which is equivalent to 'reconcile-resources-cyclades --fix'.
448
* Rename 'cyclades-reconcile-commissions' management command to
449
  'reconcile-commissions-cyclades'.
450
* Remove obsolete 'MAX_VMS_PER_USER', 'MAX_NETWORKS_PER_USER',
451
  "VMS_USER_QUOTA" and "NETWORKS_USER_QUOTA" settings, since their usage
452
  is covered by Quotaholder.
453
* Remove obsolete setting 'API_ROOT_URL', since it is being covered by
454
  the use of CYCLADES_BASE_URL* Remove obsolete setting 'API_ROOT_URL', since
455
  it is being covered by 'CYCLADES_BASE_URL'.
456
* Remove obsolete settings GANETI_DISK_TEMPLATES and
457
  DEFAULT_GANETI_DISK_TEMPLATE
458

    
459
Cyclades helpdesk
460
-----------------
461

    
462
* Additional start/stop vm action
463
* Display extend backend info in vm's view
464
* Fixed IP lookup
465

    
466
Pithos
467
------
468

    
469
* Remove PITHOS_AUTHENTICATION_USERS setting, which was used to override
470
  astakos users.
471
* Remove 'PITHOS_USER_CATALOG_URL', 'PITHOS_USER_FEEDBACK_URL' and
472
  'PITHOS_USER_LOGIN_URL' settings.
473
* Remove PITHOS_USE_QUOTAHOLDER, PITHOS_QUOTAHOLDER_URL,
474
  PITHOS_QUOTAHOLDER_TOKEN and PITHOS_ASTAKOSCLIENT_POOLSIZE
475

    
476
Tools
477
-----
478

    
479

    
480
.. _Changelog-0.13:
481

    
482
v0.13
483
=====
484

    
485
Released: Wed Apr 10 18:52:50 EEST 2013
486

    
487
In v0.13 the code was very heavily refactored for increased uniformity since
488
most of the Synnefo components have been merged into a single repository. Thus,
489
**just for this version** we will not document a complete Changelog (features,
490
fixes, improvements, issues, setting changes), but rather just copy from the
491
`NEWS` file with minor additions wherever needed.
492

    
493
Synnefo-wide
494
------------
495

    
496
* Support for pooling throughout Synnefo
497

    
498
  * Pooled Django DB connections, Pithos backend connections, HTTP
499
    connections using single `objpool` package
500

    
501
* Improved management commands
502

    
503
  * Unified codebase for output of tables in JSON, CSV
504

    
505
* Bring most of Synnefo code inside a single, unified repository
506

    
507
  * support automatic Python and Debian package builds for individual commits
508
  * with automatic version generation
509

    
510
* Overhauling of Synnefo settings: renames and refactoring, for increased
511
  uniformity (in progress)
512
* Deployment: Standardize on gunicorn, with gevent-based workers
513
  and use of Green threads throughout Synnefo
514
* Documentation: New scale-out guide, with distinct node roles,
515
  for mass Synnefo deployments
516

    
517
Astakos
518
-------
519

    
520
* Support multiple authentication methods
521

    
522
  * Classic (username/password), Shibboleth, LDAP/Active Directory,
523
    Google, Twitter, LinkedIn
524
  * Users can enable/disable auth methods, and switch between them
525

    
526
* Introduce a UUID as a global identifier for users, throughout Synnefo
527

    
528
  * The UUID remains constant as the user enables/disables login methods
529

    
530
* Allow users to modify their email address freely
531
* Per-user, per-resource accounting mechanism (quotaholder)
532
* Full quota support, with per-user, per-resource quotas, based on quotaholder
533
* Projects: Users can create and join Projects
534

    
535
  * Projects grant extra resources to their members
536

    
537
* UI Enhancements for quotas and projects
538

    
539
  * distinct Usage tab, showing usage of individual resources
540
  * Project management UI
541
  * New Overview page
542

    
543
* refactored/improved /login endpoint used by desktop/mobile clients.
544
  * endpoint url is now exposed by `weblogin` service
545
  * clients should use unauthenticated identity/tokens api to resolve the 
546
    endpoint url
547
  * view only allows redirects to `pithos://` scheme urls
548
  * removed uuid from redirect parameters. Client should use authenticated 
549
    request to identity/tokens to retrieve user uuid.
550

    
551

    
552
Cyclades
553
--------
554

    
555
* Commission resources on quotaholder/Astakos
556
* Support mass creation of flavors
557
* Support for the ExtStorage disk template in Ganeti
558
* Query and report quotas in the UI
559
* Pass VM configuration parameters over a VM-side API (`vmapi`)
560

    
561
  * Do not pass sensitive data as Ganeti OS parameters
562
  * Keep sensitive data in memory caches (memcached) and
563
    never allow them to hit the disk
564

    
565
* Display additional backend information in helpdesk machines list
566
* Allow helpdesk users to search for an account using a known machine id
567
* Helpdesk actions are now logged using the synnefo's common login
568
  infrastructure
569

    
570
UI
571
^^
572
* Removed feedback endpoint. Feedback requests delegate to astakos feedback
573
  service. ``FEEDBACK_CONTACTS``, ``FEEDBACK_EMAIL_FROM`` settings removed, 
574
  and no longer used.
575
* ``UI_LOGIN_URL``, ``UI_GLANCE_URL``, ``COMPUTE_URL`` settings no longer 
576
  required to be set and are dynamically computed based on ``ASTAKOS_BASE_URL``
577
  and ``CYCLADES_BASE_URL`` settings.
578
* File group is no longer included in ssh keys personality metadata sent in 
579
  create vm calls.
580
  
581

    
582
Pithos
583
------
584

    
585
* Support storage of blocks on a RADOS backend, for Archipelago
586

    
587
  * new settings:
588
    PITHOS_RADOS_STORAGE, PITHOS_RADOS_POOL_BLOCKS, PITHOS_RADOS_POOL_MAPS
589

    
590
* X-Object-Public now contains full url (domain + proper component prefix + 
591
  file path)
592

    
593
* Rewritten support for public URLs, with admin-selectable length
594

    
595
  * new settings:
596
    PITHOS_PUBLIC_URL_SECURITY, PITHOS_PUBLIC_URL_ALPHABET
597

    
598
* Enable pithos backend to use external quotaholder component
599

    
600
  * new settings:
601
    PITHOS_USE_QUOTAHOLDER, PITHOS_QUOTAHOLDER_URL, PITHOS_QUOTAHOLDER_TOKEN,
602
    PITHOS_QUOTAHOLDER_POOLSIZE
603

    
604
* Moderated version debiting mechanism
605

    
606
  * new setting:
607
    PITHOS_BACKEND_FREE_VERSIONING
608

    
609
* Proxy Astakos user-visible services
610

    
611
  * new settings:
612
    PITHOS_PROXY_USER_SERVICES, PITHOS_USER_CATALOG_URL,
613
    PITHOS_USER_FEEDBACK_URL, PITHOS_USER_LOGIN_URL
614

    
615
Tools
616
-----
617

    
618
* Extend snf-burnin to include testing of Pithos functionality