Statistics
| Branch: | Tag: | Revision:

root / Changelog @ 4911365b

History | View | Annotate | Download (17.1 kB)

1
.. _Changelog:
2

    
3
Unified Changelog file for Synnefo versions >= 0.13
4
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
5

    
6
Since v0.13 most of the Synnefo components have been merged into a single
7
repository and have aligned versions.
8

    
9
v0.14next
10
=========
11

    
12
Released: UNRELEASED
13

    
14
Synnefo-wide
15
------------
16

    
17
* Integrate Pithos tests in continuous integration.
18

    
19
Astakos
20
-------
21

    
22
* Changes in project schema:
23

    
24
  * A Project entry is created when submitting an application for a new
25
    project, rather than on approval. Its state is dependent on the state
26
    of its `reference' application (current definition). Lock Project rather
27
    than Chain (the latter is semantically obsolete).
28

    
29
  * Improve recording of project, application, and membership actions.
30

    
31
* Implement API calls for projects.
32

    
33
* Store the base URL of a component. Deployer should provide it when adding
34
  a new component. Service endpoints originating from a component are
35
  expected to match its base URL; otherwise, a warning is issued.
36
  Re-registration with `snf-component-register' affects both the base and
37
  the ui URL.
38

    
39
* Management commands:
40
  * Introduced new commands:
41
     * component-show
42
  * Changed commands:
43
     * component-add got options --base-url and --ui-url
44

    
45
Cyclades
46
--------
47

    
48
* Implement Floating IP addresses, which are addresses that can be dynamically
49
  added and removed to a running server.
50

    
51
  * Implement the 'os-floating-ips' and 'os-floating-ip-pools' API extensions.
52
  * Implement 'snf-manage floating-ip-list' management command.
53
  * Add 'floating_ip_pool' attribute to networks. Such networks must exist to
54
    all Ganeti backends.
55

    
56
* Speed up server reconciliation, by performing parallel reconciliation for
57
  each backend.
58
* Implement IPv6 only networks.
59
* Implement 'resize' server action.
60

    
61
  * Implement the 'resize' server action, to change the flavor of a server.
62
  Only 'cpu' and 'memory' resizing is supported.
63

    
64
* Compute quotas for CPU and memory of running vms.
65
* Obsolete PUBLIC_USE_POOL setting, since Cyclades manages IP pool for all
66
  type of networks.
67
* Extend servers info API response with 'SNF:fqdn' attribute, and introduce
68
  CYCLADES_SERVERS_FQDN to set the template for servers FDQN.
69
* Extend servers info API response with 'SNF:port_forwarding' attribute,
70
  describing port fowarding rules (DNAT) that are applied to vms. The
71
  description of such rules is done via the new CYCLADES_PORT_FORWARDING
72
  setting.
73
* Change --dhcp option of network management commands from a flag to a boolean
74
  value, e.g. --dhcp=True
75
* Remove 'ARCHIPELAGO_BACKENDS' setting used to distinquish between backends
76
  that hosted only archipelago backends. Instead allocation is based on which
77
  disk-templates are enabled in each backend.
78
* Implement 'snf-manage server-remove' management command.
79
* Move reconciliation of IP pools from 'reconcile-networks' to
80
  'reconcile-pools'. The IP pool reconciliation does not reconcile the IP
81
  pools with Ganeti. Instead it checks if the pool is consistent with the
82
  IPs that are used by instances.
83
* Do not automatically release externally reserved IPs if they are released
84
  from a Ganeti backend. Management of externally reserved IPs must be
85
  performed from Cyclades with 'network-modify' command.
86

    
87
Pithos
88
------
89

    
90
* Refactor metadata schema (table attributes) in Pithos DB to speedup current
91
objects by domain attribute. This is used by Plankton for listing VM images.
92

    
93
* Enforce container-level atomicity in (most) Pithos API calls.
94

    
95

    
96
.. _Changelog-0.14.7:
97

    
98
v0.14.7
99
=======
100

    
101
Released: Wed Sep 18 17:50:12 EEST 2013
102

    
103
Cyclades
104
--------
105

    
106
* Fix bug in helpdesk view
107

    
108
.. _Changelog-0.14.6:
109

    
110
v0.14.6
111
=======
112

    
113
Released: Wed Sep 18 16:18:58 EEST 2013
114

    
115
Pithos
116
------
117

    
118
* Substitute the PITHOS_BACKEND_QUOTA setting with two
119
  distinct settings: PITHOS_BACKEND_ACCOUNT_QUOTA &
120
  PITHOS_BACKEND_CONTAINER_QUOTA
121
* Set PITHOS_BACKEND_CONTAINER_QUOTA default value to 0 (unlimited)
122
* Fix bug that resulted in DB deadlocks.
123

    
124
Cyclades
125
--------
126

    
127
* Fix bug in snf-dispatcher that resulted in servers to be deleted from the
128
  DB even if the corresponding Ganeti job failed.
129

    
130
Branding
131
--------
132

    
133
* Add new BRANDING_FOOTER_EXTRA_MESSAGE setting.
134

    
135

    
136
.. _Changelog-0.14.5:
137

    
138
v0.14.5
139
=======
140

    
141
Released: Wed Aug  7 11:19:49 EEST 2013
142

    
143
Pithos
144
------
145

    
146
* Fix security issue with handling Pithos versions.
147

    
148

    
149
.. _Changelog-0.14.4:
150

    
151
v0.14.4
152
=======
153

    
154
Released: Mon Jul 29 12:24:22 EEST 2013
155

    
156
Pithos
157
------
158

    
159
* Fix bug in reconcile resources management command.
160

    
161

    
162
.. _Changelog-0.14.3:
163

    
164
v0.14.3
165
=======
166

    
167
Released: Thu Jul 25 12:22:47 EEST 2013
168

    
169
Synnefo-wide
170
------------
171

    
172
* Use the SYNNEFO_TRACE environmental variable to control whether the greenlet
173
  tracing code will get loaded or not.
174
* Split the HIDDEN_COOKIES setting in HIDDEN_HEADERS and HIDDEN_COOKIES, and
175
  add the MAIL_MAX_LEN setting, to limit the mail size for unhandled
176
  exceptions.
177

    
178

    
179
.. _Changelog-0.14.2:
180

    
181
Released: Fri Jul 12 13:13:32 EEST 2013
182

    
183
v0.14.2
184
=======
185

    
186
Cyclades
187
--------
188

    
189
* Add new setting PITHOS_BACKEND_POOL_SIZE, which configures the size
190
  of the pool of Pithos backends that are used by plankton.
191

    
192

    
193
.. _Changelog-0.14:
194

    
195
v0.14
196
=====
197

    
198
Released: Tue Jun 25 14:01:19 EEST 2013
199

    
200
Synnefo-wide
201
------------
202

    
203
* Create 'snf_django' Python package to hold common code for all Synnefo
204
  components.
205

    
206
* Create a JSON-exportable definition document for each Synnefo Components
207
  (Astakos, Cyclades, Pithos, etc.) that consolidates APIs (services),
208
  resources, and other standardized properties (e.g. default URL prefixes).
209

    
210
* Standardize URLs for Synnefo Components, impose structure and naming
211
  conventions to related settings. Make each component deployable under
212
  a user-configurable <COMPONENT>_BASE_URL. Each API (compute, image, etc.)
213
  is deployable under a developer-configurable prefix beneath BASE_URL.
214

    
215
* Deprecate CLOUDBAR_ACTIVE_SERVICE setting from all apps. 
216

    
217
* Common synnefo 404/500 templates (located in snf-webproject)
218

    
219
Astakos
220
-------
221

    
222
* Redesign of the accounting system (quotaholder) and integration into
223
  Astakos.
224

    
225
  * Simplified the quotaholder model; removed tables Entity and Policy; now
226
    table Holding contains limit and usage for every holding.
227
  * Extended table Holding, so that we can keep track of quota for every
228
    valid combination of holder (e.g. user), resource, and source (e.g. the
229
    default system or some specific project).
230
  * Refactored code for issuing and resolving commissions for robustness;
231
    added a 'force' option to bypass the upper limit check when issuing a
232
    commission.
233
  * Simplified syncing to the quotaholder; removed fields from models
234
    Project and ProjectMembership, previously needed for syncing; removed
235
    state PROJECT_DEACTIVATED from ProjectMembership.
236
  * Removed settings ASTAKOS_QUOTAHOLDER_URL, ASTAKOS_QUOTAHOLDER_TOKEN,
237
    and ASTAKOS_QUOTAHOLDER_POOLSIZE.
238

    
239
* API-related changes:
240

    
241
  * Implemented API calls for quota, resources, and commissions.
242
  * Moved all API calls under '/account/v1.0'.
243
  * Implemented the keystone API call POST /tokens under '/identity/v2.0'.
244

    
245
* Service and resource specification and handling:
246

    
247
  * Specified a format for defining services along with the API endpoints
248
    and the resources they expose. Migrated internal resource name by
249
    prefixing it with service name (e.g. 'vm' becomes 'cyclades.vm');
250
    renamed registered service 'pithos+' to 'pithos'.
251
  * Specified a procedure to register a Synnefo component, its services and
252
    their resources in astakos and set the resources' default base quota
253
    limit. Removed resource definitions from settings.
254
  * Moved service and resource presentation data out of the respective db
255
    models into a separate file of UI constants.
256

    
257
* Converted the limit on pending applications from a setting to a quotable
258
  resource. Converted the related user setting to a user-specific base quota
259
  limit. Deprecated model UserSetting; removed setting
260
  ASTAKOS_PENDING_APPLICATION_LIMIT.
261

    
262
* Changes in locking strategy:
263

    
264
  * Lock only project's chain for all project operations; lock user before
265
    syncing to quotaholder.
266
  * When locking multiple rows (e.g. users or holdings) include an ORDER BY
267
    clause in the query to impose ordering on locking.
268

    
269
* Changes in views:
270

    
271
  * Replaced custom transaction context with a simple decorator for managing
272
    transactions and a context 'ExceptionHandler', which logs and suppresses
273
    exceptions
274

    
275
* Added fine grain user auth provider's policies.
276

    
277
  * Administrator can override default auth provider policies to a specific 
278
    user or group of users.
279
  * Optionally a user can be assigned to a list of groups, based on the
280
    authentication method he choosed to signup.
281

    
282
* Removed explicit handling of SMTP errors on each email delivery. Exceptions 
283
  are now propagated to base django exception handler.
284

    
285
* Email used in html/email tempaltes which prompt user to contact for service 
286
  support prompts is now defined in ``CONTACT_EMAIL`` setting introduced in 
287
  snf-common settings.
288

    
289
* Improvements in user activation flow
290

    
291
  * User moderation now takes place after the user has verified his email
292
    address.
293
  * User model enriched with additional user state fields
294
  * Split activation email from moderation process. Administrator is required 
295
    to moderate user explicitly using the `user-modify --accept` or
296
    `user-modify --reject` commands.
297
  * Improved logging throught out user activation procedures.
298

    
299
* Remove deprecated AstakosUser model fields: `provider`,
300
  `third_party_identifier`
301

    
302
* Allow override of authentication provider messages using the following 
303
  format in setting names: ``ASTAKOS_<PROVIDER_MODULE>_<MSGID>_MSG``
304

    
305
* Cloudbar automatically tries to identify the active service based on window 
306
  location.
307

    
308
* Removing authentication provider view is now CSRF protected.
309

    
310
* New `API access` view, containing useful information to users on how to 
311
  access available Synnefo services API's.
312

    
313
* Remove of ASTAKOS_*_EMAIL_SUBJECT settings. All email subjects are now 
314
  defined in astakos.im.messages module. Overriding default values can be 
315
  achieved using custom gettext files or using astakos messages settings::
316
	
317
	#change of greeting email subject
318
  	ASTAKOS_GREETING_EMAIL_SUBJECT_MESSAGE = 'Welcome to my cloud'
319

    
320
* Remove ``ASTAKOS_ACTIVATION_REDIRECT_URL`` and ``ASTAKOS_LOGIN_SUCCESS_URL`` 
321
  from astakos .conf file. Settings are dynamically computed based on 
322
  ``ASTAKOS_BASE_URL``.
323

    
324
* Management commands:
325

    
326
  * Introduced new commands:
327
     * authpolicy-{add, list, remove, set, show}
328
     * group-{add, list}
329
     * component-{add, list, modify, remove}
330
     * reconcile-resources-astakos
331
     * resource-{export-astakos, import, modify}
332
     * service-{export-astakos, import, show}
333
  * Renamed commands:
334
     * astakos-quota to quota
335
     * user-update to user-modify
336
     * full-cleanup to cleanup-full
337
  * Removed commands:
338
     * astakos-init
339
     * invitation-{details, list}
340
     * project-sync
341
     * resource-{add, remove}
342
     * service-{add, remove, token-renew, update}
343
     * user-invite
344
     * user-set-initial-quota (integrated its functionality in user-modify and quota)
345
  * Added quota and project-related information in user-show command; added
346
    membership information in project-show.
347

    
348
Cyclades
349
--------
350

    
351
* Make 'type' attribute required for network create API request.
352
* Networks not created to all Ganeti backends upon creation, they are instead
353
  created to a backend only when a VM connects to the network.
354
* Add 'CYCLADES_ASTAKOSCLIENT_POOLSIZE' setting which tunes the size of the
355
  http connection pool to astakos.
356
* Remove 'CYCLADES_USER_CATALOG_URL' and 'CYCLADES_USER_FEEDBACK_URL' settings
357
* Remove CYCLADES_USE_QUOTAHOLDER, CYCLADES_QUOTAHOLDER_TOKEN,
358
  CYCLADES_QUOTAHOLDER_URL, CYCLADES_QUOTAHOLDER_POOLSIZE settings
359
* Rename 'cyclades-usage-verify' management command to
360
  'reconcile-resources-cyclades'. Also, remove 'cyclades-usage-reset' command,
361
  which is equivalent to 'reconcile-resources-cyclades --fix'.
362
* Rename 'cyclades-reconcile-commissions' management command to
363
  'reconcile-commissions-cyclades'.
364
* Remove obsolete 'MAX_VMS_PER_USER', 'MAX_NETWORKS_PER_USER',
365
  "VMS_USER_QUOTA" and "NETWORKS_USER_QUOTA" settings, since their usage
366
  is covered by Quotaholder.
367
* Remove obsolete setting 'API_ROOT_URL', since it is being covered by
368
  the use of CYCLADES_BASE_URL* Remove obsolete setting 'API_ROOT_URL', since
369
  it is being covered by 'CYCLADES_BASE_URL'.
370
* Remove obsolete settings GANETI_DISK_TEMPLATES and
371
  DEFAULT_GANETI_DISK_TEMPLATE
372

    
373
Cyclades helpdesk
374
-----------------
375

    
376
* Additional start/stop vm action
377
* Display extend backend info in vm's view
378
* Fixed IP lookup
379

    
380
Pithos
381
------
382

    
383
* Remove PITHOS_AUTHENTICATION_USERS setting, which was used to override
384
  astakos users.
385
* Remove 'PITHOS_USER_CATALOG_URL', 'PITHOS_USER_FEEDBACK_URL' and
386
  'PITHOS_USER_LOGIN_URL' settings.
387
* Remove PITHOS_USE_QUOTAHOLDER, PITHOS_QUOTAHOLDER_URL,
388
  PITHOS_QUOTAHOLDER_TOKEN and PITHOS_ASTAKOSCLIENT_POOLSIZE
389

    
390
Tools
391
-----
392

    
393

    
394
.. _Changelog-0.13:
395

    
396
v0.13
397
=====
398

    
399
Released: Wed Apr 10 18:52:50 EEST 2013
400

    
401
In v0.13 the code was very heavily refactored for increased uniformity since
402
most of the Synnefo components have been merged into a single repository. Thus,
403
**just for this version** we will not document a complete Changelog (features,
404
fixes, improvements, issues, setting changes), but rather just copy from the
405
`NEWS` file with minor additions wherever needed.
406

    
407
Synnefo-wide
408
------------
409

    
410
* Support for pooling throughout Synnefo
411

    
412
  * Pooled Django DB connections, Pithos backend connections, HTTP
413
    connections using single `objpool` package
414

    
415
* Improved management commands
416

    
417
  * Unified codebase for output of tables in JSON, CSV
418

    
419
* Bring most of Synnefo code inside a single, unified repository
420

    
421
  * support automatic Python and Debian package builds for individual commits
422
  * with automatic version generation
423

    
424
* Overhauling of Synnefo settings: renames and refactoring, for increased
425
  uniformity (in progress)
426
* Deployment: Standardize on gunicorn, with gevent-based workers
427
  and use of Green threads throughout Synnefo
428
* Documentation: New scale-out guide, with distinct node roles,
429
  for mass Synnefo deployments
430

    
431
Astakos
432
-------
433

    
434
* Support multiple authentication methods
435

    
436
  * Classic (username/password), Shibboleth, LDAP/Active Directory,
437
    Google, Twitter, LinkedIn
438
  * Users can enable/disable auth methods, and switch between them
439

    
440
* Introduce a UUID as a global identifier for users, throughout Synnefo
441

    
442
  * The UUID remains constant as the user enables/disables login methods
443

    
444
* Allow users to modify their email address freely
445
* Per-user, per-resource accounting mechanism (quotaholder)
446
* Full quota support, with per-user, per-resource quotas, based on quotaholder
447
* Projects: Users can create and join Projects
448

    
449
  * Projects grant extra resources to their members
450

    
451
* UI Enhancements for quotas and projects
452

    
453
  * distinct Usage tab, showing usage of individual resources
454
  * Project management UI
455
  * New Overview page
456

    
457
* refactored/improved /login endpoint used by desktop/mobile clients.
458
  * endpoint url is now exposed by `weblogin` service
459
  * clients should use unauthenticated identity/tokens api to resolve the 
460
    endpoint url
461
  * view only allows redirects to `pithos://` scheme urls
462
  * removed uuid from redirect parameters. Client should use authenticated 
463
    request to identity/tokens to retrieve user uuid.
464

    
465

    
466
Cyclades
467
--------
468

    
469
* Commission resources on quotaholder/Astakos
470
* Support mass creation of flavors
471
* Support for the ExtStorage disk template in Ganeti
472
* Query and report quotas in the UI
473
* Pass VM configuration parameters over a VM-side API (`vmapi`)
474

    
475
  * Do not pass sensitive data as Ganeti OS parameters
476
  * Keep sensitive data in memory caches (memcached) and
477
    never allow them to hit the disk
478

    
479
* Display additional backend information in helpdesk machines list
480
* Allow helpdesk users to search for an account using a known machine id
481
* Helpdesk actions are now logged using the synnefo's common login
482
  infrastructure
483

    
484
UI
485
^^
486
* Removed feedback endpoint. Feedback requests delegate to astakos feedback
487
  service. ``FEEDBACK_CONTACTS``, ``FEEDBACK_EMAIL_FROM`` settings removed, 
488
  and no longer used.
489
* ``UI_LOGIN_URL``, ``UI_GLANCE_URL``, ``COMPUTE_URL`` settings no longer 
490
  required to be set and are dynamically computed based on ``ASTAKOS_BASE_URL``
491
  and ``CYCLADES_BASE_URL`` settings.
492
* File group is no longer included in ssh keys personality metadata sent in 
493
  create vm calls.
494
  
495

    
496
Pithos
497
------
498

    
499
* Support storage of blocks on a RADOS backend, for Archipelago
500

    
501
  * new settings:
502
    PITHOS_RADOS_STORAGE, PITHOS_RADOS_POOL_BLOCKS, PITHOS_RADOS_POOL_MAPS
503

    
504
* X-Object-Public now contains full url (domain + proper component prefix + 
505
  file path)
506

    
507
* Rewritten support for public URLs, with admin-selectable length
508

    
509
  * new settings:
510
    PITHOS_PUBLIC_URL_SECURITY, PITHOS_PUBLIC_URL_ALPHABET
511

    
512
* Enable pithos backend to use external quotaholder component
513

    
514
  * new settings:
515
    PITHOS_USE_QUOTAHOLDER, PITHOS_QUOTAHOLDER_URL, PITHOS_QUOTAHOLDER_TOKEN,
516
    PITHOS_QUOTAHOLDER_POOLSIZE
517

    
518
* Moderated version debiting mechanism
519

    
520
  * new setting:
521
    PITHOS_BACKEND_FREE_VERSIONING
522

    
523
* Proxy Astakos user-visible services
524

    
525
  * new settings:
526
    PITHOS_PROXY_USER_SERVICES, PITHOS_USER_CATALOG_URL,
527
    PITHOS_USER_FEEDBACK_URL, PITHOS_USER_LOGIN_URL
528

    
529
Tools
530
-----
531

    
532
* Extend snf-burnin to include testing of Pithos functionality