Statistics
| Branch: | Tag: | Revision:

root / Changelog @ 30761818

History | View | Annotate | Download (15.3 kB)

1
.. _Changelog:
2

    
3
Unified Changelog file for Synnefo versions >= 0.13
4
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
5

    
6
Since v0.13 most of the Synnefo components have been merged into a single
7
repository and have aligned versions.
8

    
9
v0.14next
10
=========
11

    
12
Released: UNRELEASED
13

    
14
Synnefo-wide
15
------------
16

    
17
* Integrate Pithos tests in continuous integration.
18

    
19
Astakos
20
-------
21

    
22
* Changes in project schema:
23

    
24
  * A Project entry is created when submitting an application for a new
25
    project, rather than on approval. Its state is dependent on the state
26
    of its `reference' application (current definition). Lock Project rather
27
    than Chain (the latter is semantically obsolete).
28

    
29
  * Improve recording of project, application, and membership actions.
30

    
31
* Implement API calls for projects.
32

    
33
Cyclades
34
--------
35

    
36
* Implement Floating IP addresses, which are addresses that can be dynamically
37
  added and removed to a running server.
38

    
39
  * Implement the 'os-floating-ips' and 'os-floating-ip-pools' API extensions.
40
  * Implement 'snf-manage floating-ip-list' management command.
41
  * Add 'floating_ip_pool' attribute to networks. Such networks must exist to
42
    all Ganeti backends.
43

    
44
* Speed up server reconciliation, by performing parallel reconciliation for
45
  each backend.
46
* Implement IPv6 only networks.
47
* Implement 'resize' server action.
48

    
49
  * Implement the 'resize' server action, to change the flavor of a server.
50
  Only 'cpu' and 'memory' resizing is supported.
51

    
52
* Compute quotas for CPU and memory of running vms.
53
* Obsolete PUBLIC_USE_POOL setting, since Cyclades manages IP pool for all
54
  type of networks.
55
* Extend servers info API response with 'SNF:fqdn' attribute, and introduce
56
  CYCLADES_SERVERS_FQDN to set the template for servers FDQN.
57
* Extend servers info API response with 'SNF:port_forwarding' attribute,
58
  describing port fowarding rules (DNAT) that are applied to vms. The
59
  description of such rules is done via the new CYCLADES_PORT_FORWARDING
60
  setting.
61
* Change --dhcp option of network management commands from a flag to a boolean
62
  value, e.g. --dhcp=True
63

    
64
Pithos
65
------
66

    
67
* Refactor metadata schema (table attributes) in Pithos DB to speedup current
68
objects by domain attribute. This is used by Plankton for listing VM images.
69

    
70
* Enforce container-level atomicity in (most) Pithos API calls.
71

    
72

    
73
.. _Changelog-0.14.5:
74

    
75
v0.14.5
76
=======
77

    
78
Released: Wed Aug  7 11:19:49 EEST 2013
79

    
80
Pithos
81
------
82

    
83
* Fix security issue with handling Pithos versions.
84

    
85

    
86
.. _Changelog-0.14.4:
87

    
88
v0.14.4
89
=======
90

    
91
Released: Mon Jul 29 12:24:22 EEST 2013
92

    
93
Pithos
94
------
95

    
96
* Fix bug in reconcile resources management command.
97

    
98

    
99
.. _Changelog-0.14.3:
100

    
101
v0.14.3
102
=======
103

    
104
Released: Thu Jul 25 12:22:47 EEST 2013
105

    
106
Synnefo-wide
107
------------
108

    
109
* Use the SYNNEFO_TRACE environmental variable to control whether the greenlet
110
  tracing code will get loaded or not.
111
* Split the HIDDEN_COOKIES setting in HIDDEN_HEADERS and HIDDEN_COOKIES, and
112
  add the MAIL_MAX_LEN setting, to limit the mail size for unhandled
113
  exceptions.
114

    
115

    
116
.. _Changelog-0.14.2:
117

    
118
Released: Fri Jul 12 13:13:32 EEST 2013
119

    
120
v0.14.2
121
=======
122

    
123
Cyclades
124
--------
125

    
126
* Add new setting PITHOS_BACKEND_POOL_SIZE, which configures the size
127
  of the pool of Pithos backends that are used by plankton.
128

    
129

    
130
.. _Changelog-0.14:
131

    
132
v0.14
133
=====
134

    
135
Released: Tue Jun 25 14:01:19 EEST 2013
136

    
137
Synnefo-wide
138
------------
139

    
140
* Create 'snf_django' Python package to hold common code for all Synnefo
141
  components.
142

    
143
* Create a JSON-exportable definition document for each Synnefo Components
144
  (Astakos, Cyclades, Pithos, etc.) that consolidates APIs (services),
145
  resources, and other standardized properties (e.g. default URL prefixes).
146

    
147
* Standardize URLs for Synnefo Components, impose structure and naming
148
  conventions to related settings. Make each component deployable under
149
  a user-configurable <COMPONENT>_BASE_URL. Each API (compute, image, etc.)
150
  is deployable under a developer-configurable prefix beneath BASE_URL.
151

    
152
* Deprecate CLOUDBAR_ACTIVE_SERVICE setting from all apps. 
153

    
154
* Common synnefo 404/500 templates (located in snf-webproject)
155

    
156
Astakos
157
-------
158

    
159
* Redesign of the accounting system (quotaholder) and integration into
160
  Astakos.
161

    
162
  * Simplified the quotaholder model; removed tables Entity and Policy; now
163
    table Holding contains limit and usage for every holding.
164
  * Extended table Holding, so that we can keep track of quota for every
165
    valid combination of holder (e.g. user), resource, and source (e.g. the
166
    default system or some specific project).
167
  * Refactored code for issuing and resolving commissions for robustness;
168
    added a 'force' option to bypass the upper limit check when issuing a
169
    commission.
170
  * Simplified syncing to the quotaholder; removed fields from models
171
    Project and ProjectMembership, previously needed for syncing; removed
172
    state PROJECT_DEACTIVATED from ProjectMembership.
173
  * Removed settings ASTAKOS_QUOTAHOLDER_URL, ASTAKOS_QUOTAHOLDER_TOKEN,
174
    and ASTAKOS_QUOTAHOLDER_POOLSIZE.
175

    
176
* API-related changes:
177

    
178
  * Implemented API calls for quota, resources, and commissions.
179
  * Moved all API calls under '/account/v1.0'.
180
  * Implemented the keystone API call POST /tokens under '/identity/v2.0'.
181

    
182
* Service and resource specification and handling:
183

    
184
  * Specified a format for defining services along with the API endpoints
185
    and the resources they expose. Migrated internal resource name by
186
    prefixing it with service name (e.g. 'vm' becomes 'cyclades.vm');
187
    renamed registered service 'pithos+' to 'pithos'.
188
  * Specified a procedure to register a Synnefo component, its services and
189
    their resources in astakos and set the resources' default base quota
190
    limit. Removed resource definitions from settings.
191
  * Moved service and resource presentation data out of the respective db
192
    models into a separate file of UI constants.
193

    
194
* Converted the limit on pending applications from a setting to a quotable
195
  resource. Converted the related user setting to a user-specific base quota
196
  limit. Deprecated model UserSetting; removed setting
197
  ASTAKOS_PENDING_APPLICATION_LIMIT.
198

    
199
* Changes in locking strategy:
200

    
201
  * Lock only project's chain for all project operations; lock user before
202
    syncing to quotaholder.
203
  * When locking multiple rows (e.g. users or holdings) include an ORDER BY
204
    clause in the query to impose ordering on locking.
205

    
206
* Changes in views:
207

    
208
  * Replaced custom transaction context with a simple decorator for managing
209
    transactions and a context 'ExceptionHandler', which logs and suppresses
210
    exceptions
211

    
212
* Added fine grain user auth provider's policies.
213

    
214
  * Administrator can override default auth provider policies to a specific 
215
    user or group of users.
216
  * Optionally a user can be assigned to a list of groups, based on the
217
    authentication method he choosed to signup.
218

    
219
* Removed explicit handling of SMTP errors on each email delivery. Exceptions 
220
  are now propagated to base django exception handler.
221

    
222
* Email used in html/email tempaltes which prompt user to contact for service 
223
  support prompts is now defined in ``CONTACT_EMAIL`` setting introduced in 
224
  snf-common settings.
225

    
226
* Improvements in user activation flow
227

    
228
  * User moderation now takes place after the user has verified his email
229
    address.
230
  * User model enriched with additional user state fields
231
  * Split activation email from moderation process. Administrator is required 
232
    to moderate user explicitly using the `user-modify --accept` or
233
    `user-modify --reject` commands.
234
  * Improved logging throught out user activation procedures.
235

    
236
* Remove deprecated AstakosUser model fields: `provider`,
237
  `third_party_identifier`
238

    
239
* Allow override of authentication provider messages using the following 
240
  format in setting names: ``ASTAKOS_<PROVIDER_MODULE>_<MSGID>_MSG``
241

    
242
* Cloudbar automatically tries to identify the active service based on window 
243
  location.
244

    
245
* Removing authentication provider view is now CSRF protected.
246

    
247
* New `API access` view, containing useful information to users on how to 
248
  access available Synnefo services API's.
249

    
250
* Remove of ASTAKOS_*_EMAIL_SUBJECT settings. All email subjects are now 
251
  defined in astakos.im.messages module. Overriding default values can be 
252
  achieved using custom gettext files or using astakos messages settings::
253
	
254
	#change of greeting email subject
255
  	ASTAKOS_GREETING_EMAIL_SUBJECT_MESSAGE = 'Welcome to my cloud'
256

    
257
* Remove ``ASTAKOS_ACTIVATION_REDIRECT_URL`` and ``ASTAKOS_LOGIN_SUCCESS_URL`` 
258
  from astakos .conf file. Settings are dynamically computed based on 
259
  ``ASTAKOS_BASE_URL``.
260

    
261
* Management commands:
262

    
263
  * Introduced new commands:
264
     * authpolicy-{add, list, remove, set, show}
265
     * group-{add, list}
266
     * component-{add, list, modify, remove}
267
     * reconcile-resources-astakos
268
     * resource-{export-astakos, import, modify}
269
     * service-{export-astakos, import, show}
270
  * Renamed commands:
271
     * astakos-quota to quota
272
     * user-update to user-modify
273
     * full-cleanup to cleanup-full
274
  * Removed commands:
275
     * astakos-init
276
     * invitation-{details, list}
277
     * project-sync
278
     * resource-{add, remove}
279
     * service-{add, remove, token-renew, update}
280
     * user-invite
281
     * user-set-initial-quota (integrated its functionality in user-modify and quota)
282
  * Added quota and project-related information in user-show command; added
283
    membership information in project-show.
284

    
285
Cyclades
286
--------
287

    
288
* Make 'type' attribute required for network create API request.
289
* Networks not created to all Ganeti backends upon creation, they are instead
290
  created to a backend only when a VM connects to the network.
291
* Add 'CYCLADES_ASTAKOSCLIENT_POOLSIZE' setting which tunes the size of the
292
  http connection pool to astakos.
293
* Remove 'CYCLADES_USER_CATALOG_URL' and 'CYCLADES_USER_FEEDBACK_URL' settings
294
* Remove CYCLADES_USE_QUOTAHOLDER, CYCLADES_QUOTAHOLDER_TOKEN,
295
  CYCLADES_QUOTAHOLDER_URL, CYCLADES_QUOTAHOLDER_POOLSIZE settings
296
* Rename 'cyclades-usage-verify' management command to
297
  'reconcile-resources-cyclades'. Also, remove 'cyclades-usage-reset' command,
298
  which is equivalent to 'reconcile-resources-cyclades --fix'.
299
* Rename 'cyclades-reconcile-commissions' management command to
300
  'reconcile-commissions-cyclades'.
301
* Remove obsolete 'MAX_VMS_PER_USER', 'MAX_NETWORKS_PER_USER',
302
  "VMS_USER_QUOTA" and "NETWORKS_USER_QUOTA" settings, since their usage
303
  is covered by Quotaholder.
304
* Remove obsolete setting 'API_ROOT_URL', since it is being covered by
305
  the use of CYCLADES_BASE_URL* Remove obsolete setting 'API_ROOT_URL', since
306
  it is being covered by 'CYCLADES_BASE_URL'.
307
* Remove obsolete settings GANETI_DISK_TEMPLATES and
308
  DEFAULT_GANETI_DISK_TEMPLATE
309

    
310
Cyclades helpdesk
311
-----------------
312

    
313
* Additional start/stop vm action
314
* Display extend backend info in vm's view
315
* Fixed IP lookup
316

    
317
Pithos
318
------
319

    
320
* Remove PITHOS_AUTHENTICATION_USERS setting, which was used to override
321
  astakos users.
322
* Remove 'PITHOS_USER_CATALOG_URL', 'PITHOS_USER_FEEDBACK_URL' and
323
  'PITHOS_USER_LOGIN_URL' settings.
324
* Remove PITHOS_USE_QUOTAHOLDER, PITHOS_QUOTAHOLDER_URL,
325
  PITHOS_QUOTAHOLDER_TOKEN and PITHOS_ASTAKOSCLIENT_POOLSIZE
326

    
327
Tools
328
-----
329

    
330

    
331
.. _Changelog-0.13:
332

    
333
v0.13
334
=====
335

    
336
Released: Wed Apr 10 18:52:50 EEST 2013
337

    
338
In v0.13 the code was very heavily refactored for increased uniformity since
339
most of the Synnefo components have been merged into a single repository. Thus,
340
**just for this version** we will not document a complete Changelog (features,
341
fixes, improvements, issues, setting changes), but rather just copy from the
342
`NEWS` file with minor additions wherever needed.
343

    
344
Synnefo-wide
345
------------
346

    
347
* Support for pooling throughout Synnefo
348

    
349
  * Pooled Django DB connections, Pithos backend connections, HTTP
350
    connections using single `objpool` package
351

    
352
* Improved management commands
353

    
354
  * Unified codebase for output of tables in JSON, CSV
355

    
356
* Bring most of Synnefo code inside a single, unified repository
357

    
358
  * support automatic Python and Debian package builds for individual commits
359
  * with automatic version generation
360

    
361
* Overhauling of Synnefo settings: renames and refactoring, for increased
362
  uniformity (in progress)
363
* Deployment: Standardize on gunicorn, with gevent-based workers
364
  and use of Green threads throughout Synnefo
365
* Documentation: New scale-out guide, with distinct node roles,
366
  for mass Synnefo deployments
367

    
368
Astakos
369
-------
370

    
371
* Support multiple authentication methods
372

    
373
  * Classic (username/password), Shibboleth, LDAP/Active Directory,
374
    Google, Twitter, LinkedIn
375
  * Users can enable/disable auth methods, and switch between them
376

    
377
* Introduce a UUID as a global identifier for users, throughout Synnefo
378

    
379
  * The UUID remains constant as the user enables/disables login methods
380

    
381
* Allow users to modify their email address freely
382
* Per-user, per-resource accounting mechanism (quotaholder)
383
* Full quota support, with per-user, per-resource quotas, based on quotaholder
384
* Projects: Users can create and join Projects
385

    
386
  * Projects grant extra resources to their members
387

    
388
* UI Enhancements for quotas and projects
389

    
390
  * distinct Usage tab, showing usage of individual resources
391
  * Project management UI
392
  * New Overview page
393

    
394
* refactored/improved /login endpoint used by desktop/mobile clients.
395
  * endpoint url is now exposed by `weblogin` service
396
  * clients should use unauthenticated identity/tokens api to resolve the 
397
    endpoint url
398
  * view only allows redirects to `pithos://` scheme urls
399
  * removed uuid from redirect parameters. Client should use authenticated 
400
    request to identity/tokens to retrieve user uuid.
401

    
402

    
403
Cyclades
404
--------
405

    
406
* Commission resources on quotaholder/Astakos
407
* Support mass creation of flavors
408
* Support for the ExtStorage disk template in Ganeti
409
* Query and report quotas in the UI
410
* Pass VM configuration parameters over a VM-side API (`vmapi`)
411

    
412
  * Do not pass sensitive data as Ganeti OS parameters
413
  * Keep sensitive data in memory caches (memcached) and
414
    never allow them to hit the disk
415

    
416
* Display additional backend information in helpdesk machines list
417
* Allow helpdesk users to search for an account using a known machine id
418
* Helpdesk actions are now logged using the synnefo's common login
419
  infrastructure
420

    
421
UI
422
^^
423
* Removed feedback endpoint. Feedback requests delegate to astakos feedback
424
  service. ``FEEDBACK_CONTACTS``, ``FEEDBACK_EMAIL_FROM`` settings removed, 
425
  and no longer used.
426
* ``UI_LOGIN_URL``, ``UI_GLANCE_URL``, ``COMPUTE_URL`` settings no longer 
427
  required to be set and are dynamically computed based on ``ASTAKOS_BASE_URL``
428
  and ``CYCLADES_BASE_URL`` settings.
429
* File group is no longer included in ssh keys personality metadata sent in 
430
  create vm calls.
431
  
432

    
433
Pithos
434
------
435

    
436
* Support storage of blocks on a RADOS backend, for Archipelago
437

    
438
  * new settings:
439
    PITHOS_RADOS_STORAGE, PITHOS_RADOS_POOL_BLOCKS, PITHOS_RADOS_POOL_MAPS
440

    
441
* X-Object-Public now contains full url (domain + proper component prefix + 
442
  file path)
443

    
444
* Rewritten support for public URLs, with admin-selectable length
445

    
446
  * new settings:
447
    PITHOS_PUBLIC_URL_SECURITY, PITHOS_PUBLIC_URL_ALPHABET
448

    
449
* Enable pithos backend to use external quotaholder component
450

    
451
  * new settings:
452
    PITHOS_USE_QUOTAHOLDER, PITHOS_QUOTAHOLDER_URL, PITHOS_QUOTAHOLDER_TOKEN,
453
    PITHOS_QUOTAHOLDER_POOLSIZE
454

    
455
* Moderated version debiting mechanism
456

    
457
  * new setting:
458
    PITHOS_BACKEND_FREE_VERSIONING
459

    
460
* Proxy Astakos user-visible services
461

    
462
  * new settings:
463
    PITHOS_PROXY_USER_SERVICES, PITHOS_USER_CATALOG_URL,
464
    PITHOS_USER_FEEDBACK_URL, PITHOS_USER_LOGIN_URL
465

    
466
Tools
467
-----
468

    
469
* Extend snf-burnin to include testing of Pithos functionality