Statistics
| Branch: | Tag: | Revision:

root / NEWS @ a3d1dc0a

History | View | Annotate | Download (90 kB)

1
News
2
====
3

    
4

    
5
Version 2.6.2
6
-------------
7

    
8
*(unreleased)*
9

    
10
Behaviour change: hbal won't rebalance anymore instances which have the
11
'auto_balance' attribute set to false. This was the intention all along,
12
but until now it only skipped those from the N+1 memory reservation
13
(DRBD-specific).
14

    
15
Besides that, a number of bugfixes:
16

    
17
- Disk adoption interaction with ipolicy checks has been fixed.
18
- Tap device's MAC prefix is now forcibly set to "fe" (issue 217).
19
- Option to force master-failover without voting added (issue 282).
20
- Removal of storage directory on shared file storage was fixed (issue
21
  262).
22
- Validation of LVM volume group name in OpClusterSetParams
23
  (``gnt-cluster modify``) was corrected (issue 285).
24
- Clarified error message on lock conflict (issue 287).
25
- Logging of newly submitted jobs has been improved (issue 290).
26
- Hostname checks have been made uniform between instance rename and
27
  create (issue 291).
28
- The ``--submit`` option is now supported by ``gnt-debug delay``.
29
- Shutting down the master daemon by sending SIGTERM now stops it from
30
  processing jobs waiting for locks; instead, those jobs will be started
31
  once again after the master daemon is started the next time (issue
32
  296).
33
- Support for Xen's ``xl`` program has been improved.
34
- A type error when doing live migrations with KVM has been fixed (issue
35
  297) and error messages for failing migrations have been improved.
36
- Another type error when unsetting OS parameters has been fixed (issue
37
  311).
38
- Several man page updates and typo fixes.
39

    
40

    
41
Version 2.6.1
42
-------------
43

    
44
*(Released Fri, 12 Oct 2012)*
45

    
46
A small bugfix release. Among the bugs fixed:
47

    
48
- Fixed double use of ``PRIORITY_OPT`` in ``gnt-node migrate``, that
49
  made the command unusable.
50
- Commands that issue many jobs don't fail anymore just because some jobs
51
  take so long that other jobs are archived.
52
- Failures during ``gnt-instance reinstall`` are reflected by the exit
53
  status.
54
- Issue 190 fixed. Check for DRBD in cluster verify is enabled only when
55
  DRBD is enabled.
56
- When ``always_failover`` is set, ``--allow-failover`` is not required
57
  in migrate commands anymore.
58
- ``bash_completion`` works even if extglob is disabled.
59
- Fixed bug with locks that made failover for RDB-based instances fail.
60
- Fixed bug in non-mirrored instance allocation that made Ganeti choose
61
  a random node instead of one based on the allocator metric.
62
- Support for newer versions of pylint and pep8.
63
- Hail doesn't fail anymore when trying to add an instance of type
64
  ``file``, ``sharedfile`` or ``rbd``.
65
- Added new Makefile target to rebuild the whole distribution, so that
66
  all files are included.
67

    
68

    
69
Version 2.6.0
70
-------------
71

    
72
*(Released Fri, 27 Jul 2012)*
73

    
74

    
75
.. attention:: The ``LUXI`` protocol has been made more consistent
76
   regarding its handling of command arguments. This, however, leads to
77
   incompatibility issues with previous versions. Please ensure that you
78
   restart Ganeti daemons soon after the upgrade, otherwise most
79
   ``LUXI`` calls (job submission, setting/resetting the drain flag,
80
   pausing/resuming the watcher, cancelling and archiving jobs, querying
81
   the cluster configuration) will fail.
82

    
83

    
84
New features
85
~~~~~~~~~~~~
86

    
87
Instance run status
88
+++++++++++++++++++
89

    
90
The current ``admin_up`` field, which used to denote whether an instance
91
should be running or not, has been removed. Instead, ``admin_state`` is
92
introduced, with 3 possible values -- ``up``, ``down`` and ``offline``.
93

    
94
The rational behind this is that an instance being “down” can have
95
different meanings:
96

    
97
- it could be down during a reboot
98
- it could be temporarily be down for a reinstall
99
- or it could be down because it is deprecated and kept just for its
100
  disk
101

    
102
The previous Boolean state was making it difficult to do capacity
103
calculations: should Ganeti reserve memory for a down instance? Now, the
104
tri-state field makes it clear:
105

    
106
- in ``up`` and ``down`` state, all resources are reserved for the
107
  instance, and it can be at any time brought up if it is down
108
- in ``offline`` state, only disk space is reserved for it, but not
109
  memory or CPUs
110

    
111
The field can have an extra use: since the transition between ``up`` and
112
``down`` and vice-versus is done via ``gnt-instance start/stop``, but
113
transition between ``offline`` and ``down`` is done via ``gnt-instance
114
modify``, it is possible to given different rights to users. For
115
example, owners of an instance could be allowed to start/stop it, but
116
not transition it out of the offline state.
117

    
118
Instance policies and specs
119
+++++++++++++++++++++++++++
120

    
121
In previous Ganeti versions, an instance creation request was not
122
limited on the minimum size and on the maximum size just by the cluster
123
resources. As such, any policy could be implemented only in third-party
124
clients (RAPI clients, or shell wrappers over ``gnt-*``
125
tools). Furthermore, calculating cluster capacity via ``hspace`` again
126
required external input with regards to instance sizes.
127

    
128
In order to improve these workflows and to allow for example better
129
per-node group differentiation, we introduced instance specs, which
130
allow declaring:
131

    
132
- minimum instance disk size, disk count, memory size, cpu count
133
- maximum values for the above metrics
134
- and “standard” values (used in ``hspace`` to calculate the standard
135
  sized instances)
136

    
137
The minimum/maximum values can be also customised at node-group level,
138
for example allowing more powerful hardware to support bigger instance
139
memory sizes.
140

    
141
Beside the instance specs, there are a few other settings belonging to
142
the instance policy framework. It is possible now to customise, per
143
cluster and node-group:
144

    
145
- the list of allowed disk templates
146
- the maximum ratio of VCPUs per PCPUs (to control CPU oversubscription)
147
- the maximum ratio of instance to spindles (see below for more
148
  information) for local storage
149

    
150
All these together should allow all tools that talk to Ganeti to know
151
what are the ranges of allowed values for instances and the
152
over-subscription that is allowed.
153

    
154
For the VCPU/PCPU ratio, we already have the VCPU configuration from the
155
instance configuration, and the physical CPU configuration from the
156
node. For the spindle ratios however, we didn't track before these
157
values, so new parameters have been added:
158

    
159
- a new node parameter ``spindle_count``, defaults to 1, customisable at
160
  node group or node level
161
- at new backend parameter (for instances), ``spindle_use`` defaults to 1
162

    
163
Note that spindles in this context doesn't need to mean actual
164
mechanical hard-drives; it's just a relative number for both the node
165
I/O capacity and instance I/O consumption.
166

    
167
Instance migration behaviour
168
++++++++++++++++++++++++++++
169

    
170
While live-migration is in general desirable over failover, it is
171
possible that for some workloads it is actually worse, due to the
172
variable time of the “suspend” phase during live migration.
173

    
174
To allow the tools to work consistently over such instances (without
175
having to hard-code instance names), a new backend parameter
176
``always_failover`` has been added to control the migration/failover
177
behaviour. When set to True, all migration requests for an instance will
178
instead fall-back to failover.
179

    
180
Instance memory ballooning
181
++++++++++++++++++++++++++
182

    
183
Initial support for memory ballooning has been added. The memory for an
184
instance is no longer fixed (backend parameter ``memory``), but instead
185
can vary between minimum and maximum values (backend parameters
186
``minmem`` and ``maxmem``). Currently we only change an instance's
187
memory when:
188

    
189
- live migrating or failing over and instance and the target node
190
  doesn't have enough memory
191
- user requests changing the memory via ``gnt-instance modify
192
  --runtime-memory``
193

    
194
Instance CPU pinning
195
++++++++++++++++++++
196

    
197
In order to control the use of specific CPUs by instance, support for
198
controlling CPU pinning has been added for the Xen, HVM and LXC
199
hypervisors. This is controlled by a new hypervisor parameter
200
``cpu_mask``; details about possible values for this are in the
201
:manpage:`gnt-instance(8)`. Note that use of the most specific (precise
202
VCPU-to-CPU mapping) form will work well only when all nodes in your
203
cluster have the same amount of CPUs.
204

    
205
Disk parameters
206
+++++++++++++++
207

    
208
Another area in which Ganeti was not customisable were the parameters
209
used for storage configuration, e.g. how many stripes to use for LVM,
210
DRBD resync configuration, etc.
211

    
212
To improve this area, we've added disks parameters, which are
213
customisable at cluster and node group level, and which allow to
214
specify various parameters for disks (DRBD has the most parameters
215
currently), for example:
216

    
217
- DRBD resync algorithm and parameters (e.g. speed)
218
- the default VG for meta-data volumes for DRBD
219
- number of stripes for LVM (plain disk template)
220
- the RBD pool
221

    
222
These parameters can be modified via ``gnt-cluster modify -D …`` and
223
``gnt-group modify -D …``, and are used at either instance creation (in
224
case of LVM stripes, for example) or at disk “activation” time
225
(e.g. resync speed).
226

    
227
Rados block device support
228
++++++++++++++++++++++++++
229

    
230
A Rados (http://ceph.com/wiki/Rbd) storage backend has been added,
231
denoted by the ``rbd`` disk template type. This is considered
232
experimental, feedback is welcome. For details on configuring it, see
233
the :doc:`install` document and the :manpage:`gnt-cluster(8)` man page.
234

    
235
Master IP setup
236
+++++++++++++++
237

    
238
The existing master IP functionality works well only in simple setups (a
239
single network shared by all nodes); however, if nodes belong to
240
different networks, then the ``/32`` setup and lack of routing
241
information is not enough.
242

    
243
To allow the master IP to function well in more complex cases, the
244
system was reworked as follows:
245

    
246
- a master IP netmask setting has been added
247
- the master IP activation/turn-down code was moved from the node daemon
248
  to a separate script
249
- whether to run the Ganeti-supplied master IP script or a user-supplied
250
  on is a ``gnt-cluster init`` setting
251

    
252
Details about the location of the standard and custom setup scripts are
253
in the man page :manpage:`gnt-cluster(8)`; for information about the
254
setup script protocol, look at the Ganeti-supplied script.
255

    
256
SPICE support
257
+++++++++++++
258

    
259
The `SPICE <http://www.linux-kvm.org/page/SPICE>`_ support has been
260
improved.
261

    
262
It is now possible to use TLS-protected connections, and when renewing
263
or changing the cluster certificates (via ``gnt-cluster renew-crypto``,
264
it is now possible to specify spice or spice CA certificates. Also, it
265
is possible to configure a password for SPICE sessions via the
266
hypervisor parameter ``spice_password_file``.
267

    
268
There are also new parameters to control the compression and streaming
269
options (e.g. ``spice_image_compression``, ``spice_streaming_video``,
270
etc.). For details, see the man page :manpage:`gnt-instance(8)` and look
271
for the spice parameters.
272

    
273
Lastly, it is now possible to see the SPICE connection information via
274
``gnt-instance console``.
275

    
276
OVF converter
277
+++++++++++++
278

    
279
A new tool (``tools/ovfconverter``) has been added that supports
280
conversion between Ganeti and the `Open Virtualization Format
281
<http://en.wikipedia.org/wiki/Open_Virtualization_Format>`_ (both to and
282
from).
283

    
284
This relies on the ``qemu-img`` tool to convert the disk formats, so the
285
actual compatibility with other virtualization solutions depends on it.
286

    
287
Confd daemon changes
288
++++++++++++++++++++
289

    
290
The configuration query daemon (``ganeti-confd``) is now optional, and
291
has been rewritten in Haskell; whether to use the daemon at all, use the
292
Python (default) or the Haskell version is selectable at configure time
293
via the ``--enable-confd`` parameter, which can take one of the
294
``haskell``, ``python`` or ``no`` values. If not used, disabling the
295
daemon will result in a smaller footprint; for larger systems, we
296
welcome feedback on the Haskell version which might become the default
297
in future versions.
298

    
299
If you want to use ``gnt-node list-drbd`` you need to have the Haskell
300
daemon running. The Python version doesn't implement the new call.
301

    
302

    
303
User interface changes
304
~~~~~~~~~~~~~~~~~~~~~~
305

    
306
We have replaced the ``--disks`` option of ``gnt-instance
307
replace-disks`` with a more flexible ``--disk`` option, which allows
308
adding and removing disks at arbitrary indices (Issue 188). Furthermore,
309
disk size and mode can be changed upon recreation (via ``gnt-instance
310
recreate-disks``, which accepts the same ``--disk`` option).
311

    
312
As many people are used to a ``show`` command, we have added that as an
313
alias to ``info`` on all ``gnt-*`` commands.
314

    
315
The ``gnt-instance grow-disk`` command has a new mode in which it can
316
accept the target size of the disk, instead of the delta; this can be
317
more safe since two runs in absolute mode will be idempotent, and
318
sometimes it's also easier to specify the desired size directly.
319

    
320
Also the handling of instances with regard to offline secondaries has
321
been improved. Instance operations should not fail because one of it's
322
secondary nodes is offline, even though it's safe to proceed.
323

    
324
A new command ``list-drbd`` has been added to the ``gnt-node`` script to
325
support debugging of DRBD issues on nodes. It provides a mapping of DRBD
326
minors to instance name.
327

    
328
API changes
329
~~~~~~~~~~~
330

    
331
RAPI coverage has improved, with (for example) new resources for
332
recreate-disks, node power-cycle, etc.
333

    
334
Compatibility
335
~~~~~~~~~~~~~
336

    
337
There is partial support for ``xl`` in the Xen hypervisor; feedback is
338
welcome.
339

    
340
Python 2.7 is better supported, and after Ganeti 2.6 we will investigate
341
whether to still support Python 2.4 or move to Python 2.6 as minimum
342
required version.
343

    
344
Support for Fedora has been slightly improved; the provided example
345
init.d script should work better on it and the INSTALL file should
346
document the needed dependencies.
347

    
348
Internal changes
349
~~~~~~~~~~~~~~~~
350

    
351
The deprecated ``QueryLocks`` LUXI request has been removed. Use
352
``Query(what=QR_LOCK, ...)`` instead.
353

    
354
The LUXI requests :pyeval:`luxi.REQ_QUERY_JOBS`,
355
:pyeval:`luxi.REQ_QUERY_INSTANCES`, :pyeval:`luxi.REQ_QUERY_NODES`,
356
:pyeval:`luxi.REQ_QUERY_GROUPS`, :pyeval:`luxi.REQ_QUERY_EXPORTS` and
357
:pyeval:`luxi.REQ_QUERY_TAGS` are deprecated and will be removed in a
358
future version. :pyeval:`luxi.REQ_QUERY` should be used instead.
359

    
360
RAPI client: ``CertificateError`` now derives from
361
``GanetiApiError``. This should make it more easy to handle Ganeti
362
errors.
363

    
364
Deprecation warnings due to PyCrypto/paramiko import in
365
``tools/setup-ssh`` have been silenced, as usually they are safe; please
366
make sure to run an up-to-date paramiko version, if you use this tool.
367

    
368
The QA scripts now depend on Python 2.5 or above (the main code base
369
still works with Python 2.4).
370

    
371
The configuration file (``config.data``) is now written without
372
indentation for performance reasons; if you want to edit it, it can be
373
re-formatted via ``tools/fmtjson``.
374

    
375
A number of bugs has been fixed in the cluster merge tool.
376

    
377
``x509`` certification verification (used in import-export) has been
378
changed to allow the same clock skew as permitted by the cluster
379
verification. This will remove some rare but hard to diagnose errors in
380
import-export.
381

    
382

    
383
Version 2.6.0 rc4
384
-----------------
385

    
386
*(Released Thu, 19 Jul 2012)*
387

    
388
Very few changes from rc4 to the final release, only bugfixes:
389

    
390
- integrated fixes from release 2.5.2 (fix general boot flag for KVM
391
  instance, fix CDROM booting for KVM instances)
392
- fixed node group modification of node parameters
393
- fixed issue in LUClusterVerifyGroup with multi-group clusters
394
- fixed generation of bash completion to ensure a stable ordering
395
- fixed a few typos
396

    
397

    
398
Version 2.6.0 rc3
399
-----------------
400

    
401
*(Released Fri, 13 Jul 2012)*
402

    
403
Third release candidate for 2.6. The following changes were done from
404
rc3 to rc4:
405

    
406
- Fixed ``UpgradeConfig`` w.r.t. to disk parameters on disk objects.
407
- Fixed an inconsistency in the LUXI protocol with the provided
408
  arguments (NOT backwards compatible)
409
- Fixed a bug with node groups ipolicy where ``min`` was greater than
410
  the cluster ``std`` value
411
- Implemented a new ``gnt-node list-drbd`` call to list DRBD minors for
412
  easier instance debugging on nodes (requires ``hconfd`` to work)
413

    
414

    
415
Version 2.6.0 rc2
416
-----------------
417

    
418
*(Released Tue, 03 Jul 2012)*
419

    
420
Second release candidate for 2.6. The following changes were done from
421
rc2 to rc3:
422

    
423
- Fixed ``gnt-cluster verify`` regarding ``master-ip-script`` on non
424
  master candidates
425
- Fixed a RAPI regression on missing beparams/memory
426
- Fixed redistribution of files on offline nodes
427
- Added possibility to run activate-disks even though secondaries are
428
  offline. With this change it relaxes also the strictness on some other
429
  commands which use activate disks internally:
430
  * ``gnt-instance start|reboot|rename|backup|export``
431
- Made it possible to remove safely an instance if its secondaries are
432
  offline
433
- Made it possible to reinstall even though secondaries are offline
434

    
435

    
436
Version 2.6.0 rc1
437
-----------------
438

    
439
*(Released Mon, 25 Jun 2012)*
440

    
441
First release candidate for 2.6. The following changes were done from
442
rc1 to rc2:
443

    
444
- Fixed bugs with disk parameters and ``rbd`` templates as well as
445
  ``instance_os_add``
446
- Made ``gnt-instance modify`` more consistent regarding new NIC/Disk
447
  behaviour. It supports now the modify operation
448
- ``hcheck`` implemented to analyze cluster health and possibility of
449
  improving health by rebalance
450
- ``hbal`` has been improved in dealing with split instances
451

    
452

    
453
Version 2.6.0 beta2
454
-------------------
455

    
456
*(Released Mon, 11 Jun 2012)*
457

    
458
Second beta release of 2.6. The following changes were done from beta2
459
to rc1:
460

    
461
- Fixed ``daemon-util`` with non-root user models
462
- Fixed creation of plain instances with ``--no-wait-for-sync``
463
- Fix wrong iv_names when running ``cfgupgrade``
464
- Export more information in RAPI group queries
465
- Fixed bug when changing instance network interfaces
466
- Extended burnin to do NIC changes
467
- query: Added ``<``, ``>``, ``<=``, ``>=`` comparison operators
468
- Changed default for DRBD barriers
469
- Fixed DRBD error reporting for syncer rate
470
- Verify the options on disk parameters
471

    
472
And of course various fixes to documentation and improved unittests and
473
QA.
474

    
475

    
476
Version 2.6.0 beta1
477
-------------------
478

    
479
*(Released Wed, 23 May 2012)*
480

    
481
First beta release of 2.6. The following changes were done from beta1 to
482
beta2:
483

    
484
- integrated patch for distributions without ``start-stop-daemon``
485
- adapted example init.d script to work on Fedora
486
- fixed log handling in Haskell daemons
487
- adapted checks in the watcher for pycurl linked against libnss
488
- add partial support for ``xl`` instead of ``xm`` for Xen
489
- fixed a type issue in cluster verification
490
- fixed ssconf handling in the Haskell code (was breaking confd in IPv6
491
  clusters)
492

    
493
Plus integrated fixes from the 2.5 branch:
494

    
495
- fixed ``kvm-ifup`` to use ``/bin/bash``
496
- fixed parallel build failures
497
- KVM live migration when using a custom keymap
498

    
499

    
500
Version 2.5.2
501
-------------
502

    
503
*(Released Tue, 24 Jul 2012)*
504

    
505
A small bugfix release, with no new features:
506

    
507
- fixed bash-isms in kvm-ifup, for compatibility with systems which use a
508
  different default shell (e.g. Debian, Ubuntu)
509
- fixed KVM startup and live migration with a custom keymap (fixes Issue
510
  243 and Debian bug #650664)
511
- fixed compatibility with KVM versions that don't support multiple boot
512
  devices (fixes Issue 230 and Debian bug #624256)
513

    
514
Additionally, a few fixes were done to the build system (fixed parallel
515
build failures) and to the unittests (fixed race condition in test for
516
FileID functions, and the default enable/disable mode for QA test is now
517
customisable).
518

    
519

    
520
Version 2.5.1
521
-------------
522

    
523
*(Released Fri, 11 May 2012)*
524

    
525
A small bugfix release.
526

    
527
The main issues solved are on the topic of compatibility with newer LVM
528
releases:
529

    
530
- fixed parsing of ``lv_attr`` field
531
- adapted to new ``vgreduce --removemissing`` behaviour where sometimes
532
  the ``--force`` flag is needed
533

    
534
Also on the topic of compatibility, ``tools/lvmstrap`` has been changed
535
to accept kernel 3.x too (was hardcoded to 2.6.*).
536

    
537
A regression present in 2.5.0 that broke handling (in the gnt-* scripts)
538
of hook results and that also made display of other errors suboptimal
539
was fixed; the code behaves now like 2.4 and earlier.
540

    
541
Another change in 2.5, the cleanup of the OS scripts environment, is too
542
aggressive: it removed even the ``PATH`` variable, which requires the OS
543
scripts to *always* need to export it. Since this is a bit too strict,
544
we now export a minimal PATH, the same that we export for hooks.
545

    
546
The fix for issue 201 (Preserve bridge MTU in KVM ifup script) was
547
integrated into this release.
548

    
549
Finally, a few other miscellaneous changes were done (no new features,
550
just small improvements):
551

    
552
- Fix ``gnt-group --help`` display
553
- Fix hardcoded Xen kernel path
554
- Fix grow-disk handling of invalid units
555
- Update synopsis for ``gnt-cluster repair-disk-sizes``
556
- Accept both PUT and POST in noded (makes future upgrade to 2.6 easier)
557

    
558

    
559
Version 2.5.0
560
-------------
561

    
562
*(Released Thu, 12 Apr 2012)*
563

    
564
Incompatible/important changes and bugfixes
565
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
566

    
567
- The default of the ``/2/instances/[instance_name]/rename`` RAPI
568
  resource's ``ip_check`` parameter changed from ``True`` to ``False``
569
  to match the underlying LUXI interface.
570
- The ``/2/nodes/[node_name]/evacuate`` RAPI resource was changed to use
571
  body parameters, see :doc:`RAPI documentation <rapi>`. The server does
572
  not maintain backwards-compatibility as the underlying operation
573
  changed in an incompatible way. The RAPI client can talk to old
574
  servers, but it needs to be told so as the return value changed.
575
- When creating file-based instances via RAPI, the ``file_driver``
576
  parameter no longer defaults to ``loop`` and must be specified.
577
- The deprecated ``bridge`` NIC parameter is no longer supported. Use
578
  ``link`` instead.
579
- Support for the undocumented and deprecated RAPI instance creation
580
  request format version 0 has been dropped. Use version 1, supported
581
  since Ganeti 2.1.3 and :doc:`documented <rapi>`, instead.
582
- Pyparsing 1.4.6 or above is required, see :doc:`installation
583
  documentation <install>`.
584
- The "cluster-verify" hooks are now executed per group by the
585
  ``OP_CLUSTER_VERIFY_GROUP`` opcode. This maintains the same behavior
586
  if you just run ``gnt-cluster verify``, which generates one opcode per
587
  group.
588
- The environment as passed to the OS scripts is cleared, and thus no
589
  environment variables defined in the node daemon's environment will be
590
  inherited by the scripts.
591
- The :doc:`iallocator <iallocator>` mode ``multi-evacuate`` has been
592
  deprecated.
593
- :doc:`New iallocator modes <design-multi-reloc>` have been added to
594
  support operations involving multiple node groups.
595
- Offline nodes are ignored when failing over an instance.
596
- Support for KVM version 1.0, which changed the version reporting format
597
  from 3 to 2 digits.
598
- TCP/IP ports used by DRBD disks are returned to a pool upon instance
599
  removal.
600
- ``Makefile`` is now compatible with Automake 1.11.2
601
- Includes all bugfixes made in the 2.4 series
602

    
603
New features
604
~~~~~~~~~~~~
605

    
606
- The ganeti-htools project has been merged into the ganeti-core source
607
  tree and will be built as part of Ganeti (see :doc:`install-quick`).
608
- Implemented support for :doc:`shared storage <design-shared-storage>`.
609
- Add support for disks larger than 2 TB in ``lvmstrap`` by supporting
610
  GPT-style partition tables (requires `parted
611
  <http://www.gnu.org/s/parted/>`_).
612
- Added support for floppy drive and 2nd CD-ROM drive in KVM hypervisor.
613
- Allowed adding tags on instance creation.
614
- Export instance tags to hooks (``INSTANCE_TAGS``, see :doc:`hooks`)
615
- Allow instances to be started in a paused state, enabling the user to
616
  see the complete console output on boot using the console.
617
- Added new hypervisor flag to control default reboot behaviour
618
  (``reboot_behavior``).
619
- Added support for KVM keymaps (hypervisor parameter ``keymap``).
620
- Improved out-of-band management support:
621

    
622
  - Added ``gnt-node health`` command reporting the health status of
623
    nodes.
624
  - Added ``gnt-node power`` command to manage power status of nodes.
625
  - Added command for emergency power-off (EPO), ``gnt-cluster epo``.
626

    
627
- Instance migration can fall back to failover if instance is not
628
  running.
629
- Filters can be used when listing nodes, instances, groups and locks;
630
  see *ganeti(7)* manpage.
631
- Added post-execution status as variables to :doc:`hooks <hooks>`
632
  environment.
633
- Instance tags are exported/imported together with the instance.
634
- When given an explicit job ID, ``gnt-job info`` will work for archived
635
  jobs.
636
- Jobs can define dependencies on other jobs (not yet supported via
637
  RAPI or command line, but used by internal commands and usable via
638
  LUXI).
639

    
640
  - Lock monitor (``gnt-debug locks``) shows jobs waiting for
641
    dependencies.
642

    
643
- Instance failover is now available as a RAPI resource
644
  (``/2/instances/[instance_name]/failover``).
645
- ``gnt-instance info`` defaults to static information if primary node
646
  is offline.
647
- Opcodes have a new ``comment`` attribute.
648
- Added basic SPICE support to KVM hypervisor.
649
- ``tools/ganeti-listrunner`` allows passing of arguments to executable.
650

    
651
Node group improvements
652
~~~~~~~~~~~~~~~~~~~~~~~
653

    
654
- ``gnt-cluster verify`` has been modified to check groups separately,
655
  thereby improving performance.
656
- Node group support has been added to ``gnt-cluster verify-disks``,
657
  which now operates per node group.
658
- Watcher has been changed to work better with node groups.
659

    
660
  - One process and state file per node group.
661
  - Slow watcher in one group doesn't block other group's watcher.
662

    
663
- Added new command, ``gnt-group evacuate``, to move all instances in a
664
  node group to other groups.
665
- Added ``gnt-instance change-group`` to move an instance to another
666
  node group.
667
- ``gnt-cluster command`` and ``gnt-cluster copyfile`` now support
668
  per-group operations.
669
- Node groups can be tagged.
670
- Some operations switch from an exclusive to a shared lock as soon as
671
  possible.
672
- Instance's primary and secondary nodes' groups are now available as
673
  query fields (``pnode.group``, ``pnode.group.uuid``, ``snodes.group``
674
  and ``snodes.group.uuid``).
675

    
676
Misc
677
~~~~
678

    
679
- Numerous updates to documentation and manpages.
680

    
681
  - :doc:`RAPI <rapi>` documentation now has detailed parameter
682
    descriptions.
683
  - Some opcode/job results are now also documented, see :doc:`RAPI
684
    <rapi>`.
685

    
686
- A lockset's internal lock is now also visible in lock monitor.
687
- Log messages from job queue workers now contain information about the
688
  opcode they're processing.
689
- ``gnt-instance console`` no longer requires the instance lock.
690
- A short delay when waiting for job changes reduces the number of LUXI
691
  requests significantly.
692
- DRBD metadata volumes are overwritten with zeros during disk creation.
693
- Out-of-band commands no longer acquire the cluster lock in exclusive
694
  mode.
695
- ``devel/upload`` now uses correct permissions for directories.
696

    
697

    
698
Version 2.5.0 rc6
699
-----------------
700

    
701
*(Released Fri, 23 Mar 2012)*
702

    
703
This was the sixth release candidate of the 2.5 series.
704

    
705

    
706
Version 2.5.0 rc5
707
-----------------
708

    
709
*(Released Mon, 9 Jan 2012)*
710

    
711
This was the fifth release candidate of the 2.5 series.
712

    
713

    
714
Version 2.5.0 rc4
715
-----------------
716

    
717
*(Released Thu, 27 Oct 2011)*
718

    
719
This was the fourth release candidate of the 2.5 series.
720

    
721

    
722
Version 2.5.0 rc3
723
-----------------
724

    
725
*(Released Wed, 26 Oct 2011)*
726

    
727
This was the third release candidate of the 2.5 series.
728

    
729

    
730
Version 2.5.0 rc2
731
-----------------
732

    
733
*(Released Tue, 18 Oct 2011)*
734

    
735
This was the second release candidate of the 2.5 series.
736

    
737

    
738
Version 2.5.0 rc1
739
-----------------
740

    
741
*(Released Tue, 4 Oct 2011)*
742

    
743
This was the first release candidate of the 2.5 series.
744

    
745

    
746
Version 2.5.0 beta3
747
-------------------
748

    
749
*(Released Wed, 31 Aug 2011)*
750

    
751
This was the third beta release of the 2.5 series.
752

    
753

    
754
Version 2.5.0 beta2
755
-------------------
756

    
757
*(Released Mon, 22 Aug 2011)*
758

    
759
This was the second beta release of the 2.5 series.
760

    
761

    
762
Version 2.5.0 beta1
763
-------------------
764

    
765
*(Released Fri, 12 Aug 2011)*
766

    
767
This was the first beta release of the 2.5 series.
768

    
769

    
770
Version 2.4.5
771
-------------
772

    
773
*(Released Thu, 27 Oct 2011)*
774

    
775
- Fixed bug when parsing command line parameter values ending in
776
  backslash
777
- Fixed assertion error after unclean master shutdown
778
- Disable HTTP client pool for RPC, significantly reducing memory usage
779
  of master daemon
780
- Fixed queue archive creation with wrong permissions
781

    
782

    
783
Version 2.4.4
784
-------------
785

    
786
*(Released Tue, 23 Aug 2011)*
787

    
788
Small bug-fixes:
789

    
790
- Fixed documentation for importing with ``--src-dir`` option
791
- Fixed a bug in ``ensure-dirs`` with queue/archive permissions
792
- Fixed a parsing issue with DRBD 8.3.11 in the Linux kernel
793

    
794

    
795
Version 2.4.3
796
-------------
797

    
798
*(Released Fri, 5 Aug 2011)*
799

    
800
Many bug-fixes and a few small features:
801

    
802
- Fixed argument order in ``ReserveLV`` and ``ReserveMAC`` which caused
803
  issues when you tried to add an instance with two MAC addresses in one
804
  request
805
- KVM: fixed per-instance stored UID value
806
- KVM: configure bridged NICs at migration start
807
- KVM: Fix a bug where instance will not start with never KVM versions
808
  (>= 0.14)
809
- Added OS search path to ``gnt-cluster info``
810
- Fixed an issue with ``file_storage_dir`` where you were forced to
811
  provide an absolute path, but the documentation states it is a
812
  relative path, the documentation was right
813
- Added a new parameter to instance stop/start called ``--no-remember``
814
  that will make the state change to not be remembered
815
- Implemented ``no_remember`` at RAPI level
816
- Improved the documentation
817
- Node evacuation: don't call IAllocator if node is already empty
818
- Fixed bug in DRBD8 replace disks on current nodes
819
- Fixed bug in recreate-disks for DRBD instances
820
- Moved assertion checking locks in ``gnt-instance replace-disks``
821
  causing it to abort with not owning the right locks for some situation
822
- Job queue: Fixed potential race condition when cancelling queued jobs
823
- Fixed off-by-one bug in job serial generation
824
- ``gnt-node volumes``: Fix instance names
825
- Fixed aliases in bash completion
826
- Fixed a bug in reopening log files after being sent a SIGHUP
827
- Added a flag to burnin to allow specifying VCPU count
828
- Bugfixes to non-root Ganeti configuration
829

    
830

    
831
Version 2.4.2
832
-------------
833

    
834
*(Released Thu, 12 May 2011)*
835

    
836
Many bug-fixes and a few new small features:
837

    
838
- Fixed a bug related to log opening failures
839
- Fixed a bug in instance listing with orphan instances
840
- Fixed a bug which prevented resetting the cluster-level node parameter
841
  ``oob_program`` to the default
842
- Many fixes related to the ``cluster-merge`` tool
843
- Fixed a race condition in the lock monitor, which caused failures
844
  during (at least) creation of many instances in parallel
845
- Improved output for gnt-job info
846
- Removed the quiet flag on some ssh calls which prevented debugging
847
  failures
848
- Improved the N+1 failure messages in cluster verify by actually
849
  showing the memory values (needed and available)
850
- Increased lock attempt timeouts so that when executing long operations
851
  (e.g. DRBD replace-disks) other jobs do not enter 'blocking acquire'
852
  too early and thus prevent the use of the 'fair' mechanism
853
- Changed instance query data (``gnt-instance info``) to not acquire
854
  locks unless needed, thus allowing its use on locked instance if only
855
  static information is asked for
856
- Improved behaviour with filesystems that do not support rename on an
857
  opened file
858
- Fixed the behaviour of ``prealloc_wipe_disks`` cluster parameter which
859
  kept locks on all nodes during the wipe, which is unneeded
860
- Fixed ``gnt-watcher`` handling of errors during hooks execution
861
- Fixed bug in ``prealloc_wipe_disks`` with small disk sizes (less than
862
  10GiB) which caused the wipe to fail right at the end in some cases
863
- Fixed master IP activation when doing master failover with no-voting
864
- Fixed bug in ``gnt-node add --readd`` which allowed the re-adding of
865
  the master node itself
866
- Fixed potential data-loss in under disk full conditions, where Ganeti
867
  wouldn't check correctly the return code and would consider
868
  partially-written files 'correct'
869
- Fixed bug related to multiple VGs and DRBD disk replacing
870
- Added new disk parameter ``metavg`` that allows placement of the meta
871
  device for DRBD in a different volume group
872
- Fixed error handling in the node daemon when the system libc doesn't
873
  have major number 6 (i.e. if ``libc.so.6`` is not the actual libc)
874
- Fixed lock release during replace-disks, which kept cluster-wide locks
875
  when doing disk replaces with an iallocator script
876
- Added check for missing bridges in cluster verify
877
- Handle EPIPE errors while writing to the terminal better, so that
878
  piping the output to e.g. ``less`` doesn't cause a backtrace
879
- Fixed rare case where a ^C during Luxi calls could have been
880
  interpreted as server errors, instead of simply terminating
881
- Fixed a race condition in LUGroupAssignNodes (``gnt-group
882
  assign-nodes``)
883
- Added a few more parameters to the KVM hypervisor, allowing a second
884
  CDROM, custom disk type for CDROMs and a floppy image
885
- Removed redundant message in instance rename when the name is given
886
  already as a FQDN
887
- Added option to ``gnt-instance recreate-disks`` to allow creating the
888
  disks on new nodes, allowing recreation when the original instance
889
  nodes are completely gone
890
- Added option when converting disk templates to DRBD to skip waiting
891
  for the resync, in order to make the instance available sooner
892
- Added two new variables to the OS scripts environment (containing the
893
  instance's nodes)
894
- Made the root_path and optional parameter for the xen-pvm hypervisor,
895
  to allow use of ``pvgrub`` as bootloader
896
- Changed the instance memory modifications to only check out-of-memory
897
  conditions on memory increases, and turned the secondary node warnings
898
  into errors (they can still be overridden via ``--force``)
899
- Fixed the handling of a corner case when the Python installation gets
900
  corrupted (e.g. a bad disk) while ganeti-noded is running and we try
901
  to execute a command that doesn't exist
902
- Fixed a bug in ``gnt-instance move`` (LUInstanceMove) when the primary
903
  node of the instance returned failures during instance shutdown; this
904
  adds the option ``--ignore-consistency`` to gnt-instance move
905

    
906
And as usual, various improvements to the error messages, documentation
907
and man pages.
908

    
909

    
910
Version 2.4.1
911
-------------
912

    
913
*(Released Wed, 09 Mar 2011)*
914

    
915
Emergency bug-fix release. ``tools/cfgupgrade`` was broken and overwrote
916
the RAPI users file if run twice (even with ``--dry-run``).
917

    
918
The release fixes that bug (nothing else changed).
919

    
920

    
921
Version 2.4.0
922
-------------
923

    
924
*(Released Mon, 07 Mar 2011)*
925

    
926
Final 2.4.0 release. Just a few small fixes:
927

    
928
- Fixed RAPI node evacuate
929
- Fixed the kvm-ifup script
930
- Fixed internal error handling for special job cases
931
- Updated man page to specify the escaping feature for options
932

    
933

    
934
Version 2.4.0 rc3
935
-----------------
936

    
937
*(Released Mon, 28 Feb 2011)*
938

    
939
A critical fix for the ``prealloc_wipe_disks`` feature: it is possible
940
that this feature wiped the disks of the wrong instance, leading to loss
941
of data.
942

    
943
Other changes:
944

    
945
- Fixed title of query field containing instance name
946
- Expanded the glossary in the documentation
947
- Fixed one unittest (internal issue)
948

    
949

    
950
Version 2.4.0 rc2
951
-----------------
952

    
953
*(Released Mon, 21 Feb 2011)*
954

    
955
A number of bug fixes plus just a couple functionality changes.
956

    
957
On the user-visible side, the ``gnt-* list`` command output has changed
958
with respect to "special" field states. The current rc1 style of display
959
can be re-enabled by passing a new ``--verbose`` (``-v``) flag, but in
960
the default output mode special fields states are displayed as follows:
961

    
962
- Offline resource: ``*``
963
- Unavailable/not applicable: ``-``
964
- Data missing (RPC failure): ``?``
965
- Unknown field: ``??``
966

    
967
Another user-visible change is the addition of ``--force-join`` to
968
``gnt-node add``.
969

    
970
As for bug fixes:
971

    
972
- ``tools/cluster-merge`` has seen many fixes and is now enabled again
973
- Fixed regression in RAPI/instance reinstall where all parameters were
974
  required (instead of optional)
975
- Fixed ``gnt-cluster repair-disk-sizes``, was broken since Ganeti 2.2
976
- Fixed iallocator usage (offline nodes were not considered offline)
977
- Fixed ``gnt-node list`` with respect to non-vm_capable nodes
978
- Fixed hypervisor and OS parameter validation with respect to
979
  non-vm_capable nodes
980
- Fixed ``gnt-cluster verify`` with respect to offline nodes (mostly
981
  cosmetic)
982
- Fixed ``tools/listrunner`` with respect to agent-based usage
983

    
984

    
985
Version 2.4.0 rc1
986
-----------------
987

    
988
*(Released Fri,  4 Feb 2011)*
989

    
990
Many changes and fixes since the beta1 release. While there were some
991
internal changes, the code has been mostly stabilised for the RC
992
release.
993

    
994
Note: the dumb allocator was removed in this release, as it was not kept
995
up-to-date with the IAllocator protocol changes. It is recommended to
996
use the ``hail`` command from the ganeti-htools package.
997

    
998
Note: the 2.4 and up versions of Ganeti are not compatible with the
999
0.2.x branch of ganeti-htools. You need to upgrade to
1000
ganeti-htools-0.3.0 (or later).
1001

    
1002
Regressions fixed from 2.3
1003
~~~~~~~~~~~~~~~~~~~~~~~~~~
1004

    
1005
- Fixed the ``gnt-cluster verify-disks`` command
1006
- Made ``gnt-cluster verify-disks`` work in parallel (as opposed to
1007
  serially on nodes)
1008
- Fixed disk adoption breakage
1009
- Fixed wrong headers in instance listing for field aliases
1010

    
1011
Other bugs fixed
1012
~~~~~~~~~~~~~~~~
1013

    
1014
- Fixed corner case in KVM handling of NICs
1015
- Fixed many cases of wrong handling of non-vm_capable nodes
1016
- Fixed a bug where a missing instance symlink was not possible to
1017
  recreate with any ``gnt-*`` command (now ``gnt-instance
1018
  activate-disks`` does it)
1019
- Fixed the volume group name as reported by ``gnt-cluster
1020
  verify-disks``
1021
- Increased timeouts for the import-export code, hopefully leading to
1022
  fewer aborts due network or instance timeouts
1023
- Fixed bug in ``gnt-node list-storage``
1024
- Fixed bug where not all daemons were started on cluster
1025
  initialisation, but only at the first watcher run
1026
- Fixed many bugs in the OOB implementation
1027
- Fixed watcher behaviour in presence of instances with offline
1028
  secondaries
1029
- Fixed instance list output for instances running on the wrong node
1030
- a few fixes to the cluster-merge tool, but it still cannot merge
1031
  multi-node groups (currently it is not recommended to use this tool)
1032

    
1033

    
1034
Improvements
1035
~~~~~~~~~~~~
1036

    
1037
- Improved network configuration for the KVM hypervisor
1038
- Added e1000 as a supported NIC for Xen-HVM
1039
- Improved the lvmstrap tool to also be able to use partitions, as
1040
  opposed to full disks
1041
- Improved speed of disk wiping (the cluster parameter
1042
  ``prealloc_wipe_disks``, so that it has a low impact on the total time
1043
  of instance creations
1044
- Added documentation for the OS parameters
1045
- Changed ``gnt-instance deactivate-disks`` so that it can work if the
1046
  hypervisor is not responding
1047
- Added display of blacklisted and hidden OS information in
1048
  ``gnt-cluster info``
1049
- Extended ``gnt-cluster verify`` to also validate hypervisor, backend,
1050
  NIC and node parameters, which might create problems with currently
1051
  invalid (but undetected) configuration files, but prevents validation
1052
  failures when unrelated parameters are modified
1053
- Changed cluster initialisation to wait for the master daemon to become
1054
  available
1055
- Expanded the RAPI interface:
1056

    
1057
  - Added config redistribution resource
1058
  - Added activation/deactivation of instance disks
1059
  - Added export of console information
1060

    
1061
- Implemented log file reopening on SIGHUP, which allows using
1062
  logrotate(8) for the Ganeti log files
1063
- Added a basic OOB helper script as an example
1064

    
1065

    
1066
Version 2.4.0 beta1
1067
-------------------
1068

    
1069
*(Released Fri, 14 Jan 2011)*
1070

    
1071
User-visible
1072
~~~~~~~~~~~~
1073

    
1074
- Fixed timezone issues when formatting timestamps
1075
- Added support for node groups, available via ``gnt-group`` and other
1076
  commands
1077
- Added out-of-band framework and management, see :doc:`design
1078
  document <design-oob>`
1079
- Removed support for roman numbers from ``gnt-node list`` and
1080
  ``gnt-instance list``.
1081
- Allowed modification of master network interface via ``gnt-cluster
1082
  modify --master-netdev``
1083
- Accept offline secondaries while shutting down instance disks
1084
- Added ``blockdev_prefix`` parameter to Xen PVM and HVM hypervisors
1085
- Added support for multiple LVM volume groups
1086
- Avoid sorting nodes for ``gnt-node list`` if specific nodes are
1087
  requested
1088
- Added commands to list available fields:
1089

    
1090
  - ``gnt-node list-fields``
1091
  - ``gnt-group list-fields``
1092
  - ``gnt-instance list-fields``
1093

    
1094
- Updated documentation and man pages
1095

    
1096
Integration
1097
~~~~~~~~~~~
1098

    
1099
- Moved ``rapi_users`` file into separate directory, now named
1100
  ``.../ganeti/rapi/users``, ``cfgupgrade`` moves the file and creates a
1101
  symlink
1102
- Added new tool for running commands on many machines,
1103
  ``tools/ganeti-listrunner``
1104
- Implemented more verbose result in ``OpInstanceConsole`` opcode, also
1105
  improving the ``gnt-instance console`` output
1106
- Allowed customisation of disk index separator at ``configure`` time
1107
- Export node group allocation policy to :doc:`iallocator <iallocator>`
1108
- Added support for non-partitioned md disks in ``lvmstrap``
1109
- Added script to gracefully power off KVM instances
1110
- Split ``utils`` module into smaller parts
1111
- Changed query operations to return more detailed information, e.g.
1112
  whether an information is unavailable due to an offline node. To use
1113
  this new functionality, the LUXI call ``Query`` must be used. Field
1114
  information is now stored by the master daemon and can be retrieved
1115
  using ``QueryFields``. Instances, nodes and groups can also be queried
1116
  using the new opcodes ``OpQuery`` and ``OpQueryFields`` (not yet
1117
  exposed via RAPI). The following commands make use of this
1118
  infrastructure change:
1119

    
1120
  - ``gnt-group list``
1121
  - ``gnt-group list-fields``
1122
  - ``gnt-node list``
1123
  - ``gnt-node list-fields``
1124
  - ``gnt-instance list``
1125
  - ``gnt-instance list-fields``
1126
  - ``gnt-debug locks``
1127

    
1128
Remote API
1129
~~~~~~~~~~
1130

    
1131
- New RAPI resources (see :doc:`rapi`):
1132

    
1133
  - ``/2/modify``
1134
  - ``/2/groups``
1135
  - ``/2/groups/[group_name]``
1136
  - ``/2/groups/[group_name]/assign-nodes``
1137
  - ``/2/groups/[group_name]/modify``
1138
  - ``/2/groups/[group_name]/rename``
1139
  - ``/2/instances/[instance_name]/disk/[disk_index]/grow``
1140

    
1141
- RAPI changes:
1142

    
1143
  - Implemented ``no_install`` for instance creation
1144
  - Implemented OS parameters for instance reinstallation, allowing
1145
    use of special settings on reinstallation (e.g. for preserving data)
1146

    
1147
Misc
1148
~~~~
1149

    
1150
- Added IPv6 support in import/export
1151
- Pause DRBD synchronization while wiping disks on instance creation
1152
- Updated unittests and QA scripts
1153
- Improved network parameters passed to KVM
1154
- Converted man pages from docbook to reStructuredText
1155

    
1156

    
1157
Version 2.3.1
1158
-------------
1159

    
1160
*(Released Mon, 20 Dec 2010)*
1161

    
1162
Released version 2.3.1~rc1 without any changes.
1163

    
1164

    
1165
Version 2.3.1 rc1
1166
-----------------
1167

    
1168
*(Released Wed, 1 Dec 2010)*
1169

    
1170
- impexpd: Disable OpenSSL compression in socat if possible (backport
1171
  from master, commit e90739d625b, see :doc:`installation guide
1172
  <install-quick>` for details)
1173
- Changed unittest coverage report to exclude test scripts
1174
- Added script to check version format
1175

    
1176

    
1177
Version 2.3.0
1178
-------------
1179

    
1180
*(Released Wed, 1 Dec 2010)*
1181

    
1182
Released version 2.3.0~rc1 without any changes.
1183

    
1184

    
1185
Version 2.3.0 rc1
1186
-----------------
1187

    
1188
*(Released Fri, 19 Nov 2010)*
1189

    
1190
A number of bugfixes and documentation updates:
1191

    
1192
- Update ganeti-os-interface documentation
1193
- Fixed a bug related to duplicate MACs or similar items which should be
1194
  unique
1195
- Fix breakage in OS state modify
1196
- Reinstall instance: disallow offline secondaries (fixes bug related to
1197
  OS changing but reinstall failing)
1198
- plus all the other fixes between 2.2.1 and 2.2.2
1199

    
1200

    
1201
Version 2.3.0 rc0
1202
-----------------
1203

    
1204
*(Released Tue, 2 Nov 2010)*
1205

    
1206
- Fixed clearing of the default iallocator using ``gnt-cluster modify``
1207
- Fixed master failover race with watcher
1208
- Fixed a bug in ``gnt-node modify`` which could lead to an inconsistent
1209
  configuration
1210
- Accept previously stopped instance for export with instance removal
1211
- Simplify and extend the environment variables for instance OS scripts
1212
- Added new node flags, ``master_capable`` and ``vm_capable``
1213
- Added optional instance disk wiping prior during allocation. This is a
1214
  cluster-wide option and can be set/modified using
1215
  ``gnt-cluster {init,modify} --prealloc-wipe-disks``.
1216
- Added IPv6 support, see :doc:`design document <design-2.3>` and
1217
  :doc:`install-quick`
1218
- Added a new watcher option (``--ignore-pause``)
1219
- Added option to ignore offline node on instance start/stop
1220
  (``--ignore-offline``)
1221
- Allow overriding OS parameters with ``gnt-instance reinstall``
1222
- Added ability to change node's secondary IP address using ``gnt-node
1223
  modify``
1224
- Implemented privilege separation for all daemons except
1225
  ``ganeti-noded``, see ``configure`` options
1226
- Complain if an instance's disk is marked faulty in ``gnt-cluster
1227
  verify``
1228
- Implemented job priorities (see ``ganeti(7)`` manpage)
1229
- Ignore failures while shutting down instances during failover from
1230
  offline node
1231
- Exit daemon's bootstrap process only once daemon is ready
1232
- Export more information via ``LUInstanceQuery``/remote API
1233
- Improved documentation, QA and unittests
1234
- RAPI daemon now watches ``rapi_users`` all the time and doesn't need a
1235
  restart if the file was created or changed
1236
- Added LUXI protocol version sent with each request and response,
1237
  allowing detection of server/client mismatches
1238
- Moved the Python scripts among gnt-* and ganeti-* into modules
1239
- Moved all code related to setting up SSH to an external script,
1240
  ``setup-ssh``
1241
- Infrastructure changes for node group support in future versions
1242

    
1243

    
1244
Version 2.2.2
1245
-------------
1246

    
1247
*(Released Fri, 19 Nov 2010)*
1248

    
1249
A few small bugs fixed, and some improvements to the build system:
1250

    
1251
- Fix documentation regarding conversion to drbd
1252
- Fix validation of parameters in cluster modify (``gnt-cluster modify
1253
  -B``)
1254
- Fix error handling in node modify with multiple changes
1255
- Allow remote imports without checked names
1256

    
1257

    
1258
Version 2.2.1
1259
-------------
1260

    
1261
*(Released Tue, 19 Oct 2010)*
1262

    
1263
- Disable SSL session ID cache in RPC client
1264

    
1265

    
1266
Version 2.2.1 rc1
1267
-----------------
1268

    
1269
*(Released Thu, 14 Oct 2010)*
1270

    
1271
- Fix interaction between Curl/GnuTLS and the Python's HTTP server
1272
  (thanks Apollon Oikonomopoulos!), finally allowing the use of Curl
1273
  with GnuTLS
1274
- Fix problems with interaction between Curl and Python's HTTP server,
1275
  resulting in increased speed in many RPC calls
1276
- Improve our release script to prevent breakage with older aclocal and
1277
  Python 2.6
1278

    
1279

    
1280
Version 2.2.1 rc0
1281
-----------------
1282

    
1283
*(Released Thu, 7 Oct 2010)*
1284

    
1285
- Fixed issue 125, replace hardcoded "xenvg" in ``gnt-cluster`` with
1286
  value retrieved from master
1287
- Added support for blacklisted or hidden OS definitions
1288
- Added simple lock monitor (accessible via (``gnt-debug locks``)
1289
- Added support for -mem-path in KVM hypervisor abstraction layer
1290
- Allow overriding instance parameters in tool for inter-cluster
1291
  instance moves (``tools/move-instance``)
1292
- Improved opcode summaries (e.g. in ``gnt-job list``)
1293
- Improve consistency of OS listing by sorting it
1294
- Documentation updates
1295

    
1296

    
1297
Version 2.2.0.1
1298
---------------
1299

    
1300
*(Released Fri, 8 Oct 2010)*
1301

    
1302
- Rebuild with a newer autotools version, to fix python 2.6 compatibility
1303

    
1304

    
1305
Version 2.2.0
1306
-------------
1307

    
1308
*(Released Mon, 4 Oct 2010)*
1309

    
1310
- Fixed regression in ``gnt-instance rename``
1311

    
1312

    
1313
Version 2.2.0 rc2
1314
-----------------
1315

    
1316
*(Released Wed, 22 Sep 2010)*
1317

    
1318
- Fixed OS_VARIANT variable for OS scripts
1319
- Fixed cluster tag operations via RAPI
1320
- Made ``setup-ssh`` exit with non-zero code if an error occurred
1321
- Disabled RAPI CA checks in watcher
1322

    
1323

    
1324
Version 2.2.0 rc1
1325
-----------------
1326

    
1327
*(Released Mon, 23 Aug 2010)*
1328

    
1329
- Support DRBD versions of the format "a.b.c.d"
1330
- Updated manpages
1331
- Re-introduce support for usage from multiple threads in RAPI client
1332
- Instance renames and modify via RAPI
1333
- Work around race condition between processing and archival in job
1334
  queue
1335
- Mark opcodes following failed one as failed, too
1336
- Job field ``lock_status`` was removed due to difficulties making it
1337
  work with the changed job queue in Ganeti 2.2; a better way to monitor
1338
  locks is expected for a later 2.2.x release
1339
- Fixed dry-run behaviour with many commands
1340
- Support ``ssh-agent`` again when adding nodes
1341
- Many additional bugfixes
1342

    
1343

    
1344
Version 2.2.0 rc0
1345
-----------------
1346

    
1347
*(Released Fri, 30 Jul 2010)*
1348

    
1349
Important change: the internal RPC mechanism between Ganeti nodes has
1350
changed from using a home-grown http library (based on the Python base
1351
libraries) to use the PycURL library. This requires that PycURL is
1352
installed on nodes. Please note that on Debian/Ubuntu, PycURL is linked
1353
against GnuTLS by default. cURL's support for GnuTLS had known issues
1354
before cURL 7.21.0 and we recommend using the latest cURL release or
1355
linking against OpenSSL. Most other distributions already link PycURL
1356
and cURL against OpenSSL. The command::
1357

    
1358
  python -c 'import pycurl; print pycurl.version'
1359

    
1360
can be used to determine the libraries PycURL and cURL are linked
1361
against.
1362

    
1363
Other significant changes:
1364

    
1365
- Rewrote much of the internals of the job queue, in order to achieve
1366
  better parallelism; this decouples job query operations from the job
1367
  processing, and it should allow much nicer behaviour of the master
1368
  daemon under load, and it also has uncovered some long-standing bugs
1369
  related to the job serialisation (now fixed)
1370
- Added a default iallocator setting to the cluster parameters,
1371
  eliminating the need to always pass nodes or an iallocator for
1372
  operations that require selection of new node(s)
1373
- Added experimental support for the LXC virtualization method
1374
- Added support for OS parameters, which allows the installation of
1375
  instances to pass parameter to OS scripts in order to customise the
1376
  instance
1377
- Added a hypervisor parameter controlling the migration type (live or
1378
  non-live), since hypervisors have various levels of reliability; this
1379
  has renamed the 'live' parameter to 'mode'
1380
- Added a cluster parameter ``reserved_lvs`` that denotes reserved
1381
  logical volumes, meaning that cluster verify will ignore them and not
1382
  flag their presence as errors
1383
- The watcher will now reset the error count for failed instances after
1384
  8 hours, thus allowing self-healing if the problem that caused the
1385
  instances to be down/fail to start has cleared in the meantime
1386
- Added a cluster parameter ``drbd_usermode_helper`` that makes Ganeti
1387
  check for, and warn, if the drbd module parameter ``usermode_helper``
1388
  is not consistent with the cluster-wide setting; this is needed to
1389
  make diagnose easier of failed drbd creations
1390
- Started adding base IPv6 support, but this is not yet
1391
  enabled/available for use
1392
- Rename operations (cluster, instance) will now return the new name,
1393
  which is especially useful if a short name was passed in
1394
- Added support for instance migration in RAPI
1395
- Added a tool to pre-configure nodes for the SSH setup, before joining
1396
  them to the cluster; this will allow in the future a simplified model
1397
  for node joining (but not yet fully enabled in 2.2); this needs the
1398
  paramiko python library
1399
- Fixed handling of name-resolving errors
1400
- Fixed consistency of job results on the error path
1401
- Fixed master-failover race condition when executed multiple times in
1402
  sequence
1403
- Fixed many bugs related to the job queue (mostly introduced during the
1404
  2.2 development cycle, so not all are impacting 2.1)
1405
- Fixed instance migration with missing disk symlinks
1406
- Fixed handling of unknown jobs in ``gnt-job archive``
1407
- And many other small fixes/improvements
1408

    
1409
Internal changes:
1410

    
1411
- Enhanced both the unittest and the QA coverage
1412
- Switched the opcode validation to a generic model, and extended the
1413
  validation to all opcode parameters
1414
- Changed more parts of the code that write shell scripts to use the
1415
  same class for this
1416
- Switched the master daemon to use the asyncore library for the Luxi
1417
  server endpoint
1418

    
1419

    
1420
Version 2.2.0 beta0
1421
-------------------
1422

    
1423
*(Released Thu, 17 Jun 2010)*
1424

    
1425
- Added tool (``move-instance``) and infrastructure to move instances
1426
  between separate clusters (see :doc:`separate documentation
1427
  <move-instance>` and :doc:`design document <design-2.2>`)
1428
- Added per-request RPC timeout
1429
- RAPI now requires a Content-Type header for requests with a body (e.g.
1430
  ``PUT`` or ``POST``) which must be set to ``application/json`` (see
1431
  :rfc:`2616` (HTTP/1.1), section 7.2.1)
1432
- ``ganeti-watcher`` attempts to restart ``ganeti-rapi`` if RAPI is not
1433
  reachable
1434
- Implemented initial support for running Ganeti daemons as separate
1435
  users, see configure-time flags ``--with-user-prefix`` and
1436
  ``--with-group-prefix`` (only ``ganeti-rapi`` is supported at this
1437
  time)
1438
- Instances can be removed after export (``gnt-backup export
1439
  --remove-instance``)
1440
- Self-signed certificates generated by Ganeti now use a 2048 bit RSA
1441
  key (instead of 1024 bit)
1442
- Added new cluster configuration file for cluster domain secret
1443
- Import/export now use SSL instead of SSH
1444
- Added support for showing estimated time when exporting an instance,
1445
  see the ``ganeti-os-interface(7)`` manpage and look for
1446
  ``EXP_SIZE_FD``
1447

    
1448

    
1449
Version 2.1.8
1450
-------------
1451

    
1452
*(Released Tue, 16 Nov 2010)*
1453

    
1454
Some more bugfixes. Unless critical bugs occur, this will be the last
1455
2.1 release:
1456

    
1457
- Fix case of MAC special-values
1458
- Fix mac checker regex
1459
- backend: Fix typo causing "out of range" error
1460
- Add missing --units in gnt-instance list man page
1461

    
1462

    
1463
Version 2.1.7
1464
-------------
1465

    
1466
*(Released Tue, 24 Aug 2010)*
1467

    
1468
Bugfixes only:
1469
  - Don't ignore secondary node silently on non-mirrored disk templates
1470
    (issue 113)
1471
  - Fix --master-netdev arg name in gnt-cluster(8) (issue 114)
1472
  - Fix usb_mouse parameter breaking with vnc_console (issue 109)
1473
  - Properly document the usb_mouse parameter
1474
  - Fix path in ganeti-rapi(8) (issue 116)
1475
  - Adjust error message when the ganeti user's .ssh directory is
1476
    missing
1477
  - Add same-node-check when changing the disk template to drbd
1478

    
1479

    
1480
Version 2.1.6
1481
-------------
1482

    
1483
*(Released Fri, 16 Jul 2010)*
1484

    
1485
Bugfixes only:
1486
  - Add an option to only select some reboot types during qa/burnin.
1487
    (on some hypervisors consequent reboots are not supported)
1488
  - Fix infrequent race condition in master failover. Sometimes the old
1489
    master ip address would be still detected as up for a short time
1490
    after it was removed, causing failover to fail.
1491
  - Decrease mlockall warnings when the ctypes module is missing. On
1492
    Python 2.4 we support running even if no ctypes module is installed,
1493
    but we were too verbose about this issue.
1494
  - Fix building on old distributions, on which man doesn't have a
1495
    --warnings option.
1496
  - Fix RAPI not to ignore the MAC address on instance creation
1497
  - Implement the old instance creation format in the RAPI client.
1498

    
1499

    
1500
Version 2.1.5
1501
-------------
1502

    
1503
*(Released Thu, 01 Jul 2010)*
1504

    
1505
A small bugfix release:
1506
  - Fix disk adoption: broken by strict --disk option checking in 2.1.4
1507
  - Fix batch-create: broken in the whole 2.1 series due to a lookup on
1508
    a non-existing option
1509
  - Fix instance create: the --force-variant option was ignored
1510
  - Improve pylint 0.21 compatibility and warnings with Python 2.6
1511
  - Fix modify node storage with non-FQDN arguments
1512
  - Fix RAPI client to authenticate under Python 2.6 when used
1513
    for more than 5 requests needing authentication
1514
  - Fix gnt-instance modify -t (storage) giving a wrong error message
1515
    when converting a non-shutdown drbd instance to plain
1516

    
1517

    
1518
Version 2.1.4
1519
-------------
1520

    
1521
*(Released Fri, 18 Jun 2010)*
1522

    
1523
A small bugfix release:
1524

    
1525
  - Fix live migration of KVM instances started with older Ganeti
1526
    versions which had fewer hypervisor parameters
1527
  - Fix gnt-instance grow-disk on down instances
1528
  - Fix an error-reporting bug during instance migration
1529
  - Better checking of the ``--net`` and ``--disk`` values, to avoid
1530
    silently ignoring broken ones
1531
  - Fix an RPC error reporting bug affecting, for example, RAPI client
1532
    users
1533
  - Fix bug triggered by different API version os-es on different nodes
1534
  - Fix a bug in instance startup with custom hvparams: OS level
1535
    parameters would fail to be applied.
1536
  - Fix the RAPI client under Python 2.6 (but more work is needed to
1537
    make it work completely well with OpenSSL)
1538
  - Fix handling of errors when resolving names from DNS
1539

    
1540

    
1541
Version 2.1.3
1542
-------------
1543

    
1544
*(Released Thu, 3 Jun 2010)*
1545

    
1546
A medium sized development cycle. Some new features, and some
1547
fixes/small improvements/cleanups.
1548

    
1549
Significant features
1550
~~~~~~~~~~~~~~~~~~~~
1551

    
1552
The node deamon now tries to mlock itself into memory, unless the
1553
``--no-mlock`` flag is passed. It also doesn't fail if it can't write
1554
its logs, and falls back to console logging. This allows emergency
1555
features such as ``gnt-node powercycle`` to work even in the event of a
1556
broken node disk (tested offlining the disk hosting the node's
1557
filesystem and dropping its memory caches; don't try this at home)
1558

    
1559
KVM: add vhost-net acceleration support. It can be tested with a new
1560
enough version of the kernel and of qemu-kvm.
1561

    
1562
KVM: Add instance chrooting feature. If you use privilege dropping for
1563
your VMs you can also now force them to chroot to an empty directory,
1564
before starting the emulated guest.
1565

    
1566
KVM: Add maximum migration bandwith and maximum downtime tweaking
1567
support (requires a new-enough version of qemu-kvm).
1568

    
1569
Cluster verify will now warn if the master node doesn't have the master
1570
ip configured on it.
1571

    
1572
Add a new (incompatible) instance creation request format to RAPI which
1573
supports all parameters (previously only a subset was supported, and it
1574
wasn't possible to extend the old format to accomodate all the new
1575
features. The old format is still supported, and a client can check for
1576
this feature, before using it, by checking for its presence in the
1577
``features`` RAPI resource.
1578

    
1579
Now with ancient latin support. Try it passing the ``--roman`` option to
1580
``gnt-instance info``, ``gnt-cluster info`` or ``gnt-node list``
1581
(requires the python-roman module to be installed, in order to work).
1582

    
1583
Other changes
1584
~~~~~~~~~~~~~
1585

    
1586
As usual many internal code refactorings, documentation updates, and
1587
such. Among others:
1588

    
1589
  - Lots of improvements and cleanups to the experimental Remote API
1590
    (RAPI) client library.
1591
  - A new unit test suite for the core daemon libraries.
1592
  - A fix to creating missing directories makes sure the umask is not
1593
    applied anymore. This enforces the same directory permissions
1594
    everywhere.
1595
  - Better handling terminating daemons with ctrl+c (used when running
1596
    them in debugging mode).
1597
  - Fix a race condition in live migrating a KVM instance, when stat()
1598
    on the old proc status file returned EINVAL, which is an unexpected
1599
    value.
1600
  - Fixed manpage checking with newer man and utf-8 charachters. But now
1601
    you need the en_US.UTF-8 locale enabled to build Ganeti from git.
1602

    
1603

    
1604
Version 2.1.2.1
1605
---------------
1606

    
1607
*(Released Fri, 7 May 2010)*
1608

    
1609
Fix a bug which prevented untagged KVM instances from starting.
1610

    
1611

    
1612
Version 2.1.2
1613
-------------
1614

    
1615
*(Released Fri, 7 May 2010)*
1616

    
1617
Another release with a long development cycle, during which many
1618
different features were added.
1619

    
1620
Significant features
1621
~~~~~~~~~~~~~~~~~~~~
1622

    
1623
The KVM hypervisor now can run the individual instances as non-root, to
1624
reduce the impact of a VM being hijacked due to bugs in the
1625
hypervisor. It is possible to run all instances as a single (non-root)
1626
user, to manually specify a user for each instance, or to dynamically
1627
allocate a user out of a cluster-wide pool to each instance, with the
1628
guarantee that no two instances will run under the same user ID on any
1629
given node.
1630

    
1631
An experimental RAPI client library, that can be used standalone
1632
(without the other Ganeti libraries), is provided in the source tree as
1633
``lib/rapi/client.py``. Note this client might change its interface in
1634
the future, as we iterate on its capabilities.
1635

    
1636
A new command, ``gnt-cluster renew-crypto`` has been added to easily
1637
replace the cluster's certificates and crypto keys. This might help in
1638
case they have been compromised, or have simply expired.
1639

    
1640
A new disk option for instance creation has been added that allows one
1641
to "adopt" currently existing logical volumes, with data
1642
preservation. This should allow easier migration to Ganeti from
1643
unmanaged (or managed via other software) instances.
1644

    
1645
Another disk improvement is the possibility to convert between redundant
1646
(DRBD) and plain (LVM) disk configuration for an instance. This should
1647
allow better scalability (starting with one node and growing the
1648
cluster, or shrinking a two-node cluster to one node).
1649

    
1650
A new feature that could help with automated node failovers has been
1651
implemented: if a node sees itself as offline (by querying the master
1652
candidates), it will try to shutdown (hard) all instances and any active
1653
DRBD devices. This reduces the risk of duplicate instances if an
1654
external script automatically failovers the instances on such nodes. To
1655
enable this, the cluster parameter ``maintain_node_health`` should be
1656
enabled; in the future this option (per the name) will enable other
1657
automatic maintenance features.
1658

    
1659
Instance export/import now will reuse the original instance
1660
specifications for all parameters; that means exporting an instance,
1661
deleting it and the importing it back should give an almost identical
1662
instance. Note that the default import behaviour has changed from
1663
before, where it created only one NIC; now it recreates the original
1664
number of NICs.
1665

    
1666
Cluster verify has added a few new checks: SSL certificates validity,
1667
/etc/hosts consistency across the cluster, etc.
1668

    
1669
Other changes
1670
~~~~~~~~~~~~~
1671

    
1672
As usual, many internal changes were done, documentation fixes,
1673
etc. Among others:
1674

    
1675
- Fixed cluster initialization with disabled cluster storage (regression
1676
  introduced in 2.1.1)
1677
- File-based storage supports growing the disks
1678
- Fixed behaviour of node role changes
1679
- Fixed cluster verify for some corner cases, plus a general rewrite of
1680
  cluster verify to allow future extension with more checks
1681
- Fixed log spamming by watcher and node daemon (regression introduced
1682
  in 2.1.1)
1683
- Fixed possible validation issues when changing the list of enabled
1684
  hypervisors
1685
- Fixed cleanup of /etc/hosts during node removal
1686
- Fixed RAPI response for invalid methods
1687
- Fixed bug with hashed passwords in ``ganeti-rapi`` daemon
1688
- Multiple small improvements to the KVM hypervisor (VNC usage, booting
1689
  from ide disks, etc.)
1690
- Allow OS changes without re-installation (to record a changed OS
1691
  outside of Ganeti, or to allow OS renames)
1692
- Allow instance creation without OS installation (useful for example if
1693
  the OS will be installed manually, or restored from a backup not in
1694
  Ganeti format)
1695
- Implemented option to make cluster ``copyfile`` use the replication
1696
  network
1697
- Added list of enabled hypervisors to ssconf (possibly useful for
1698
  external scripts)
1699
- Added a new tool (``tools/cfgupgrade12``) that allows upgrading from
1700
  1.2 clusters
1701
- A partial form of node re-IP is possible via node readd, which now
1702
  allows changed node primary IP
1703
- Command line utilities now show an informational message if the job is
1704
  waiting for a lock
1705
- The logs of the master daemon now show the PID/UID/GID of the
1706
  connected client
1707

    
1708

    
1709
Version 2.1.1
1710
-------------
1711

    
1712
*(Released Fri, 12 Mar 2010)*
1713

    
1714
During the 2.1.0 long release candidate cycle, a lot of improvements and
1715
changes have accumulated with were released later as 2.1.1.
1716

    
1717
Major changes
1718
~~~~~~~~~~~~~
1719

    
1720
The node evacuate command (``gnt-node evacuate``) was significantly
1721
rewritten, and as such the IAllocator protocol was changed - a new
1722
request type has been added. This unfortunate change during a stable
1723
series is designed to improve performance of node evacuations; on
1724
clusters with more than about five nodes and which are well-balanced,
1725
evacuation should proceed in parallel for all instances of the node
1726
being evacuated. As such, any existing IAllocator scripts need to be
1727
updated, otherwise the above command will fail due to the unknown
1728
request. The provided "dumb" allocator has not been updated; but the
1729
ganeti-htools package supports the new protocol since version 0.2.4.
1730

    
1731
Another important change is increased validation of node and instance
1732
names. This might create problems in special cases, if invalid host
1733
names are being used.
1734

    
1735
Also, a new layer of hypervisor parameters has been added, that sits at
1736
OS level between the cluster defaults and the instance ones. This allows
1737
customisation of virtualization parameters depending on the installed
1738
OS. For example instances with OS 'X' may have a different KVM kernel
1739
(or any other parameter) than the cluster defaults. This is intended to
1740
help managing a multiple OSes on the same cluster, without manual
1741
modification of each instance's parameters.
1742

    
1743
A tool for merging clusters, ``cluster-merge``, has been added in the
1744
tools sub-directory.
1745

    
1746
Bug fixes
1747
~~~~~~~~~
1748

    
1749
- Improved the int/float conversions that should make the code more
1750
  robust in face of errors from the node daemons
1751
- Fixed the remove node code in case of internal configuration errors
1752
- Fixed the node daemon behaviour in face of inconsistent queue
1753
  directory (e.g. read-only file-system where we can't open the files
1754
  read-write, etc.)
1755
- Fixed the behaviour of gnt-node modify for master candidate demotion;
1756
  now it either aborts cleanly or, if given the new "auto_promote"
1757
  parameter, will automatically promote other nodes as needed
1758
- Fixed compatibility with (unreleased yet) Python 2.6.5 that would
1759
  completely prevent Ganeti from working
1760
- Fixed bug for instance export when not all disks were successfully
1761
  exported
1762
- Fixed behaviour of node add when the new node is slow in starting up
1763
  the node daemon
1764
- Fixed handling of signals in the LUXI client, which should improve
1765
  behaviour of command-line scripts
1766
- Added checks for invalid node/instance names in the configuration (now
1767
  flagged during cluster verify)
1768
- Fixed watcher behaviour for disk activation errors
1769
- Fixed two potentially endless loops in http library, which led to the
1770
  RAPI daemon hanging and consuming 100% CPU in some cases
1771
- Fixed bug in RAPI daemon related to hashed passwords
1772
- Fixed bug for unintended qemu-level bridging of multi-NIC KVM
1773
  instances
1774
- Enhanced compatibility with non-Debian OSes, but not using absolute
1775
  path in some commands and allowing customisation of the ssh
1776
  configuration directory
1777
- Fixed possible future issue with new Python versions by abiding to the
1778
  proper use of ``__slots__`` attribute on classes
1779
- Added checks that should prevent directory traversal attacks
1780
- Many documentation fixes based on feedback from users
1781

    
1782
New features
1783
~~~~~~~~~~~~
1784

    
1785
- Added an "early_release" more for instance replace disks and node
1786
  evacuate, where we release locks earlier and thus allow higher
1787
  parallelism within the cluster
1788
- Added watcher hooks, intended to allow the watcher to restart other
1789
  daemons (e.g. from the ganeti-nbma project), but they can be used of
1790
  course for any other purpose
1791
- Added a compile-time disable for DRBD barriers, to increase
1792
  performance if the administrator trusts the power supply or the
1793
  storage system to not lose writes
1794
- Added the option of using syslog for logging instead of, or in
1795
  addition to, Ganeti's own log files
1796
- Removed boot restriction for paravirtual NICs for KVM, recent versions
1797
  can indeed boot from a paravirtual NIC
1798
- Added a generic debug level for many operations; while this is not
1799
  used widely yet, it allows one to pass the debug value all the way to
1800
  the OS scripts
1801
- Enhanced the hooks environment for instance moves (failovers,
1802
  migrations) where the primary/secondary nodes changed during the
1803
  operation, by adding {NEW,OLD}_{PRIMARY,SECONDARY} vars
1804
- Enhanced data validations for many user-supplied values; one important
1805
  item is the restrictions imposed on instance and node names, which
1806
  might reject some (invalid) host names
1807
- Add a configure-time option to disable file-based storage, if it's not
1808
  needed; this allows greater security separation between the master
1809
  node and the other nodes from the point of view of the inter-node RPC
1810
  protocol
1811
- Added user notification in interactive tools if job is waiting in the
1812
  job queue or trying to acquire locks
1813
- Added log messages when a job is waiting for locks
1814
- Added filtering by node tags in instance operations which admit
1815
  multiple instances (start, stop, reboot, reinstall)
1816
- Added a new tool for cluster mergers, ``cluster-merge``
1817
- Parameters from command line which are of the form ``a=b,c=d`` can now
1818
  use backslash escapes to pass in values which contain commas,
1819
  e.g. ``a=b\\c,d=e`` where the 'a' parameter would get the value
1820
  ``b,c``
1821
- For KVM, the instance name is the first parameter passed to KVM, so
1822
  that it's more visible in the process list
1823

    
1824

    
1825
Version 2.1.0
1826
-------------
1827

    
1828
*(Released Tue, 2 Mar 2010)*
1829

    
1830
Ganeti 2.1 brings many improvements with it. Major changes:
1831

    
1832
- Added infrastructure to ease automated disk repairs
1833
- Added new daemon to export configuration data in a cheaper way than
1834
  using the remote API
1835
- Instance NICs can now be routed instead of being associated with a
1836
  networking bridge
1837
- Improved job locking logic to reduce impact of jobs acquiring multiple
1838
  locks waiting for other long-running jobs
1839

    
1840
In-depth implementation details can be found in the Ganeti 2.1 design
1841
document.
1842

    
1843
Details
1844
~~~~~~~
1845

    
1846
- Added chroot hypervisor
1847
- Added more options to xen-hvm hypervisor (``kernel_path`` and
1848
  ``device_model``)
1849
- Added more options to xen-pvm hypervisor (``use_bootloader``,
1850
  ``bootloader_path`` and ``bootloader_args``)
1851
- Added the ``use_localtime`` option for the xen-hvm and kvm
1852
  hypervisors, and the default value for this has changed to false (in
1853
  2.0 xen-hvm always enabled it)
1854
- Added luxi call to submit multiple jobs in one go
1855
- Added cluster initialization option to not modify ``/etc/hosts``
1856
  file on nodes
1857
- Added network interface parameters
1858
- Added dry run mode to some LUs
1859
- Added RAPI resources:
1860

    
1861
  - ``/2/instances/[instance_name]/info``
1862
  - ``/2/instances/[instance_name]/replace-disks``
1863
  - ``/2/nodes/[node_name]/evacuate``
1864
  - ``/2/nodes/[node_name]/migrate``
1865
  - ``/2/nodes/[node_name]/role``
1866
  - ``/2/nodes/[node_name]/storage``
1867
  - ``/2/nodes/[node_name]/storage/modify``
1868
  - ``/2/nodes/[node_name]/storage/repair``
1869

    
1870
- Added OpCodes to evacuate or migrate all instances on a node
1871
- Added new command to list storage elements on nodes (``gnt-node
1872
  list-storage``) and modify them (``gnt-node modify-storage``)
1873
- Added new ssconf files with master candidate IP address
1874
  (``ssconf_master_candidates_ips``), node primary IP address
1875
  (``ssconf_node_primary_ips``) and node secondary IP address
1876
  (``ssconf_node_secondary_ips``)
1877
- Added ``ganeti-confd`` and a client library to query the Ganeti
1878
  configuration via UDP
1879
- Added ability to run hooks after cluster initialization and before
1880
  cluster destruction
1881
- Added automatic mode for disk replace (``gnt-instance replace-disks
1882
  --auto``)
1883
- Added ``gnt-instance recreate-disks`` to re-create (empty) disks
1884
  after catastrophic data-loss
1885
- Added ``gnt-node repair-storage`` command to repair damaged LVM volume
1886
  groups
1887
- Added ``gnt-instance move`` command to move instances
1888
- Added ``gnt-cluster watcher`` command to control watcher
1889
- Added ``gnt-node powercycle`` command to powercycle nodes
1890
- Added new job status field ``lock_status``
1891
- Added parseable error codes to cluster verification (``gnt-cluster
1892
  verify --error-codes``) and made output less verbose (use
1893
  ``--verbose`` to restore previous behaviour)
1894
- Added UUIDs to the main config entities (cluster, nodes, instances)
1895
- Added support for OS variants
1896
- Added support for hashed passwords in the Ganeti remote API users file
1897
  (``rapi_users``)
1898
- Added option to specify maximum timeout on instance shutdown
1899
- Added ``--no-ssh-init`` option to ``gnt-cluster init``
1900
- Added new helper script to start and stop Ganeti daemons
1901
  (``daemon-util``), with the intent to reduce the work necessary to
1902
  adjust Ganeti for non-Debian distributions and to start/stop daemons
1903
  from one place
1904
- Added more unittests
1905
- Fixed critical bug in ganeti-masterd startup
1906
- Removed the configure-time ``kvm-migration-port`` parameter, this is
1907
  now customisable at the cluster level for both the KVM and Xen
1908
  hypervisors using the new ``migration_port`` parameter
1909
- Pass ``INSTANCE_REINSTALL`` variable to OS installation script when
1910
  reinstalling an instance
1911
- Allowed ``@`` in tag names
1912
- Migrated to Sphinx (http://sphinx.pocoo.org/) for documentation
1913
- Many documentation updates
1914
- Distribute hypervisor files on ``gnt-cluster redist-conf``
1915
- ``gnt-instance reinstall`` can now reinstall multiple instances
1916
- Updated many command line parameters
1917
- Introduced new OS API version 15
1918
- No longer support a default hypervisor
1919
- Treat virtual LVs as inexistent
1920
- Improved job locking logic to reduce lock contention
1921
- Match instance and node names case insensitively
1922
- Reimplemented bash completion script to be more complete
1923
- Improved burnin
1924

    
1925

    
1926
Version 2.0.6
1927
-------------
1928

    
1929
*(Released Thu, 4 Feb 2010)*
1930

    
1931
- Fix cleaner behaviour on nodes not in a cluster (Debian bug 568105)
1932
- Fix a string formatting bug
1933
- Improve safety of the code in some error paths
1934
- Improve data validation in the master of values returned from nodes
1935

    
1936

    
1937
Version 2.0.5
1938
-------------
1939

    
1940
*(Released Thu, 17 Dec 2009)*
1941

    
1942
- Fix security issue due to missing validation of iallocator names; this
1943
  allows local and remote execution of arbitrary executables
1944
- Fix failure of gnt-node list during instance removal
1945
- Ship the RAPI documentation in the archive
1946

    
1947

    
1948
Version 2.0.4
1949
-------------
1950

    
1951
*(Released Wed, 30 Sep 2009)*
1952

    
1953
- Fixed many wrong messages
1954
- Fixed a few bugs related to the locking library
1955
- Fixed MAC checking at instance creation time
1956
- Fixed a DRBD parsing bug related to gaps in /proc/drbd
1957
- Fixed a few issues related to signal handling in both daemons and
1958
  scripts
1959
- Fixed the example startup script provided
1960
- Fixed insserv dependencies in the example startup script (patch from
1961
  Debian)
1962
- Fixed handling of drained nodes in the iallocator framework
1963
- Fixed handling of KERNEL_PATH parameter for xen-hvm (Debian bug
1964
  #528618)
1965
- Fixed error related to invalid job IDs in job polling
1966
- Fixed job/opcode persistence on unclean master shutdown
1967
- Fixed handling of partial job processing after unclean master
1968
  shutdown
1969
- Fixed error reporting from LUs, previously all errors were converted
1970
  into execution errors
1971
- Fixed error reporting from burnin
1972
- Decreased significantly the memory usage of the job queue
1973
- Optimised slightly multi-job submission
1974
- Optimised slightly opcode loading
1975
- Backported the multi-job submit framework from the development
1976
  branch; multi-instance start and stop should be faster
1977
- Added script to clean archived jobs after 21 days; this will reduce
1978
  the size of the queue directory
1979
- Added some extra checks in disk size tracking
1980
- Added an example ethers hook script
1981
- Added a cluster parameter that prevents Ganeti from modifying of
1982
  /etc/hosts
1983
- Added more node information to RAPI responses
1984
- Added a ``gnt-job watch`` command that allows following the ouput of a
1985
  job
1986
- Added a bind-address option to ganeti-rapi
1987
- Added more checks to the configuration verify
1988
- Enhanced the burnin script such that some operations can be retried
1989
  automatically
1990
- Converted instance reinstall to multi-instance model
1991

    
1992

    
1993
Version 2.0.3
1994
-------------
1995

    
1996
*(Released Fri, 7 Aug 2009)*
1997

    
1998
- Added ``--ignore-size`` to the ``gnt-instance activate-disks`` command
1999
  to allow using the pre-2.0.2 behaviour in activation, if any existing
2000
  instances have mismatched disk sizes in the configuration
2001
- Added ``gnt-cluster repair-disk-sizes`` command to check and update
2002
  any configuration mismatches for disk sizes
2003
- Added ``gnt-master cluste-failover --no-voting`` to allow master
2004
  failover to work on two-node clusters
2005
- Fixed the ``--net`` option of ``gnt-backup import``, which was
2006
  unusable
2007
- Fixed detection of OS script errors in ``gnt-backup export``
2008
- Fixed exit code of ``gnt-backup export``
2009

    
2010

    
2011
Version 2.0.2
2012
-------------
2013

    
2014
*(Released Fri, 17 Jul 2009)*
2015

    
2016
- Added experimental support for stripped logical volumes; this should
2017
  enhance performance but comes with a higher complexity in the block
2018
  device handling; stripping is only enabled when passing
2019
  ``--with-lvm-stripecount=N`` to ``configure``, but codepaths are
2020
  affected even in the non-stripped mode
2021
- Improved resiliency against transient failures at the end of DRBD
2022
  resyncs, and in general of DRBD resync checks
2023
- Fixed a couple of issues with exports and snapshot errors
2024
- Fixed a couple of issues in instance listing
2025
- Added display of the disk size in ``gnt-instance info``
2026
- Fixed checking for valid OSes in instance creation
2027
- Fixed handling of the "vcpus" parameter in instance listing and in
2028
  general of invalid parameters
2029
- Fixed http server library, and thus RAPI, to handle invalid
2030
  username/password combinations correctly; this means that now they
2031
  report unauthorized for queries too, not only for modifications,
2032
  allowing earlier detect of configuration problems
2033
- Added a new "role" node list field, equivalent to the master/master
2034
  candidate/drained/offline flags combinations
2035
- Fixed cluster modify and changes of candidate pool size
2036
- Fixed cluster verify error messages for wrong files on regular nodes
2037
- Fixed a couple of issues with node demotion from master candidate role
2038
- Fixed node readd issues
2039
- Added non-interactive mode for ``ganeti-masterd --no-voting`` startup
2040
- Added a new ``--no-voting`` option for masterfailover to fix failover
2041
  on two-nodes clusters when the former master node is unreachable
2042
- Added instance reinstall over RAPI
2043

    
2044

    
2045
Version 2.0.1
2046
-------------
2047

    
2048
*(Released Tue, 16 Jun 2009)*
2049

    
2050
- added ``-H``/``-B`` startup parameters to ``gnt-instance``, which will
2051
  allow re-adding the start in single-user option (regression from 1.2)
2052
- the watcher writes the instance status to a file, to allow monitoring
2053
  to report the instance status (from the master) based on cached
2054
  results of the watcher's queries; while this can get stale if the
2055
  watcher is being locked due to other work on the cluster, this is
2056
  still an improvement
2057
- the watcher now also restarts the node daemon and the rapi daemon if
2058
  they died
2059
- fixed the watcher to handle full and drained queue cases
2060
- hooks export more instance data in the environment, which helps if
2061
  hook scripts need to take action based on the instance's properties
2062
  (no longer need to query back into ganeti)
2063
- instance failovers when the instance is stopped do not check for free
2064
  RAM, so that failing over a stopped instance is possible in low memory
2065
  situations
2066
- rapi uses queries for tags instead of jobs (for less job traffic), and
2067
  for cluster tags it won't talk to masterd at all but read them from
2068
  ssconf
2069
- a couple of error handling fixes in RAPI
2070
- drbd handling: improved the error handling of inconsistent disks after
2071
  resync to reduce the frequency of "there are some degraded disks for
2072
  this instance" messages
2073
- fixed a bug in live migration when DRBD doesn't want to reconnect (the
2074
  error handling path called a wrong function name)
2075

    
2076

    
2077
Version 2.0.0
2078
-------------
2079

    
2080
*(Released Wed, 27 May 2009)*
2081

    
2082
- no changes from rc5
2083

    
2084

    
2085
Version 2.0 rc5
2086
---------------
2087

    
2088
*(Released Wed, 20 May 2009)*
2089

    
2090
- fix a couple of bugs (validation, argument checks)
2091
- fix ``gnt-cluster getmaster`` on non-master nodes (regression)
2092
- some small improvements to RAPI and IAllocator
2093
- make watcher automatically start the master daemon if down
2094

    
2095

    
2096
Version 2.0 rc4
2097
---------------
2098

    
2099
*(Released Mon, 27 Apr 2009)*
2100

    
2101
- change the OS list to not require locks; this helps with big clusters
2102
- fix ``gnt-cluster verify`` and ``gnt-cluster verify-disks`` when the
2103
  volume group is broken
2104
- ``gnt-instance info``, without any arguments, doesn't run for all
2105
  instances anymore; either pass ``--all`` or pass the desired
2106
  instances; this helps against mistakes on big clusters where listing
2107
  the information for all instances takes a long time
2108
- miscellaneous doc and man pages fixes
2109

    
2110

    
2111
Version 2.0 rc3
2112
---------------
2113

    
2114
*(Released Wed, 8 Apr 2009)*
2115

    
2116
- Change the internal locking model of some ``gnt-node`` commands, in
2117
  order to reduce contention (and blocking of master daemon) when
2118
  batching many creation/reinstall jobs
2119
- Fixes to Xen soft reboot
2120
- No longer build documentation at build time, instead distribute it in
2121
  the archive, in order to reduce the need for the whole docbook/rst
2122
  toolchains
2123

    
2124

    
2125
Version 2.0 rc2
2126
---------------
2127

    
2128
*(Released Fri, 27 Mar 2009)*
2129

    
2130
- Now the cfgupgrade scripts works and can upgrade 1.2.7 clusters to 2.0
2131
- Fix watcher startup sequence, improves the behaviour of busy clusters
2132
- Some other fixes in ``gnt-cluster verify``, ``gnt-instance
2133
  replace-disks``, ``gnt-instance add``, ``gnt-cluster queue``, KVM VNC
2134
  bind address and other places
2135
- Some documentation fixes and updates
2136

    
2137

    
2138
Version 2.0 rc1
2139
---------------
2140

    
2141
*(Released Mon, 2 Mar 2009)*
2142

    
2143
- More documentation updates, now all docs should be more-or-less
2144
  up-to-date
2145
- A couple of small fixes (mixed hypervisor clusters, offline nodes,
2146
  etc.)
2147
- Added a customizable HV_KERNEL_ARGS hypervisor parameter (for Xen PVM
2148
  and KVM)
2149
- Fix an issue related to $libdir/run/ganeti and cluster creation
2150

    
2151

    
2152
Version 2.0 beta2
2153
-----------------
2154

    
2155
*(Released Thu, 19 Feb 2009)*
2156

    
2157
- Xen PVM and KVM have switched the default value for the instance root
2158
  disk to the first partition on the first drive, instead of the whole
2159
  drive; this means that the OS installation scripts must be changed
2160
  accordingly
2161
- Man pages have been updated
2162
- RAPI has been switched by default to HTTPS, and the exported functions
2163
  should all work correctly
2164
- RAPI v1 has been removed
2165
- Many improvements to the KVM hypervisor
2166
- Block device errors are now better reported
2167
- Many other bugfixes and small improvements
2168

    
2169

    
2170
Version 2.0 beta1
2171
-----------------
2172

    
2173
*(Released Mon, 26 Jan 2009)*
2174

    
2175
- Version 2 is a general rewrite of the code and therefore the
2176
  differences are too many to list, see the design document for 2.0 in
2177
  the ``doc/`` subdirectory for more details
2178
- In this beta version there is not yet a migration path from 1.2 (there
2179
  will be one in the final 2.0 release)
2180
- A few significant changes are:
2181

    
2182
  - all commands are executed by a daemon (``ganeti-masterd``) and the
2183
    various ``gnt-*`` commands are just front-ends to it
2184
  - all the commands are entered into, and executed from a job queue,
2185
    see the ``gnt-job(8)`` manpage
2186
  - the RAPI daemon supports read-write operations, secured by basic
2187
    HTTP authentication on top of HTTPS
2188
  - DRBD version 0.7 support has been removed, DRBD 8 is the only
2189
    supported version (when migrating from Ganeti 1.2 to 2.0, you need
2190
    to migrate to DRBD 8 first while still running Ganeti 1.2)
2191
  - DRBD devices are using statically allocated minor numbers, which
2192
    will be assigned to existing instances during the migration process
2193
  - there is support for both Xen PVM and Xen HVM instances running on
2194
    the same cluster
2195
  - KVM virtualization is supported too
2196
  - file-based storage has been implemented, which means that it is
2197
    possible to run the cluster without LVM and DRBD storage, for
2198
    example using a shared filesystem exported from shared storage (and
2199
    still have live migration)
2200

    
2201

    
2202
Version 1.2.7
2203
-------------
2204

    
2205
*(Released Tue, 13 Jan 2009)*
2206

    
2207
- Change the default reboot type in ``gnt-instance reboot`` to "hard"
2208
- Reuse the old instance mac address by default on instance import, if
2209
  the instance name is the same.
2210
- Handle situations in which the node info rpc returns incomplete
2211
  results (issue 46)
2212
- Add checks for tcp/udp ports collisions in ``gnt-cluster verify``
2213
- Improved version of batcher:
2214

    
2215
  - state file support
2216
  - instance mac address support
2217
  - support for HVM clusters/instances
2218

    
2219
- Add an option to show the number of cpu sockets and nodes in
2220
  ``gnt-node list``
2221
- Support OSes that handle more than one version of the OS api (but do
2222
  not change the current API in any other way)
2223
- Fix ``gnt-node migrate``
2224
- ``gnt-debug`` man page
2225
- Fixes various more typos and small issues
2226
- Increase disk resync maximum speed to 60MB/s (from 30MB/s)
2227

    
2228

    
2229
Version 1.2.6
2230
-------------
2231

    
2232
*(Released Wed, 24 Sep 2008)*
2233

    
2234
- new ``--hvm-nic-type`` and ``--hvm-disk-type`` flags to control the
2235
  type of disk exported to fully virtualized instances.
2236
- provide access to the serial console of HVM instances
2237
- instance auto_balance flag, set by default. If turned off it will
2238
  avoid warnings on cluster verify if there is not enough memory to fail
2239
  over an instance. in the future it will prevent automatically failing
2240
  it over when we will support that.
2241
- batcher tool for instance creation, see ``tools/README.batcher``
2242
- ``gnt-instance reinstall --select-os`` to interactively select a new
2243
  operating system when reinstalling an instance.
2244
- when changing the memory amount on instance modify a check has been
2245
  added that the instance will be able to start. also warnings are
2246
  emitted if the instance will not be able to fail over, if auto_balance
2247
  is true.
2248
- documentation fixes
2249
- sync fields between ``gnt-instance list/modify/add/import``
2250
- fix a race condition in drbd when the sync speed was set after giving
2251
  the device a remote peer.
2252

    
2253

    
2254
Version 1.2.5
2255
-------------
2256

    
2257
*(Released Tue, 22 Jul 2008)*
2258

    
2259
- note: the allowed size and number of tags per object were reduced
2260
- fix a bug in ``gnt-cluster verify`` with inconsistent volume groups
2261
- fixed twisted 8.x compatibility
2262
- fixed ``gnt-instance replace-disks`` with iallocator
2263
- add TCP keepalives on twisted connections to detect restarted nodes
2264
- disk increase support, see ``gnt-instance grow-disk``
2265
- implement bulk node/instance query for RAPI
2266
- add tags in node/instance listing (optional)
2267
- experimental migration (and live migration) support, read the man page
2268
  for ``gnt-instance migrate``
2269
- the ``ganeti-watcher`` logs are now timestamped, and the watcher also
2270
  has some small improvements in handling its state file
2271

    
2272

    
2273
Version 1.2.4
2274
-------------
2275

    
2276
*(Released Fri, 13 Jun 2008)*
2277

    
2278
- Experimental readonly, REST-based remote API implementation;
2279
  automatically started on master node, TCP port 5080, if enabled by
2280
  ``--enable-rapi`` parameter to configure script.
2281
- Instance allocator support. Add and import instance accept a
2282
  ``--iallocator`` parameter, and call that instance allocator to decide
2283
  which node to use for the instance. The iallocator document describes
2284
  what's expected from an allocator script.
2285
- ``gnt-cluster verify`` N+1 memory redundancy checks: Unless passed the
2286
  ``--no-nplus1-mem`` option ``gnt-cluster verify`` now checks that if a
2287
  node is lost there is still enough memory to fail over the instances
2288
  that reside on it.
2289
- ``gnt-cluster verify`` hooks: it is now possible to add post-hooks to
2290
  ``gnt-cluster verify``, to check for site-specific compliance. All the
2291
  hooks will run, and their output, if any, will be displayed. Any
2292
  failing hook will make the verification return an error value.
2293
- ``gnt-cluster verify`` now checks that its peers are reachable on the
2294
  primary and secondary interfaces
2295
- ``gnt-node add`` now supports the ``--readd`` option, to readd a node
2296
  that is still declared as part of the cluster and has failed.
2297
- ``gnt-* list`` commands now accept a new ``-o +field`` way of
2298
  specifying output fields, that just adds the chosen fields to the
2299
  default ones.
2300
- ``gnt-backup`` now has a new ``remove`` command to delete an existing
2301
  export from the filesystem.
2302
- New per-instance parameters hvm_acpi, hvm_pae and hvm_cdrom_image_path
2303
  have been added. Using them you can enable/disable acpi and pae
2304
  support, and specify a path for a cd image to be exported to the
2305
  instance. These parameters as the name suggest only work on HVM
2306
  clusters.
2307
- When upgrading an HVM cluster to Ganeti 1.2.4, the values for ACPI and
2308
  PAE support will be set to the previously hardcoded values, but the
2309
  (previously hardcoded) path to the CDROM ISO image will be unset and
2310
  if required, needs to be set manually with ``gnt-instance modify``
2311
  after the upgrade.
2312
- The address to which an instance's VNC console is bound is now
2313
  selectable per-instance, rather than being cluster wide. Of course
2314
  this only applies to instances controlled via VNC, so currently just
2315
  applies to HVM clusters.
2316

    
2317

    
2318
Version 1.2.3
2319
-------------
2320

    
2321
*(Released Mon, 18 Feb 2008)*
2322

    
2323
- more tweaks to the disk activation code (especially helpful for DRBD)
2324
- change the default ``gnt-instance list`` output format, now there is
2325
  one combined status field (see the manpage for the exact values this
2326
  field will have)
2327
- some more fixes for the mac export to hooks change
2328
- make Ganeti not break with DRBD 8.2.x (which changed the version
2329
  format in ``/proc/drbd``) (issue 24)
2330
- add an upgrade tool from "remote_raid1" disk template to "drbd" disk
2331
  template, allowing migration from DRBD0.7+MD to DRBD8
2332

    
2333

    
2334
Version 1.2.2
2335
-------------
2336

    
2337
*(Released Wed, 30 Jan 2008)*
2338

    
2339
- fix ``gnt-instance modify`` breakage introduced in 1.2.1 with the HVM
2340
  support (issue 23)
2341
- add command aliases infrastructure and a few aliases
2342
- allow listing of VCPUs in the ``gnt-instance list`` and improve the
2343
  man pages and the ``--help`` option of ``gnt-node
2344
  list``/``gnt-instance list``
2345
- fix ``gnt-backup list`` with down nodes (issue 21)
2346
- change the tools location (move from $pkgdatadir to $pkglibdir/tools)
2347
- fix the dist archive and add a check for including svn/git files in
2348
  the future
2349
- some developer-related changes: improve the burnin and the QA suite,
2350
  add an upload script for testing during development
2351

    
2352

    
2353
Version 1.2.1
2354
-------------
2355

    
2356
*(Released Wed, 16 Jan 2008)*
2357

    
2358
- experimental HVM support, read the install document, section
2359
  "Initializing the cluster"
2360
- allow for the PVM hypervisor per-instance kernel and initrd paths
2361
- add a new command ``gnt-cluster verify-disks`` which uses a new
2362
  algorithm to improve the reconnection of the DRBD pairs if the device
2363
  on the secondary node has gone away
2364
- make logical volume code auto-activate LVs at disk activation time
2365
- slightly improve the speed of activating disks
2366
- allow specification of the MAC address at instance creation time, and
2367
  changing it later via ``gnt-instance modify``
2368
- fix handling of external commands that generate lots of output on
2369
  stderr
2370
- update documentation with regard to minimum version of DRBD8 supported
2371

    
2372

    
2373
Version 1.2.0
2374
-------------
2375

    
2376
*(Released Tue, 4 Dec 2007)*
2377

    
2378
- Log the ``xm create`` output to the node daemon log on failure (to
2379
  help diagnosing the error)
2380
- In debug mode, log all external commands output if failed to the logs
2381
- Change parsing of lvm commands to ignore stderr
2382

    
2383

    
2384
Version 1.2 beta3
2385
-----------------
2386

    
2387
*(Released Wed, 28 Nov 2007)*
2388

    
2389
- Another round of updates to the DRBD 8 code to deal with more failures
2390
  in the replace secondary node operation
2391
- Some more logging of failures in disk operations (lvm, drbd)
2392
- A few documentation updates
2393
- QA updates
2394

    
2395

    
2396
Version 1.2 beta2
2397
-----------------
2398

    
2399
*(Released Tue, 13 Nov 2007)*
2400

    
2401
- Change configuration file format from Python's Pickle to JSON.
2402
  Upgrading is possible using the cfgupgrade utility.
2403
- Add support for DRBD 8.0 (new disk template ``drbd``) which allows for
2404
  faster replace disks and is more stable (DRBD 8 has many improvements
2405
  compared to DRBD 0.7)
2406
- Added command line tags support (see man pages for ``gnt-instance``,
2407
  ``gnt-node``, ``gnt-cluster``)
2408
- Added instance rename support
2409
- Added multi-instance startup/shutdown
2410
- Added cluster rename support
2411
- Added ``gnt-node evacuate`` to simplify some node operations
2412
- Added instance reboot operation that can speedup reboot as compared to
2413
  stop and start
2414
- Soften the requirement that hostnames are in FQDN format
2415
- The ``ganeti-watcher`` now activates drbd pairs after secondary node
2416
  reboots
2417
- Removed dependency on debian's patched fping that uses the
2418
  non-standard ``-S`` option
2419
- Now the OS definitions are searched for in multiple, configurable
2420
  paths (easier for distros to package)
2421
- Some changes to the hooks infrastructure (especially the new
2422
  post-configuration update hook)
2423
- Other small bugfixes
2424

    
2425
.. vim: set textwidth=72 syntax=rst :
2426
.. Local Variables:
2427
.. mode: rst
2428
.. fill-column: 72
2429
.. End: