8 Ganeti 2.1 brings many improvements with it. Major changes:
10 - Added infrastructure to ease automated disk repairs
11 - Added new daemon to export configuration data in a cheaper way than
13 - Instance NICs can now be routed instead of being associated with a
15 - Improved job locking logic to reduce impact of jobs acquiring multiple
16 locks waiting for other long-running jobs
18 In-depth implementation details can be found in the Ganeti 2.1 design
24 - Added chroot hypervisor
25 - Added more options to xen-hvm hypervisor (``kernel_path`` and
27 - Added more options to xen-pvm hypervisor (``use_bootloader``,
28 ``bootloader_path`` and ``bootloader_args``)
29 - Added the ``use_localtime`` option for the xen-hvm and kvm
30 hypervisors, and the default value for this has changed to false (in
31 2.0 xen-hvm always enabled it)
32 - Added luxi call to submit multiple jobs in one go
33 - Added cluster initialization option to not modify ``/etc/hosts``
35 - Added network interface parameters
36 - Added dry run mode to some LUs
37 - Added RAPI resources:
39 - ``/2/instances/[instance_name]/info``
40 - ``/2/instances/[instance_name]/replace-disks``
41 - ``/2/nodes/[node_name]/evacuate``
42 - ``/2/nodes/[node_name]/migrate``
43 - ``/2/nodes/[node_name]/role``
44 - ``/2/nodes/[node_name]/storage``
45 - ``/2/nodes/[node_name]/storage/modify``
46 - ``/2/nodes/[node_name]/storage/repair``
48 - Added OpCodes to evacuate or migrate all instances on a node
49 - Added new command to list storage elements on nodes (``gnt-node
50 list-storage``) and modify them (``gnt-node modify-storage``)
51 - Added new ssconf files with master candidate IP address
52 (``ssconf_master_candidates_ips``), node primary IP address
53 (``ssconf_node_primary_ips``) and node secondary IP address
54 (``ssconf_node_secondary_ips``)
55 - Added ``ganeti-confd`` and a client library to query the Ganeti
57 - Added ability to run hooks after cluster initialization and before
59 - Added automatic mode for disk replace (``gnt-instance replace-disks
61 - Added ``gnt-instance recreate-disks`` to re-create (empty) disks
62 after catastrophic data-loss
63 - Added ``gnt-node repair-storage`` command to repair damaged LVM volume
65 - Added ``gnt-instance move`` command to move instances
66 - Added ``gnt-cluster watcher`` command to control watcher
67 - Added ``gnt-node powercycle`` command to powercycle nodes
68 - Added new job status field ``lock_status``
69 - Added parseable error codes to cluster verification (``gnt-cluster
70 verify --error-codes``) and made output less verbose (use
71 ``--verbose`` to restore previous behaviour)
72 - Added UUIDs to the main config entities (cluster, nodes, instances)
73 - Added support for OS variants
74 - Added support for hashed passwords in the Ganeti remote API users file
76 - Added option to specify maximum timeout on instance shutdown
77 - Added ``--no-ssh-init`` option to ``gnt-cluster init``
78 - Added new helper script to start and stop Ganeti daemons
79 (``daemon-util``), with the intent to reduce the work necessary to
80 adjust Ganeti for non-Debian distributions and to start/stop daemons
82 - Added more unittests
83 - Fixed critical bug in ganeti-masterd startup
84 - Removed the configure-time ``kvm-migration-port`` parameter, this is
85 now customisable at the cluster level for both the KVM and Xen
86 hypervisors using the new ``migration_port`` parameter
87 - Pass ``INSTANCE_REINSTALL`` variable to OS installation script when
88 reinstalling an instance
89 - Allowed ``@`` in tag names
90 - Migrated to Sphinx (http://sphinx.pocoo.org/) for documentation
91 - Many documentation updates
92 - Distribute hypervisor files on ``gnt-cluster redist-conf``
93 - ``gnt-instance reinstall`` can now reinstall multiple instances
94 - Updated many command line parameters
95 - Introduced new OS API version 15
96 - No longer support a default hypervisor
97 - Treat virtual LVs as inexistent
98 - Improved job locking logic to reduce lock contention
99 - Match instance and node names case insensitively
100 - Reimplemented bash completion script to be more complete
107 - Fix cleaner behaviour on nodes not in a cluster (Debian bug 568105)
108 - Fix a string formatting bug
109 - Improve safety of the code in some error paths
110 - Improve data validation in the master of values returned from nodes
116 - Fix security issue due to missing validation of iallocator names; this
117 allows local and remote execution of arbitrary executables
118 - Fix failure of gnt-node list during instance removal
119 - Ship the RAPI documentation in the archive
125 - Fixed many wrong messages
126 - Fixed a few bugs related to the locking library
127 - Fixed MAC checking at instance creation time
128 - Fixed a DRBD parsing bug related to gaps in /proc/drbd
129 - Fixed a few issues related to signal handling in both daemons and
131 - Fixed the example startup script provided
132 - Fixed insserv dependencies in the example startup script (patch from
134 - Fixed handling of drained nodes in the iallocator framework
135 - Fixed handling of KERNEL_PATH parameter for xen-hvm (Debian bug
137 - Fixed error related to invalid job IDs in job polling
138 - Fixed job/opcode persistence on unclean master shutdown
139 - Fixed handling of partial job processing after unclean master
141 - Fixed error reporting from LUs, previously all errors were converted
142 into execution errors
143 - Fixed error reporting from burnin
144 - Decreased significantly the memory usage of the job queue
145 - Optimised slightly multi-job submission
146 - Optimised slightly opcode loading
147 - Backported the multi-job submit framework from the development
148 branch; multi-instance start and stop should be faster
149 - Added script to clean archived jobs after 21 days; this will reduce
150 the size of the queue directory
151 - Added some extra checks in disk size tracking
152 - Added an example ethers hook script
153 - Added a cluster parameter that prevents Ganeti from modifying of
155 - Added more node information to RAPI responses
156 - Added a ``gnt-job watch`` command that allows following the ouput of a
158 - Added a bind-address option to ganeti-rapi
159 - Added more checks to the configuration verify
160 - Enhanced the burnin script such that some operations can be retried
162 - Converted instance reinstall to multi-instance model
168 - Added ``--ignore-size`` to the ``gnt-instance activate-disks`` command
169 to allow using the pre-2.0.2 behaviour in activation, if any existing
170 instances have mismatched disk sizes in the configuration
171 - Added ``gnt-cluster repair-disk-sizes`` command to check and update
172 any configuration mismatches for disk sizes
173 - Added ``gnt-master cluste-failover --no-voting`` to allow master
174 failover to work on two-node clusters
175 - Fixed the ``--net`` option of ``gnt-backup import``, which was
177 - Fixed detection of OS script errors in ``gnt-backup export``
178 - Fixed exit code of ``gnt-backup export``
184 - Added experimental support for stripped logical volumes; this should
185 enhance performance but comes with a higher complexity in the block
186 device handling; stripping is only enabled when passing
187 ``--with-lvm-stripecount=N`` to ``configure``, but codepaths are
188 affected even in the non-stripped mode
189 - Improved resiliency against transient failures at the end of DRBD
190 resyncs, and in general of DRBD resync checks
191 - Fixed a couple of issues with exports and snapshot errors
192 - Fixed a couple of issues in instance listing
193 - Added display of the disk size in ``gnt-instance info``
194 - Fixed checking for valid OSes in instance creation
195 - Fixed handling of the "vcpus" parameter in instance listing and in
196 general of invalid parameters
197 - Fixed http server library, and thus RAPI, to handle invalid
198 username/password combinations correctly; this means that now they
199 report unauthorized for queries too, not only for modifications,
200 allowing earlier detect of configuration problems
201 - Added a new "role" node list field, equivalent to the master/master
202 candidate/drained/offline flags combinations
203 - Fixed cluster modify and changes of candidate pool size
204 - Fixed cluster verify error messages for wrong files on regular nodes
205 - Fixed a couple of issues with node demotion from master candidate role
206 - Fixed node readd issues
207 - Added non-interactive mode for ``ganeti-masterd --no-voting`` startup
208 - Added a new ``--no-voting`` option for masterfailover to fix failover
209 on two-nodes clusters when the former master node is unreachable
210 - Added instance reinstall over RAPI
216 - added ``-H``/``-B`` startup parameters to ``gnt-instance``, which will
217 allow re-adding the start in single-user option (regression from 1.2)
218 - the watcher writes the instance status to a file, to allow monitoring
219 to report the instance status (from the master) based on cached
220 results of the watcher's queries; while this can get stale if the
221 watcher is being locked due to other work on the cluster, this is
223 - the watcher now also restarts the node daemon and the rapi daemon if
225 - fixed the watcher to handle full and drained queue cases
226 - hooks export more instance data in the environment, which helps if
227 hook scripts need to take action based on the instance's properties
228 (no longer need to query back into ganeti)
229 - instance failovers when the instance is stopped do not check for free
230 RAM, so that failing over a stopped instance is possible in low memory
232 - rapi uses queries for tags instead of jobs (for less job traffic), and
233 for cluster tags it won't talk to masterd at all but read them from
235 - a couple of error handling fixes in RAPI
236 - drbd handling: improved the error handling of inconsistent disks after
237 resync to reduce the frequency of "there are some degraded disks for
238 this instance" messages
239 - fixed a bug in live migration when DRBD doesn't want to reconnect (the
240 error handling path called a wrong function name)
246 - no changes from rc5
249 Version 2.0 release candidate 5
250 -------------------------------
252 - fix a couple of bugs (validation, argument checks)
253 - fix ``gnt-cluster getmaster`` on non-master nodes (regression)
254 - some small improvements to RAPI and IAllocator
255 - make watcher automatically start the master daemon if down
258 Version 2.0 release candidate 4
259 -------------------------------
261 - change the OS list to not require locks; this helps with big clusters
262 - fix ``gnt-cluster verify`` and ``gnt-cluster verify-disks`` when the
263 volume group is broken
264 - ``gnt-instance info``, without any arguments, doesn't run for all
265 instances anymore; either pass ``--all`` or pass the desired
266 instances; this helps against mistakes on big clusters where listing
267 the information for all instances takes a long time
268 - miscellaneous doc and man pages fixes
271 Version 2.0 release candidate 3
272 -------------------------------
274 - Change the internal locking model of some ``gnt-node`` commands, in
275 order to reduce contention (and blocking of master daemon) when
276 batching many creation/reinstall jobs
277 - Fixes to Xen soft reboot
278 - No longer build documentation at build time, instead distribute it in
279 the archive, in order to reduce the need for the whole docbook/rst
283 Version 2.0 release candidate 2
284 -------------------------------
286 - Now the cfgupgrade scripts works and can upgrade 1.2.7 clusters to 2.0
287 - Fix watcher startup sequence, improves the behaviour of busy clusters
288 - Some other fixes in ``gnt-cluster verify``, ``gnt-instance
289 replace-disks``, ``gnt-instance add``, ``gnt-cluster queue``, KVM VNC
290 bind address and other places
291 - Some documentation fixes and updates
294 Version 2.0 release candidate 1
295 -------------------------------
297 - More documentation updates, now all docs should be more-or-less
299 - A couple of small fixes (mixed hypervisor clusters, offline nodes,
301 - Added a customizable HV_KERNEL_ARGS hypervisor parameter (for Xen PVM
303 - Fix an issue related to $libdir/run/ganeti and cluster creation
309 - Xen PVM and KVM have switched the default value for the instance root
310 disk to the first partition on the first drive, instead of the whole
311 drive; this means that the OS installation scripts must be changed
313 - Man pages have been updated
314 - RAPI has been switched by default to HTTPS, and the exported functions
315 should all work correctly
316 - RAPI v1 has been removed
317 - Many improvements to the KVM hypervisor
318 - Block device errors are now better reported
319 - Many other bugfixes and small improvements
325 - Version 2 is a general rewrite of the code and therefore the
326 differences are too many to list, see the design document for 2.0 in
327 the ``doc/`` subdirectory for more details
328 - In this beta version there is not yet a migration path from 1.2 (there
329 will be one in the final 2.0 release)
330 - A few significant changes are:
332 - all commands are executed by a daemon (``ganeti-masterd``) and the
333 various ``gnt-*`` commands are just front-ends to it
334 - all the commands are entered into, and executed from a job queue,
335 see the ``gnt-job(8)`` manpage
336 - the RAPI daemon supports read-write operations, secured by basic
337 HTTP authentication on top of HTTPS
338 - DRBD version 0.7 support has been removed, DRBD 8 is the only
339 supported version (when migrating from Ganeti 1.2 to 2.0, you need
340 to migrate to DRBD 8 first while still running Ganeti 1.2)
341 - DRBD devices are using statically allocated minor numbers, which
342 will be assigned to existing instances during the migration process
343 - there is support for both Xen PVM and Xen HVM instances running on
345 - KVM virtualization is supported too
346 - file-based storage has been implemented, which means that it is
347 possible to run the cluster without LVM and DRBD storage, for
348 example using a shared filesystem exported from shared storage (and
349 still have live migration)
355 - Change the default reboot type in ``gnt-instance reboot`` to "hard"
356 - Reuse the old instance mac address by default on instance import, if
357 the instance name is the same.
358 - Handle situations in which the node info rpc returns incomplete
360 - Add checks for tcp/udp ports collisions in ``gnt-cluster verify``
361 - Improved version of batcher:
364 - instance mac address support
365 - support for HVM clusters/instances
367 - Add an option to show the number of cpu sockets and nodes in
369 - Support OSes that handle more than one version of the OS api (but do
370 not change the current API in any other way)
371 - Fix ``gnt-node migrate``
372 - ``gnt-debug`` man page
373 - Fixes various more typos and small issues
374 - Increase disk resync maximum speed to 60MB/s (from 30MB/s)
380 - new ``--hvm-nic-type`` and ``--hvm-disk-type`` flags to control the
381 type of disk exported to fully virtualized instances.
382 - provide access to the serial console of HVM instances
383 - instance auto_balance flag, set by default. If turned off it will
384 avoid warnings on cluster verify if there is not enough memory to fail
385 over an instance. in the future it will prevent automatically failing
386 it over when we will support that.
387 - batcher tool for instance creation, see ``tools/README.batcher``
388 - ``gnt-instance reinstall --select-os`` to interactively select a new
389 operating system when reinstalling an instance.
390 - when changing the memory amount on instance modify a check has been
391 added that the instance will be able to start. also warnings are
392 emitted if the instance will not be able to fail over, if auto_balance
394 - documentation fixes
395 - sync fields between ``gnt-instance list/modify/add/import``
396 - fix a race condition in drbd when the sync speed was set after giving
397 the device a remote peer.
403 - note: the allowed size and number of tags per object were reduced
404 - fix a bug in ``gnt-cluster verify`` with inconsistent volume groups
405 - fixed twisted 8.x compatibility
406 - fixed ``gnt-instance replace-disks`` with iallocator
407 - add TCP keepalives on twisted connections to detect restarted nodes
408 - disk increase support, see ``gnt-instance grow-disk``
409 - implement bulk node/instance query for RAPI
410 - add tags in node/instance listing (optional)
411 - experimental migration (and live migration) support, read the man page
412 for ``gnt-instance migrate``
413 - the ``ganeti-watcher`` logs are now timestamped, and the watcher also
414 has some small improvements in handling its state file
420 - Experimental readonly, REST-based remote API implementation;
421 automatically started on master node, TCP port 5080, if enabled by
422 ``--enable-rapi`` parameter to configure script.
423 - Instance allocator support. Add and import instance accept a
424 ``--iallocator`` parameter, and call that instance allocator to decide
425 which node to use for the instance. The iallocator document describes
426 what's expected from an allocator script.
427 - ``gnt-cluster verify`` N+1 memory redundancy checks: Unless passed the
428 ``--no-nplus1-mem`` option ``gnt-cluster verify`` now checks that if a
429 node is lost there is still enough memory to fail over the instances
431 - ``gnt-cluster verify`` hooks: it is now possible to add post-hooks to
432 ``gnt-cluster verify``, to check for site-specific compliance. All the
433 hooks will run, and their output, if any, will be displayed. Any
434 failing hook will make the verification return an error value.
435 - ``gnt-cluster verify`` now checks that its peers are reachable on the
436 primary and secondary interfaces
437 - ``gnt-node add`` now supports the ``--readd`` option, to readd a node
438 that is still declared as part of the cluster and has failed.
439 - ``gnt-* list`` commands now accept a new ``-o +field`` way of
440 specifying output fields, that just adds the chosen fields to the
442 - ``gnt-backup`` now has a new ``remove`` command to delete an existing
443 export from the filesystem.
444 - New per-instance parameters hvm_acpi, hvm_pae and hvm_cdrom_image_path
445 have been added. Using them you can enable/disable acpi and pae
446 support, and specify a path for a cd image to be exported to the
447 instance. These parameters as the name suggest only work on HVM
449 - When upgrading an HVM cluster to Ganeti 1.2.4, the values for ACPI and
450 PAE support will be set to the previously hardcoded values, but the
451 (previously hardcoded) path to the CDROM ISO image will be unset and
452 if required, needs to be set manually with ``gnt-instance modify``
454 - The address to which an instance's VNC console is bound is now
455 selectable per-instance, rather than being cluster wide. Of course
456 this only applies to instances controlled via VNC, so currently just
457 applies to HVM clusters.
463 - more tweaks to the disk activation code (especially helpful for DRBD)
464 - change the default ``gnt-instance list`` output format, now there is
465 one combined status field (see the manpage for the exact values this
467 - some more fixes for the mac export to hooks change
468 - make Ganeti not break with DRBD 8.2.x (which changed the version
469 format in ``/proc/drbd``) (issue 24)
470 - add an upgrade tool from "remote_raid1" disk template to "drbd" disk
471 template, allowing migration from DRBD0.7+MD to DRBD8
477 - fix ``gnt-instance modify`` breakage introduced in 1.2.1 with the HVM
479 - add command aliases infrastructure and a few aliases
480 - allow listing of VCPUs in the ``gnt-instance list`` and improve the
481 man pages and the ``--help`` option of ``gnt-node
482 list``/``gnt-instance list``
483 - fix ``gnt-backup list`` with down nodes (issue 21)
484 - change the tools location (move from $pkgdatadir to $pkglibdir/tools)
485 - fix the dist archive and add a check for including svn/git files in
487 - some developer-related changes: improve the burnin and the QA suite,
488 add an upload script for testing during development
494 - experimental HVM support, read the install document, section
495 "Initializing the cluster"
496 - allow for the PVM hypervisor per-instance kernel and initrd paths
497 - add a new command ``gnt-cluster verify-disks`` which uses a new
498 algorithm to improve the reconnection of the DRBD pairs if the device
499 on the secondary node has gone away
500 - make logical volume code auto-activate LVs at disk activation time
501 - slightly improve the speed of activating disks
502 - allow specification of the MAC address at instance creation time, and
503 changing it later via ``gnt-instance modify``
504 - fix handling of external commands that generate lots of output on
506 - update documentation with regard to minimum version of DRBD8 supported
512 - Log the ``xm create`` output to the node daemon log on failure (to
513 help diagnosing the error)
514 - In debug mode, log all external commands output if failed to the logs
515 - Change parsing of lvm commands to ignore stderr
521 - Another round of updates to the DRBD 8 code to deal with more failures
522 in the replace secondary node operation
523 - Some more logging of failures in disk operations (lvm, drbd)
524 - A few documentation updates
531 - Change configuration file format from Python's Pickle to JSON.
532 Upgrading is possible using the cfgupgrade utility.
533 - Add support for DRBD 8.0 (new disk template ``drbd``) which allows for
534 faster replace disks and is more stable (DRBD 8 has many improvements
535 compared to DRBD 0.7)
536 - Added command line tags support (see man pages for ``gnt-instance``,
537 ``gnt-node``, ``gnt-cluster``)
538 - Added instance rename support
539 - Added multi-instance startup/shutdown
540 - Added cluster rename support
541 - Added ``gnt-node evacuate`` to simplify some node operations
542 - Added instance reboot operation that can speedup reboot as compared to
544 - Soften the requirement that hostnames are in FQDN format
545 - The ``ganeti-watcher`` now activates drbd pairs after secondary node
547 - Removed dependency on debian's patched fping that uses the
548 non-standard ``-S`` option
549 - Now the OS definitions are searched for in multiple, configurable
550 paths (easier for distros to package)
551 - Some changes to the hooks infrastructure (especially the new
552 post-configuration update hook)
553 - Other small bugfixes
555 .. vim: set textwidth=72 :