News
====
+
+Version 2.5.0 rc6
+-----------------
+
+*(Released Fri, 23 Mar 2012)*
+
+Incompatible/important changes and bugfixes
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+- The default of the ``/2/instances/[instance_name]/rename`` RAPI
+ resource's ``ip_check`` parameter changed from ``True`` to ``False``
+ to match the underlying LUXI interface.
+- The ``/2/nodes/[node_name]/evacuate`` RAPI resource was changed to use
+ body parameters, see :doc:`RAPI documentation <rapi>`. The server does
+ not maintain backwards-compatibility as the underlying operation
+ changed in an incompatible way. The RAPI client can talk to old
+ servers, but it needs to be told so as the return value changed.
+- When creating file-based instances via RAPI, the ``file_driver``
+ parameter no longer defaults to ``loop`` and must be specified.
+- The deprecated ``bridge`` NIC parameter is no longer supported. Use
+ ``link`` instead.
+- Support for the undocumented and deprecated RAPI instance creation
+ request format version 0 has been dropped. Use version 1, supported
+ since Ganeti 2.1.3 and :doc:`documented <rapi>`, instead.
+- Pyparsing 1.4.6 or above is required, see :doc:`installation
+ documentation <install>`.
+- The "cluster-verify" hooks are now executed per group by the
+ ``OP_CLUSTER_VERIFY_GROUP`` opcode. This maintains the same behavior
+ if you just run ``gnt-cluster verify``, which generates one opcode per
+ group.
+- The environment as passed to the OS scripts is cleared, and thus no
+ environment variables defined in the node daemon's environment will be
+ inherited by the scripts.
+- The :doc:`iallocator <iallocator>` mode ``multi-evacuate`` has been
+ deprecated.
+- :doc:`New iallocator modes <design-multi-reloc>` have been added to
+ support operations involving multiple node groups.
+- Offline nodes are ignored when failing over an instance.
+- Support for KVM version 1.0, which changed the version reporting format
+ from 3 to 2 digits.
+- ``Makefile`` is now compatible with Automake 1.11.2
+- Includes all bugfixes made in the 2.4 series
+
+New features
+~~~~~~~~~~~~
+
+- The ganeti-htools project has been merged into the ganeti-core source
+ tree and will be built as part of Ganeti (see :doc:`install-quick`).
+- Implemented support for :doc:`shared storage <design-shared-storage>`.
+- Add support for disks larger than 2 TB in ``lvmstrap`` by supporting
+ GPT-style partition tables (requires `parted
+ <http://www.gnu.org/s/parted/>`_).
+- Added support for floppy drive and 2nd CD-ROM drive in KVM hypervisor.
+- Allowed adding tags on instance creation.
+- Export instance tags to hooks (``INSTANCE_TAGS``, see :doc:`hooks`)
+- Allow instances to be started in a paused state, enabling the user to
+ see the complete console output on boot using the console.
+- Added new hypervisor flag to control default reboot behaviour
+ (``reboot_behavior``).
+- Added support for KVM keymaps (hypervisor parameter ``keymap``).
+- Improved out-of-band management support:
+
+ - Added ``gnt-node health`` command reporting the health status of
+ nodes.
+ - Added ``gnt-node power`` command to manage power status of nodes.
+ - Added command for emergency power-off (EPO), ``gnt-cluster epo``.
+
+- Instance migration can fall back to failover if instance is not
+ running.
+- Filters can be used when listing nodes, instances, groups and locks;
+ see *ganeti(7)* manpage.
+- Added post-execution status as variables to :doc:`hooks <hooks>`
+ environment.
+- Instance tags are exported/imported together with the instance.
+- When given an explicit job ID, ``gnt-job info`` will work for archived
+ jobs.
+- Jobs can define dependencies on other jobs (not yet supported via
+ RAPI or command line, but used by internal commands and usable via
+ LUXI).
+
+ - Lock monitor (``gnt-debug locks``) shows jobs waiting for
+ dependencies.
+
+- Instance failover is now available as a RAPI resource
+ (``/2/instances/[instance_name]/failover``).
+- ``gnt-instance info`` defaults to static information if primary node
+ is offline.
+- Opcodes have a new ``comment`` attribute.
+- Added basic SPICE support to KVM hypervisor.
+- ``tools/ganeti-listrunner`` allows passing of arguments to executable.
+
+Node group improvements
+~~~~~~~~~~~~~~~~~~~~~~~
+
+- ``gnt-cluster verify`` has been modified to check groups separately,
+ thereby improving performance.
+- Node group support has been added to ``gnt-cluster verify-disks``,
+ which now operates per node group.
+- Watcher has been changed to work better with node groups.
+
+ - One process and state file per node group.
+ - Slow watcher in one group doesn't block other group's watcher.
+
+- Added new command, ``gnt-group evacuate``, to move all instances in a
+ node group to other groups.
+- Added ``gnt-instance change-group`` to move an instance to another
+ node group.
+- ``gnt-cluster command`` and ``gnt-cluster copyfile`` now support
+ per-group operations.
+- Node groups can be tagged.
+- Some operations switch from an exclusive to a shared lock as soon as
+ possible.
+- Instance's primary and secondary nodes' groups are now available as
+ query fields (``pnode.group``, ``pnode.group.uuid``, ``snodes.group``
+ and ``snodes.group.uuid``).
+
+Misc
+~~~~
+
+- Numerous updates to documentation and manpages.
+
+ - :doc:`RAPI <rapi>` documentation now has detailed parameter
+ descriptions.
+ - Some opcode/job results are now also documented, see :doc:`RAPI
+ <rapi>`.
+
+- A lockset's internal lock is now also visible in lock monitor.
+- Log messages from job queue workers now contain information about the
+ opcode they're processing.
+- ``gnt-instance console`` no longer requires the instance lock.
+- A short delay when waiting for job changes reduces the number of LUXI
+ requests significantly.
+- DRBD metadata volumes are overwritten with zeros during disk creation.
+- ``devel/upload`` now uses correct permissions for directories.
+
+
+Version 2.5.0 rc5
+-----------------
+
+*(Released Mon, 9 Jan 2012)*
+
+This was the fifth release candidate of the 2.5 series.
+
+
+Version 2.5.0 rc4
+-----------------
+
+*(Released Thu, 27 Oct 2011)*
+
+This was the fourth release candidate of the 2.5 series.
+
+
+Version 2.5.0 rc3
+-----------------
+
+*(Released Wed, 26 Oct 2011)*
+
+This was the third release candidate of the 2.5 series.
+
+
+Version 2.5.0 rc2
+-----------------
+
+*(Released Tue, 18 Oct 2011)*
+
+This was the second release candidate of the 2.5 series.
+
+
+Version 2.5.0 rc1
+-----------------
+
+*(Released Tue, 4 Oct 2011)*
+
+This was the first release candidate of the 2.5 series.
+
+
+Version 2.5.0 beta3
+-------------------
+
+*(Released Wed, 31 Aug 2011)*
+
+This was the third beta release of the 2.5 series.
+
+
+Version 2.5.0 beta2
+-------------------
+
+*(Released Mon, 22 Aug 2011)*
+
+This was the second beta release of the 2.5 series.
+
+
+Version 2.5.0 beta1
+-------------------
+
+*(Released Fri, 12 Aug 2011)*
+
+This was the first beta release of the 2.5 series.
+
+
+Version 2.4.5
+-------------
+
+*(Released Thu, 27 Oct 2011)*
+
+- Fixed bug when parsing command line parameter values ending in
+ backslash
+- Fixed assertion error after unclean master shutdown
+- Disable HTTP client pool for RPC, significantly reducing memory usage
+ of master daemon
+- Fixed queue archive creation with wrong permissions
+
+
+Version 2.4.4
+-------------
+
+*(Released Tue, 23 Aug 2011)*
+
+Small bug-fixes:
+
+- Fixed documentation for importing with ``--src-dir`` option
+- Fixed a bug in ``ensure-dirs`` with queue/archive permissions
+- Fixed a parsing issue with DRBD 8.3.11 in the Linux kernel
+
+
+Version 2.4.3
+-------------
+
+*(Released Fri, 5 Aug 2011)*
+
+Many bug-fixes and a few small features:
+
+- Fixed argument order in ``ReserveLV`` and ``ReserveMAC`` which caused
+ issues when you tried to add an instance with two MAC addresses in one
+ request
+- KVM: fixed per-instance stored UID value
+- KVM: configure bridged NICs at migration start
+- KVM: Fix a bug where instance will not start with never KVM versions
+ (>= 0.14)
+- Added OS search path to ``gnt-cluster info``
+- Fixed an issue with ``file_storage_dir`` where you were forced to
+ provide an absolute path, but the documentation states it is a
+ relative path, the documentation was right
+- Added a new parameter to instance stop/start called ``--no-remember``
+ that will make the state change to not be remembered
+- Implemented ``no_remember`` at RAPI level
+- Improved the documentation
+- Node evacuation: don't call IAllocator if node is already empty
+- Fixed bug in DRBD8 replace disks on current nodes
+- Fixed bug in recreate-disks for DRBD instances
+- Moved assertion checking locks in ``gnt-instance replace-disks``
+ causing it to abort with not owning the right locks for some situation
+- Job queue: Fixed potential race condition when cancelling queued jobs
+- Fixed off-by-one bug in job serial generation
+- ``gnt-node volumes``: Fix instance names
+- Fixed aliases in bash completion
+- Fixed a bug in reopening log files after being sent a SIGHUP
+- Added a flag to burnin to allow specifying VCPU count
+- Bugfixes to non-root Ganeti configuration
+
+
+Version 2.4.2
+-------------
+
+*(Released Thu, 12 May 2011)*
+
+Many bug-fixes and a few new small features:
+
+- Fixed a bug related to log opening failures
+- Fixed a bug in instance listing with orphan instances
+- Fixed a bug which prevented resetting the cluster-level node parameter
+ ``oob_program`` to the default
+- Many fixes related to the ``cluster-merge`` tool
+- Fixed a race condition in the lock monitor, which caused failures
+ during (at least) creation of many instances in parallel
+- Improved output for gnt-job info
+- Removed the quiet flag on some ssh calls which prevented debugging
+ failures
+- Improved the N+1 failure messages in cluster verify by actually
+ showing the memory values (needed and available)
+- Increased lock attempt timeouts so that when executing long operations
+ (e.g. DRBD replace-disks) other jobs do not enter 'blocking acquire'
+ too early and thus prevent the use of the 'fair' mechanism
+- Changed instance query data (``gnt-instance info``) to not acquire
+ locks unless needed, thus allowing its use on locked instance if only
+ static information is asked for
+- Improved behaviour with filesystems that do not support rename on an
+ opened file
+- Fixed the behaviour of ``prealloc_wipe_disks`` cluster parameter which
+ kept locks on all nodes during the wipe, which is unneeded
+- Fixed ``gnt-watcher`` handling of errors during hooks execution
+- Fixed bug in ``prealloc_wipe_disks`` with small disk sizes (less than
+ 10GiB) which caused the wipe to fail right at the end in some cases
+- Fixed master IP activation when doing master failover with no-voting
+- Fixed bug in ``gnt-node add --readd`` which allowed the re-adding of
+ the master node itself
+- Fixed potential data-loss in under disk full conditions, where Ganeti
+ wouldn't check correctly the return code and would consider
+ partially-written files 'correct'
+- Fixed bug related to multiple VGs and DRBD disk replacing
+- Added new disk parameter ``metavg`` that allows placement of the meta
+ device for DRBD in a different volume group
+- Fixed error handling in the node daemon when the system libc doesn't
+ have major number 6 (i.e. if ``libc.so.6`` is not the actual libc)
+- Fixed lock release during replace-disks, which kept cluster-wide locks
+ when doing disk replaces with an iallocator script
+- Added check for missing bridges in cluster verify
+- Handle EPIPE errors while writing to the terminal better, so that
+ piping the output to e.g. ``less`` doesn't cause a backtrace
+- Fixed rare case where a ^C during Luxi calls could have been
+ interpreted as server errors, instead of simply terminating
+- Fixed a race condition in LUGroupAssignNodes (``gnt-group
+ assign-nodes``)
+- Added a few more parameters to the KVM hypervisor, allowing a second
+ CDROM, custom disk type for CDROMs and a floppy image
+- Removed redundant message in instance rename when the name is given
+ already as a FQDN
+- Added option to ``gnt-instance recreate-disks`` to allow creating the
+ disks on new nodes, allowing recreation when the original instance
+ nodes are completely gone
+- Added option when converting disk templates to DRBD to skip waiting
+ for the resync, in order to make the instance available sooner
+- Added two new variables to the OS scripts environment (containing the
+ instance's nodes)
+- Made the root_path and optional parameter for the xen-pvm hypervisor,
+ to allow use of ``pvgrub`` as bootloader
+- Changed the instance memory modifications to only check out-of-memory
+ conditions on memory increases, and turned the secondary node warnings
+ into errors (they can still be overridden via ``--force``)
+- Fixed the handling of a corner case when the Python installation gets
+ corrupted (e.g. a bad disk) while ganeti-noded is running and we try
+ to execute a command that doesn't exist
+- Fixed a bug in ``gnt-instance move`` (LUInstanceMove) when the primary
+ node of the instance returned failures during instance shutdown; this
+ adds the option ``--ignore-consistency`` to gnt-instance move
+
+And as usual, various improvements to the error messages, documentation
+and man pages.
+
+Version 2.4.1
+-------------
+
+*(Released Wed, 09 Mar 2011)*
+
+Emergency bug-fix release. ``tools/cfgupgrade`` was broken and overwrote
+the RAPI users file if run twice (even with ``--dry-run``).
+
+The release fixes that bug (nothing else changed).
+
+
+Version 2.4.0
+-------------
+
+*(Released Mon, 07 Mar 2011)*
+
+Final 2.4.0 release. Just a few small fixes:
+
+- Fixed RAPI node evacuate
+- Fixed the kvm-ifup script
+- Fixed internal error handling for special job cases
+- Updated man page to specify the escaping feature for options
+
+
+Version 2.4.0 rc3
+-----------------
+
+*(Released Mon, 28 Feb 2011)*
+
+A critical fix for the ``prealloc_wipe_disks`` feature: it is possible
+that this feature wiped the disks of the wrong instance, leading to loss
+of data.
+
+Other changes:
+
+- Fixed title of query field containing instance name
+- Expanded the glossary in the documentation
+- Fixed one unittest (internal issue)
+
+
+Version 2.4.0 rc2
+-----------------
+
+*(Released Mon, 21 Feb 2011)*
+
+A number of bug fixes plus just a couple functionality changes.
+
+On the user-visible side, the ``gnt-* list`` command output has changed
+with respect to "special" field states. The current rc1 style of display
+can be re-enabled by passing a new ``--verbose`` (``-v``) flag, but in
+the default output mode special fields states are displayed as follows:
+
+- Offline resource: ``*``
+- Unavailable/not applicable: ``-``
+- Data missing (RPC failure): ``?``
+- Unknown field: ``??``
+
+Another user-visible change is the addition of ``--force-join`` to
+``gnt-node add``.
+
+As for bug fixes:
+
+- ``tools/cluster-merge`` has seen many fixes and is now enabled again
+- Fixed regression in RAPI/instance reinstall where all parameters were
+ required (instead of optional)
+- Fixed ``gnt-cluster repair-disk-sizes``, was broken since Ganeti 2.2
+- Fixed iallocator usage (offline nodes were not considered offline)
+- Fixed ``gnt-node list`` with respect to non-vm_capable nodes
+- Fixed hypervisor and OS parameter validation with respect to
+ non-vm_capable nodes
+- Fixed ``gnt-cluster verify`` with respect to offline nodes (mostly
+ cosmetic)
+- Fixed ``tools/listrunner`` with respect to agent-based usage
+
+
+Version 2.4.0 rc1
+-----------------
+
+*(Released Fri, 4 Feb 2011)*
+
+Many changes and fixes since the beta1 release. While there were some
+internal changes, the code has been mostly stabilised for the RC
+release.
+
+Note: the dumb allocator was removed in this release, as it was not kept
+up-to-date with the IAllocator protocol changes. It is recommended to
+use the ``hail`` command from the ganeti-htools package.
+
+Note: the 2.4 and up versions of Ganeti are not compatible with the
+0.2.x branch of ganeti-htools. You need to upgrade to
+ganeti-htools-0.3.0 (or later).
+
+Regressions fixed from 2.3
+~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+- Fixed the ``gnt-cluster verify-disks`` command
+- Made ``gnt-cluster verify-disks`` work in parallel (as opposed to
+ serially on nodes)
+- Fixed disk adoption breakage
+- Fixed wrong headers in instance listing for field aliases
+
+Other bugs fixed
+~~~~~~~~~~~~~~~~
+
+- Fixed corner case in KVM handling of NICs
+- Fixed many cases of wrong handling of non-vm_capable nodes
+- Fixed a bug where a missing instance symlink was not possible to
+ recreate with any ``gnt-*`` command (now ``gnt-instance
+ activate-disks`` does it)
+- Fixed the volume group name as reported by ``gnt-cluster
+ verify-disks``
+- Increased timeouts for the import-export code, hopefully leading to
+ fewer aborts due network or instance timeouts
+- Fixed bug in ``gnt-node list-storage``
+- Fixed bug where not all daemons were started on cluster
+ initialisation, but only at the first watcher run
+- Fixed many bugs in the OOB implementation
+- Fixed watcher behaviour in presence of instances with offline
+ secondaries
+- Fixed instance list output for instances running on the wrong node
+- a few fixes to the cluster-merge tool, but it still cannot merge
+ multi-node groups (currently it is not recommended to use this tool)
+
+
+Improvements
+~~~~~~~~~~~~
+
+- Improved network configuration for the KVM hypervisor
+- Added e1000 as a supported NIC for Xen-HVM
+- Improved the lvmstrap tool to also be able to use partitions, as
+ opposed to full disks
+- Improved speed of disk wiping (the cluster parameter
+ ``prealloc_wipe_disks``, so that it has a low impact on the total time
+ of instance creations
+- Added documentation for the OS parameters
+- Changed ``gnt-instance deactivate-disks`` so that it can work if the
+ hypervisor is not responding
+- Added display of blacklisted and hidden OS information in
+ ``gnt-cluster info``
+- Extended ``gnt-cluster verify`` to also validate hypervisor, backend,
+ NIC and node parameters, which might create problems with currently
+ invalid (but undetected) configuration files, but prevents validation
+ failures when unrelated parameters are modified
+- Changed cluster initialisation to wait for the master daemon to become
+ available
+- Expanded the RAPI interface:
+
+ - Added config redistribution resource
+ - Added activation/deactivation of instance disks
+ - Added export of console information
+
+- Implemented log file reopening on SIGHUP, which allows using
+ logrotate(8) for the Ganeti log files
+- Added a basic OOB helper script as an example
+
+
+Version 2.4.0 beta1
+-------------------
+
+*(Released Fri, 14 Jan 2011)*
+
+User-visible
+~~~~~~~~~~~~
+
+- Fixed timezone issues when formatting timestamps
+- Added support for node groups, available via ``gnt-group`` and other
+ commands
+- Added out-of-band framework and management, see :doc:`design
+ document <design-oob>`
+- Removed support for roman numbers from ``gnt-node list`` and
+ ``gnt-instance list``.
+- Allowed modification of master network interface via ``gnt-cluster
+ modify --master-netdev``
+- Accept offline secondaries while shutting down instance disks
+- Added ``blockdev_prefix`` parameter to Xen PVM and HVM hypervisors
+- Added support for multiple LVM volume groups
+- Avoid sorting nodes for ``gnt-node list`` if specific nodes are
+ requested
+- Added commands to list available fields:
+
+ - ``gnt-node list-fields``
+ - ``gnt-group list-fields``
+ - ``gnt-instance list-fields``
+
+- Updated documentation and man pages
+
+Integration
+~~~~~~~~~~~
+
+- Moved ``rapi_users`` file into separate directory, now named
+ ``.../ganeti/rapi/users``, ``cfgupgrade`` moves the file and creates a
+ symlink
+- Added new tool for running commands on many machines,
+ ``tools/ganeti-listrunner``
+- Implemented more verbose result in ``OpInstanceConsole`` opcode, also
+ improving the ``gnt-instance console`` output
+- Allowed customisation of disk index separator at ``configure`` time
+- Export node group allocation policy to :doc:`iallocator <iallocator>`
+- Added support for non-partitioned md disks in ``lvmstrap``
+- Added script to gracefully power off KVM instances
+- Split ``utils`` module into smaller parts
+- Changed query operations to return more detailed information, e.g.
+ whether an information is unavailable due to an offline node. To use
+ this new functionality, the LUXI call ``Query`` must be used. Field
+ information is now stored by the master daemon and can be retrieved
+ using ``QueryFields``. Instances, nodes and groups can also be queried
+ using the new opcodes ``OpQuery`` and ``OpQueryFields`` (not yet
+ exposed via RAPI). The following commands make use of this
+ infrastructure change:
+
+ - ``gnt-group list``
+ - ``gnt-group list-fields``
+ - ``gnt-node list``
+ - ``gnt-node list-fields``
+ - ``gnt-instance list``
+ - ``gnt-instance list-fields``
+ - ``gnt-debug locks``
+
+Remote API
+~~~~~~~~~~
+
+- New RAPI resources (see :doc:`rapi`):
+
+ - ``/2/modify``
+ - ``/2/groups``
+ - ``/2/groups/[group_name]``
+ - ``/2/groups/[group_name]/assign-nodes``
+ - ``/2/groups/[group_name]/modify``
+ - ``/2/groups/[group_name]/rename``
+ - ``/2/instances/[instance_name]/disk/[disk_index]/grow``
+
+- RAPI changes:
+
+ - Implemented ``no_install`` for instance creation
+ - Implemented OS parameters for instance reinstallation, allowing
+ use of special settings on reinstallation (e.g. for preserving data)
+
+Misc
+~~~~
+
+- Added IPv6 support in import/export
+- Pause DRBD synchronization while wiping disks on instance creation
+- Updated unittests and QA scripts
+- Improved network parameters passed to KVM
+- Converted man pages from docbook to reStructuredText
+
+
+Version 2.3.1
+-------------
+
+*(Released Mon, 20 Dec 2010)*
+
+Released version 2.3.1~rc1 without any changes.
+
+
+Version 2.3.1 rc1
+-----------------
+
+*(Released Wed, 1 Dec 2010)*
+
+- impexpd: Disable OpenSSL compression in socat if possible (backport
+ from master, commit e90739d625b, see :doc:`installation guide
+ <install-quick>` for details)
+- Changed unittest coverage report to exclude test scripts
+- Added script to check version format
+
+
+Version 2.3.0
+-------------
+
+*(Released Wed, 1 Dec 2010)*
+
+Released version 2.3.0~rc1 without any changes.
+
+
Version 2.3.0 rc1
-----------------
- Ignore failures while shutting down instances during failover from
offline node
- Exit daemon's bootstrap process only once daemon is ready
-- Export more information via ``LUQueryInstances``/remote API
+- Export more information via ``LUInstanceQuery``/remote API
- Improved documentation, QA and unittests
- RAPI daemon now watches ``rapi_users`` all the time and doesn't need a
restart if the file was created or changed
*(Released Thu, 7 Oct 2010)*
-- Fixed issue 125, replace hardcoded “xenvg” in ``gnt-cluster`` with
+- Fixed issue 125, replace hardcoded "xenvg" in ``gnt-cluster`` with
value retrieved from master
- Added support for blacklisted or hidden OS definitions
- Added simple lock monitor (accessible via (``gnt-debug locks``)
- Fix case of MAC special-values
- Fix mac checker regex
-- backend: Fix typo causing “out of range” error
+- backend: Fix typo causing "out of range" error
- Add missing --units in gnt-instance list man page
directory (e.g. read-only file-system where we can't open the files
read-write, etc.)
- Fixed the behaviour of gnt-node modify for master candidate demotion;
- now it either aborts cleanly or, if given the new “auto_promote”
+ now it either aborts cleanly or, if given the new "auto_promote"
parameter, will automatically promote other nodes as needed
- Fixed compatibility with (unreleased yet) Python 2.6.5 that would
completely prevent Ganeti from working
New features
~~~~~~~~~~~~
-- Added an “early_release” more for instance replace disks and node
+- Added an "early_release" more for instance replace disks and node
evacuate, where we release locks earlier and thus allow higher
parallelism within the cluster
- Added watcher hooks, intended to allow the watcher to restart other