Merge branch 'stable-2.8' into master
Merge branch 'stable-2.7' into stable-2.8
Conflicts: doc/iallocator.rst...
Document users-setup tool
The users-setup tool was added but had no documentation up to now. This commitfixes this issue.
Signed-off-by: Michele Tartara <mtartara@google.com>Reviewed-by: Bernardo Dal Seno <bdalseno@google.com>
Update IAllocator interface documentation
Update the missing documentation for the tags fields of node groups.
Signed-off-by: Thomas Thrainer <thomasth@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>(partially cherry picked from commit 2daca99b5be21ea4667637721ee2c65a14444520)...
Document the newly added network field of node groups, and also updatethe missing documentation for the other fields of node groups.
Signed-off-by: Thomas Thrainer <thomasth@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>
Merge branch 'stable-2.8'
Create overall design document for 2.8
Also, cleanup the list of draft designs.
Signed-off-by: Michele Tartara <mtartara@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>
Design doc for internal shutdown detection
Ganeti is currently not able to detect a legit shutdown request performed by auser from inside a Xen domain.
This patch provides a design document to implement a mechanism able to cope withsuch events.
Signed-off-by: Michele Tartara <mtartara@google.com>...
Remove obsolete Debian-related documentation
This part of the documentation refers to Grub instead of Grub2, butGrub2 has been the standard boot loader since Squeeze. As this part only(wrongly) repeats the preceeding documentation, it's removed completely....
Improve installation documentation
Based on user feedback the installation documentation is clarified andextended.
Signed-off-by: Thomas Thrainer <thomasth@google.com>Reviewed-by: Michele Tartara <mtartara@google.com>(cherry picked from commit 3913eaa72b8a48706ca4caa59dd022fa1a05805a)...
Signed-off-by: Thomas Thrainer <thomasth@google.com>Reviewed-by: Michele Tartara <mtartara@google.com>
Monitoring design doc: better specify field names
The name of the list of instances was not specified.
Also, fix a line that was longer than 80 characters.
Signed-off-by: Michele Tartara <mtartara@google.com>Reviewed-by: Klaus Aehlig <aehlig@google.com>
Fix a misspelled word in design-storagetypes
Signed-off-by: Weiwei Jia <harryxiyou@gmail.com>Reviewed-by: Guido Trotter <ultrotter@google.com>
Correction of design doc regarding RPC extension
This corrects the storage types design doc regarding the specificationof the RPC call.
Signed-off-by: Helga Velroyen <helgav@google.com>Reviewed-by: Bernardo dal Seno <bdalseno@google.com>
Change design of algorithm for computing rolling reboots
Instead of computing a coloring for one condition first and then refiningit for the other condition, we can construct a graph with edges for allconditions that prevent simultaneous reboots. This will not only result...
Merge remote-tracking branch 'origin/stable-2.8'
Conflicts: lib/bdev.py lib/cmdlib.py
Fix white spaces in partitioned design doc
Bullet lists start after a blank line.
Signed-off-by: Bernardo Dal Seno <bdalseno@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>
Reuse current spindles in design for partitioned
Renaming the current parameters dealing with spindles is nice, as theirmeaning would be clearer, but that would mean changing a lot of code,change external interfaces, and renaming internal variables for little...
Merge stable-2.7 into stable-2.8
Conflicts: INSTALL NEWS configure.ac src/Ganeti/Query/Group.hs test/hs/Test/Ganeti/Objects.hs test/hs/Test/Ganeti/Query/Query.hs
Signed-off-by: Michele Tartara <mtartara@google.com>Reviewed-by: Helga Velroyen <helgav@google.com>
admin guide updates for 2.7
- Mention the file-storage-paths config file- Add information about sharedfile and ext storage types- Change one manpage reference to a proper link
Signed-off-by: Guido Trotter <ultrotter@google.com>Reviewed-by: Michele Tartara <mtartara@google.com>
INSTALL updates for wheezy, and fixes
- Remove mention of python 2.4 specific modules, as that version is not supported anymore- Add bitarray and ipaddr- Remove a double space- Add mandatory C library packages too- Mention the option of using drbd modules directly from your kernel...
Update "reason" field in instance status design
Now the reason field is implemented according to the reason trail designdocument.
Improve monitoring agent design document
Specify more precisely the format of the category names.
Add dependency on python-mock
Python Mock (http://www.voidspace.org.uk/python/mock/) is a mockinglibrary for Python. It is included in the standard Python distributionas of Python 3.3, but has been around for quite a while. Debian unstablecontains a version we require....
Add multiple min/max specs in instance policy
Now instance policies can contain more than one min/max specs. This is themain element of the "Constrained instance sizes" section in the"Partitioned Ganeti" design doc.
This is a big patch, but changing the type of a configuration item requires...
Conflicts: NEWS doc/rapi.rst
Signed-off-by: Klaus Aehlig <aehlig@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>
Minor changes / bugfixes in documentation
Signed-off-by: Sebastian Gebhard <sege@fs.ei.tum.de>Signed-off-by: Klaus Aehlig <aehlig@google.com>Reviewed-by: Klaus Aehlig <aehlig@google.com>
More specifics on the implementation of the reason trail
Adding the reason trail as a parameter instead of as a new class attribute fitsbetter with the current structure of the system.
Also, the description of what part of the implementation will be OpCode...
Use correct name for design-storagespace.rst
This was renamed in b284f50 but the old name was still in use in themakefile and draft designs list.
Signed-off-by: Guido Trotter <ultrotter@google.com>Reviewed-by: Klaus Aehlig <aehlig@google.com>
Rename design doc from space reporting to storage types
Since the design doc for storage space reporting ended up being mostlyabout disk templates and storage types, and the space reporting beingjust a small part of it, I am renaming the design doc.
Signed-off-by: Helga Velroyen <helgav@google.com>...
Storage type design doc: ipolicy vs. enabled disk templates
Adding the design decision regarding the consistency of the enabled disktemplates in the ipolicy and in the cluster config.
Signed-off-by: Helga Velroyen <helgav@google.com>Reviewed-by: Klaus Aehlig <aehlig@google.com>
Add design doc for device UUIDs and names
This commit adds the design document for adding UUID and name slots to NIC andDisk objects and the ability to refer to them by these slots.
Signed-off-by: Christos Stavrakakis <cstavr@grnet.gr>Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>...
Improve RAPI documentation for command line usage
Provide some more insights about how to use the RAPI from the command linethrough the "curl" command.
More info on using the RAPI
Add some additional information about how to use/test the RAPI,including how to specify authentication credentials.
Cherry picked from 681f4f7bb95a2b467f917c84a68ccf9aa7665763 on master.
Extension of storage reporting design doc
This patch rewrites and extends the design doc about storage reportingwith respect to disk templates and storage types. In constrast to theprevious version, we now consider disk templates as the user-facingentity, that the user can dis/enable for the cluster. Storage types...
Document procedure to downgrade a cluster
This is based on the --donwgrade option of cfgupgrade, first introduced in1709435e.
Fix error in the developer notes
The version numbers of two programs had been swapped.
Add dependency on PyYAML in devnotes
This is required because of 0e79564a; otherwise, the pylint-qa target willfail.
Update installation documentation
Some required dependencies were missing from the installation instructions.
Add DCStatus data type for the data collectors
Also adds the DCStatusCode, part of DCStatus, and the addStatusutility function for adding the "status" field to an already existingJSValue.
The design document is updated to have the status codes sorted by increasing...
Export the dcVersionInformation for the Drbd collector
Also, update the JSON output (and the design document) so that it is notin camelcase anymore. This is part of a bigger effort to remove camelcasefrom the exposed JSON.
Change format of the empty status message
Having 'null' instead of an empty string for an empty status messageincreases the complexity of the code with no real improvement.
This patch modifies the monitoring agent design document solving this issue.
Refactor ispecs in ipolicy structures
Minimum and maximum instance specs are put together into a single elementof the instance policy. This is in preparation for introducing multiplemin/max specs.
Signed-off-by: Bernardo Dal Seno <bdalseno@google.com>...
Amend partitioned design doc for multiple ispecs
There will be only one standard specification in instance policies.
Fixing some mistakes in design doc for space reporting
- Use entities as examples for storage types that are actually storagetypes.- Fix mixing up 'external_storage' and 'exclusive_storage'.
Signed-off-by: Helga Velroyen <helgav@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>
Use 'storage type' consistently in design doc
To minimize the confusion between whether or not a storage typeis the same as a storage method, I updated the design doc touse 'storage type' instead of 'storage method' consistently.
Add constants for storage types to constants.py
This patch adds the currently known and used storage methods to theconstants.py file. Note that storage types are different from disktemplates. For example both disk templates, drbd and plain, use lvmstorage types....
Add design document for the "reason trail"
This commit adds the design document for introducing "reason trails",tracing the reason why opcodes are executed, step by step.
Update design doc about free space reporting
This patch updates the design doc "Design correct reporting of storagefree space". The modifications were chosen to not conflict with anyfuture changes of Ganeti regarding storage pools.
Fix typo in the monitoring agent design doc
Merge branch 'devel-2.7'
Conflicts: Makefile.am (curl changes and new hs directories)...
Update required pylint version
This should help a lot of users, since pylint 0.21.1 was quite an oldversion…
The tree is "clean" w.r.t. the new pylint version.
Signed-off-by: Iustin Pop <iustin@google.com>Reviewed-by: Michele Tartara <mtartara@google.com>
Fix sphinx label namespace
Thanks Michael for pointing out the error!
Signed-off-by: Iustin Pop <iustin@google.com>Reviewed-by: Michael Hanselmann <hansmi@google.com>
Clarify use of move-instance with self-signed certificates
The document doesn't mention which certificates need to be passed asca-file, so let's try to clarify that.
rapi.rst: Replace manual method lists with directive
Many resources, but not all, list their supported methods. With a newreST directive, this list is now automatically generated and also liststhe required permissions.
Signed-off-by: Michael Hanselmann <hansmi@google.com>...
Improve RAPI documentation on users and options
- Document fields in “rapi/users” file in the order they appear (username, password, options)- Mention new “--require-authentication” option- Clarify use of “write” on “GET” method
Describe format of the monitoring agent HTTP queries
The previous patch was incomplete when erroneously pushed.
This patch, originally intended as part of the previous one, fixes it.
Signed-off-by: Michele Tartara <mtartara@google.com>Reviewed-by: Iustin Pop <iustin@google.com>
Update the monitoring agent design document adding the format of the HTTPqueries that will have to be used to query the monitoring agent.
Build table with access permissions for RAPI resources
Sometimes it can be difficult to determine the access permissions neededfor a certain RAPI resource without looking at code. This table, addedat the end of “rapi.rst”, shows all resources and the permissions needed...
HRoller design updates
- Specify that there will be options for selecting nodes by at least nodegroups and tags, rather than just individually.- Specify a better handling for non-redundant instances (eg. plain or file) which today are simply ignored...
RAPI documentation: Add link targets
A newly added table of RAPI access permissions will link to allresources and their supported methods. For this reason link targets needto be added.
The GET method on “/2/nodes/[node_name]” was not separately mentioned....
RAPI documentation: Assertion for console fields
Assert that the documented fields are equal to those in the actualobject.
Signed-off-by: Michael Hanselmann <hansmi@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>
Update monitoring agent report format
This commit expands the monitoring agent design document improving thedescription of the general report file format.
There can be two kinds of data collectors (performance and status collectors).
Every collector can now be part of a category of collectors (such as...
Document possible hypervisor bug in serial_console
This is described in Issue 83.
Update both the install guide and the gnt-instance manpage.In the install guide move another KVM specific example inside a new KVMadmonition for the hypervisor parameters section....
Update man pages wrt ExtStorage
Also link to its design doc in the design-2.7 doc
Signed-off-by: Constantinos Venetsanopoulos <cven@grnet.gr>...
Design correct reporting of storage free space
This is a long standing bug in Ganeti. Add a small design on how we planto fix this for Ganeti 2.7.
Signed-off-by: Guido Trotter <ultrotter@google.com>Reviewed-by: Iustin Pop <iustin@google.com>Reviewed-by: Helga Velroyen <helgav@google.com>
Add hroller design to Makefile and design-drafts
Signed-off-by: Guido Trotter <ultrotter@google.com>Reviewed-by: Iustin Pop <iustin@google.com>
Hroller design doc
Hroller in 2.7 was implemented (as an experiment) but never explicitlydesigned. This design mentions the current functionality, and explainsthe changes that will happen for the next release to support livemaintenance scheduling (rolling reboot)....
Finish the remote→restricted commands rename
The documentation still points to /etc/ganeti/remote-commands,although the code is already using restricted-command. Update thedocumentation and a few docstrings accordingly.
Signed-off-by: Iustin Pop <iustin@google.com>...
Remove network_type slot (Issue 363)
This slot was not used by Ganeti so the same info can beprovided via tags. In order not to break configuration datawe add a FromDict() method in Network config object thatremoves the deprecated network_type (if found) and then invoke...
Remove family and size from network objects
This info is not used by Ganeti and therefore is removed.
Signed-off-by: Dimitris Aragiorgis <dimara@grnet.gr>Reviewed-by: Guido Trotter <ultrotter@google.com>
Update the security document for Ganeti 2.7
This should address 359, but I'm not sure if it covers all of 2.7…
OS environment: add network information
1) Move the hooks environment dict generator inside the object. Thisalso adds missing values such as network family and uuid.2) Use the same generator both for the os environment and for theinstance hooks.3) Update manpage and hooks documentation....
Version bump for 2.7.0~beta1
Also update the documentation target versions and the cfgupgrade tool torecognize 2.6 and upgrade to 2.7
Signed-off-by: Guido Trotter <ultrotter@google.com>Reviewed-by: Michael Hanselmann <hansmi@google.com>
Update hooks.rst for Ganeti 2.7
- The migrate instance hook now also executes on the primary node in the "pre" phase.- Instance hooks now get full network information on each nic, if a nic's network is set.
Signed-off-by: Guido Trotter <ultrotter@google.com>...
Update 2.7 design doc
Move two designs that have been implemented in 2.7 to design-2.7 and outof drafts.
Other designs were partly implemented: explain what part was, and leavethem as drafts pending their completion.
Option to include man pages in documentation
Before this patch, HTML versions of man pages (man/*.rst) were alreadybuilt. However, since they are separate from the normal documentation,their content is not indexed for Sphinx' search functionality.Additionally it would simply be nice to have everything in one place....
design-autorepair.rst: separate list of jobs with plus sign
Commas are not valid characters in tags, hence they can't be use toseparate the different job IDs; plus signs (+) are available, and not toobad.
Signed-off-by: Dato Simó <dato@google.com>Reviewed-by: Iustin Pop <iustin@google.com>
design-autorepair.rst: clarify tag precedence and conflict
This commit clarifies one particular point of the auto-repair workflow:what to do when multiple, conflicting administrator-set tags exist in anobject; and how tags at different levels (cluster, node group and instance)...
design-autorepair.rst: add a graph with state transitions
The graph added here follows the data types introduced in 7ec2f76, by which"Suspended" is not a state, but a possible value of the auto-repair policy.
design-autorepair.rst: use the same prefix everywhere
This commit changes the "ganeti:watcher:repair:pending" and"ganeti:watcher:repair:result" tag prefixes to use"ganeti:watcher:autorepair:{pending,result}", so that the same prefix isused in all cases....
Update copyright in documentation
Use range() instead of building the list manually. Keeps the codeshorter starting next year.
Signed-off-by: Michael Hanselmann <hansmi@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>Reviewed-and-lolled-by: Iustin Pop <iustin@google.com>
More documentation and man page fixes
- Include numbers in man page references- Use “:manpage:” where appropriate- Don't escape underscore in verbatim text (e.g. “``always_failover``) as it would show up in the generated man page- Quote whole paths, not just build-time part...
Highlight external links in HTML documentation
Based on MediaWiki's monobook skin.
Signed-off-by: Michael Hanselmann <hansmi@google.com>Reviewed-by: Iustin Pop <iustin@google.com>
Update the monitoring agent design document
This commit updates the design document of the monitoring agent accordingto what has already been discussed in various meetings and email threads.
Update name of test/htest in doc/devnotes.rst
Update the docs after the rename of 'test/hs/test' to'test/hs/htest'. This must have been forgotten in 3e16567e.
Signed-off-by: Yiannis Tsiouris <gtsiour@softlab.ntua.gr>Signed-off-by: Iustin Pop <iustin@google.com>...
Improve a bit Haskell library recommended versions
The hinotify library was missing any versions, and finding one thatworks with ghc 6.12 (base 4.2.x) was not obvious. Thetest-framework-quickcheck2 recommended version didn't actually workwith the test-framework version, so fix that as well....
Stop manually building images out of dot files
The first dot files we added way back in the 2.0 release are managedmanually: we build the .pngs ourselves, track them in .gitingore,etc. Since then, we have switched to allow sphinx to build/manage themitself, so it makes sense to cleanup the build system and covert...
Inline the standalone dot files
This removes entirely the standalone dot files by inlining them in theRST documents - as they weren't referenced from more than one documenteither way.
Signed-off-by: Iustin Pop <iustin@google.com>Reviewed-by: Guido Trotter <ultrotter@google.com>
Document the ExtStorage `SetInfo' functionality
Small updates to the extstorage design document and interface.
Signed-off-by: Constantinos Venetsanopoulos <cven@grnet.gr>Signed-off-by: Iustin Pop <iustin@google.com>Reviewed-by: Iustin Pop <iustin@google.com>
Move htest/ files under the test/ tree
htest/data becomes test/data/htools (basically reverting commit8feabc89), and htest/* becomes test/hs/*.
Most changes beside the rename are trivial s/…/…, with the exceptionof autotools/run-in-tempdir, which needed some more changes now that...
Move python test files to test/py
This is the first step of the test files reorganisation: moving test/*(except test/data) to new directory test/py/.
Rename htools/ to src/
Per offline discussions, this is the first patch of therenames. Tested with "make distcheck", seems to work fine.
The only change outside of the renaming is a bit of simplification inthe .gitignore rules; otherwise, simply s/htools/src/....