root / doc / install.sgml @ 973d7867
History | View | Annotate | Download (32.2 kB)
1 | f1a808df | Guido Trotter | <!DOCTYPE article PUBLIC "-//OASIS//DTD DocBook V4.2//EN" [ |
---|---|---|---|
2 | f1a808df | Guido Trotter | ]> |
3 | f1a808df | Guido Trotter | <article class="specification"> |
4 | f1a808df | Guido Trotter | <articleinfo> |
5 | b212bf8b | Iustin Pop | <title>Ganeti installation tutorial</title> |
6 | f1a808df | Guido Trotter | </articleinfo> |
7 | f1a808df | Guido Trotter | <para>Documents Ganeti version 1.2</para> |
8 | f1a808df | Guido Trotter | |
9 | f1a808df | Guido Trotter | <sect1> |
10 | f1a808df | Guido Trotter | <title>Introduction</title> |
11 | f1a808df | Guido Trotter | |
12 | 5d6dd340 | Iustin Pop | <para> |
13 | 32ad0582 | Iustin Pop | Ganeti is a cluster virtualization management system based on |
14 | 32ad0582 | Iustin Pop | Xen. This document explains how to bootstrap a Ganeti node (Xen |
15 | 32ad0582 | Iustin Pop | <literal>dom0</literal>), create a running cluster and install |
16 | 32ad0582 | Iustin Pop | virtual instance (Xen <literal>domU</literal>). You need to |
17 | 32ad0582 | Iustin Pop | repeat most of the steps in this document for every node you |
18 | 32ad0582 | Iustin Pop | want to install, but of course we recommend creating some |
19 | 32ad0582 | Iustin Pop | semi-automatic procedure if you plan to deploy Ganeti on a |
20 | 32ad0582 | Iustin Pop | medium/large scale. |
21 | 32ad0582 | Iustin Pop | </para> |
22 | 32ad0582 | Iustin Pop | |
23 | 32ad0582 | Iustin Pop | <para> |
24 | 32ad0582 | Iustin Pop | A basic Ganeti terminology glossary is provided in the |
25 | 32ad0582 | Iustin Pop | introductory section of the <emphasis>Ganeti administrator's |
26 | 32ad0582 | Iustin Pop | guide</emphasis>. Please refer to that document if you are |
27 | 32ad0582 | Iustin Pop | uncertain about the terms we are using. |
28 | 32ad0582 | Iustin Pop | </para> |
29 | 32ad0582 | Iustin Pop | |
30 | 32ad0582 | Iustin Pop | <para> |
31 | 32ad0582 | Iustin Pop | Ganeti has been developed for Linux and is |
32 | 32ad0582 | Iustin Pop | distribution-agnostic. This documentation will use Debian Etch |
33 | 32ad0582 | Iustin Pop | as an example system but the examples can easily be translated |
34 | 32ad0582 | Iustin Pop | to any other distribution. You are expected to be familiar with |
35 | 32ad0582 | Iustin Pop | your distribution, its package management system, and Xen before |
36 | 32ad0582 | Iustin Pop | trying to use Ganeti. |
37 | f1a808df | Guido Trotter | </para> |
38 | f1a808df | Guido Trotter | |
39 | f1a808df | Guido Trotter | <para>This document is divided into two main sections: |
40 | f1a808df | Guido Trotter | |
41 | f1a808df | Guido Trotter | <itemizedlist> |
42 | f1a808df | Guido Trotter | <listitem> |
43 | 32ad0582 | Iustin Pop | <simpara>Installation of the base system and base |
44 | e3c826ec | Michael Hanselmann | components</simpara> |
45 | f1a808df | Guido Trotter | </listitem> |
46 | f1a808df | Guido Trotter | <listitem> |
47 | 5d6dd340 | Iustin Pop | <simpara>Configuration of the environment for |
48 | e3c826ec | Michael Hanselmann | Ganeti</simpara> |
49 | f1a808df | Guido Trotter | </listitem> |
50 | f1a808df | Guido Trotter | </itemizedlist> |
51 | f1a808df | Guido Trotter | |
52 | e3c826ec | Michael Hanselmann | Each of these is divided into sub-sections. While a full Ganeti system |
53 | e3c826ec | Michael Hanselmann | will need all of the steps specified, some are not strictly required for |
54 | e3c826ec | Michael Hanselmann | every environment. Which ones they are, and why, is specified in the |
55 | e3c826ec | Michael Hanselmann | corresponding sections. |
56 | f1a808df | Guido Trotter | </para> |
57 | f1a808df | Guido Trotter | |
58 | f1a808df | Guido Trotter | </sect1> |
59 | f1a808df | Guido Trotter | |
60 | f1a808df | Guido Trotter | <sect1> |
61 | 32ad0582 | Iustin Pop | <title>Installing the base system and base components</title> |
62 | 32ad0582 | Iustin Pop | |
63 | 32ad0582 | Iustin Pop | <sect2> |
64 | 32ad0582 | Iustin Pop | <title>Hardware requirements</title> |
65 | 32ad0582 | Iustin Pop | |
66 | 32ad0582 | Iustin Pop | <para> |
67 | e3c826ec | Michael Hanselmann | Any system supported by your Linux distribution is fine. 64-bit |
68 | e3c826ec | Michael Hanselmann | systems are better as they can support more memory. |
69 | 32ad0582 | Iustin Pop | </para> |
70 | 32ad0582 | Iustin Pop | |
71 | 32ad0582 | Iustin Pop | <para> |
72 | e3c826ec | Michael Hanselmann | Any disk drive recognized by Linux |
73 | e3c826ec | Michael Hanselmann | (<literal>IDE</literal>/<literal>SCSI</literal>/<literal>SATA</literal>/etc.) |
74 | e3c826ec | Michael Hanselmann | is supported in Ganeti. Note that no shared storage (e.g. |
75 | e3c826ec | Michael Hanselmann | <literal>SAN</literal>) is needed to get high-availability features. It |
76 | e3c826ec | Michael Hanselmann | is highly recommended to use more than one disk drive to improve speed. |
77 | e3c826ec | Michael Hanselmann | But Ganeti also works with one disk per machine. |
78 | 32ad0582 | Iustin Pop | </para> |
79 | f1a808df | Guido Trotter | |
80 | f1a808df | Guido Trotter | <sect2> |
81 | f1a808df | Guido Trotter | <title>Installing the base system</title> |
82 | f1a808df | Guido Trotter | |
83 | 0bac47cf | Iustin Pop | <para> |
84 | 0bac47cf | Iustin Pop | <emphasis role="strong">Mandatory</emphasis> on all nodes. |
85 | 0bac47cf | Iustin Pop | </para> |
86 | 0bac47cf | Iustin Pop | |
87 | 0bac47cf | Iustin Pop | <para> |
88 | 0bac47cf | Iustin Pop | It is advised to start with a clean, minimal install of the |
89 | 0bac47cf | Iustin Pop | operating system. The only requirement you need to be aware of |
90 | 0bac47cf | Iustin Pop | at this stage is to partition leaving enough space for a big |
91 | 16450d30 | Iustin Pop | (<emphasis role="strong">minimum |
92 | 16450d30 | Iustin Pop | <constant>20GiB</constant></emphasis>) LVM volume group which |
93 | 16450d30 | Iustin Pop | will then host your instance filesystems. The volume group |
94 | 16450d30 | Iustin Pop | name Ganeti 1.2 uses (by default) is |
95 | 32ad0582 | Iustin Pop | <emphasis>xenvg</emphasis>. |
96 | 0bac47cf | Iustin Pop | </para> |
97 | f1a808df | Guido Trotter | |
98 | 5d6dd340 | Iustin Pop | <para> |
99 | 16450d30 | Iustin Pop | While you can use an existing system, please note that the |
100 | 0bac47cf | Iustin Pop | Ganeti installation is intrusive in terms of changes to the |
101 | 0bac47cf | Iustin Pop | system configuration, and it's best to use a newly-installed |
102 | 0bac47cf | Iustin Pop | system without important data on it. |
103 | 0bac47cf | Iustin Pop | </para> |
104 | 0bac47cf | Iustin Pop | |
105 | 0bac47cf | Iustin Pop | <para> |
106 | 0bac47cf | Iustin Pop | Also, for best results, it's advised that the nodes have as |
107 | 0bac47cf | Iustin Pop | much as possible the same hardware and software |
108 | 0bac47cf | Iustin Pop | configuration. This will make administration much easier. |
109 | f1a808df | Guido Trotter | </para> |
110 | f1a808df | Guido Trotter | |
111 | 5a96795f | Iustin Pop | <sect3> |
112 | 5a96795f | Iustin Pop | <title>Hostname issues</title> |
113 | 5a96795f | Iustin Pop | <para> |
114 | 5a96795f | Iustin Pop | Note that Ganeti requires the hostnames of the systems |
115 | 5a96795f | Iustin Pop | (i.e. what the <computeroutput>hostname</computeroutput> |
116 | 5a96795f | Iustin Pop | command outputs to be a fully-qualified name, not a short |
117 | 5a96795f | Iustin Pop | name. In other words, you should use |
118 | 5a96795f | Iustin Pop | <literal>node1.example.com</literal> as a hostname and not |
119 | 5a96795f | Iustin Pop | just <literal>node1</literal>. |
120 | 5a96795f | Iustin Pop | </para> |
121 | 5a96795f | Iustin Pop | |
122 | 5a96795f | Iustin Pop | <formalpara> |
123 | 5a96795f | Iustin Pop | <title>Debian</title> |
124 | 5a96795f | Iustin Pop | <para> |
125 | 5a96795f | Iustin Pop | Note that Debian Etch configures the hostname differently |
126 | 5a96795f | Iustin Pop | than you need it for Ganeti. For example, this is what |
127 | 5a96795f | Iustin Pop | Etch puts in <filename>/etc/hosts</filename> in certain |
128 | 5a96795f | Iustin Pop | situations: |
129 | 5a96795f | Iustin Pop | <screen> |
130 | 5a96795f | Iustin Pop | 127.0.0.1 localhost |
131 | 5a96795f | Iustin Pop | 127.0.1.1 node1.example.com node1 |
132 | 5a96795f | Iustin Pop | </screen> |
133 | 5a96795f | Iustin Pop | |
134 | 5a96795f | Iustin Pop | but for Ganeti you need to have: |
135 | 5a96795f | Iustin Pop | <screen> |
136 | 5a96795f | Iustin Pop | 127.0.0.1 localhost |
137 | 5a96795f | Iustin Pop | 192.168.1.1 node1.example.com node1 |
138 | 5a96795f | Iustin Pop | </screen> |
139 | 5a96795f | Iustin Pop | replacing <literal>192.168.1.1</literal> with your node's |
140 | 5a96795f | Iustin Pop | address. Also, the file <filename>/etc/hostname</filename> |
141 | 5a96795f | Iustin Pop | which configures the hostname of the system should contain |
142 | 5a96795f | Iustin Pop | <literal>node1.example.com</literal> and not just |
143 | 5a96795f | Iustin Pop | <literal>node1</literal> (you need to run the command |
144 | 5a96795f | Iustin Pop | <computeroutput>/etc/init.d/hostname.sh |
145 | 5a96795f | Iustin Pop | start</computeroutput> after changing the file). |
146 | 5a96795f | Iustin Pop | </para> |
147 | 5a96795f | Iustin Pop | </formalpara> |
148 | 5a96795f | Iustin Pop | </sect3> |
149 | 5a96795f | Iustin Pop | |
150 | f1a808df | Guido Trotter | </sect2> |
151 | f1a808df | Guido Trotter | |
152 | f1a808df | Guido Trotter | <sect2> |
153 | f1a808df | Guido Trotter | <title>Installing Xen</title> |
154 | f1a808df | Guido Trotter | |
155 | 5d6dd340 | Iustin Pop | <para> |
156 | 0bac47cf | Iustin Pop | <emphasis role="strong">Mandatory</emphasis> on all nodes. |
157 | 32ad0582 | Iustin Pop | </para> |
158 | 32ad0582 | Iustin Pop | |
159 | 32ad0582 | Iustin Pop | <para> |
160 | 0bac47cf | Iustin Pop | While Ganeti is developed with the ability to modularly run on |
161 | 0bac47cf | Iustin Pop | different virtualization environments in mind the only one |
162 | 0bac47cf | Iustin Pop | currently useable on a live system is <ulink |
163 | 0bac47cf | Iustin Pop | url="http://xen.xensource.com/">Xen</ulink>. Supported |
164 | 0bac47cf | Iustin Pop | versions are: <simplelist type="inline"> |
165 | 0bac47cf | Iustin Pop | <member><literal>3.0.3</literal></member> |
166 | 0bac47cf | Iustin Pop | <member><literal>3.0.4</literal></member> |
167 | 0bac47cf | Iustin Pop | <member><literal>3.1</literal></member> </simplelist>. |
168 | f1a808df | Guido Trotter | </para> |
169 | f1a808df | Guido Trotter | |
170 | 5d6dd340 | Iustin Pop | <para> |
171 | 5d6dd340 | Iustin Pop | Please follow your distribution's recommended way to install |
172 | 5d6dd340 | Iustin Pop | and set up Xen, or install Xen from the upstream source, if |
173 | 5d6dd340 | Iustin Pop | you wish, following their manual. |
174 | f1a808df | Guido Trotter | </para> |
175 | f1a808df | Guido Trotter | |
176 | 5d6dd340 | Iustin Pop | <para> |
177 | 051f92ec | Michael Hanselmann | After installing Xen you need to reboot into your Xen-ified |
178 | 0bac47cf | Iustin Pop | dom0 system. On some distributions this might involve |
179 | 0bac47cf | Iustin Pop | configuring GRUB appropriately, whereas others will configure |
180 | 0bac47cf | Iustin Pop | it automatically when you install Xen from a package. |
181 | f1a808df | Guido Trotter | </para> |
182 | f1a808df | Guido Trotter | |
183 | 32ad0582 | Iustin Pop | <formalpara><title>Debian</title> |
184 | 32ad0582 | Iustin Pop | <para> |
185 | 32ad0582 | Iustin Pop | Under Debian Etch or Sarge+backports you can install the |
186 | 16450d30 | Iustin Pop | relevant <literal>xen-linux-system</literal> package, which |
187 | 727830bf | Iustin Pop | will pull in both the hypervisor and the relevant |
188 | 727830bf | Iustin Pop | kernel. Also, if you are installing a 32-bit Etch, you should |
189 | 958c8f40 | Guido Trotter | install the <computeroutput>libc6-xen</computeroutput> package |
190 | 727830bf | Iustin Pop | (run <computeroutput>apt-get install |
191 | 727830bf | Iustin Pop | libc6-xen</computeroutput>). |
192 | 32ad0582 | Iustin Pop | </para> |
193 | 32ad0582 | Iustin Pop | </formalpara> |
194 | 32ad0582 | Iustin Pop | |
195 | 16450d30 | Iustin Pop | <sect3> |
196 | 0a2a0d91 | Iustin Pop | <title>Xen settings</title> |
197 | 0a2a0d91 | Iustin Pop | |
198 | 0a2a0d91 | Iustin Pop | <para> |
199 | 0a2a0d91 | Iustin Pop | It's recommended that dom0 is restricted to a low amount of |
200 | 0a2a0d91 | Iustin Pop | memory (<constant>512MiB</constant> is reasonable) and that |
201 | 0a2a0d91 | Iustin Pop | memory ballooning is disabled in the file |
202 | 0a2a0d91 | Iustin Pop | <filename>/etc/xen/xend-config.sxp</filename> by setting the |
203 | 0a2a0d91 | Iustin Pop | value <literal>dom0-min-mem</literal> to |
204 | 0a2a0d91 | Iustin Pop | <constant>0</constant>, like this: |
205 | 0a2a0d91 | Iustin Pop | <computeroutput>(dom0-min-mem 0)</computeroutput> |
206 | 0a2a0d91 | Iustin Pop | </para> |
207 | 0a2a0d91 | Iustin Pop | |
208 | 0a2a0d91 | Iustin Pop | <para> |
209 | 0a2a0d91 | Iustin Pop | For optimum performance when running both CPU and I/O |
210 | 0a2a0d91 | Iustin Pop | intensive instances, it's also recommended that the dom0 is |
211 | 0a2a0d91 | Iustin Pop | restricted to one CPU only, for example by booting with the |
212 | 0a2a0d91 | Iustin Pop | kernel parameter <literal>nosmp</literal>. |
213 | 0a2a0d91 | Iustin Pop | </para> |
214 | 0a2a0d91 | Iustin Pop | |
215 | dfea906f | Michael Hanselmann | <para> |
216 | dfea906f | Michael Hanselmann | It is recommended that you disable xen's automatic save of virtual |
217 | dfea906f | Michael Hanselmann | machines at system shutdown and subsequent restore of them at reboot. |
218 | dfea906f | Michael Hanselmann | To obtain this make sure the variable |
219 | dfea906f | Michael Hanselmann | <literal>XENDOMAINS_SAVE</literal> in the file |
220 | dfea906f | Michael Hanselmann | <literal>/etc/default/xendomains</literal> is set to an empty value. |
221 | dfea906f | Michael Hanselmann | </para> |
222 | 1df40cb5 | Guido Trotter | |
223 | 0a2a0d91 | Iustin Pop | <formalpara> |
224 | 0a2a0d91 | Iustin Pop | <title>Debian</title> |
225 | 0a2a0d91 | Iustin Pop | <para> |
226 | ac232de3 | Iustin Pop | Besides the ballooning change which you need to set in |
227 | 0a2a0d91 | Iustin Pop | <filename>/etc/xen/xend-config.sxp</filename>, you need to |
228 | 0a2a0d91 | Iustin Pop | set the memory and nosmp parameters in the file |
229 | 0a2a0d91 | Iustin Pop | <filename>/boot/grub/menu.lst</filename>. You need to |
230 | 0a2a0d91 | Iustin Pop | modify the variable <literal>xenhopt</literal> to add |
231 | 0a2a0d91 | Iustin Pop | <userinput>dom0_mem=512M</userinput> like this: |
232 | 0a2a0d91 | Iustin Pop | <screen> |
233 | 0a2a0d91 | Iustin Pop | ## Xen hypervisor options to use with the default Xen boot option |
234 | 0a2a0d91 | Iustin Pop | # xenhopt=dom0_mem=512M |
235 | 0a2a0d91 | Iustin Pop | </screen> |
236 | 0a2a0d91 | Iustin Pop | and the <literal>xenkopt</literal> needs to include the |
237 | 0a2a0d91 | Iustin Pop | <userinput>nosmp</userinput> option like this: |
238 | 0a2a0d91 | Iustin Pop | <screen> |
239 | 0a2a0d91 | Iustin Pop | ## Xen Linux kernel options to use with the default Xen boot option |
240 | 0a2a0d91 | Iustin Pop | # xenkopt=nosmp |
241 | 0a2a0d91 | Iustin Pop | </screen> |
242 | 0a2a0d91 | Iustin Pop | |
243 | 0a2a0d91 | Iustin Pop | Any existing parameters can be left in place: it's ok to |
244 | 0a2a0d91 | Iustin Pop | have <computeroutput>xenkopt=console=tty0 |
245 | 0a2a0d91 | Iustin Pop | nosmp</computeroutput>, for example. After modifying the |
246 | 0a2a0d91 | Iustin Pop | files, you need to run: |
247 | 0a2a0d91 | Iustin Pop | <screen> |
248 | 0a2a0d91 | Iustin Pop | /sbin/update-grub |
249 | 0a2a0d91 | Iustin Pop | </screen> |
250 | 0a2a0d91 | Iustin Pop | </para> |
251 | 0a2a0d91 | Iustin Pop | </formalpara> |
252 | bf6fe28b | Alexander Schreiber | <para> |
253 | bf6fe28b | Alexander Schreiber | If you want to test the experimental HVM support |
254 | bf6fe28b | Alexander Schreiber | with Ganeti and want VNC access to the console of your |
255 | bf6fe28b | Alexander Schreiber | instances, set the following two entries in |
256 | bf6fe28b | Alexander Schreiber | <filename>/etc/xen/xend-config.sxp</filename>: |
257 | bf6fe28b | Alexander Schreiber | <screen> |
258 | bf6fe28b | Alexander Schreiber | (vnc-listen '0.0.0.0') |
259 | bf6fe28b | Alexander Schreiber | (vncpasswd '') |
260 | bf6fe28b | Alexander Schreiber | </screen> |
261 | bf6fe28b | Alexander Schreiber | You need to restart the Xen daemon for these settings to |
262 | bf6fe28b | Alexander Schreiber | take effect: |
263 | bf6fe28b | Alexander Schreiber | <screen> |
264 | bf6fe28b | Alexander Schreiber | /etc/init.d/xend restart |
265 | bf6fe28b | Alexander Schreiber | </screen> |
266 | bf6fe28b | Alexander Schreiber | </para> |
267 | 0a2a0d91 | Iustin Pop | |
268 | 0a2a0d91 | Iustin Pop | </sect3> |
269 | 0a2a0d91 | Iustin Pop | |
270 | 0a2a0d91 | Iustin Pop | <sect3> |
271 | 16450d30 | Iustin Pop | <title>Selecting the instance kernel</title> |
272 | 16450d30 | Iustin Pop | |
273 | 16450d30 | Iustin Pop | <para> |
274 | 051f92ec | Michael Hanselmann | After you have installed Xen, you need to tell Ganeti |
275 | 16450d30 | Iustin Pop | exactly what kernel to use for the instances it will |
276 | 16450d30 | Iustin Pop | create. This is done by creating a |
277 | 16450d30 | Iustin Pop | <emphasis>symlink</emphasis> from your actual kernel to |
278 | 16450d30 | Iustin Pop | <filename>/boot/vmlinuz-2.6-xenU</filename>, and one from |
279 | 16450d30 | Iustin Pop | your initrd to |
280 | 16450d30 | Iustin Pop | <filename>/boot/initrd-2.6-xenU</filename>. Note that if you |
281 | 16450d30 | Iustin Pop | don't use an initrd for the <literal>domU</literal> kernel, |
282 | 16450d30 | Iustin Pop | you don't need to create the initrd symlink. |
283 | 16450d30 | Iustin Pop | </para> |
284 | 16450d30 | Iustin Pop | |
285 | 16450d30 | Iustin Pop | <formalpara> |
286 | 16450d30 | Iustin Pop | <title>Debian</title> |
287 | 16450d30 | Iustin Pop | <para> |
288 | 16450d30 | Iustin Pop | After installation of the |
289 | 16450d30 | Iustin Pop | <literal>xen-linux-system</literal> package, you need to |
290 | 16450d30 | Iustin Pop | run (replace the exact version number with the one you |
291 | 16450d30 | Iustin Pop | have): |
292 | 16450d30 | Iustin Pop | <screen> |
293 | 16450d30 | Iustin Pop | cd /boot |
294 | 16450d30 | Iustin Pop | ln -s vmlinuz-2.6.18-5-xen-686 vmlinuz-2.6-xenU |
295 | 16450d30 | Iustin Pop | ln -s initrd.img-2.6.18-5-xen-686 initrd-2.6-xenU |
296 | 16450d30 | Iustin Pop | </screen> |
297 | 16450d30 | Iustin Pop | </para> |
298 | 16450d30 | Iustin Pop | </formalpara> |
299 | 16450d30 | Iustin Pop | </sect3> |
300 | 16450d30 | Iustin Pop | |
301 | f1a808df | Guido Trotter | </sect2> |
302 | f1a808df | Guido Trotter | |
303 | f1a808df | Guido Trotter | <sect2> |
304 | f1a808df | Guido Trotter | <title>Installing DRBD</title> |
305 | f1a808df | Guido Trotter | |
306 | 5d6dd340 | Iustin Pop | <para> |
307 | 0bac47cf | Iustin Pop | Recommended on all nodes: <ulink |
308 | 0bac47cf | Iustin Pop | url="http://www.drbd.org/">DRBD</ulink> is required if you |
309 | 0bac47cf | Iustin Pop | want to use the high availability (HA) features of Ganeti, but |
310 | 0bac47cf | Iustin Pop | optional if you don't require HA or only run Ganeti on |
311 | 0bac47cf | Iustin Pop | single-node clusters. You can upgrade a non-HA cluster to an |
312 | 32ad0582 | Iustin Pop | HA one later, but you might need to export and re-import all |
313 | 0bac47cf | Iustin Pop | your instances to take advantage of the new features. |
314 | 0bac47cf | Iustin Pop | </para> |
315 | 0bac47cf | Iustin Pop | |
316 | 0bac47cf | Iustin Pop | <para> |
317 | 6c4811dc | Iustin Pop | Supported DRBD versions: the <literal>0.7</literal> series |
318 | 6c4811dc | Iustin Pop | <emphasis role="strong">or</emphasis> |
319 | bb987157 | Iustin Pop | <literal>8.0.7</literal>. It's recommended to have at least |
320 | 6c4811dc | Iustin Pop | version <literal>0.7.24</literal> if you use |
321 | 6c4811dc | Iustin Pop | <command>udev</command> since older versions have a bug |
322 | 6c4811dc | Iustin Pop | related to device discovery which can be triggered in cases of |
323 | 6c4811dc | Iustin Pop | hard drive failure. |
324 | f1a808df | Guido Trotter | </para> |
325 | f1a808df | Guido Trotter | |
326 | 5d6dd340 | Iustin Pop | <para> |
327 | 5d6dd340 | Iustin Pop | Now the bad news: unless your distribution already provides it |
328 | 5d6dd340 | Iustin Pop | installing DRBD might involve recompiling your kernel or |
329 | 051f92ec | Michael Hanselmann | anyway fiddling with it. Hopefully at least the Xen-ified |
330 | 5d6dd340 | Iustin Pop | kernel source to start from will be provided. |
331 | f1a808df | Guido Trotter | </para> |
332 | f1a808df | Guido Trotter | |
333 | 5d6dd340 | Iustin Pop | <para> |
334 | 5d6dd340 | Iustin Pop | The good news is that you don't need to configure DRBD at all. |
335 | 5d6dd340 | Iustin Pop | Ganeti will do it for you for every instance you set up. If |
336 | 5d6dd340 | Iustin Pop | you have the DRBD utils installed and the module in your |
337 | 5d6dd340 | Iustin Pop | kernel you're fine. Please check that your system is |
338 | 727830bf | Iustin Pop | configured to load the module at every boot, and that it |
339 | 6c4811dc | Iustin Pop | passes the following option to the module (for |
340 | 6c4811dc | Iustin Pop | <literal>0.7.x</literal>: |
341 | 727830bf | Iustin Pop | <computeroutput>minor_count=64</computeroutput> (this will |
342 | 6c4811dc | Iustin Pop | allow you to use up to 32 instances per node) or for |
343 | 6c4811dc | Iustin Pop | <literal>8.0.x</literal> you can use up to |
344 | 6c4811dc | Iustin Pop | <constant>255</constant> |
345 | 6c4811dc | Iustin Pop | (i.e. <computeroutput>minor_count=255</computeroutput>, but |
346 | 6c4811dc | Iustin Pop | for most clusters <constant>128</constant> should be enough). |
347 | f1a808df | Guido Trotter | </para> |
348 | f1a808df | Guido Trotter | |
349 | 32ad0582 | Iustin Pop | <formalpara><title>Debian</title> |
350 | 32ad0582 | Iustin Pop | <para> |
351 | 32ad0582 | Iustin Pop | You can just install (build) the DRBD 0.7 module with the |
352 | 851765bb | Iustin Pop | following commands (make sure you are running the Xen |
353 | 851765bb | Iustin Pop | kernel): |
354 | 32ad0582 | Iustin Pop | </para> |
355 | 32ad0582 | Iustin Pop | </formalpara> |
356 | 32ad0582 | Iustin Pop | |
357 | 32ad0582 | Iustin Pop | <screen> |
358 | 32ad0582 | Iustin Pop | apt-get install drbd0.7-module-source drbd0.7-utils |
359 | 32ad0582 | Iustin Pop | m-a update |
360 | 32ad0582 | Iustin Pop | m-a a-i drbd0.7 |
361 | 727830bf | Iustin Pop | echo drbd minor_count=64 >> /etc/modules |
362 | 727830bf | Iustin Pop | modprobe drbd minor_count=64 |
363 | 32ad0582 | Iustin Pop | </screen> |
364 | bb987157 | Iustin Pop | <para> |
365 | bb987157 | Iustin Pop | or for using DRBD <literal>8.x</literal> from the etch |
366 | bb987157 | Iustin Pop | backports (note: you need at least 8.0.7, older version have |
367 | bb987157 | Iustin Pop | a bug that breaks ganeti's usage of drbd): |
368 | bb987157 | Iustin Pop | </para> |
369 | 6c4811dc | Iustin Pop | <screen> |
370 | 6c4811dc | Iustin Pop | apt-get install -t etch-backports drbd8-module-source drbd8-utils |
371 | 6c4811dc | Iustin Pop | m-a update |
372 | 6c4811dc | Iustin Pop | m-a a-i drbd8 |
373 | 6c4811dc | Iustin Pop | echo drbd minor_count=128 >> /etc/modules |
374 | 6c4811dc | Iustin Pop | modprobe drbd minor_count=128 |
375 | 6c4811dc | Iustin Pop | </screen> |
376 | 32ad0582 | Iustin Pop | |
377 | 61bf23ec | Iustin Pop | <para> |
378 | 61bf23ec | Iustin Pop | It is also recommended that you comment out the default |
379 | 61bf23ec | Iustin Pop | resources in the <filename>/etc/dbrd.conf</filename> file, so |
380 | 61bf23ec | Iustin Pop | that the init script doesn't try to configure any drbd |
381 | 61bf23ec | Iustin Pop | devices. You can do this by prefixing all |
382 | 61bf23ec | Iustin Pop | <literal>resource</literal> lines in the file with the keyword |
383 | 61bf23ec | Iustin Pop | <literal>skip</literal>, like this: |
384 | 61bf23ec | Iustin Pop | </para> |
385 | 61bf23ec | Iustin Pop | |
386 | 61bf23ec | Iustin Pop | <screen> |
387 | 61bf23ec | Iustin Pop | skip resource r0 { |
388 | 61bf23ec | Iustin Pop | ... |
389 | 61bf23ec | Iustin Pop | } |
390 | 61bf23ec | Iustin Pop | |
391 | 61bf23ec | Iustin Pop | skip resource "r1" { |
392 | 61bf23ec | Iustin Pop | ... |
393 | 61bf23ec | Iustin Pop | } |
394 | 61bf23ec | Iustin Pop | </screen> |
395 | 61bf23ec | Iustin Pop | |
396 | f1a808df | Guido Trotter | </sect2> |
397 | f1a808df | Guido Trotter | |
398 | a7a19281 | Iustin Pop | <sect2> |
399 | a7a19281 | Iustin Pop | <title>Other required software</title> |
400 | a7a19281 | Iustin Pop | |
401 | a7a19281 | Iustin Pop | <para>Besides Xen and DRBD, you will need to install the |
402 | 0bac47cf | Iustin Pop | following (on all nodes):</para> |
403 | a7a19281 | Iustin Pop | |
404 | a7a19281 | Iustin Pop | <itemizedlist> |
405 | a7a19281 | Iustin Pop | <listitem> |
406 | a7a19281 | Iustin Pop | <simpara><ulink url="http://sourceware.org/lvm2/">LVM |
407 | a7a19281 | Iustin Pop | version 2</ulink></simpara> |
408 | a7a19281 | Iustin Pop | </listitem> |
409 | a7a19281 | Iustin Pop | <listitem> |
410 | a7a19281 | Iustin Pop | <simpara><ulink |
411 | a7a19281 | Iustin Pop | url="http://www.openssl.org/">OpenSSL</ulink></simpara> |
412 | a7a19281 | Iustin Pop | </listitem> |
413 | a7a19281 | Iustin Pop | <listitem> |
414 | a7a19281 | Iustin Pop | <simpara><ulink |
415 | a7a19281 | Iustin Pop | url="http://www.openssh.com/portable.html">OpenSSH</ulink></simpara> |
416 | a7a19281 | Iustin Pop | </listitem> |
417 | a7a19281 | Iustin Pop | <listitem> |
418 | a7a19281 | Iustin Pop | <simpara><ulink url="http://bridge.sourceforge.net/">Bridge |
419 | a7a19281 | Iustin Pop | utilities</ulink></simpara> |
420 | a7a19281 | Iustin Pop | </listitem> |
421 | a7a19281 | Iustin Pop | <listitem> |
422 | a7a19281 | Iustin Pop | <simpara><ulink |
423 | a7a19281 | Iustin Pop | url="http://developer.osdl.org/dev/iproute2">iproute2</ulink></simpara> |
424 | a7a19281 | Iustin Pop | </listitem> |
425 | a7a19281 | Iustin Pop | <listitem> |
426 | a7a19281 | Iustin Pop | <simpara><ulink |
427 | a7a19281 | Iustin Pop | url="ftp://ftp.inr.ac.ru/ip-routing/iputils-current.tar.gz">arping</ulink> |
428 | a7a19281 | Iustin Pop | (part of iputils package)</simpara> |
429 | a7a19281 | Iustin Pop | </listitem> |
430 | a7a19281 | Iustin Pop | <listitem> |
431 | a7a19281 | Iustin Pop | <simpara><ulink |
432 | a7a19281 | Iustin Pop | url="http://www.kernel.org/pub/linux/utils/raid/mdadm/">mdadm</ulink> |
433 | a7a19281 | Iustin Pop | (Linux Software Raid tools)</simpara> |
434 | a7a19281 | Iustin Pop | </listitem> |
435 | a7a19281 | Iustin Pop | <listitem> |
436 | a7a19281 | Iustin Pop | <simpara><ulink url="http://www.python.org">Python 2.4</ulink></simpara> |
437 | a7a19281 | Iustin Pop | </listitem> |
438 | a7a19281 | Iustin Pop | <listitem> |
439 | a7a19281 | Iustin Pop | <simpara><ulink url="http://twistedmatrix.com/">Python |
440 | a7a19281 | Iustin Pop | Twisted library</ulink> - the core library is |
441 | a7a19281 | Iustin Pop | enough</simpara> |
442 | a7a19281 | Iustin Pop | </listitem> |
443 | a7a19281 | Iustin Pop | <listitem> |
444 | a7a19281 | Iustin Pop | <simpara><ulink |
445 | a7a19281 | Iustin Pop | url="http://pyopenssl.sourceforge.net/">Python OpenSSL |
446 | a7a19281 | Iustin Pop | bindings</ulink></simpara> |
447 | 319856a9 | Michael Hanselmann | </listitem> |
448 | 319856a9 | Michael Hanselmann | <listitem> |
449 | 319856a9 | Michael Hanselmann | <simpara><ulink |
450 | 319856a9 | Michael Hanselmann | url="http://www.undefined.org/python/#simplejson">simplejson Python |
451 | 319856a9 | Michael Hanselmann | module</ulink></simpara> |
452 | a2cfdea2 | Iustin Pop | </listitem> |
453 | a2cfdea2 | Iustin Pop | <listitem> |
454 | a2cfdea2 | Iustin Pop | <simpara><ulink |
455 | a2cfdea2 | Iustin Pop | url="http://pyparsing.wikispaces.com/">pyparsing Python |
456 | a2cfdea2 | Iustin Pop | module</ulink></simpara> |
457 | a7a19281 | Iustin Pop | </listitem> |
458 | a7a19281 | Iustin Pop | </itemizedlist> |
459 | a7a19281 | Iustin Pop | |
460 | 32ad0582 | Iustin Pop | <para> |
461 | 32ad0582 | Iustin Pop | These programs are supplied as part of most Linux |
462 | 32ad0582 | Iustin Pop | distributions, so usually they can be installed via apt or |
463 | 32ad0582 | Iustin Pop | similar methods. Also many of them will already be installed |
464 | 32ad0582 | Iustin Pop | on a standard machine. |
465 | 32ad0582 | Iustin Pop | </para> |
466 | 32ad0582 | Iustin Pop | |
467 | 32ad0582 | Iustin Pop | |
468 | 32ad0582 | Iustin Pop | <formalpara><title>Debian</title> |
469 | 32ad0582 | Iustin Pop | |
470 | 32ad0582 | Iustin Pop | <para>You can use this command line to install all of them:</para> |
471 | a7a19281 | Iustin Pop | |
472 | 32ad0582 | Iustin Pop | </formalpara> |
473 | a7a19281 | Iustin Pop | <screen> |
474 | a7a19281 | Iustin Pop | # apt-get install lvm2 ssh bridge-utils iproute iputils-arping \ |
475 | 16abfbc2 | Alexander Schreiber | python2.4 python-twisted-core python-pyopenssl openssl \ |
476 | 7ec54942 | Guido Trotter | mdadm python-pyparsing python-simplejson |
477 | a7a19281 | Iustin Pop | </screen> |
478 | 5cd0d9c0 | Iustin Pop | |
479 | a7a19281 | Iustin Pop | </sect2> |
480 | a7a19281 | Iustin Pop | |
481 | f1a808df | Guido Trotter | </sect1> |
482 | f1a808df | Guido Trotter | |
483 | f1a808df | Guido Trotter | |
484 | f1a808df | Guido Trotter | <sect1> |
485 | f1a808df | Guido Trotter | <title>Setting up the environment for Ganeti</title> |
486 | f1a808df | Guido Trotter | |
487 | f1a808df | Guido Trotter | <sect2> |
488 | f1a808df | Guido Trotter | <title>Configuring the network</title> |
489 | f1a808df | Guido Trotter | |
490 | 0bac47cf | Iustin Pop | <para><emphasis role="strong">Mandatory</emphasis> on all nodes.</para> |
491 | 0bac47cf | Iustin Pop | |
492 | 32ad0582 | Iustin Pop | <para> |
493 | 32ad0582 | Iustin Pop | Ganeti relies on Xen running in "bridge mode", which means the |
494 | 32ad0582 | Iustin Pop | instances network interfaces will be attached to a software bridge |
495 | 32ad0582 | Iustin Pop | running in dom0. Xen by default creates such a bridge at startup, but |
496 | 32ad0582 | Iustin Pop | your distribution might have a different way to do things. |
497 | f1a808df | Guido Trotter | </para> |
498 | f1a808df | Guido Trotter | |
499 | f1a808df | Guido Trotter | <para> |
500 | 32ad0582 | Iustin Pop | Beware that the default name Ganeti uses is |
501 | 32ad0582 | Iustin Pop | <hardware>xen-br0</hardware> (which was used in Xen 2.0) |
502 | 32ad0582 | Iustin Pop | while Xen 3.0 uses <hardware>xenbr0</hardware> by |
503 | 32ad0582 | Iustin Pop | default. The default bridge your Ganeti cluster will use for new |
504 | 32ad0582 | Iustin Pop | instances can be specified at cluster initialization time. |
505 | 32ad0582 | Iustin Pop | </para> |
506 | 5d6dd340 | Iustin Pop | |
507 | 32ad0582 | Iustin Pop | <formalpara><title>Debian</title> |
508 | 32ad0582 | Iustin Pop | <para> |
509 | 051f92ec | Michael Hanselmann | The recommended Debian way to configure the Xen bridge is to |
510 | 32ad0582 | Iustin Pop | edit your <filename>/etc/network/interfaces</filename> file |
511 | 32ad0582 | Iustin Pop | and substitute your normal Ethernet stanza with the |
512 | 32ad0582 | Iustin Pop | following snippet: |
513 | 32ad0582 | Iustin Pop | |
514 | 32ad0582 | Iustin Pop | <screen> |
515 | 32ad0582 | Iustin Pop | auto xen-br0 |
516 | 32ad0582 | Iustin Pop | iface xen-br0 inet static |
517 | 5d6dd340 | Iustin Pop | address <replaceable>YOUR_IP_ADDRESS</replaceable> |
518 | 5d6dd340 | Iustin Pop | netmask <replaceable>YOUR_NETMASK</replaceable> |
519 | 5d6dd340 | Iustin Pop | network <replaceable>YOUR_NETWORK</replaceable> |
520 | 5d6dd340 | Iustin Pop | broadcast <replaceable>YOUR_BROADCAST_ADDRESS</replaceable> |
521 | 5d6dd340 | Iustin Pop | gateway <replaceable>YOUR_GATEWAY</replaceable> |
522 | 32ad0582 | Iustin Pop | bridge_ports eth0 |
523 | f1a808df | Guido Trotter | bridge_stp off |
524 | f1a808df | Guido Trotter | bridge_fd 0 |
525 | 32ad0582 | Iustin Pop | </screen> |
526 | 32ad0582 | Iustin Pop | </para> |
527 | 32ad0582 | Iustin Pop | </formalpara> |
528 | 32ad0582 | Iustin Pop | |
529 | 32ad0582 | Iustin Pop | <para> |
530 | 32ad0582 | Iustin Pop | The following commands need to be executed on the local console |
531 | 32ad0582 | Iustin Pop | </para> |
532 | 32ad0582 | Iustin Pop | <screen> |
533 | 32ad0582 | Iustin Pop | ifdown eth0 |
534 | 32ad0582 | Iustin Pop | ifup xen-br0 |
535 | 32ad0582 | Iustin Pop | </screen> |
536 | 32ad0582 | Iustin Pop | |
537 | 32ad0582 | Iustin Pop | <para> |
538 | 32ad0582 | Iustin Pop | To check if the bridge is setup, use <command>ip</command> |
539 | 32ad0582 | Iustin Pop | and <command>brctl show</command>: |
540 | 32ad0582 | Iustin Pop | <para> |
541 | 32ad0582 | Iustin Pop | |
542 | 32ad0582 | Iustin Pop | <screen> |
543 | 32ad0582 | Iustin Pop | # ip a show xen-br0 |
544 | 32ad0582 | Iustin Pop | 9: xen-br0: <BROADCAST,MULTICAST,UP,10000> mtu 1500 qdisc noqueue |
545 | 32ad0582 | Iustin Pop | link/ether 00:20:fc:1e:d5:5d brd ff:ff:ff:ff:ff:ff |
546 | 32ad0582 | Iustin Pop | inet 10.1.1.200/24 brd 10.1.1.255 scope global xen-br0 |
547 | 32ad0582 | Iustin Pop | inet6 fe80::220:fcff:fe1e:d55d/64 scope link |
548 | 32ad0582 | Iustin Pop | valid_lft forever preferred_lft forever |
549 | 32ad0582 | Iustin Pop | |
550 | 32ad0582 | Iustin Pop | # brctl show xen-br0 |
551 | 32ad0582 | Iustin Pop | bridge name bridge id STP enabled interfaces |
552 | 32ad0582 | Iustin Pop | xen-br0 8000.0020fc1ed55d no eth0 |
553 | 5d6dd340 | Iustin Pop | </screen> |
554 | f1a808df | Guido Trotter | |
555 | f1a808df | Guido Trotter | |
556 | f1a808df | Guido Trotter | </sect2> |
557 | f1a808df | Guido Trotter | |
558 | f1a808df | Guido Trotter | <sect2> |
559 | f1a808df | Guido Trotter | <title>Configuring LVM</title> |
560 | f1a808df | Guido Trotter | |
561 | 32ad0582 | Iustin Pop | |
562 | 0bac47cf | Iustin Pop | <para><emphasis role="strong">Mandatory</emphasis> on all nodes.</para> |
563 | 0bac47cf | Iustin Pop | |
564 | 16450d30 | Iustin Pop | <note> |
565 | 16450d30 | Iustin Pop | <simpara>The volume group is required to be at least |
566 | 16450d30 | Iustin Pop | <constant>20GiB</constant>.</simpara> |
567 | 16450d30 | Iustin Pop | </note> |
568 | f1a808df | Guido Trotter | <para> |
569 | 5d6dd340 | Iustin Pop | If you haven't configured your LVM volume group at install |
570 | 5d6dd340 | Iustin Pop | time you need to do it before trying to initialize the Ganeti |
571 | 5d6dd340 | Iustin Pop | cluster. This is done by formatting the devices/partitions you |
572 | 5d6dd340 | Iustin Pop | want to use for it and then adding them to the relevant volume |
573 | 5d6dd340 | Iustin Pop | group: |
574 | 5d6dd340 | Iustin Pop | |
575 | 5d6dd340 | Iustin Pop | <screen> |
576 | 32ad0582 | Iustin Pop | pvcreate /dev/sda3 |
577 | 32ad0582 | Iustin Pop | vgcreate xenvg /dev/sda3 |
578 | 32ad0582 | Iustin Pop | </screen> |
579 | 32ad0582 | Iustin Pop | or |
580 | 32ad0582 | Iustin Pop | <screen> |
581 | 32ad0582 | Iustin Pop | pvcreate /dev/sdb1 |
582 | f1a808df | Guido Trotter | pvcreate /dev/sdc1 |
583 | 32ad0582 | Iustin Pop | vgcreate xenvg /dev/sdb1 /dev/sdc1 |
584 | 5d6dd340 | Iustin Pop | </screen> |
585 | 32ad0582 | Iustin Pop | </para> |
586 | f1a808df | Guido Trotter | |
587 | f1a808df | Guido Trotter | <para> |
588 | 5d6dd340 | Iustin Pop | If you want to add a device later you can do so with the |
589 | 53b78ba4 | Guido Trotter | <citerefentry><refentrytitle>vgextend</refentrytitle> |
590 | 5d6dd340 | Iustin Pop | <manvolnum>8</manvolnum></citerefentry> command: |
591 | 5d6dd340 | Iustin Pop | </para> |
592 | 5d6dd340 | Iustin Pop | |
593 | 5d6dd340 | Iustin Pop | <screen> |
594 | 32ad0582 | Iustin Pop | pvcreate /dev/sdd1 |
595 | 32ad0582 | Iustin Pop | vgextend xenvg /dev/sdd1 |
596 | 5d6dd340 | Iustin Pop | </screen> |
597 | 89624642 | Iustin Pop | |
598 | 89624642 | Iustin Pop | <formalpara> |
599 | 89624642 | Iustin Pop | <title>Optional</title> |
600 | 89624642 | Iustin Pop | <para> |
601 | 89624642 | Iustin Pop | It is recommended to configure LVM not to scan the DRBD |
602 | 89624642 | Iustin Pop | devices for physical volumes. This can be accomplished by |
603 | 89624642 | Iustin Pop | editing <filename>/etc/lvm/lvm.conf</filename> and adding |
604 | 89624642 | Iustin Pop | the <literal>/dev/drbd[0-9]+</literal> regular expression to |
605 | 89624642 | Iustin Pop | the <literal>filter</literal> variable, like this: |
606 | 89624642 | Iustin Pop | <screen> |
607 | 89624642 | Iustin Pop | filter = [ "r|/dev/cdrom|", "r|/dev/drbd[0-9]+|" ] |
608 | 89624642 | Iustin Pop | </screen> |
609 | 89624642 | Iustin Pop | </para> |
610 | 89624642 | Iustin Pop | </formalpara> |
611 | 89624642 | Iustin Pop | |
612 | f1a808df | Guido Trotter | </sect2> |
613 | f1a808df | Guido Trotter | |
614 | f1a808df | Guido Trotter | <sect2> |
615 | f1a808df | Guido Trotter | <title>Installing Ganeti</title> |
616 | f1a808df | Guido Trotter | |
617 | 0bac47cf | Iustin Pop | <para><emphasis role="strong">Mandatory</emphasis> on all nodes.</para> |
618 | 0bac47cf | Iustin Pop | |
619 | 1005b0c1 | Iustin Pop | <para> |
620 | 32ad0582 | Iustin Pop | It's now time to install the Ganeti software itself. Download |
621 | 32ad0582 | Iustin Pop | the source from <ulink |
622 | 32ad0582 | Iustin Pop | url="http://code.google.com/p/ganeti/"></ulink>. |
623 | 1005b0c1 | Iustin Pop | </para> |
624 | f1a808df | Guido Trotter | |
625 | 5d6dd340 | Iustin Pop | <screen> |
626 | ce628bb4 | Iustin Pop | tar xvzf ganeti-1.2.0.tar.gz |
627 | ce628bb4 | Iustin Pop | cd ganeti-1.2.0 |
628 | bd205d0e | Michael Hanselmann | ./configure --localstatedir=/var --sysconfdir=/etc |
629 | f1a808df | Guido Trotter | make |
630 | f1a808df | Guido Trotter | make install |
631 | 1005b0c1 | Iustin Pop | mkdir /srv/ganeti/ /srv/ganeti/os /srv/ganeti/export |
632 | 5d6dd340 | Iustin Pop | </screen> |
633 | f1a808df | Guido Trotter | |
634 | 1005b0c1 | Iustin Pop | <para> |
635 | 32ad0582 | Iustin Pop | You also need to copy the file |
636 | bd205d0e | Michael Hanselmann | <filename>doc/examples/ganeti.initd</filename> |
637 | 32ad0582 | Iustin Pop | from the source archive to |
638 | 32ad0582 | Iustin Pop | <filename>/etc/init.d/ganeti</filename> and register it with |
639 | 1005b0c1 | Iustin Pop | your distribution's startup scripts, for example in Debian: |
640 | f1a808df | Guido Trotter | </para> |
641 | 1005b0c1 | Iustin Pop | <screen>update-rc.d ganeti defaults 20 80</screen> |
642 | f1a808df | Guido Trotter | |
643 | 727830bf | Iustin Pop | <para> |
644 | 727830bf | Iustin Pop | In order to automatically restart failed instances, you need |
645 | 727830bf | Iustin Pop | to setup a cron job run the |
646 | 727830bf | Iustin Pop | <computeroutput>ganeti-watcher</computeroutput> program. A |
647 | 727830bf | Iustin Pop | sample cron file is provided in the source at |
648 | bd205d0e | Michael Hanselmann | <filename>doc/examples/ganeti.cron</filename> and you can |
649 | 727830bf | Iustin Pop | copy that (eventually altering the path) to |
650 | 727830bf | Iustin Pop | <filename>/etc/cron.d/ganeti</filename> |
651 | 727830bf | Iustin Pop | </para> |
652 | 727830bf | Iustin Pop | |
653 | f1a808df | Guido Trotter | </sect2> |
654 | f1a808df | Guido Trotter | |
655 | f1a808df | Guido Trotter | <sect2> |
656 | f1a808df | Guido Trotter | <title>Installing the Operating System support packages</title> |
657 | f1a808df | Guido Trotter | |
658 | 0bac47cf | Iustin Pop | <para><emphasis role="strong">Mandatory</emphasis> on all nodes.</para> |
659 | 0bac47cf | Iustin Pop | |
660 | a7a19281 | Iustin Pop | <para> |
661 | 32ad0582 | Iustin Pop | To be able to install instances you need to have an Operating |
662 | 32ad0582 | Iustin Pop | System installation script. An example for Debian Etch is |
663 | 32ad0582 | Iustin Pop | provided on the project web site. Download it from <ulink |
664 | 32ad0582 | Iustin Pop | url="http://code.google.com/p/ganeti/"></ulink> and follow the |
665 | 32ad0582 | Iustin Pop | instructions in the <filename>README</filename> file. Here is |
666 | 5736852e | Iustin Pop | the installation procedure (replace <constant>0.2</constant> |
667 | 5736852e | Iustin Pop | with the latest version that is compatible with your ganeti |
668 | 5736852e | Iustin Pop | version): |
669 | a7a19281 | Iustin Pop | </para> |
670 | a7a19281 | Iustin Pop | |
671 | 32ad0582 | Iustin Pop | <screen> |
672 | 32ad0582 | Iustin Pop | cd /srv/ganeti/os |
673 | 3d492b09 | Iustin Pop | tar xvf ganeti-instance-debian-etch-0.3.tar |
674 | 3d492b09 | Iustin Pop | mv ganeti-instance-debian-etch-0.3 debian-etch |
675 | 32ad0582 | Iustin Pop | </screen> |
676 | 32ad0582 | Iustin Pop | |
677 | a7a19281 | Iustin Pop | <para> |
678 | 16450d30 | Iustin Pop | In order to use this OS definition, you need to have internet |
679 | 116b0c88 | Iustin Pop | access from your nodes and have the <citerefentry> |
680 | 16450d30 | Iustin Pop | <refentrytitle>debootstrap</refentrytitle> |
681 | 116b0c88 | Iustin Pop | <manvolnum>8</manvolnum></citerefentry>, <citerefentry> |
682 | 116b0c88 | Iustin Pop | <refentrytitle>dump</refentrytitle><manvolnum>8</manvolnum> |
683 | 116b0c88 | Iustin Pop | </citerefentry> and <citerefentry> |
684 | 116b0c88 | Iustin Pop | <refentrytitle>restore</refentrytitle> |
685 | 116b0c88 | Iustin Pop | <manvolnum>8</manvolnum> </citerefentry> commands installed on |
686 | 116b0c88 | Iustin Pop | all nodes. |
687 | 16450d30 | Iustin Pop | </para> |
688 | 16450d30 | Iustin Pop | <formalpara> |
689 | 16450d30 | Iustin Pop | <title>Debian</title> |
690 | 16450d30 | Iustin Pop | <para> |
691 | 116b0c88 | Iustin Pop | Use this command on all nodes to install the required |
692 | 116b0c88 | Iustin Pop | packages: |
693 | 16450d30 | Iustin Pop | |
694 | 116b0c88 | Iustin Pop | <screen>apt-get install debootstrap dump</screen> |
695 | 16450d30 | Iustin Pop | </para> |
696 | 16450d30 | Iustin Pop | </formalpara> |
697 | 16450d30 | Iustin Pop | |
698 | 16450d30 | Iustin Pop | <para> |
699 | 32ad0582 | Iustin Pop | Alternatively, you can create your own OS definitions. See the |
700 | 0bac47cf | Iustin Pop | manpage |
701 | a7a19281 | Iustin Pop | <citerefentry> |
702 | a7a19281 | Iustin Pop | <refentrytitle>ganeti-os-interface</refentrytitle> |
703 | a7a19281 | Iustin Pop | <manvolnum>8</manvolnum> |
704 | a7a19281 | Iustin Pop | </citerefentry>. |
705 | f1a808df | Guido Trotter | </para> |
706 | f1a808df | Guido Trotter | |
707 | f1a808df | Guido Trotter | </sect2> |
708 | f1a808df | Guido Trotter | |
709 | f1a808df | Guido Trotter | <sect2> |
710 | f1a808df | Guido Trotter | <title>Initializing the cluster</title> |
711 | f1a808df | Guido Trotter | |
712 | 5d6dd340 | Iustin Pop | <para><emphasis role="strong">Mandatory:</emphasis> only on one |
713 | 5d6dd340 | Iustin Pop | node per cluster.</para> |
714 | f1a808df | Guido Trotter | |
715 | f1a808df | Guido Trotter | |
716 | f1a808df | Guido Trotter | <para>The last step is to initialize the cluster. After you've repeated |
717 | 32ad0582 | Iustin Pop | the above process on all of your nodes, choose one as the master, and execute: |
718 | 5d6dd340 | Iustin Pop | </para> |
719 | f1a808df | Guido Trotter | |
720 | 5d6dd340 | Iustin Pop | <screen> |
721 | 5d6dd340 | Iustin Pop | gnt-cluster init <replaceable>CLUSTERNAME</replaceable> |
722 | 5d6dd340 | Iustin Pop | </screen> |
723 | f1a808df | Guido Trotter | |
724 | 5d6dd340 | Iustin Pop | <para> |
725 | 0bac47cf | Iustin Pop | The <replaceable>CLUSTERNAME</replaceable> is a hostname, |
726 | 0bac47cf | Iustin Pop | which must be resolvable (e.g. it must exist in DNS or in |
727 | 0bac47cf | Iustin Pop | <filename>/etc/hosts</filename>) by all the nodes in the |
728 | 0bac47cf | Iustin Pop | cluster. You must choose a name different from any of the |
729 | 0bac47cf | Iustin Pop | nodes names for a multi-node cluster. In general the best |
730 | 0bac47cf | Iustin Pop | choice is to have a unique name for a cluster, even if it |
731 | 0bac47cf | Iustin Pop | consists of only one machine, as you will be able to expand it |
732 | 0bac47cf | Iustin Pop | later without any problems. |
733 | 0bac47cf | Iustin Pop | </para> |
734 | 0bac47cf | Iustin Pop | |
735 | 0bac47cf | Iustin Pop | <para> |
736 | 32ad0582 | Iustin Pop | If the bridge name you are using is not |
737 | 32ad0582 | Iustin Pop | <literal>xen-br0</literal>, use the <option>-b |
738 | 32ad0582 | Iustin Pop | <replaceable>BRIDGENAME</replaceable></option> option to |
739 | 32ad0582 | Iustin Pop | specify the bridge name. In this case, you should also use the |
740 | 32ad0582 | Iustin Pop | <option>--master-netdev |
741 | 32ad0582 | Iustin Pop | <replaceable>BRIDGENAME</replaceable></option> option with the |
742 | 32ad0582 | Iustin Pop | same <replaceable>BRIDGENAME</replaceable> argument. |
743 | 1005b0c1 | Iustin Pop | </para> |
744 | 1005b0c1 | Iustin Pop | |
745 | 1005b0c1 | Iustin Pop | <para> |
746 | 32ad0582 | Iustin Pop | You can use a different name than <literal>xenvg</literal> for |
747 | 32ad0582 | Iustin Pop | the volume group (but note that the name must be identical on |
748 | 32ad0582 | Iustin Pop | all nodes). In this case you need to specify it by passing the |
749 | 32ad0582 | Iustin Pop | <option>-g <replaceable>VGNAME</replaceable></option> option |
750 | 32ad0582 | Iustin Pop | to <computeroutput>gnt-cluster init</computeroutput>. |
751 | f1a808df | Guido Trotter | </para> |
752 | f1a808df | Guido Trotter | |
753 | 5d6dd340 | Iustin Pop | <para> |
754 | bf6fe28b | Alexander Schreiber | To set up the cluster as an HVM cluster, use the |
755 | bf6fe28b | Alexander Schreiber | <option>--hypervisor=xen-hvm3.1</option> option to use |
756 | bf6fe28b | Alexander Schreiber | the Xen 3.1 HVM hypervisor. Note that with the |
757 | bf6fe28b | Alexander Schreiber | experimental HVM support, you will only be able to create |
758 | bf6fe28b | Alexander Schreiber | HVM instances in a cluster set to this hypervisor type. Mixed |
759 | bf6fe28b | Alexander Schreiber | PVM/HVM clusters are not supported by the Ganeti 1.2 |
760 | bf6fe28b | Alexander Schreiber | experimental HVM support. You will also need to create the VNC |
761 | bf6fe28b | Alexander Schreiber | cluster password file |
762 | bf6fe28b | Alexander Schreiber | <filename>/etc/ganeti/vnc-cluster-password</filename> |
763 | bf6fe28b | Alexander Schreiber | which contains one line with the default VNC password for the |
764 | bf6fe28b | Alexander Schreiber | cluster. Finally, you need to provide an installation ISO |
765 | bf6fe28b | Alexander Schreiber | image for HVM instance which will not only be mapped to the |
766 | bf6fe28b | Alexander Schreiber | first CDROM of the instance, but which the instance will also |
767 | bf6fe28b | Alexander Schreiber | boot from. This ISO image is expected at |
768 | bf6fe28b | Alexander Schreiber | <filename>/srv/ganeti/iso/hvm-install.iso</filename>. |
769 | bf6fe28b | Alexander Schreiber | </para> |
770 | bf6fe28b | Alexander Schreiber | |
771 | bf6fe28b | Alexander Schreiber | <para> |
772 | 32ad0582 | Iustin Pop | You can also invoke the command with the |
773 | 32ad0582 | Iustin Pop | <option>--help</option> option in order to see all the |
774 | 32ad0582 | Iustin Pop | possibilities. |
775 | f1a808df | Guido Trotter | </para> |
776 | 32ad0582 | Iustin Pop | |
777 | f1a808df | Guido Trotter | </sect2> |
778 | f1a808df | Guido Trotter | |
779 | f1a808df | Guido Trotter | <sect2> |
780 | 32ad0582 | Iustin Pop | <title>Joining the nodes to the cluster</title> |
781 | f1a808df | Guido Trotter | |
782 | 5d6dd340 | Iustin Pop | <para> |
783 | 5d6dd340 | Iustin Pop | <emphasis role="strong">Mandatory:</emphasis> for all the |
784 | 5d6dd340 | Iustin Pop | other nodes. |
785 | f1a808df | Guido Trotter | </para> |
786 | f1a808df | Guido Trotter | |
787 | f1a808df | Guido Trotter | <para> |
788 | 0bac47cf | Iustin Pop | After you have initialized your cluster you need to join the |
789 | 0bac47cf | Iustin Pop | other nodes to it. You can do so by executing the following |
790 | 0bac47cf | Iustin Pop | command on the master node: |
791 | 32ad0582 | Iustin Pop | </para> |
792 | 5d6dd340 | Iustin Pop | <screen> |
793 | 5d6dd340 | Iustin Pop | gnt-node add <replaceable>NODENAME</replaceable> |
794 | 5d6dd340 | Iustin Pop | </screen> |
795 | 32ad0582 | Iustin Pop | </sect2> |
796 | f1a808df | Guido Trotter | |
797 | 32ad0582 | Iustin Pop | <sect2> |
798 | 32ad0582 | Iustin Pop | <title>Separate replication network</title> |
799 | 32ad0582 | Iustin Pop | |
800 | 32ad0582 | Iustin Pop | <para><emphasis role="strong">Optional</emphasis></para> |
801 | 32ad0582 | Iustin Pop | <para> |
802 | 32ad0582 | Iustin Pop | Ganeti uses DRBD to mirror the disk of the virtual instances |
803 | 32ad0582 | Iustin Pop | between nodes. To use a dedicated network interface for this |
804 | 32ad0582 | Iustin Pop | (in order to improve performance or to enhance security) you |
805 | 32ad0582 | Iustin Pop | need to configure an additional interface for each node. Use |
806 | 32ad0582 | Iustin Pop | the <option>-s</option> option with |
807 | 32ad0582 | Iustin Pop | <computeroutput>gnt-cluster init</computeroutput> and |
808 | 32ad0582 | Iustin Pop | <computeroutput>gnt-node add</computeroutput> to specify the |
809 | ac232de3 | Iustin Pop | IP address of this secondary interface to use for each |
810 | 32ad0582 | Iustin Pop | node. Note that if you specified this option at cluster setup |
811 | 32ad0582 | Iustin Pop | time, you must afterwards use it for every node add operation. |
812 | f1a808df | Guido Trotter | </para> |
813 | f1a808df | Guido Trotter | </sect2> |
814 | f1a808df | Guido Trotter | |
815 | 32ad0582 | Iustin Pop | <sect2> |
816 | 32ad0582 | Iustin Pop | <title>Testing the setup</title> |
817 | f1a808df | Guido Trotter | |
818 | 32ad0582 | Iustin Pop | <para> |
819 | 32ad0582 | Iustin Pop | Execute the <computeroutput>gnt-node list</computeroutput> |
820 | 32ad0582 | Iustin Pop | command to see all nodes in the cluster: |
821 | 32ad0582 | Iustin Pop | <screen> |
822 | 32ad0582 | Iustin Pop | # gnt-node list |
823 | 32ad0582 | Iustin Pop | Node DTotal DFree MTotal MNode MFree Pinst Sinst |
824 | 32ad0582 | Iustin Pop | node1.example.com 197404 197404 2047 1896 125 0 0 |
825 | 32ad0582 | Iustin Pop | </screen> |
826 | f1a808df | Guido Trotter | </para> |
827 | 32ad0582 | Iustin Pop | </sect2> |
828 | f1a808df | Guido Trotter | |
829 | 32ad0582 | Iustin Pop | <sect1> |
830 | 32ad0582 | Iustin Pop | <title>Setting up and managing virtual instances</title> |
831 | 32ad0582 | Iustin Pop | <sect2> |
832 | 32ad0582 | Iustin Pop | <title>Setting up virtual instances</title> |
833 | 32ad0582 | Iustin Pop | <para> |
834 | 32ad0582 | Iustin Pop | This step shows how to setup a virtual instance with either |
835 | 32ad0582 | Iustin Pop | non-mirrored disks (<computeroutput>plain</computeroutput>) or |
836 | 32ad0582 | Iustin Pop | with network mirrored disks |
837 | 6c4811dc | Iustin Pop | (<computeroutput>remote_raid1</computeroutput> for drbd 0.7 |
838 | 6c4811dc | Iustin Pop | and <computeroutput>drbd</computeroutput> for drbd 8.x). All |
839 | 6c4811dc | Iustin Pop | commands need to be executed on the Ganeti master node (the |
840 | 6c4811dc | Iustin Pop | one on which <computeroutput>gnt-cluster init</computeroutput> |
841 | 6c4811dc | Iustin Pop | was run). Verify that the OS scripts are present on all |
842 | 6c4811dc | Iustin Pop | cluster nodes with <computeroutput>gnt-os |
843 | 6c4811dc | Iustin Pop | list</computeroutput>. |
844 | 32ad0582 | Iustin Pop | </para> |
845 | 32ad0582 | Iustin Pop | <para> |
846 | 32ad0582 | Iustin Pop | To create a virtual instance, you need a hostname which is |
847 | 32ad0582 | Iustin Pop | resolvable (DNS or <filename>/etc/hosts</filename> on all |
848 | 32ad0582 | Iustin Pop | nodes). The following command will create a non-mirrored |
849 | 32ad0582 | Iustin Pop | instance for you: |
850 | 32ad0582 | Iustin Pop | </para> |
851 | 32ad0582 | Iustin Pop | <screen> |
852 | 32ad0582 | Iustin Pop | gnt-instance add --node=node1 -o debian-etch -t plain inst1.example.com |
853 | 32ad0582 | Iustin Pop | * creating instance disks... |
854 | 32ad0582 | Iustin Pop | adding instance inst1.example.com to cluster config |
855 | 32ad0582 | Iustin Pop | Waiting for instance inst1.example.com to sync disks. |
856 | 32ad0582 | Iustin Pop | Instance inst1.example.com's disks are in sync. |
857 | 32ad0582 | Iustin Pop | creating os for instance inst1.example.com on node node1.example.com |
858 | 32ad0582 | Iustin Pop | * running the instance OS create scripts... |
859 | 32ad0582 | Iustin Pop | </screen> |
860 | 32ad0582 | Iustin Pop | |
861 | 32ad0582 | Iustin Pop | <para> |
862 | 32ad0582 | Iustin Pop | The above instance will have no network interface enabled. |
863 | 32ad0582 | Iustin Pop | You can access it over the virtual console with |
864 | 32ad0582 | Iustin Pop | <computeroutput>gnt-instance console |
865 | 32ad0582 | Iustin Pop | <literal>inst1</literal></computeroutput>. There is no |
866 | 32ad0582 | Iustin Pop | password for root. As this is a Debian instance, you can |
867 | ac232de3 | Iustin Pop | modify the <filename>/etc/network/interfaces</filename> file |
868 | 32ad0582 | Iustin Pop | to setup the network interface (<literal>eth0</literal> is the |
869 | 32ad0582 | Iustin Pop | name of the interface provided to the instance). |
870 | 32ad0582 | Iustin Pop | </para> |
871 | f1a808df | Guido Trotter | |
872 | 32ad0582 | Iustin Pop | <para> |
873 | 32ad0582 | Iustin Pop | To create a network mirrored instance, change the argument to |
874 | 32ad0582 | Iustin Pop | the <option>-t</option> option from <literal>plain</literal> |
875 | 6c4811dc | Iustin Pop | to <literal>remote_raid1</literal> (drbd 0.7) or |
876 | 6c4811dc | Iustin Pop | <literal>drbd</literal> (drbd 8.0) and specify the node on |
877 | 4677a909 | Michael Hanselmann | which the mirror should reside with the second value of the |
878 | 4677a909 | Michael Hanselmann | <option>--node</option> option, like this: |
879 | 32ad0582 | Iustin Pop | </para> |
880 | 32ad0582 | Iustin Pop | |
881 | 32ad0582 | Iustin Pop | <screen> |
882 | 4677a909 | Michael Hanselmann | # gnt-instance add -t remote_raid1 -n node1:node2 -o debian-etch instance2 |
883 | 32ad0582 | Iustin Pop | * creating instance disks... |
884 | 32ad0582 | Iustin Pop | adding instance instance2 to cluster config |
885 | 32ad0582 | Iustin Pop | Waiting for instance instance1 to sync disks. |
886 | 32ad0582 | Iustin Pop | - device sdb: 3.50% done, 304 estimated seconds remaining |
887 | 32ad0582 | Iustin Pop | - device sdb: 21.70% done, 270 estimated seconds remaining |
888 | 32ad0582 | Iustin Pop | - device sdb: 39.80% done, 247 estimated seconds remaining |
889 | 32ad0582 | Iustin Pop | - device sdb: 58.10% done, 121 estimated seconds remaining |
890 | 32ad0582 | Iustin Pop | - device sdb: 76.30% done, 72 estimated seconds remaining |
891 | 32ad0582 | Iustin Pop | - device sdb: 94.80% done, 18 estimated seconds remaining |
892 | 32ad0582 | Iustin Pop | Instance instance2's disks are in sync. |
893 | 4677a909 | Michael Hanselmann | creating os for instance instance2 on node node1.example.com |
894 | 32ad0582 | Iustin Pop | * running the instance OS create scripts... |
895 | 32ad0582 | Iustin Pop | * starting instance... |
896 | 32ad0582 | Iustin Pop | </screen> |
897 | 32ad0582 | Iustin Pop | |
898 | 32ad0582 | Iustin Pop | </sect2> |
899 | 32ad0582 | Iustin Pop | |
900 | 32ad0582 | Iustin Pop | <sect2> |
901 | 32ad0582 | Iustin Pop | <title>Managing virtual instances</title> |
902 | 32ad0582 | Iustin Pop | <para> |
903 | 32ad0582 | Iustin Pop | All commands need to be executed on the Ganeti master node |
904 | 32ad0582 | Iustin Pop | </para> |
905 | 32ad0582 | Iustin Pop | |
906 | 32ad0582 | Iustin Pop | <para> |
907 | 32ad0582 | Iustin Pop | To access the console of an instance, use |
908 | 32ad0582 | Iustin Pop | <computeroutput>gnt-instance console |
909 | 32ad0582 | Iustin Pop | <replaceable>INSTANCENAME</replaceable></computeroutput>. |
910 | 32ad0582 | Iustin Pop | </para> |
911 | 32ad0582 | Iustin Pop | |
912 | 32ad0582 | Iustin Pop | <para> |
913 | 32ad0582 | Iustin Pop | To shutdown an instance, use <computeroutput>gnt-instance |
914 | 32ad0582 | Iustin Pop | shutdown |
915 | 32ad0582 | Iustin Pop | <replaceable>INSTANCENAME</replaceable></computeroutput>. To |
916 | 32ad0582 | Iustin Pop | startup an instance, use <computeroutput>gnt-instance startup |
917 | 32ad0582 | Iustin Pop | <replaceable>INSTANCENAME</replaceable></computeroutput>. |
918 | 32ad0582 | Iustin Pop | </para> |
919 | 32ad0582 | Iustin Pop | |
920 | 32ad0582 | Iustin Pop | <para> |
921 | 32ad0582 | Iustin Pop | To failover an instance to its secondary node (only possible |
922 | 6c4811dc | Iustin Pop | in <literal>remote_raid1</literal> or <literal>drbd</literal> |
923 | 6c4811dc | Iustin Pop | disk templates), use <computeroutput>gnt-instance failover |
924 | 32ad0582 | Iustin Pop | <replaceable>INSTANCENAME</replaceable></computeroutput>. |
925 | 32ad0582 | Iustin Pop | </para> |
926 | 32ad0582 | Iustin Pop | |
927 | 32ad0582 | Iustin Pop | <para> |
928 | 32ad0582 | Iustin Pop | For more instance and cluster administration details, see the |
929 | 32ad0582 | Iustin Pop | <emphasis>Ganeti administrator's guide</emphasis>. |
930 | 32ad0582 | Iustin Pop | </para> |
931 | 32ad0582 | Iustin Pop | |
932 | 32ad0582 | Iustin Pop | </sect2> |
933 | 32ad0582 | Iustin Pop | |
934 | 32ad0582 | Iustin Pop | </sect1> |
935 | f1a808df | Guido Trotter | |
936 | f1a808df | Guido Trotter | </article> |