Statistics
| Branch: | Tag: | Revision:

root / NEWS @ 42c067b7

History | View | Annotate | Download (15.2 kB)

1 550a995a Iustin Pop
Version 2.0.2
2 550a995a Iustin Pop
  - Added experimental support for stripped logical volumes; this should
3 550a995a Iustin Pop
    enhance performance but comes with a higher complexity in the block
4 550a995a Iustin Pop
    device handling; stripping is only enabled when passing
5 550a995a Iustin Pop
    --with-lvm-stripecount=N to configure, but codepaths are affected
6 550a995a Iustin Pop
    even in the non-stripped mode
7 550a995a Iustin Pop
  - Improved resiliency against transient failures at the end of DRBD
8 550a995a Iustin Pop
    resyncs, and in general of DRBD resync checks
9 550a995a Iustin Pop
  - Fixed a couple of issues with exports and snapshot errors
10 550a995a Iustin Pop
  - Fixed a couple of issues in instance listing
11 550a995a Iustin Pop
  - Added display of the disk size in “gnt-instance info”
12 550a995a Iustin Pop
  - Fixed checking for valid OSes in instance creation
13 550a995a Iustin Pop
  - Fixed handling of the ‘vcpus’ parameter in instance listing and in
14 550a995a Iustin Pop
    general of invalid parameters
15 550a995a Iustin Pop
  - Fixed http server library, and thus RAPI, to handle invalid
16 550a995a Iustin Pop
    username/password combinations correctly; this means that now they
17 550a995a Iustin Pop
    report unauthorized for queries too, not only for modifications,
18 550a995a Iustin Pop
    allowing earlier detect of configuration problems
19 550a995a Iustin Pop
  - Added a new ‘role’ node list field, equivalent to the master/master
20 550a995a Iustin Pop
    candidate/drained/offline flags combinations
21 550a995a Iustin Pop
  - Fixed cluster modify and changes of candidate pool size
22 550a995a Iustin Pop
  - Fixed cluster verify error messages for wrong files on regular nodes
23 550a995a Iustin Pop
  - Fixed a couple of issues with node demotion from master candidate
24 550a995a Iustin Pop
    role
25 550a995a Iustin Pop
  - Fixed node readd issues
26 550a995a Iustin Pop
  - Added non-interactive mode for “ganeti-masterd --no-voting” startup
27 550a995a Iustin Pop
  - Added a new ‘--no-voting’ option for masterfailover to fix failover
28 550a995a Iustin Pop
    on two-nodes clusters when the former master node is unreachable
29 550a995a Iustin Pop
  - Added instance reinstall over RAPI
30 550a995a Iustin Pop
31 0dea942c Iustin Pop
Version 2.0.1
32 0dea942c Iustin Pop
  - added -H/-B startup parameters to gnt-instance, which will allow
33 0dea942c Iustin Pop
    re-adding the start in single-user option (regression from 1.2)
34 0dea942c Iustin Pop
  - the watcher writes the instance status to a file, to allow
35 0dea942c Iustin Pop
    monitoring to report the instance status (from the master) based on
36 0dea942c Iustin Pop
    cached results of the watcher's queries; while this can get stale if
37 0dea942c Iustin Pop
    the watcher is being locked due to other work on the cluster, this
38 0dea942c Iustin Pop
    is still an improvement
39 0dea942c Iustin Pop
  - the watcher now also restarts the node daemon and the rapi daemon if
40 0dea942c Iustin Pop
    they died
41 0dea942c Iustin Pop
  - fixed the watcher to handle full and drained queue cases
42 0dea942c Iustin Pop
  - hooks export more instance data in the environment, which helps if
43 0dea942c Iustin Pop
    hook scripts need to take action based on the instance's properties
44 0dea942c Iustin Pop
    (no longer need to query back into ganeti)
45 0dea942c Iustin Pop
  - instance failovers when the instance is stopped do not check for
46 0dea942c Iustin Pop
    free RAM, so that failing over a stopped instance is possible in low
47 0dea942c Iustin Pop
    memory situations
48 0dea942c Iustin Pop
  - rapi uses queries for tags instead of jobs (for less job traffic),
49 0dea942c Iustin Pop
    and for cluster tags it won't talk to masterd at all but read them
50 0dea942c Iustin Pop
    from ssconf
51 0dea942c Iustin Pop
  - a couple of error handling fixes in RAPI
52 0dea942c Iustin Pop
  - drbd handling: improved the error handling of inconsistent disks
53 0dea942c Iustin Pop
    after resync to reduce the frequency of "there are some degraded
54 0dea942c Iustin Pop
    disks for this instance" message
55 0dea942c Iustin Pop
  - fixed a bug in live migration when DRBD doesn't want to reconnect
56 0dea942c Iustin Pop
    (the error handling path called a wrong function name)
57 0dea942c Iustin Pop
58 7a8994d4 Iustin Pop
Version 2.0.0 final
59 7a8994d4 Iustin Pop
  - no changes from rc5
60 7a8994d4 Iustin Pop
61 b926bd98 Iustin Pop
Version 2.0 release candidate 5
62 b926bd98 Iustin Pop
  - fix a couple of bugs (validation, argument checks)
63 b926bd98 Iustin Pop
  - fix gnt-cluster getmaster on non-master nodes (regression)
64 b926bd98 Iustin Pop
  - some small improvements to RAPI and IAllocator
65 b926bd98 Iustin Pop
  - make watcher automatically start the master daemon if down
66 b926bd98 Iustin Pop
67 d1908b41 Iustin Pop
Version 2.0 release candidate 4
68 d1908b41 Iustin Pop
  - change the OS list to not require locks; this helps with big
69 d1908b41 Iustin Pop
    clusters
70 d1908b41 Iustin Pop
  - fix gnt-cluster verify and gnt-cluster verify-disks when the volume
71 d1908b41 Iustin Pop
    group is broken
72 d1908b41 Iustin Pop
  - “gnt-instance info”, without any arguments, doesn't run for all
73 d1908b41 Iustin Pop
    instances anymore; either pass ‘--all’ or pass the desired
74 d1908b41 Iustin Pop
    instances; this helps against mistakes on big clusters where listing
75 d1908b41 Iustin Pop
    the information for all instances takes a long time
76 d1908b41 Iustin Pop
  - miscellaneous doc and man pages fixes
77 d1908b41 Iustin Pop
78 5bbefdec Iustin Pop
Version 2.0 release candidate 3
79 5bbefdec Iustin Pop
  - Change the internal locking model of some gnt-node commands, in
80 5bbefdec Iustin Pop
    order to reduce contention (and blocking of master daemon) when
81 5bbefdec Iustin Pop
    batching many creation/reinstall jobs
82 5bbefdec Iustin Pop
  - Fixes to Xen soft reboot
83 5bbefdec Iustin Pop
  - No longer build documentation at 'make' time, instead distribute it
84 5bbefdec Iustin Pop
    in the archive, in order to reduce the need for the whole
85 5bbefdec Iustin Pop
    docbook/rst toolchains
86 5bbefdec Iustin Pop
87 f06d91f2 Iustin Pop
Version 2.0 release candidate 2
88 f06d91f2 Iustin Pop
  - Now the cfgupgrade scripts works and can upgrade 1.2.7 clusters to
89 f06d91f2 Iustin Pop
    2.0
90 f06d91f2 Iustin Pop
  - Fix watcher startup sequence, improves the behaviour of busy
91 f06d91f2 Iustin Pop
    clusters
92 f06d91f2 Iustin Pop
  - Some other fixes in cluster verify, replace-disks, gnt-instance add,
93 f06d91f2 Iustin Pop
    gnt-cluster queue, KVM VNC bind address and other places
94 f06d91f2 Iustin Pop
  - Some documentation fixes and updates
95 f06d91f2 Iustin Pop
96 a2370b24 Iustin Pop
Version 2.0 release candidate 1
97 a2370b24 Iustin Pop
  - More documentation updates, now all docs should be more-or-less
98 a2370b24 Iustin Pop
    up-to-date
99 a2370b24 Iustin Pop
  - A couple of small fixes (mixed hypervisor clusters, offline nodes,
100 a2370b24 Iustin Pop
    etc.)
101 a2370b24 Iustin Pop
  - Added a customizable HV_KERNEL_ARGS hypervisor parameter (for Xen
102 a2370b24 Iustin Pop
    PVM and KVM)
103 a2370b24 Iustin Pop
  - Fix an issue related to $libdir/run/ganeti and cluster creation
104 a2370b24 Iustin Pop
105 2fb85b64 Iustin Pop
Version 2.0 beta 2
106 2fb85b64 Iustin Pop
  - Xen PVM and KVM have switched the default value for the instance
107 2fb85b64 Iustin Pop
    root disk to the first partition on the first drive, instead of the
108 2fb85b64 Iustin Pop
    whole drive; this means that the OS installation scripts must be
109 2fb85b64 Iustin Pop
    changed accordingly
110 2fb85b64 Iustin Pop
  - Man pages have been updated
111 2fb85b64 Iustin Pop
  - RAPI has been switched by default to HTTPS, and the exported
112 2fb85b64 Iustin Pop
    functions should all work correctly
113 2fb85b64 Iustin Pop
  - RAPI v1 has been removed
114 2fb85b64 Iustin Pop
  - Many improvements to the KVM hypervisor
115 2fb85b64 Iustin Pop
  - Block device errors are now better reported
116 2fb85b64 Iustin Pop
  - Many other bugfixes and small improvements
117 2fb85b64 Iustin Pop
118 10f31783 Iustin Pop
Version 2.0 beta 1
119 10f31783 Iustin Pop
  - Version 2 is a general rewrite of the code and therefore the
120 10f31783 Iustin Pop
    differences are too many to list, see the design document for 2.0 in
121 10f31783 Iustin Pop
    the doc/ subdirectory for more details
122 10f31783 Iustin Pop
  - In this beta version there is not yet a migration path from 1.2
123 10f31783 Iustin Pop
    (there will be one in the final 2.0 release)
124 10f31783 Iustin Pop
  - A few significant changes are:
125 10f31783 Iustin Pop
    - all commands are executed by a daemon (ganeti-masterd) and the
126 10f31783 Iustin Pop
      various gnt-* commands are just front-ends to it
127 10f31783 Iustin Pop
    - all the commands are entered into, and executed from a job queue,
128 10f31783 Iustin Pop
      see gnt-job(8)
129 10f31783 Iustin Pop
    - the RAPI daemon supports read-write operations, secured by basic
130 10f31783 Iustin Pop
      HTTP authentication on top of HTTPS
131 10f31783 Iustin Pop
    - DRBD version 0.7 support has been removed, DRBD 8 is the only
132 10f31783 Iustin Pop
      supported version (when migrating from Ganeti 1.2 to 2.0, you need
133 10f31783 Iustin Pop
      to migrate to DRBD 8 first while still running Ganeti 1.2)
134 10f31783 Iustin Pop
    - DRBD devices are using statically allocated minor numbers, which
135 10f31783 Iustin Pop
      will be assigned to existing instances during the migration
136 10f31783 Iustin Pop
      process
137 10f31783 Iustin Pop
    - there is support for both Xen PVM and Xen HVM instances running on
138 10f31783 Iustin Pop
      the same cluster
139 10f31783 Iustin Pop
    - KVM virtualization is supported too
140 10f31783 Iustin Pop
    - file-based storage has been implemented, which means that it is
141 10f31783 Iustin Pop
      possible to run the cluster without LVM and DRBD storage, for
142 10f31783 Iustin Pop
      example using a shared filesystem exported from shared storage
143 10f31783 Iustin Pop
      (and still have live migration)
144 10f31783 Iustin Pop
145 10f31783 Iustin Pop
Version 1.2.7
146 10f31783 Iustin Pop
  - Change the default reboot type in gnt-instance reboot to "hard"
147 10f31783 Iustin Pop
  - Reuse the old instance mac address by default on instance import,
148 10f31783 Iustin Pop
    if the instance name is the same.
149 10f31783 Iustin Pop
  - Handle situations in which the node info rpc returns incomplete results
150 10f31783 Iustin Pop
    (issue 46)
151 10f31783 Iustin Pop
  - Add checks for tcp/udp ports collisions in gnt-cluster verify
152 10f31783 Iustin Pop
  - Improved version of batcher:
153 10f31783 Iustin Pop
    - state file support
154 10f31783 Iustin Pop
    - instance mac address support
155 10f31783 Iustin Pop
    - support for HVM clusters/instances
156 10f31783 Iustin Pop
  - Add an option to show the number of cpu sockets and nodes in gnt-node list
157 10f31783 Iustin Pop
  - Support OSes that handle more than one version of the OS api
158 10f31783 Iustin Pop
    (but do not change the current API in any other way)
159 10f31783 Iustin Pop
  - Fix gnt-node migrate
160 10f31783 Iustin Pop
  - gnt-debug man page
161 10f31783 Iustin Pop
  - Fixes various more typos&small issues
162 10f31783 Iustin Pop
  - Increase disk resync maximum speed to 60MB/s (from 30MB/s)
163 10f31783 Iustin Pop
164 10f31783 Iustin Pop
Version 1.2.6
165 10f31783 Iustin Pop
  - new --hvm-nic-type and --hvm-disk-type flags to control the type of disk
166 10f31783 Iustin Pop
    exported to fully virtualized instances.
167 10f31783 Iustin Pop
  - provide access to the serial console of HVM instances
168 10f31783 Iustin Pop
  - instance auto_balance flag, set by default. If turned off it will avoid
169 10f31783 Iustin Pop
    warnings on cluster verify if there is not enough memory to fail over an
170 10f31783 Iustin Pop
    instance. in the future it will prevent automatically failing it over when
171 10f31783 Iustin Pop
    we will support that.
172 10f31783 Iustin Pop
  - batcher tool for instance creation, see /tools/README.batcher
173 10f31783 Iustin Pop
  - gnt-instance reinstall --select-os to interactively select a new operating
174 10f31783 Iustin Pop
    system when reinstalling an instance.
175 10f31783 Iustin Pop
  - when changing the memory amount on instance modify a check has been added
176 10f31783 Iustin Pop
    that the instance will be able to start. also warnings are emitted if the
177 10f31783 Iustin Pop
    instance will not be able to fail over, if auto_balance is true.
178 10f31783 Iustin Pop
  - documentation fixes
179 10f31783 Iustin Pop
  - sync fields between instance list/modify/add/import
180 10f31783 Iustin Pop
  - fix a race condition in drbd when the sync speed was set after giving the
181 10f31783 Iustin Pop
    device a remote peer.
182 10f31783 Iustin Pop
183 10f31783 Iustin Pop
Version 1.2.5
184 10f31783 Iustin Pop
  - note: the allowed size and number of tags per object were reduced
185 10f31783 Iustin Pop
  - fix a bug in “gnt-cluster verify” with inconsistent volume groups
186 10f31783 Iustin Pop
  - fixed twisted 8.x compatibility
187 10f31783 Iustin Pop
  - fixed gnt-instance replace-disks with iallocator
188 10f31783 Iustin Pop
  - add TCP keepalives on twisted connections to detect restarted nodes
189 10f31783 Iustin Pop
  - disk increase support, see “gnt-instance grow-disk”
190 10f31783 Iustin Pop
  - implement bulk node/instance query for RAPI
191 10f31783 Iustin Pop
  - add tags in node/instance listing (optional)
192 10f31783 Iustin Pop
  - experimental migration (and live migration) support, read the man
193 10f31783 Iustin Pop
    page for “gnt-instance migrate”
194 10f31783 Iustin Pop
  - the ganeti-watcher logs are now timestamped, and the watcher also
195 10f31783 Iustin Pop
    has some small improvements in handling its state file
196 10f31783 Iustin Pop
197 10f31783 Iustin Pop
Version 1.2.4
198 10f31783 Iustin Pop
  - Experimental readonly, REST-based remote API implementation; automatically
199 10f31783 Iustin Pop
    started on master node, TCP port 5080, if enabled by --enable-rapi
200 10f31783 Iustin Pop
    parameter to configure script.
201 10f31783 Iustin Pop
  - Instance allocator support. Add and import instance accept a --iallocator
202 10f31783 Iustin Pop
    parameter, and call that instance allocator to decide which node to use for
203 10f31783 Iustin Pop
    the instance. The iallocator document describes what's expected from an
204 10f31783 Iustin Pop
    allocator script.
205 10f31783 Iustin Pop
  - gnt-cluster verify N+1 memory redundancy checks: Unless passed the
206 10f31783 Iustin Pop
    --no-nplus1-mem option gnt-cluster verify now checks that if a node is lost
207 10f31783 Iustin Pop
    there is still enough memory to fail over the instances that reside on it.
208 10f31783 Iustin Pop
  - gnt-cluster verify hooks: it is now possible to add post-hooks to
209 10f31783 Iustin Pop
    gnt-cluster verify, to check for site-specific compliance. All the hooks
210 10f31783 Iustin Pop
    will run, and their output, if any, will be displayed. Any failing hook
211 10f31783 Iustin Pop
    will make the verification return an error value.
212 10f31783 Iustin Pop
  - gnt-cluster verify now checks that its peers are reachable on the primary
213 10f31783 Iustin Pop
    and secondary interfaces
214 10f31783 Iustin Pop
  - gnt-node add now supports the --readd option, to readd a node that is still
215 10f31783 Iustin Pop
    declared as part of the cluster and has failed.
216 10f31783 Iustin Pop
  - gnt-* list commands now accept a new -o +field way of specifying output
217 10f31783 Iustin Pop
    fields, that just adds the chosen fields to the default ones.
218 10f31783 Iustin Pop
  - gnt-backup now has a new "remove" command to delete an existing export from
219 10f31783 Iustin Pop
    the filesystem.
220 10f31783 Iustin Pop
  - New per-instance parameters hvm_acpi, hvm_pae and hvm_cdrom_image_path have
221 10f31783 Iustin Pop
    been added. Using them you can enable/disable acpi and pae support, and
222 10f31783 Iustin Pop
    specify a path for a cd image to be exported to the instance. These
223 10f31783 Iustin Pop
    parameters as the name suggest only work on HVM clusters.
224 10f31783 Iustin Pop
  - When upgrading an HVM cluster to Ganeti 1.2.4, the values for ACPI and PAE
225 10f31783 Iustin Pop
    support will be set to the previously hardcoded values, but the (previously
226 10f31783 Iustin Pop
    hardcoded) path to the CDROM ISO image will be unset and if required, needs
227 10f31783 Iustin Pop
    to be set manually with gnt-instance modify after the upgrade..
228 10f31783 Iustin Pop
  - The address to which an instance's VNC console is bound is now selectable
229 10f31783 Iustin Pop
    per-instance, rather than being cluster wide. Of course this only applies
230 10f31783 Iustin Pop
    to instances controlled via VNC, so currently just applies to HVM clusters.
231 10f31783 Iustin Pop
232 bae27f68 Iustin Pop
Version 1.2.3
233 bae27f68 Iustin Pop
  - more tweaks to the disk activation code (especially helpful for DRBD)
234 bae27f68 Iustin Pop
  - change the default ‘gnt-instance list’ output format, now there is
235 bae27f68 Iustin Pop
    one combined status field (see the manpage for the exact values this
236 bae27f68 Iustin Pop
    field will have)
237 bae27f68 Iustin Pop
  - some more fixes for the mac export to hooks change
238 bae27f68 Iustin Pop
  - make Ganeti not break with DRBD 8.2.x (which changed the version
239 bae27f68 Iustin Pop
    format in /proc/drbd) (issue 24)
240 bae27f68 Iustin Pop
  - add an upgrade tool from ‘remote_raid1’ disk template to ‘drbd’ disk
241 bae27f68 Iustin Pop
    template, allowing migration from DRBD0.7+MD to DRBD8
242 bae27f68 Iustin Pop
243 e709baee Iustin Pop
Version 1.2.2
244 e709baee Iustin Pop
  - fix ‘gnt-instance modify’ breakage introduced in 1.2.1 with the HVM
245 e709baee Iustin Pop
    support (issue 23)
246 e709baee Iustin Pop
  - add command aliases infrastructure and a few aliases
247 e709baee Iustin Pop
  - allow listing of VCPUs in the gnt-instance list and improve the man
248 e709baee Iustin Pop
    pages and the --help option of gnt-node/gnt-instance list
249 e709baee Iustin Pop
  - fix gnt-backup list with down nodes (issue 21)
250 e709baee Iustin Pop
  - change the tools location (move from $pkgdatadir to
251 e709baee Iustin Pop
    $pkglibdir/tools)
252 e709baee Iustin Pop
  - fix the dist archive and add a check for including svn/git files in
253 e709baee Iustin Pop
    the future
254 e709baee Iustin Pop
  - some developer-related changes: improve the burnin and the QA
255 e709baee Iustin Pop
    suite, add an upload script for testing during development
256 e709baee Iustin Pop
257 31b9055c Iustin Pop
Version 1.2.1
258 b6f2e47f Iustin Pop
  - experimental HVM support, read the install document, section
259 31b9055c Iustin Pop
    "Initializing the cluster"
260 31b9055c Iustin Pop
  - allow for the PVM hypervisor per-instance kernel and initrd paths
261 31b9055c Iustin Pop
  - add a new command ‘gnt-cluster verify-disks’ which uses a new
262 31b9055c Iustin Pop
    algorithm to improve the reconnection of the DRBD pairs if the
263 31b9055c Iustin Pop
    device on the secondary node has gone away
264 31b9055c Iustin Pop
  - make logical volume code auto-activate LVs at disk activation time
265 31b9055c Iustin Pop
  - slightly improve the speed of activating disks
266 31b9055c Iustin Pop
  - allow specification of the MAC address at instance creation time,
267 31b9055c Iustin Pop
    and changing it later via ‘gnt-instance modify’
268 31b9055c Iustin Pop
  - fix handling of external commands that generate lots of output on
269 31b9055c Iustin Pop
    stderr
270 31b9055c Iustin Pop
  - update documentation with regard to minimum version of DRBD8
271 31b9055c Iustin Pop
    supported
272 31b9055c Iustin Pop
273 ce628bb4 Iustin Pop
Version 1.2.0
274 ce628bb4 Iustin Pop
  - Log the ‘xm create’ output to the node daemon log on failure (to
275 ce628bb4 Iustin Pop
    help diagnosing the error)
276 ce628bb4 Iustin Pop
  - In debug mode, log all external commands output if failed to the
277 ce628bb4 Iustin Pop
    logs
278 ce628bb4 Iustin Pop
  - Change parsing of lvm commands to ignore stderr
279 ce628bb4 Iustin Pop
280 3d492b09 Iustin Pop
Version 1.2b3
281 3d492b09 Iustin Pop
  - Another round of updates to the DRBD 8 code to deal with more
282 3d492b09 Iustin Pop
    failures in the replace secondary node operation
283 3d492b09 Iustin Pop
  - Some more logging of failures in disk operations (lvm, drbd)
284 3d492b09 Iustin Pop
  - A few documentation updates
285 3d492b09 Iustin Pop
  - QA updates
286 3d492b09 Iustin Pop
287 6c4811dc Iustin Pop
Version 1.2b2
288 6c4811dc Iustin Pop
  - Change configuration file format from Python's Pickle to JSON.
289 97a37b3f Michael Hanselmann
    Upgrading is possible using the cfgupgrade utility.
290 6c4811dc Iustin Pop
  - Add support for DRBD 8.0 (new disk template `drbd`) which allows for
291 6c4811dc Iustin Pop
    faster replace disks and is more stable (DRBD 8 has many
292 6c4811dc Iustin Pop
    improvements compared to DRBD 0.7)
293 6c4811dc Iustin Pop
  - Added command line tags support (see man pages for gnt-instance,
294 6c4811dc Iustin Pop
    gnt-node, gnt-cluster)
295 6c4811dc Iustin Pop
  - Added instance rename support
296 6c4811dc Iustin Pop
  - Added multi-instance startup/shutdown
297 6c4811dc Iustin Pop
  - Added cluster rename support
298 6c4811dc Iustin Pop
  - Added `gnt-node evacuate` to simplify some node operations
299 6c4811dc Iustin Pop
  - Added instance reboot operation that can speedup reboot as compared
300 6c4811dc Iustin Pop
    to stop and start
301 6c4811dc Iustin Pop
  - Soften the requirement that hostnames are in FQDN format
302 6c4811dc Iustin Pop
  - The ganeti-watcher now activates drbd pairs after secondary node
303 6c4811dc Iustin Pop
    reboots
304 6c4811dc Iustin Pop
  - Removed dependency on debian's patched fping that uses the
305 6c4811dc Iustin Pop
    non-standard -S option
306 6c4811dc Iustin Pop
  - Now the OS definitions are searched for in multiple, configurable
307 6c4811dc Iustin Pop
    paths (easier for distros to package)
308 6c4811dc Iustin Pop
  - Some changes to the hooks infrastructure (especially the new
309 6c4811dc Iustin Pop
    post-configuration update hook)
310 6c4811dc Iustin Pop
  - Other small bugfixes