archipelago
10 years agoUpdate package dependencies debian-develop
Filippos Giannakos [Mon, 24 Feb 2014 14:25:57 +0000 (16:25 +0200)]
Update package dependencies

10 years agoMerge branch 'develop' into debian-develop
Filippos Giannakos [Mon, 24 Feb 2014 13:00:45 +0000 (15:00 +0200)]
Merge branch 'develop' into debian-develop

10 years agoMerge branch 'debian-feature-stripxseg' into debian-develop
Filippos Giannakos [Mon, 24 Feb 2014 13:00:38 +0000 (15:00 +0200)]
Merge branch 'debian-feature-stripxseg' into debian-develop

10 years agoMerge branch 'feature-stripxseg' into develop
Filippos Giannakos [Mon, 24 Feb 2014 13:00:25 +0000 (15:00 +0200)]
Merge branch 'feature-stripxseg' into develop

10 years agoarchipelago: Pause/Unpause tapdisk on user restart feature-stripxseg
Chrysostomos Nanakos [Fri, 21 Feb 2014 11:46:39 +0000 (13:46 +0200)]
archipelago: Pause/Unpause tapdisk on user restart

When archipelago is invoked with '-u' argument tapdisk is paused or unpaused
accordingly. On stop all tapdisk processes, if any, are paused, peer's are
stopped and the shared memory segment is destroyed.
On start the shared memory segment is created, all peer's are started and
finally all tapdisk processes, if any, are unpaused.

10 years agoblktap: Fix type in unpause static method
Chrysostomos Nanakos [Fri, 21 Feb 2014 11:27:32 +0000 (13:27 +0200)]
blktap: Fix type in unpause static method

Add new is_paused() static method for checking the block device state.

10 years agoarchipelago: Do not unload blktap module on stop
Chrysostomos Nanakos [Thu, 20 Feb 2014 14:39:54 +0000 (16:39 +0200)]
archipelago: Do not unload blktap module on stop

10 years agoarchipelago: Change DEVICE_PREFIX for blktap
Chrysostomos Nanakos [Thu, 20 Feb 2014 14:16:42 +0000 (16:16 +0200)]
archipelago: Change DEVICE_PREFIX for blktap

Return minor number when creating new volume.

10 years agoarchipelago: Remove segdev support
Chrysostomos Nanakos [Thu, 20 Feb 2014 11:18:34 +0000 (13:18 +0200)]
archipelago: Remove segdev support

10 years agoarchipelago: Destroy shared memory segment on termination
Chrysostomos Nanakos [Thu, 20 Feb 2014 10:38:09 +0000 (12:38 +0200)]
archipelago: Destroy shared memory segment on termination

Unload blktap module after peers termination. Fix status respect
new blktap changes.

10 years agoarchipelago: pep8 fixes
Chrysostomos Nanakos [Wed, 19 Feb 2014 13:59:16 +0000 (15:59 +0200)]
archipelago: pep8 fixes

10 years agoarchipelago: Add blktap support
Chrysostomos Nanakos [Wed, 19 Feb 2014 13:54:57 +0000 (15:54 +0200)]
archipelago: Add blktap support

10 years agoRemove xsegbd support. Add blktap support
Chrysostomos Nanakos [Wed, 19 Feb 2014 13:46:47 +0000 (15:46 +0200)]
Remove xsegbd support. Add blktap support

Remove completely xsegbd support from vlmc commands and add blktap block
device support concerning map, unmap and showmapped subcommands.

10 years agoArchipelago: Change sosd to radosd in python
Filippos Giannakos [Tue, 18 Feb 2014 15:05:24 +0000 (17:05 +0200)]
Archipelago: Change sosd to radosd in python

10 years agoganeti-hooks: Fix permissions on install
Filippos Giannakos [Tue, 18 Feb 2014 09:34:29 +0000 (11:34 +0200)]
ganeti-hooks: Fix permissions on install

10 years agopython: Import version correctly
Filippos Giannakos [Mon, 17 Feb 2014 16:32:59 +0000 (18:32 +0200)]
python: Import version correctly

10 years agopython: Fix package directory
Filippos Giannakos [Mon, 17 Feb 2014 16:13:17 +0000 (18:13 +0200)]
python: Fix package directory

10 years agoci: Install libxseg0-dbg
Filippos Giannakos [Mon, 17 Feb 2014 15:49:30 +0000 (17:49 +0200)]
ci: Install libxseg0-dbg

10 years agoci: Add unstable branch to dev-grnet.list
Filippos Giannakos [Mon, 17 Feb 2014 15:32:47 +0000 (17:32 +0200)]
ci: Add unstable branch to dev-grnet.list

10 years agoci: Fix typo in dev-grnet.list
Filippos Giannakos [Mon, 17 Feb 2014 15:20:56 +0000 (17:20 +0200)]
ci: Fix typo in dev-grnet.list

10 years agoci: Add dev-grnet repo to test vm
Filippos Giannakos [Mon, 17 Feb 2014 15:12:53 +0000 (17:12 +0200)]
ci: Add dev-grnet repo to test vm

10 years agoci: Remove xseg packages
Filippos Giannakos [Mon, 17 Feb 2014 14:16:40 +0000 (16:16 +0200)]
ci: Remove xseg packages

10 years agoci: Fix tests path
Filippos Giannakos [Mon, 17 Feb 2014 14:04:03 +0000 (16:04 +0200)]
ci: Fix tests path

10 years agoFix typo in control file debian-feature-stripxseg
Filippos Giannakos [Mon, 17 Feb 2014 13:57:27 +0000 (15:57 +0200)]
Fix typo in control file

10 years agoFix typo in dependencies
Filippos Giannakos [Mon, 17 Feb 2014 13:51:48 +0000 (15:51 +0200)]
Fix typo in dependencies

10 years agoModify libxseg dependencies
Filippos Giannakos [Mon, 17 Feb 2014 13:43:24 +0000 (15:43 +0200)]
Modify libxseg dependencies

10 years agoci: Remove full archipelago tests
Filippos Giannakos [Mon, 17 Feb 2014 13:20:21 +0000 (15:20 +0200)]
ci: Remove full archipelago tests

10 years agoModify debian dir to new layout
Filippos Giannakos [Mon, 17 Feb 2014 10:39:52 +0000 (12:39 +0200)]
Modify debian dir to new layout

10 years agoCreate extstorage log directory
Filippos Giannakos [Mon, 17 Feb 2014 11:02:30 +0000 (13:02 +0200)]
Create extstorage log directory

10 years agoInstall archipelago executables
Filippos Giannakos [Mon, 17 Feb 2014 11:00:00 +0000 (13:00 +0200)]
Install archipelago executables

10 years agoFix python install
Filippos Giannakos [Mon, 17 Feb 2014 10:51:40 +0000 (12:51 +0200)]
Fix python install

10 years agoAdd cmake files
Filippos Giannakos [Mon, 17 Feb 2014 10:44:21 +0000 (12:44 +0200)]
Add cmake files

10 years agoremove me
Filippos Giannakos [Mon, 17 Feb 2014 10:41:29 +0000 (12:41 +0200)]
remove me

10 years agoRemove libxseg and rearrange code
Filippos Giannakos [Mon, 17 Feb 2014 10:30:04 +0000 (12:30 +0200)]
Remove libxseg and rearrange code

10 years agoMove xseg dir to src
Filippos Giannakos [Fri, 14 Feb 2014 15:37:49 +0000 (17:37 +0200)]
Move xseg dir to src

10 years agoStrip xseg stuff
Filippos Giannakos [Fri, 14 Feb 2014 15:37:29 +0000 (17:37 +0200)]
Strip xseg stuff

10 years agoBump version to 0.3.5next
Filippos Giannakos [Fri, 14 Feb 2014 14:42:12 +0000 (16:42 +0200)]
Bump version to 0.3.5next

10 years agovlmc tool: Disable broken mapinfo and list commands
Filippos Giannakos [Mon, 3 Feb 2014 14:33:09 +0000 (16:33 +0200)]
vlmc tool: Disable broken mapinfo and list commands

10 years agoFix wrong dependency version
Filippos Giannakos [Thu, 30 Jan 2014 13:49:40 +0000 (15:49 +0200)]
Fix wrong dependency version

10 years agoChange modules depend version to binary version
Filippos Giannakos [Thu, 30 Jan 2014 13:39:37 +0000 (15:39 +0200)]
Change modules depend version to binary version

10 years agoBuild: Add conf directory to install-src
Filippos Giannakos [Thu, 30 Jan 2014 11:46:12 +0000 (13:46 +0200)]
Build: Add conf directory to install-src

10 years agotests: Remove bin dir overwriting
Filippos Giannakos [Tue, 28 Jan 2014 15:59:34 +0000 (17:59 +0200)]
tests: Remove bin dir overwriting

10 years agoMerge branch 'debian-feature-new-configfile-rebased' into debian-develop
Filippos Giannakos [Tue, 28 Jan 2014 15:11:31 +0000 (17:11 +0200)]
Merge branch 'debian-feature-new-configfile-rebased' into debian-develop

10 years agoMerge branch 'feature-mapperimprovements-rebased' into develop
Filippos Giannakos [Tue, 28 Jan 2014 15:03:43 +0000 (17:03 +0200)]
Merge branch 'feature-mapperimprovements-rebased' into develop

10 years agomapper: Close map, opened by current req on snapshot
Filippos Giannakos [Fri, 20 Dec 2013 11:06:22 +0000 (13:06 +0200)]
mapper: Close map, opened by current req on snapshot

10 years agomapper: Keep track which request opened a map
Filippos Giannakos [Fri, 20 Dec 2013 11:05:55 +0000 (13:05 +0200)]
mapper: Keep track which request opened a map

10 years agomapper: Add counter for accepted requests
Filippos Giannakos [Fri, 20 Dec 2013 11:04:50 +0000 (13:04 +0200)]
mapper: Add counter for accepted requests

Trach each accepted request with a monotonically increased counter.

10 years agomapper: Check create_map return during snapshot
Filippos Giannakos [Fri, 20 Dec 2013 11:01:50 +0000 (13:01 +0200)]
mapper: Check create_map return during snapshot

10 years agomapper: Do not drop cache on close explicitly.
Filippos Giannakos [Fri, 20 Dec 2013 10:59:54 +0000 (12:59 +0200)]
mapper: Do not drop cache on close explicitly.

Do not drop on cache on close operation explicitly. Instead, when closing a map,
wait all pending I/O operations and then close map. If this succceeds, the map
is marked as non-Exclusive. The map action codepath will always drop the cache
when a map is marked as non Exclusive.

10 years agoMerge branch 'feature-new-configfile-rebased' into develop
Filippos Giannakos [Tue, 28 Jan 2014 15:03:16 +0000 (17:03 +0200)]
Merge branch 'feature-new-configfile-rebased' into develop

10 years agomapper: Change order when writing map.
Filippos Giannakos [Fri, 24 Jan 2014 16:14:24 +0000 (18:14 +0200)]
mapper: Change order when writing map.

When writing a map, change the order in which the map metadata and map data are
written. The map metadata is a small block of bytes while the map data can
consist of larger blocks. By doing so, and by always reading the map in the
reverse order (that is first the metadata and then the data), we can create the
illusion of atomic map creation. A map where the metadata have not been written
yet, it can not be loaded and thus cannot get partial data.

10 years agoFix bug in ganeti pre migrate hooks
Filippos Giannakos [Mon, 23 Dec 2013 14:30:25 +0000 (16:30 +0200)]
Fix bug in ganeti pre migrate hooks

Check if ganeti node is the primary before attempting to open the volumes.

10 years agoFix bug in archipelago premigrate hook
Filippos Giannakos [Tue, 17 Dec 2013 12:05:33 +0000 (14:05 +0200)]
Fix bug in archipelago premigrate hook

Return 0 if template is not ext, to allow migration of other templates.

10 years agoAdd ganeti pre-migrate hook
Filippos Giannakos [Wed, 4 Dec 2013 15:00:59 +0000 (17:00 +0200)]
Add ganeti pre-migrate hook

Add ganeti pre-migrate hook to ensure that the volume is opened by the current
node, before proceeding with the migration.

Conflicts:
xseg/base.mk

10 years agoarchipelago: Fix typo in lock, open, close vlmc ops
Filippos Giannakos [Tue, 14 Jan 2014 14:47:19 +0000 (16:47 +0200)]
archipelago: Fix typo in lock, open, close vlmc ops

10 years agoext_scripts: Fix bug in detach
Chrysostomos Nanakos [Thu, 19 Dec 2013 16:42:19 +0000 (18:42 +0200)]
ext_scripts: Fix bug in detach

Fix bug in detach when checking whether volume is already mapped.

10 years agoext_scripts: Fix bug in attach
Filippos Giannakos [Wed, 18 Dec 2013 17:27:15 +0000 (19:27 +0200)]
ext_scripts: Fix bug in attach

Fix bug in attach when checking whether volume is already mapped.

10 years agomapper: Fix bug in reading map version
Filippos Giannakos [Wed, 18 Dec 2013 17:26:36 +0000 (19:26 +0200)]
mapper: Fix bug in reading map version

10 years agoci: Fix private network ip retrieval
Filippos Giannakos [Wed, 18 Dec 2013 12:09:17 +0000 (14:09 +0200)]
ci: Fix private network ip retrieval

10 years agoArchipelago: Fix typo in new conffile
Chrysostomos Nanakos [Wed, 18 Dec 2013 11:05:47 +0000 (13:05 +0200)]
Archipelago: Fix typo in new conffile

10 years agoArchipelago: Adjust new conffile
Filippos Giannakos [Wed, 11 Dec 2013 14:57:20 +0000 (16:57 +0200)]
Archipelago: Adjust new conffile

10 years agoRemove old configuration file parsing functions
Chrysostomos Nanakos [Mon, 18 Nov 2013 09:23:04 +0000 (11:23 +0200)]
Remove old configuration file parsing functions

Use createDict function to parse the configuration file

10 years agoChange configuration file format
Chrysostomos Nanakos [Tue, 12 Nov 2013 13:19:01 +0000 (15:19 +0200)]
Change configuration file format

New configuration file format respects the parsing language provided by
the ConfigParser module

10 years agoAdd posixfd signaling
Filippos Giannakos [Thu, 29 Aug 2013 10:04:40 +0000 (13:04 +0300)]
Add posixfd signaling

10 years agoMerge branch 'feature-fdsignals-dynalloc-rebased' into develop
Filippos Giannakos [Tue, 28 Jan 2014 15:02:55 +0000 (17:02 +0200)]
Merge branch 'feature-fdsignals-dynalloc-rebased' into develop

10 years agoci: Change default flavor to cached disk
Filippos Giannakos [Wed, 11 Dec 2013 10:15:14 +0000 (12:15 +0200)]
ci: Change default flavor to cached disk

10 years agoqa: Adjust tests for dynamic port allocation
Filippos Giannakos [Tue, 10 Dec 2013 11:59:39 +0000 (13:59 +0200)]
qa: Adjust tests for dynamic port allocation

10 years agotests: Remove test BINDIR
Filippos Giannakos [Tue, 10 Dec 2013 11:07:49 +0000 (13:07 +0200)]
tests: Remove test BINDIR

10 years agoxseg-tool: Adjust it to signal descs
Filippos Giannakos [Tue, 10 Dec 2013 09:49:34 +0000 (11:49 +0200)]
xseg-tool: Adjust it to signal descs

10 years agoxseg: Fix bug in bind_dynport
Filippos Giannakos [Fri, 6 Dec 2013 12:25:25 +0000 (14:25 +0200)]
xseg: Fix bug in bind_dynport

When allocating a port which already has a signal descriptor attached to it,
check if is is of the right type. If not, allocate a new one.

10 years agovlmc tool: Dynamically allocate xseg port
Filippos Giannakos [Thu, 5 Dec 2013 11:28:50 +0000 (13:28 +0200)]
vlmc tool: Dynamically allocate xseg port

10 years agoxseg: Add support for "dynamic" port allocation
Filippos Giannakos [Thu, 5 Dec 2013 11:23:33 +0000 (13:23 +0200)]
xseg: Add support for "dynamic" port allocation

Add support to xseg for dynamic port allocation. Arrange for xseg to use a range
of ports as reusable by those who wish to get a random port. Peers do not
actually bind to the port they get, through the normal bind process (except when
a port is first used). Instead they claim a port, another peer has left and
reuse the same structures, signal descriptors, etc.

10 years agoRemove XSEGLOG when mmap()'ing XSEG segment
Chrysostomos Nanakos [Mon, 18 Nov 2013 12:18:05 +0000 (14:18 +0200)]
Remove XSEGLOG when mmap()'ing XSEG segment

XSEGLOG writes messages in stdout resulting in corrupted partition
tables when XSEG is used by snf-image and pithcat

10 years agoAdd posixfd signaling
Filippos Giannakos [Thu, 29 Aug 2013 10:04:40 +0000 (13:04 +0300)]
Add posixfd signaling

10 years agoMerge branch 'feature-cinetwork-rebased' into develop
Filippos Giannakos [Tue, 28 Jan 2014 15:02:26 +0000 (17:02 +0200)]
Merge branch 'feature-cinetwork-rebased' into develop

10 years agoci: Add support to attach specific network
Filippos Giannakos [Mon, 9 Dec 2013 16:23:35 +0000 (18:23 +0200)]
ci: Add support to attach specific network

10 years agoMerge branch 'feature-nfsdirect-rebased' into develop
Filippos Giannakos [Tue, 28 Jan 2014 15:01:56 +0000 (17:01 +0200)]
Merge branch 'feature-nfsdirect-rebased' into develop

10 years agoSet directIO in default archipelago conf
Filippos Giannakos [Wed, 2 Oct 2013 14:36:16 +0000 (17:36 +0300)]
Set directIO in default archipelago conf

10 years agofiled: Initial dummy approach to directio
Filippos Giannakos [Wed, 18 Sep 2013 09:09:39 +0000 (12:09 +0300)]
filed: Initial dummy approach to directio

10 years agosegdev: Fix segment mapping to user.
Filippos Giannakos [Tue, 1 Oct 2013 08:59:02 +0000 (11:59 +0300)]
segdev: Fix segment mapping to user.

Do not use remap_pfn_range anymore. This causes problems when a peer performs
direct IO with buffer on the segment. Use tha fault vm operation to dynamically
map a page to the userspace peer address space when it tries to access a
specific part of the segment for the first time.

10 years agoMerge branch 'feature-peer-improvements-rebased' into develop
Filippos Giannakos [Tue, 28 Jan 2014 14:58:47 +0000 (16:58 +0200)]
Merge branch 'feature-peer-improvements-rebased' into develop

10 years agoModify changelog for 0.3.5 debian-feature-new-configfile-rebased
Filippos Giannakos [Mon, 23 Dec 2013 15:57:24 +0000 (17:57 +0200)]
Modify changelog for 0.3.5

10 years agoModify changelog for 0.3.4
Filippos Giannakos [Tue, 17 Dec 2013 12:08:27 +0000 (14:08 +0200)]
Modify changelog for 0.3.4

10 years agoModify changelog for 0.3.3
Filippos Giannakos [Wed, 4 Dec 2013 15:32:22 +0000 (17:32 +0200)]
Modify changelog for 0.3.3

Conflicts:
debian/changelog

10 years agoAdd ganeti hooks to archipelago ganeti
Filippos Giannakos [Wed, 4 Dec 2013 15:29:18 +0000 (17:29 +0200)]
Add ganeti hooks to archipelago ganeti

10 years agopeer: Add core dumping and backtrace in segfaults
Alex Pyrgiotis [Thu, 12 Sep 2013 10:06:43 +0000 (13:06 +0300)]
peer: Add core dumping and backtrace in segfaults

10 years agopeer: Add support for CPU pinning
Alex Pyrgiotis [Tue, 27 Aug 2013 18:04:26 +0000 (21:04 +0300)]
peer: Add support for CPU pinning

Add the "--cpus" CLI option that is a comma-separated list of CPUs on
which threads or a process can be pinned.

10 years agoarchipelago: Add threshold option for peers
Filippos Giannakos [Wed, 7 Aug 2013 14:43:20 +0000 (17:43 +0300)]
archipelago: Add threshold option for peers

10 years agopeers: Add threshold option on cli.
Filippos Giannakos [Mon, 5 Aug 2013 10:02:04 +0000 (13:02 +0300)]
peers: Add threshold option on cli.

10 years agoext_scripts: Fix cont-addr flag during create
Filippos Giannakos [Tue, 10 Dec 2013 08:51:44 +0000 (10:51 +0200)]
ext_scripts: Fix cont-addr flag during create

Fix bug, introduced by wrongly merging commits from another branch.

10 years agoMerge branch 'feature-flush-rebased' into develop
Filippos Giannakos [Wed, 4 Dec 2013 14:52:05 +0000 (16:52 +0200)]
Merge branch 'feature-flush-rebased' into develop

10 years agotests: Add tests for vlmcd flush
Filippos Giannakos [Fri, 13 Sep 2013 10:51:55 +0000 (13:51 +0300)]
tests: Add tests for vlmcd flush

10 years agoArchipelago: Add flags on write request
Filippos Giannakos [Fri, 13 Sep 2013 10:51:26 +0000 (13:51 +0300)]
Archipelago: Add flags on write request

10 years agotests: Put requests on multi-request tests
Filippos Giannakos [Fri, 13 Sep 2013 10:47:38 +0000 (13:47 +0300)]
tests: Put requests on multi-request tests

10 years agoarchipelago: Put request on vlmc remove
Filippos Giannakos [Fri, 13 Sep 2013 10:46:24 +0000 (13:46 +0300)]
archipelago: Put request on vlmc remove

10 years agovlmcd: Complete pending requests after "flushing"
Filippos Giannakos [Fri, 13 Sep 2013 10:42:30 +0000 (13:42 +0300)]
vlmcd: Complete pending requests after "flushing"

10 years agovlmc: Honor flush req by stall until all reqs done
Filippos Giannakos [Tue, 10 Sep 2013 13:19:12 +0000 (16:19 +0300)]
vlmc: Honor flush req by stall until all reqs done

10 years agoext_storage: Update Makefile and symlinks
Christos Stavrakakis [Tue, 19 Nov 2013 13:45:12 +0000 (15:45 +0200)]
ext_storage: Update Makefile and symlinks

Update Makefile and add new symlinks for new 'snapshot' and 'setinfo'
actions.

10 years agoext_storage: Add 'snapshot' and 'setinfo' actions
Christos Stavrakakis [Mon, 18 Nov 2013 14:55:57 +0000 (16:55 +0200)]
ext_storage: Add 'snapshot' and 'setinfo' actions

Extend supported actions with the 'snapshot' action, which is used
to snapshot an existing image. Also add 'setinfo' action as NOP.
Finally, refactor 'ReadEnv' function to return a dictionary instead of a
tuple.

Conflicts:
xseg/tools/ext_scripts/vlmc_wrapper.py

10 years agoMerge branch 'feature-sosd-fix' into develop
Alex Pyrgiotis [Wed, 27 Nov 2013 13:23:45 +0000 (15:23 +0200)]
Merge branch 'feature-sosd-fix' into develop