archipelago
10 years agososd: Remove unnecessary overwrite of objname
Alex Pyrgiotis [Tue, 26 Nov 2013 13:56:46 +0000 (15:56 +0200)]
sosd: Remove unnecessary overwrite of objname

In dispatch, we would always overwrite the objname field of rio with the
request's target. Given that the dispatch is always called by the
callback function, this is potentially dangerous behavior.

This commit fixes the above issue.

10 years agoAdd COPYRIGHT file.
Filippos Giannakos [Mon, 7 Oct 2013 10:01:09 +0000 (13:01 +0300)]
Add COPYRIGHT file.

Add COPYRIGHT file in the root directory. Also add NEWS and Changelog
placeholders.

10 years agoMerge branch 'feature-docs-add-apt' into develop
Filippos Giannakos [Mon, 7 Oct 2013 10:00:36 +0000 (13:00 +0300)]
Merge branch 'feature-docs-add-apt' into develop

10 years agodocs: update installation section to include apt
Constantinos Venetsanopoulos [Fri, 4 Oct 2013 15:03:45 +0000 (18:03 +0300)]
docs: update installation section to include apt

* add section for adding the apt repository
* comment the 'list' command since it's not working yet
* minor fixes

10 years agoMerge branch 'feature-docs-update' into develop
Filippos Giannakos [Sun, 22 Sep 2013 17:05:28 +0000 (20:05 +0300)]
Merge branch 'feature-docs-update' into develop

10 years agodocs: Update Archipelago images
Filippos Giannakos [Sun, 22 Sep 2013 17:04:43 +0000 (20:04 +0300)]
docs: Update Archipelago images

10 years agodocs: Update index.rst and archipelago.rst
Constantinos Venetsanopoulos [Wed, 18 Sep 2013 10:02:15 +0000 (13:02 +0300)]
docs: Update index.rst and archipelago.rst

10 years agoci: Change ipv4 for nat VMs to synnefo.org
Filippos Giannakos [Wed, 11 Sep 2013 06:45:20 +0000 (09:45 +0300)]
ci: Change ipv4 for nat VMs to synnefo.org

10 years agoci: Adjust "synnefo" url
Filippos Giannakos [Tue, 10 Sep 2013 13:49:52 +0000 (16:49 +0300)]
ci: Adjust "synnefo" url

10 years agoarchipelago: Fix wait request in common.py
Filippos Giannakos [Fri, 6 Sep 2013 09:53:59 +0000 (12:53 +0300)]
archipelago: Fix wait request in common.py

10 years agoci: Change demo synnefo infrastructure.
Filippos Giannakos [Fri, 6 Sep 2013 08:46:41 +0000 (11:46 +0300)]
ci: Change demo synnefo infrastructure.

10 years agodocs: Add showmapped vlmc command
Filippos Giannakos [Fri, 6 Sep 2013 08:45:50 +0000 (11:45 +0300)]
docs: Add showmapped vlmc command

10 years agodocs: Insert synnefo integration image + missing vlmc snapshot
Filippos Giannakos [Thu, 5 Sep 2013 11:54:18 +0000 (14:54 +0300)]
docs: Insert synnefo integration image + missing vlmc snapshot

10 years agotests: Add extra test in test_copy for filed
Filippos Giannakos [Thu, 8 Aug 2013 09:18:10 +0000 (12:18 +0300)]
tests: Add extra test in test_copy for filed

10 years agofiled: Respect req->size for copy requests
Filippos Giannakos [Thu, 8 Aug 2013 09:15:59 +0000 (12:15 +0300)]
filed: Respect req->size for copy requests

10 years agoMerge branch 'feature-docs' into develop
Filippos Giannakos [Wed, 7 Aug 2013 14:34:20 +0000 (17:34 +0300)]
Merge branch 'feature-docs' into develop

10 years agodocs: Add archipelago-{overview, apis} images
Filippos Giannakos [Tue, 6 Aug 2013 10:13:38 +0000 (13:13 +0300)]
docs: Add archipelago-{overview, apis} images

10 years agodocs: Fix some typos
Filippos Giannakos [Mon, 5 Aug 2013 14:00:35 +0000 (17:00 +0300)]
docs: Fix some typos

10 years agodocs: Add initial docs.
Filippos Giannakos [Mon, 5 Aug 2013 13:42:49 +0000 (16:42 +0300)]
docs: Add initial docs.

Add initial sphinx docs of archipelago. Also add ci script for automatic doc
compiling.

10 years agoMerge branch 'feature-powerof2' into develop
Filippos Giannakos [Wed, 7 Aug 2013 14:30:21 +0000 (17:30 +0300)]
Merge branch 'feature-powerof2' into develop

10 years agoarchipelago: Update conf documentation about nr_ops.
Filippos Giannakos [Wed, 7 Aug 2013 14:29:23 +0000 (17:29 +0300)]
archipelago: Update conf documentation about nr_ops.

Upate config documentation that a peer nr_ops must be a power of 2.

10 years agoarchipelago: Catch exceptions in argument parsing
Filippos Giannakos [Wed, 7 Aug 2013 14:29:04 +0000 (17:29 +0300)]
archipelago: Catch exceptions in argument parsing

10 years agoarchipelago: Set nr_ops = nr_threads for filed
Filippos Giannakos [Tue, 6 Aug 2013 10:06:59 +0000 (13:06 +0300)]
archipelago: Set nr_ops = nr_threads for filed

10 years agoarchipelago: Enforce nr_ops as a power of 2 for all peers
Filippos Giannakos [Tue, 6 Aug 2013 10:06:42 +0000 (13:06 +0300)]
archipelago: Enforce nr_ops as a power of 2 for all peers

10 years agofiled: Check fd limit against the real cache size
Filippos Giannakos [Tue, 6 Aug 2013 10:05:31 +0000 (13:05 +0300)]
filed: Check fd limit against the real cache size

10 years agopeer: Respect the nr of ops enforced by xq size.
Filippos Giannakos [Tue, 6 Aug 2013 10:04:39 +0000 (13:04 +0300)]
peer: Respect the nr of ops enforced by xq size.

10 years agoxq: Respect size when allocating and initializing
Filippos Giannakos [Tue, 6 Aug 2013 10:02:11 +0000 (13:02 +0300)]
xq: Respect size when allocating and initializing

When allocating and initializing a new xq, respect the xq size limit that the
initialization sets, and do not initialize past that.

10 years agofiled: Fix custom usage
Filippos Giannakos [Mon, 5 Aug 2013 10:44:51 +0000 (13:44 +0300)]
filed: Fix custom usage

10 years agoarchipelago conf: Add comments on settings
Filippos Giannakos [Mon, 5 Aug 2013 10:44:28 +0000 (13:44 +0300)]
archipelago conf: Add comments on settings

10 years agoInstall archipelago.conf.rados_example
Filippos Giannakos [Fri, 2 Aug 2013 09:44:05 +0000 (12:44 +0300)]
Install archipelago.conf.rados_example

10 years agoci: Insert licence headers
Filippos Giannakos [Thu, 1 Aug 2013 12:03:59 +0000 (15:03 +0300)]
ci: Insert licence headers

10 years agoMerge branch 'feature-testingrados' into develop
Filippos Giannakos [Thu, 1 Aug 2013 10:51:16 +0000 (13:51 +0300)]
Merge branch 'feature-testingrados' into develop

10 years agoci: Add connection to a RADOS cluster
Filippos Giannakos [Thu, 1 Aug 2013 09:27:26 +0000 (12:27 +0300)]
ci: Add connection to a RADOS cluster

10 years agoMerge branch 'debian-feature-changesettingslocation' into debian-develop
Filippos Giannakos [Wed, 31 Jul 2013 07:13:38 +0000 (10:13 +0300)]
Merge branch 'debian-feature-changesettingslocation' into debian-develop

10 years agoMerge branch 'feature-ci' into develop
Filippos Giannakos [Wed, 31 Jul 2013 07:12:27 +0000 (10:12 +0300)]
Merge branch 'feature-ci' into develop

10 years agoarchipelago: Fix wrong identation and typos
Filippos Giannakos [Mon, 29 Jul 2013 11:47:18 +0000 (14:47 +0300)]
archipelago: Fix wrong identation and typos

10 years agoci: Do not ping servers on okeanos io
Filippos Giannakos [Fri, 26 Jul 2013 11:47:55 +0000 (14:47 +0300)]
ci: Do not ping servers on okeanos io

10 years agoci: Transfer VM creation to okeanos.io
Filippos Giannakos [Fri, 26 Jul 2013 09:47:49 +0000 (12:47 +0300)]
ci: Transfer VM creation to okeanos.io

10 years agoci: Add basic functionality test on commit.
Filippos Giannakos [Fri, 26 Jul 2013 07:15:37 +0000 (10:15 +0300)]
ci: Add basic functionality test on commit.

Also split unittests to execute each component sepereatly

10 years agoci: Reduce logging level to info to cluster.py
Filippos Giannakos [Thu, 25 Jul 2013 16:37:02 +0000 (19:37 +0300)]
ci: Reduce logging level to info to cluster.py

10 years agoci: Add simple tests.sh
Filippos Giannakos [Thu, 25 Jul 2013 15:14:00 +0000 (18:14 +0300)]
ci: Add simple tests.sh

10 years agoci: Add cluster management files
Filippos Giannakos [Thu, 25 Jul 2013 15:11:28 +0000 (18:11 +0300)]
ci: Add cluster management files

10 years agoChange archipelago default settings
Filippos Giannakos [Fri, 26 Jul 2013 07:35:51 +0000 (10:35 +0300)]
Change archipelago default settings

Change archipelago default settings to file blocker. Also provide a working
example for rados blocker

10 years agoChange location of settings file to /etc/archipelago
Filippos Giannakos [Fri, 26 Jul 2013 07:26:55 +0000 (10:26 +0300)]
Change location of settings file to /etc/archipelago

10 years agoInstall archipelago conf file
Filippos Giannakos [Fri, 26 Jul 2013 07:29:19 +0000 (10:29 +0300)]
Install archipelago conf file

10 years agoAdd archipelago-rados-dbg package
Filippos Giannakos [Thu, 25 Jul 2013 12:36:49 +0000 (15:36 +0300)]
Add archipelago-rados-dbg package

10 years agoSplit rados driver to a different package.
Filippos Giannakos [Thu, 25 Jul 2013 12:18:55 +0000 (15:18 +0300)]
Split rados driver to a different package.

Split rados driver to a different package, to avoid depending archipelago to
librados by default.
Also now we depend also to librados >= 0.65 which has all the necessary patches
merged.

10 years agoAdjust tests to the new Segment class
Filippos Giannakos [Thu, 25 Jul 2013 11:38:18 +0000 (14:38 +0300)]
Adjust tests to the new Segment class

10 years agoarchipelago: Remove duplicate get_hash_request method
Filippos Giannakos [Thu, 25 Jul 2013 11:37:42 +0000 (14:37 +0300)]
archipelago: Remove duplicate get_hash_request method

10 years agoAdd python-pkg-resources as a dependency
Filippos Giannakos [Thu, 25 Jul 2013 08:16:45 +0000 (11:16 +0300)]
Add python-pkg-resources as a dependency

10 years agoarchipelago: Add wrapper function to get segment object
Filippos Giannakos [Tue, 23 Jul 2013 09:26:58 +0000 (12:26 +0300)]
archipelago: Add wrapper function to get segment object

10 years agoModify kernel source rules version regex
Filippos Giannakos [Thu, 18 Jul 2013 13:15:00 +0000 (16:15 +0300)]
Modify kernel source rules version regex

10 years agoModify version regex to comply with the new devflow
Filippos Giannakos [Thu, 18 Jul 2013 13:12:44 +0000 (16:12 +0300)]
Modify version regex to comply with the new devflow

10 years agoMerge branch 'develop' into debian-develop
Filippos Giannakos [Mon, 22 Jul 2013 11:16:49 +0000 (14:16 +0300)]
Merge branch 'develop' into debian-develop

Conflicts:
xseg/tools/archipelago/archipelago/common.py
xseg/tools/archipelago/archipelago/vlmc.py

10 years agoext_storage: Check for 'pithos:' on create.
Filippos Giannakos [Mon, 22 Jul 2013 10:36:05 +0000 (13:36 +0300)]
ext_storage: Check for 'pithos:' on create.

10 years agoAdapt archipelago defaults to the new config
Filippos Giannakos [Mon, 22 Jul 2013 10:22:01 +0000 (13:22 +0300)]
Adapt archipelago defaults to the new config

10 years agovlmc: Add X_HASH operation
Filippos Giannakos [Mon, 22 Jul 2013 10:15:47 +0000 (13:15 +0300)]
vlmc: Add X_HASH operation

10 years agoarchipelago: Declare segment as Class and modify settings
Filippos Giannakos [Mon, 22 Jul 2013 10:14:25 +0000 (13:14 +0300)]
archipelago: Declare segment as Class and modify settings

Declare xseg segment as class, and make use of its methods. Also modify config
file check to expect segment parameters instead of one segment spec.

10 years agovlmc: Fix get_vlmc_port for all operations
Filippos Giannakos [Fri, 19 Jul 2013 15:24:46 +0000 (18:24 +0300)]
vlmc: Fix get_vlmc_port for all operations

10 years agoarchipelago: Add spec config when creating segment
Filippos Giannakos [Fri, 19 Jul 2013 14:48:11 +0000 (17:48 +0300)]
archipelago: Add spec config when creating segment

10 years agoarchipelago: Fix tabs in python modules
Filippos Giannakos [Fri, 19 Jul 2013 14:42:33 +0000 (17:42 +0300)]
archipelago: Fix tabs in python modules

10 years agoMerge branch 'feature-bench-improvements-rebased2' into develop
Filippos Giannakos [Fri, 19 Jul 2013 14:14:33 +0000 (17:14 +0300)]
Merge branch 'feature-bench-improvements-rebased2' into develop

10 years agobench: Create separate option for progress type
Alex Pyrgiotis [Fri, 19 Jul 2013 08:57:42 +0000 (11:57 +0300)]
bench: Create separate option for progress type

Progress type option is now decoupled from the progress option. This
paves the way for silent progress reports.

10 years agobench: Break usage message in sections
Alex Pyrgiotis [Fri, 19 Jul 2013 07:49:10 +0000 (10:49 +0300)]
bench: Break usage message in sections

10 years agobench: Turn ping off by default
Alex Pyrgiotis [Fri, 19 Jul 2013 07:28:03 +0000 (10:28 +0300)]
bench: Turn ping off by default

10 years agobench: Break large source file into smaller files
Alex Pyrgiotis [Fri, 19 Jul 2013 07:12:47 +0000 (10:12 +0300)]
bench: Break large source file into smaller files

The bench-utils.c file started to have utilities that could stand
semantically under a separate category. Namely, verification is now at
bench-verify.c and progress report under bench-report.c.

10 years agoMerge branch 'feature-vlmcmap' into develop
Filippos Giannakos [Fri, 19 Jul 2013 14:03:38 +0000 (17:03 +0300)]
Merge branch 'feature-vlmcmap' into develop

10 years agovlmc: Do not map an already mounted volume
Filippos Giannakos [Thu, 18 Jul 2013 16:16:22 +0000 (19:16 +0300)]
vlmc: Do not map an already mounted volume

10 years agoMerge branch 'feature-vlmcmultipleports' into develop
Filippos Giannakos [Fri, 19 Jul 2013 14:02:12 +0000 (17:02 +0300)]
Merge branch 'feature-vlmcmultipleports' into develop

10 years agoarchipelago: Fix concurrent vlmc ops
Filippos Giannakos [Fri, 19 Jul 2013 09:30:22 +0000 (12:30 +0300)]
archipelago: Fix concurrent vlmc ops

10 years agoarchipelago: Add support for nested locking
Filippos Giannakos [Fri, 19 Jul 2013 06:28:46 +0000 (09:28 +0300)]
archipelago: Add support for nested locking

10 years agoarchipelago: Add support for concurrent vlmc ops
Filippos Giannakos [Fri, 19 Jul 2013 06:12:53 +0000 (09:12 +0300)]
archipelago: Add support for concurrent vlmc ops

10 years agoMerge branch 'feature-bench-improvements-rebased2' into develop
Filippos Giannakos [Thu, 18 Jul 2013 12:20:02 +0000 (15:20 +0300)]
Merge branch 'feature-bench-improvements-rebased2' into develop

10 years agobench: Introduce new progress report and intervals
Alex Pyrgiotis [Wed, 17 Jul 2013 19:19:54 +0000 (22:19 +0300)]
bench: Introduce new progress report and intervals

This commit renews the progress report that bench has by allowing to
report bandwidth results during benchmark.

Also, an additional functionality is that of report intervals. Report
intervals allow the user to choose exactly when progress report will be
printed.

Both of these features are documented extensively in the usage section.

10 years agobench: Track elapsed time for each timer
Alex Pyrgiotis [Wed, 17 Jul 2013 19:12:23 +0000 (22:12 +0300)]
bench: Track elapsed time for each timer

Also, create two functions timespecsub() and timespecadd() that can
subtract and add two timespec structs.

10 years agobench: Handle progress report better
Alex Pyrgiotis [Tue, 16 Jul 2013 10:39:13 +0000 (13:39 +0300)]
bench: Handle progress report better

Pave the way to include bandwidth/IOPS results during progress report

10 years agobench: Add --objname option
Alex Pyrgiotis [Mon, 8 Jul 2013 11:45:10 +0000 (14:45 +0300)]
bench: Add --objname option

The --objname option allows the user to define the name of the target.
This implies that for the duration of the benchmark, a sole object will
be used. This also comes along with a set of restrictions, that are
throughly explained in the help message

10 years agobench: Fix segfault while freeing resources
Alex Pyrgiotis [Mon, 8 Jul 2013 10:59:33 +0000 (13:59 +0300)]
bench: Fix segfault while freeing resources

10 years agobench: Add --prefix option
Alex Pyrgiotis [Mon, 8 Jul 2013 10:46:03 +0000 (13:46 +0300)]
bench: Add --prefix option

The --prefix option allows the user to choose whatever prefix he/she
wants for the object names that will be generated.

This commit also cleans code that has to do with seeding and creating
object names. It also paves the way for the --objname option.

10 years agobench: Fix minor validation issue
Alex Pyrgiotis [Mon, 10 Jun 2013 15:44:25 +0000 (18:44 +0300)]
bench: Fix minor validation issue

10 years agobench: Ping target peer before starting timers
Alex Pyrgiotis [Sat, 22 Jun 2013 20:00:28 +0000 (23:00 +0300)]
bench: Ping target peer before starting timers

In some cases, the target peer may take some time before it finishes
with its initializations. Since we don't want to measure this idle time,
we send a ping request first and can start start the benchmark after we
receive an ACK.

NOTE: This behaviour can be switched off with the "--ping no" option.

10 years agobench: Remove dead code
Alex Pyrgiotis [Mon, 3 Jun 2013 11:05:07 +0000 (14:05 +0300)]
bench: Remove dead code

10 years agobench: Improve benchmark results
Alex Pyrgiotis [Fri, 31 May 2013 10:35:35 +0000 (13:35 +0300)]
bench: Improve benchmark results

Changes include:

* Show the average request latency when run with insanity "eccentric"
* Don't show bandwidth results for info/delete requests

10 years agobench: Remove dead code
Alex Pyrgiotis [Mon, 3 Jun 2013 11:05:07 +0000 (14:05 +0300)]
bench: Remove dead code

10 years agobench: Fix an LFSR init issue and minor comments
Alex Pyrgiotis [Mon, 3 Jun 2013 10:35:48 +0000 (13:35 +0300)]
bench: Fix an LFSR init issue and minor comments

If bench is requested to issue only one request, the LFSR initialization
fails. Since LFSR is not needed in this case, we simply switch to
sequential pattern for this request.

10 years agobench: Remove unnecessary malloc
Alex Pyrgiotis [Fri, 31 May 2013 15:25:17 +0000 (18:25 +0300)]
bench: Remove unnecessary malloc

10 years agobench: Improve benchmark results
Alex Pyrgiotis [Fri, 31 May 2013 10:35:35 +0000 (13:35 +0300)]
bench: Improve benchmark results

Changes include:

* Show the average request latency when run with insanity "eccentric"
* Don't show bandwidth results for info/delete requests

10 years agobench: Minor correction on seed validation
Alex Pyrgiotis [Mon, 20 May 2013 13:02:24 +0000 (16:02 +0300)]
bench: Minor correction on seed validation

10 years agobench: Fix data verification
Alex Pyrgiotis [Thu, 16 May 2013 08:14:17 +0000 (11:14 +0300)]
bench: Fix data verification

Current situation: In full verification mode, each number written across
a data chunk has 64 bits length, yet, due to a wrong LFSR
initialization, only 31 bits are utilized.

Implement a 63/64 bits utilization.

10 years agoMerge branch 'feature-snapshot' into develop
Filippos Giannakos [Thu, 18 Jul 2013 09:58:59 +0000 (12:58 +0300)]
Merge branch 'feature-snapshot' into develop

10 years agovlmc: add cont_addr option in snapshot command
Filippos Giannakos [Thu, 18 Jul 2013 09:29:53 +0000 (12:29 +0300)]
vlmc: add cont_addr option in snapshot command

10 years agopython Makefile: replace zero-length array with pointer
Filippos Giannakos [Thu, 18 Jul 2013 09:26:13 +0000 (12:26 +0300)]
python Makefile: replace zero-length array with pointer

Replace zero-length array with pointer for the xseg_reply_map flexible array
member.

10 years agoPeers Makefile: Reenable sosd
Filippos Giannakos [Thu, 18 Jul 2013 07:15:25 +0000 (10:15 +0300)]
Peers Makefile: Reenable sosd

10 years agotests: Add SosdTest
Filippos Giannakos [Thu, 18 Jul 2013 07:15:04 +0000 (10:15 +0300)]
tests: Add SosdTest

10 years agososd: Fix compilation error and hashing bug.
Filippos Giannakos [Thu, 18 Jul 2013 07:14:01 +0000 (10:14 +0300)]
sosd: Fix compilation error and hashing bug.

* Fix compilation error
* Correctly return the hased value in hash reply
* Resize X_INFO request when necessary

10 years agomapper: Use correct size for epoch when loading v2 metadata
Filippos Giannakos [Thu, 18 Jul 2013 07:13:23 +0000 (10:13 +0300)]
mapper: Use correct size for epoch when loading v2 metadata

10 years agomapper: Fix calculation of copy up target.
Filippos Giannakos [Thu, 18 Jul 2013 07:12:03 +0000 (10:12 +0300)]
mapper: Fix calculation of copy up target.

When hexlifing epoch and index, use the correct size of the source.

10 years agopeers: Fix bug in hexlify.
Filippos Giannakos [Thu, 18 Jul 2013 07:10:42 +0000 (10:10 +0300)]
peers: Fix bug in hexlify.

Ditch strncpy which alwayes NULL terminates when hexlifing and use a custom
hexlify function.

10 years agotests: Add extra tests for hashing.
Filippos Giannakos [Wed, 17 Jul 2013 12:40:13 +0000 (15:40 +0300)]
tests: Add extra tests for hashing.

10 years agopython: Extend request interface with X_HASH
Filippos Giannakos [Wed, 17 Jul 2013 12:39:49 +0000 (15:39 +0300)]
python: Extend request interface with X_HASH