Archipelago

peer.c: Call custom peer finalize with st_threads

mapperd: Add debug messages for copyup target

Rename archipelago peers with archip- prefix

Adjust mt-sosd to the new RADOS lock API.

Add wrapper function for ST peerd loop.
(cherry picked from commit d932df7a6a3ae8b17d9e0981fcb3ee2af059324c)

Conflicts:
xseg/peers/user/peer.c

Make peers close stdin when entering daemon mode.
(cherry picked from commit 04ea45339fd0e5a92c3290807805766acc1e7223)

peer: Move peerd_loop plug out of peer_reqs loop

The plugging of generic_peerd_loop to peerd_loop was falsely done inside
a loop where peer_reqs were initialized. The plugging has now been moved
out of this loop.

bench: Fix issuing of read/write requests

Due to no initialization of struct bench, some "ifs" in the code would
show different behavior depending on the junk values they would check.
Now however, there is proper initialization of struct bench.

bench: Change prefixes of static functions

In this repo, a static helpder function is prefixed with "__". However,
some static helper functions in bench-utils.c where prefixed with a
single underscore ("_"), so we updated their names to be consistent with...

Add a fallback clock for portability reasons

Split peer request queues.

Each thread has its own peer request queue, frow which it allocates data. If
this queue is empty, it tries to "steal" from the "next" thread. This greatly
reduces lock congestion to the peer request queue.

Fix queue size of per thread queue.

Add check to not respond request if none associated.

Conflicts:
xseg/peers/user/peer.c

Build only the necessary peers.

Style changes

Add request cap

Implemented by popular request, the request cap option allows the
benchmarking peer to stop the benchmark earlier, at a given number
of received requests.

Improve LFSR implementation

Also, prepare the code for the addition of verification support

Refactor struct bench and appropriate code paths

Changes:

1. Move flag values (such as pattern, insanity, verify) in a specific
bit-field.
2. Create a struct req_status where the status of requests will be
stored.
3. Tidy up code.

Rationale:

1. For parameters that can have only a few different values, it's an...

Change input option to bench

Since -dp is reserved in peer as defer port number, we change the -dp
option in bench (which stood for "destination port") to -tp, which
stands for "target port".

Allow LFSR to be used for sizes smaller than 2^3

Add support for seed values given by the user

A new option has been added (--seed) which allows the user to pre-define
the seed that he/she wants. This has the following effects:

• The target names are prefixed with the first 9 digits of the seed.
• LFSR produces a predictable sequence of "random" numbers

Make bench snappier when asked to terminate

Fix incorrect reading of "insanity" parameter

Tweak performance of bench

Implement most semi-finished functionalities

Summary of new functionalities:

• Add support for 4 different xseg operations (read, write, info,
  delete).
• Add support for random I/O patterns with a fast Galois LFSR.
• Add insanity levels in timers, which allow the user to exclude obscure...

Fix target names and chunk offsets

Design the program's skeleton for new features

Bench peer must be able to test all xseg operations in a synchronous or
asynchronous way. Also, it must have a validation mode to sanity-check
if xseg requests are issued properly. Most of the above are present in...

Add an LFSR PRNG for bench

The PRNG introduced by this commit is a Galois-XNOR LFSR, which can
generate unique pseudorandom numbers. Also, seeded with the same
seed, it will produce the same sequence.

This implementation is driven by the needs of XSEG for a blazing fast...

Alpha release of bench peer

On this release, the bench peer can measure the total elapsed time
of the benchmark. TODO:

• Allow bench peer to be multi-threaded.
• Adjust benchmarking precision, by eliminating or including more
  trivial timers.
• Measure mean time, standard deviation of requests.

Fix segfault, parameters validation

Simplify port binding code

Fix timers and add them to critical paths

Fixed incorrect handling of elapsed time and used appropriate timers to
benchmark crtical paths.

Fix segfault

Unify thread loop with peerd_loop

Since peerd_loop with thread_loop don't have many differences between
them, they can be unified in a single loop. TODO is to choose a unified
name for both threads and peers, as well as fault check the
implementation.

Add timer implementation

This an initial timer implementation. It is not very polished at the
momment and some implementation choices will have to be reviewed later
on.

Parse and error-check arguments

Add defer support to peers

Add support to peer skeleton to defer requests to another peer, by forwarding
requests to another port.

Remove dummy, vlmc-xseg, pfiled from peers build.

Fix compilation warnings

Make xsegbd use xseg_reply_info struct

Fix wrong mapper op

Add volume freeze functionality for certain ops to vlmcd

add snapshot support to vlmc-xseg tool

add mt-sosd stat before writing in snapshotting

make mapper delete the old object in a snapshot

add snapshot support in mapperd

Add make install support

change open/close to acquire/release xseg ops. also add handle_open

change open/close to acquire release in mt-sosd

make peers use macros for reading args. also remove some peer compilation warnings