Synnefo » ./kamaki

Fix pep8 compliance issues everywhere

Tide up _upload_missing_blocks code + progress chk

progress check in upload: don't let progress bar raise exceptions

Upload progress bar advances only if block uploads

was: progress bar advances if thread is initialized. In case of thread
failures, progress bar was re-initialized for a next round of uploads

now: if a block is uploaded, progress bad advances. There is one upload bar...

More retries, dynamic upload thread limit

Even the slightest progress causes upload to retry
if 502 client error is received, # of threads are limited to current thread

upload does not overwrite remote objs by default

Now you can do this to upload all you .jpg imgs to myImgDir directory object:

for img in *.jpg;
do
kamaki store upload $img mycontainer:myImgDir
done

Merge remote-tracking branch 'origin/develop' into feature-windows

Conflicts:
kamaki/cli/__init__.py
kamaki/cli/argument.py
kamaki/cli/command_shell.py
kamaki/cli/command_tree.py
kamaki/cli/commands/__init__.py
kamaki/cli/commands/astakos_cli.py
kamaki/cli/commands/config_cli.py...

Prepare to merge into develop

Add info in container-not-found error

Pithos+ publish returns access url

Better pithos upload progressbar

Update docs and doc-parsed comments in storage

docs: replace Glance with Plankton
storage: standard sphincs-parsable comments

Update comment docs at pithos client

Rearrange sections in docs, add developer corner

Unittest parallel server creation

Gradual thread inc/decrease in up/download

Thread inc/decrease is now generic for all clients that might need it
with the method _watch_thread_limit

Algorithm: set a small thread limit and when reached wait for active threads to
finish. Measure avg time. If avg time decreases, increase thread limit...

Minor improvements in pithos unitesting

Use standard threading instead of gevent/greenlets

gevent depedency is not needed after that

Merge branch 'master' of https://code.grnet.gr/git/kamaki

Conflicts:
kamaki/__init__.py
kamaki/cli.py
kamaki/clients/__init__.py
kamaki/clients/astakos.py
kamaki/clients/compute.py
kamaki/clients/cyclades.py
kamaki/clients/image.py
kamaki/clients/pithos.py...

Handle connection.close in repeated requests

Raise block upload greenlet failure error

Minor fixes

Support range at file (threaded) download

Get rid of pithos_sh

The old profecy "there will be only one [Pithos Client]" is finally
fullfilled

Get rid of pithos_sh hash methods in download

Minor CLI download behavior fixes

Voodo-fix mysterious header-destroying request bug

Greenlet/thread safe header/param requests

Requests can now distinguish between "global" headers/params
and thread-specific.

Workarround an eventlist random bug in downloading

Mild refactoring to download and upload @pithos.py

Minor bugfixes

Minor bugfixes

Major changes in client, fixed setup

Seperate Client to Client and HTTPConnection
The later is put in a separate package kamaki.client.connection
It manages headers, params, method, url and data of a connection
but the actuall http connection is not implemented at this...

Minor bug fixes

Fixed bug with reset_headers

Now headers are reset after each request by default
but there is an option for not reseting headers, in low
level

Improved incremental download, hashmap, versions

Full pithos+ copy in clients.pithos

Add arguments/options to upload

manifest is now a seperated method for uploading
old, naive upload is preserved with --unchunked option

Add options to meta

Add options to store_list

(Almost) complete pithos client unittesting

transfer_encoding still unchecked

Adjusting account/container opps + bug fixes

Added test_object_delete

Started testing object_copy +minor fixes

More testing in storage

Completed testing at container level, started at object level

Pretyfication adjustments

Fixed colors in flavor and image error messages
Pretyfied image client code

Full pithos+ support at container level

Full pithos+ support with ne container_<REST> methods
Old methods adjusted to use this functionality
No changes on CLI

Completed full pithos+ support at account level

Added full support for pithos+ headers and params for account
POST based operations, modified existing methods to take
advantage of this change

Pithos level extentions added

get_account_info now supports until parameter, and if-(un)modified-since headers
in request

Implemented overwrite

In CLI added store_overwrite

In pithos added overwrite_object which, in case of large updates, overwrites block by block

Fixed and optiomized delmeta for objects

In storage, fixed delmeta which was disfunctional
In pithos added an optimized implementation using the pithos update parameter