kamaki
11 years agoCompleted Pithos_cli adjustment
Stavros Sachtouris [Tue, 2 Oct 2012 13:31:15 +0000 (16:31 +0300)]
Completed Pithos_cli adjustment

11 years agoFix help message formating, go on with pithos_cli
Stavros Sachtouris [Tue, 2 Oct 2012 10:43:49 +0000 (13:43 +0300)]
Fix help message formating, go on with pithos_cli

11 years agoShow command-specific help
Stavros Sachtouris [Tue, 2 Oct 2012 09:32:41 +0000 (12:32 +0300)]
Show command-specific help

11 years agoInteruption - Haven't finished pithos_cli adjust
Stavros Sachtouris [Mon, 1 Oct 2012 12:35:12 +0000 (15:35 +0300)]
Interuption - Haven't finished pithos_cli adjust

11 years agoAdjust store list to new arg/config mechanism
Stavros Sachtouris [Mon, 1 Oct 2012 11:14:14 +0000 (14:14 +0300)]
Adjust store list to new arg/config mechanism

11 years agoComplete one-command CLI, but still doesn't work
Stavros Sachtouris [Fri, 28 Sep 2012 14:58:24 +0000 (17:58 +0300)]
Complete one-command CLI, but still doesn't work

missing:
1. fix the command_specs with new argument system
2. Maybe take advantage of the arbitary length of command terms for more
expressive syntax/semantics

11 years agoRefactor CommandTree, parse and get cli class
Stavros Sachtouris [Thu, 27 Sep 2012 16:47:26 +0000 (19:47 +0300)]
Refactor CommandTree, parse and get cli class

11 years agoTest CommandTree usage and notice it's no good
Stavros Sachtouris [Tue, 25 Sep 2012 16:14:27 +0000 (19:14 +0300)]
Test CommandTree usage and notice it's no good

CommandTree is not as convinient to use as planned, maybe it should
be redesinged

11 years agoFix CLI top level error handling
Stavros Sachtouris [Tue, 25 Sep 2012 14:48:57 +0000 (17:48 +0300)]
Fix CLI top level error handling

11 years agoArgument object handles part of the functionality
Stavros Sachtouris [Tue, 25 Sep 2012 13:50:56 +0000 (16:50 +0300)]
Argument object handles part of the functionality

+minor fixes

11 years agoBasic CommandTree debugging and other minor fixes
Stavros Sachtouris [Fri, 21 Sep 2012 16:01:04 +0000 (19:01 +0300)]
Basic CommandTree debugging and other minor fixes

11 years agoFirst version of error managing system for CLI
Stavros Sachtouris [Fri, 21 Sep 2012 15:14:15 +0000 (18:14 +0300)]
First version of error managing system for CLI

11 years agoStart a great deal of CLI modifictions
Stavros Sachtouris [Fri, 21 Sep 2012 15:07:21 +0000 (18:07 +0300)]
Start a great deal of CLI modifictions

Argument class wraps python ArgumentParser to provide a convinient arg system
CommandTree class manages (store, load, seek, etc) a tree of command paths
and loads them from command spec files.

Under heavy development
Target: simplify the development of various CLIs, e.g. one-command, shells, etc

11 years agoMinor fixes
Stavros Sachtouris [Thu, 20 Sep 2012 14:31:58 +0000 (17:31 +0300)]
Minor fixes

11 years agoUnitest everything untested in pithos client
Stavros Sachtouris [Thu, 20 Sep 2012 11:20:44 +0000 (14:20 +0300)]
Unitest everything untested in pithos client

11 years agoUnitest get_container_object_meta
Stavros Sachtouris [Thu, 20 Sep 2012 10:11:00 +0000 (13:11 +0300)]
Unitest get_container_object_meta

11 years agoUnitest set_account_quota/versioning, ls_container
Stavros Sachtouris [Thu, 20 Sep 2012 09:59:52 +0000 (12:59 +0300)]
Unitest set_account_quota/versioning, ls_container

11 years agoUnitest get_account_quota/versioning
Stavros Sachtouris [Thu, 20 Sep 2012 09:52:23 +0000 (12:52 +0300)]
Unitest get_account_quota/versioning

11 years agoUnitest upload_object_unchunked
Stavros Sachtouris [Thu, 20 Sep 2012 09:34:42 +0000 (12:34 +0300)]
Unitest upload_object_unchunked

11 years agoUnitest purge, create_by_manifestation, versionlst
Stavros Sachtouris [Thu, 20 Sep 2012 09:26:32 +0000 (12:26 +0300)]
Unitest purge, create_by_manifestation, versionlst

11 years agoSupport range at file (threaded) download
Stavros Sachtouris [Wed, 19 Sep 2012 14:17:21 +0000 (17:17 +0300)]
Support range at file (threaded) download

11 years agoAdd range in stream download
Stavros Sachtouris [Wed, 19 Sep 2012 13:43:45 +0000 (16:43 +0300)]
Add range in stream download

11 years agoGet rid of pithos_sh
Stavros Sachtouris [Wed, 19 Sep 2012 11:06:12 +0000 (14:06 +0300)]
Get rid of pithos_sh

The old profecy "there will be only one [Pithos Client]" is finally
fullfilled

11 years agoKamaki CLI/clients sharers implementation
Stavros Sachtouris [Wed, 19 Sep 2012 10:42:41 +0000 (13:42 +0300)]
Kamaki CLI/clients sharers implementation

mimics pithos_sh account sharers

11 years agoGet rid of pithos_sh hash methods in download
Stavros Sachtouris [Tue, 18 Sep 2012 15:31:45 +0000 (18:31 +0300)]
Get rid of pithos_sh hash methods in download

11 years agoMerge branch 'develop' of https://code.grnet.gr/git/kamaki into develop
Stavros Sachtouris [Tue, 18 Sep 2012 15:13:42 +0000 (18:13 +0300)]
Merge branch 'develop' of https://code.grnet.gr/git/kamaki into develop

Conflicts:
kamaki/clients/pithos.py

11 years agoMuch faster download resume
Stavros Sachtouris [Tue, 18 Sep 2012 15:10:09 +0000 (18:10 +0300)]
Much faster download resume

Don't preload local file blocks, but load each one dynamically
only before it is downloaded, and compare

11 years agoMuch faster resume in download
Stavros Sachtouris [Tue, 18 Sep 2012 14:58:49 +0000 (17:58 +0300)]
Much faster resume in download

11 years agoMinor CLI download behavior fixes
Stavros Sachtouris [Tue, 18 Sep 2012 14:29:17 +0000 (17:29 +0300)]
Minor CLI download behavior fixes

11 years agoPithos download supports resume (again)
Stavros Sachtouris [Tue, 18 Sep 2012 13:58:41 +0000 (16:58 +0300)]
Pithos download supports resume (again)

11 years agoVoodo-fix mysterious header-destroying request bug
Stavros Sachtouris [Tue, 18 Sep 2012 12:55:05 +0000 (15:55 +0300)]
Voodo-fix mysterious header-destroying request bug

11 years agoFix safe headers/params bug, pithos download bug
Stavros Sachtouris [Tue, 18 Sep 2012 11:07:03 +0000 (14:07 +0300)]
Fix safe headers/params bug, pithos download bug

11 years agoGreenlet/thread safe header/param requests
Stavros Sachtouris [Tue, 18 Sep 2012 09:11:48 +0000 (12:11 +0300)]
Greenlet/thread safe header/param requests

Requests can now distinguish between "global" headers/params
and thread-specific.

11 years agoRefactor pithos+ download
Stavros Sachtouris [Fri, 14 Sep 2012 12:50:47 +0000 (15:50 +0300)]
Refactor pithos+ download

3-modes:
a sequential
b sequential with resume
c asynchronous/parallel
bug: Still can't multi-download correctly

11 years agoWorkarround an eventlist random bug in downloading
Stavros Sachtouris [Thu, 13 Sep 2012 10:28:44 +0000 (13:28 +0300)]
Workarround an eventlist random bug in downloading

11 years agoMake object-download code readable
Stavros Sachtouris [Thu, 13 Sep 2012 09:47:31 +0000 (12:47 +0300)]
Make object-download code readable

11 years agoSeperate pithos rest api from pithos lib
Stavros Sachtouris [Wed, 12 Sep 2012 15:48:18 +0000 (18:48 +0300)]
Seperate pithos rest api from pithos lib

11 years agoMild refactoring to download and upload @pithos.py
Stavros Sachtouris [Wed, 12 Sep 2012 15:47:28 +0000 (18:47 +0300)]
Mild refactoring to download and upload @pithos.py

11 years agoFully integrate http connection modifications
Stavros Sachtouris [Wed, 12 Sep 2012 12:03:55 +0000 (15:03 +0300)]
Fully integrate http connection modifications

11 years agoFix gevent bug, move release action to connection
Stavros Sachtouris [Wed, 12 Sep 2012 10:21:01 +0000 (13:21 +0300)]
Fix gevent bug, move release action to connection

11 years agoMinor bugfixes
Stavros Sachtouris [Wed, 12 Sep 2012 09:16:27 +0000 (12:16 +0300)]
Minor bugfixes

11 years agoImplement kamakicon, use it
Stavros Sachtouris [Tue, 11 Sep 2012 15:10:34 +0000 (18:10 +0300)]
Implement kamakicon, use it

kamakicon: an httplib/ObjectPool based connection class

11 years agoMinor bugfixes
Stavros Sachtouris [Mon, 10 Sep 2012 13:30:04 +0000 (16:30 +0300)]
Minor bugfixes

11 years agoPool connections
Stavros Sachtouris [Mon, 10 Sep 2012 09:18:29 +0000 (12:18 +0300)]
Pool connections

Requests also block if pool is full (used to be just for
responses)

11 years agoUse connection pool after redesigning http connect
Stavros Sachtouris [Fri, 7 Sep 2012 09:51:18 +0000 (12:51 +0300)]
Use connection pool after redesigning http connect

HTTPRequestsXxx objects now use connection pooling
Atually, connections are not pooled, but responses are.

Implementation of connection pooling with httplib not ready yet

Pooling tested in uploads

11 years agoHTTPConnection can support pooling implementations
Stavros Sachtouris [Wed, 5 Sep 2012 11:56:33 +0000 (14:56 +0300)]
HTTPConnection can support pooling implementations

11 years agoHTTP Response args are now properties
Stavros Sachtouris [Tue, 4 Sep 2012 16:25:26 +0000 (19:25 +0300)]
HTTP Response args are now properties

11 years agoCorrect repackaging, minor server list improvement
Stavros Sachtouris [Tue, 4 Sep 2012 15:57:39 +0000 (18:57 +0300)]
Correct repackaging, minor server list improvement

11 years agoNew package CLI (repackaging), minor bugfixes
Stavros Sachtouris [Tue, 4 Sep 2012 15:43:54 +0000 (18:43 +0300)]
New package CLI (repackaging), minor bugfixes

kamaki now has two packages: cli and clients
cli contains all command line interface code
clients is an indepentand lib that can also used by 3rd parties
minor bugs in comput lib

11 years agoEquilize store mkdir with create for directories
Stavros Sachtouris [Tue, 4 Sep 2012 09:14:00 +0000 (12:14 +0300)]
Equilize store mkdir with create for directories

11 years agoMinor fixes
Stavros Sachtouris [Mon, 3 Sep 2012 15:28:36 +0000 (18:28 +0300)]
Minor fixes

11 years agoGeneric methods implementation in OOS Compute
Stavros Sachtouris [Mon, 3 Sep 2012 15:24:08 +0000 (18:24 +0300)]
Generic methods implementation in OOS Compute

added flavors_get, images_get/delete/post/put

11 years agoIntroduce general methods for cyclades poking
Stavros Sachtouris [Mon, 3 Sep 2012 14:26:06 +0000 (17:26 +0300)]
Introduce general methods for cyclades poking

servers_get/post, networks_get/delete/post/put with generic
arguments id and command are now used by oldern, convenience
calls. E.g.
    networks_get(100, 'action') with try
    GET http:.../networks/100/action
so it is used by list_networks

11 years agoMinor convenienve fixes
Stavros Sachtouris [Fri, 31 Aug 2012 15:53:48 +0000 (18:53 +0300)]
Minor convenienve fixes

11 years agoMinor test bug
Stavros Sachtouris [Fri, 31 Aug 2012 15:44:12 +0000 (18:44 +0300)]
Minor test bug

11 years agoAdd server_details, image_details tests
Stavros Sachtouris [Fri, 31 Aug 2012 15:36:54 +0000 (18:36 +0300)]
Add server_details, image_details tests

11 years agoImprove vm control during testing
Stavros Sachtouris [Fri, 31 Aug 2012 14:40:52 +0000 (17:40 +0300)]
Improve vm control during testing

11 years agoDelete used VMs after testing
Stavros Sachtouris [Fri, 31 Aug 2012 14:10:51 +0000 (17:10 +0300)]
Delete used VMs after testing

11 years agoPretify server list, test server list and create
Stavros Sachtouris [Thu, 30 Aug 2012 16:12:56 +0000 (19:12 +0300)]
Pretify server list, test server list and create

11 years agoImproced testing, started tests for cyclades
Stavros Sachtouris [Thu, 30 Aug 2012 15:30:09 +0000 (18:30 +0300)]
Improced testing, started tests for cyclades

11 years agoHandle requests exceptions
Stavros Sachtouris [Thu, 30 Aug 2012 12:51:36 +0000 (15:51 +0300)]
Handle requests exceptions

11 years agoReset headers and params at every request
Stavros Sachtouris [Wed, 29 Aug 2012 16:31:31 +0000 (19:31 +0300)]
Reset headers and params at every request

11 years agoMinor big fix
Stavros Sachtouris [Wed, 29 Aug 2012 16:17:02 +0000 (19:17 +0300)]
Minor big fix

11 years agoMinor arangements for error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:44:52 +0000 (18:44 +0300)]
Minor arangements for error handling

11 years agoMinor bug fixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:14:40 +0000 (18:14 +0300)]
Minor bug fixes in error handling

11 years agoMinor bigfixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:08:22 +0000 (18:08 +0300)]
Minor bigfixes in error handling

11 years agoAvoid veification (workarround for image list bug)
Stavros Sachtouris [Wed, 29 Aug 2012 14:40:54 +0000 (17:40 +0300)]
Avoid veification (workarround for image list bug)

11 years agoMajor changes in client, fixed setup
Stavros Sachtouris [Wed, 29 Aug 2012 14:26:56 +0000 (17:26 +0300)]
Major changes in client, fixed setup

Seperate Client to Client and HTTPConnection
The later is put in a separate package kamaki.client.connection
It manages headers, params, method, url and data of a connection
but the actuall http connection is not implemented at this
abstract level
There is an HTTPRequest class extention of HTTPConnection in the
same package. It implements connection using requests package
so basicaly it replicates the connection procedure that was used
in kamaki so far.
Minor modifications were nessacary at every client lib package

Setup is now aware of gevent and commands package

11 years agoImplement perform_request for HTTPRequest
Stavros Sachtouris [Tue, 28 Aug 2012 15:49:32 +0000 (18:49 +0300)]
Implement perform_request for HTTPRequest

11 years agoCreate HTTPRequest class
Stavros Sachtouris [Tue, 28 Aug 2012 15:48:04 +0000 (18:48 +0300)]
Create HTTPRequest class

Implements HTTPConnection using the requests pypi package

11 years agoConnection interface
Stavros Sachtouris [Tue, 28 Aug 2012 14:37:53 +0000 (17:37 +0300)]
Connection interface

11 years agoSeperate commands specs and connection packages
Stavros Sachtouris [Tue, 28 Aug 2012 14:22:10 +0000 (17:22 +0300)]
Seperate commands specs and connection packages

11 years agoImporove meta methods
Stavros Sachtouris [Tue, 28 Aug 2012 10:27:13 +0000 (13:27 +0300)]
Imporove meta methods

11 years agoImprove setmeta syntax
Stavros Sachtouris [Tue, 28 Aug 2012 09:40:08 +0000 (12:40 +0300)]
Improve setmeta syntax

11 years agoMinor bug fixes
Stavros Sachtouris [Tue, 28 Aug 2012 09:17:43 +0000 (12:17 +0300)]
Minor bug fixes

11 years agoOptionaly use --container instead of cont:
Stavros Sachtouris [Mon, 27 Aug 2012 15:14:03 +0000 (18:14 +0300)]
Optionaly use --container instead of cont:

11 years agoAdd more functionalities to dnl/hashmap/versions
Stavros Sachtouris [Fri, 24 Aug 2012 14:51:30 +0000 (17:51 +0300)]
Add more functionalities to dnl/hashmap/versions

download: progressbar control, overide file, resume (default)
all: extra options for conditional retrieval

11 years agoFixed bug with reset_headers
Stavros Sachtouris [Fri, 24 Aug 2012 10:46:01 +0000 (13:46 +0300)]
Fixed bug with reset_headers

Now headers are reset after each request by default
but there is an option for not reseting headers, in low
level

11 years agoVersions in download
Stavros Sachtouris [Thu, 23 Aug 2012 16:35:15 +0000 (19:35 +0300)]
Versions in download

11 years agoImproved incremental download, hashmap, versions
Stavros Sachtouris [Thu, 23 Aug 2012 16:15:44 +0000 (19:15 +0300)]
Improved incremental download, hashmap, versions

11 years agoAdd sharers from pithos_sh
Stavros Sachtouris [Thu, 23 Aug 2012 09:03:48 +0000 (12:03 +0300)]
Add sharers from pithos_sh

sharers shows the accounts that share objects with cur account

11 years agoAdd full pithos+ move in client.pithos
Stavros Sachtouris [Thu, 23 Aug 2012 08:33:03 +0000 (11:33 +0300)]
Add full pithos+ move in client.pithos

11 years agoFull pithos+ copy in clients.pithos
Stavros Sachtouris [Wed, 22 Aug 2012 15:25:31 +0000 (18:25 +0300)]
Full pithos+ copy in clients.pithos

11 years agoAdd pithos_sh GetObject as download
Stavros Sachtouris [Wed, 22 Aug 2012 13:58:40 +0000 (16:58 +0300)]
Add pithos_sh GetObject as download

pithos_sh download is incremental, therefore better than kamaki download

11 years agoCorrect some typos
Stavros Sachtouris [Tue, 21 Aug 2012 13:25:06 +0000 (16:25 +0300)]
Correct some typos

11 years agoAdd arguments/options to upload
Stavros Sachtouris [Thu, 9 Aug 2012 15:23:49 +0000 (18:23 +0300)]
Add arguments/options to upload

manifest is now a seperated method for uploading
old, naive upload is preserved with --unchunked option

11 years agoAdd options to store_delete
Stavros Sachtouris [Thu, 9 Aug 2012 12:32:59 +0000 (15:32 +0300)]
Add options to store_delete

11 years agoCreate supports meta
Stavros Sachtouris [Thu, 9 Aug 2012 11:16:10 +0000 (14:16 +0300)]
Create supports meta

11 years agoAdd options to create, add mkdir as seperate cmd
Stavros Sachtouris [Thu, 9 Aug 2012 11:05:11 +0000 (14:05 +0300)]
Add options to create, add mkdir as seperate cmd

11 years agoAdd options to meta
Stavros Sachtouris [Thu, 9 Aug 2012 10:28:01 +0000 (13:28 +0300)]
Add options to meta

11 years agoComplete store_list is superset of pithos_sh List
Stavros Sachtouris [Wed, 8 Aug 2012 18:15:21 +0000 (21:15 +0300)]
Complete store_list is superset of pithos_sh List

11 years agoAdd options to store_list
Stavros Sachtouris [Wed, 8 Aug 2012 16:06:59 +0000 (19:06 +0300)]
Add options to store_list

11 years agoRediculusly pretty store_list
Stavros Sachtouris [Wed, 8 Aug 2012 14:44:01 +0000 (17:44 +0300)]
Rediculusly pretty store_list

11 years agoMake container/object listing even more pretty!!!
Stavros Sachtouris [Wed, 8 Aug 2012 14:29:07 +0000 (17:29 +0300)]
Make container/object listing even more pretty!!!

11 years agoNew store_list with -l (detail) and bold
Stavros Sachtouris [Wed, 8 Aug 2012 14:04:56 +0000 (17:04 +0300)]
New store_list with -l (detail) and bold

11 years agoAllow cli arguments everywhere in command phrase
Stavros Sachtouris [Wed, 8 Aug 2012 10:54:32 +0000 (13:54 +0300)]
Allow cli arguments everywhere in command phrase

Changed behavior of CLI arguments that are command specific
e.g.
    kamaki server -l list
or
    kamaki -l server list
is now a valid kamaki command

11 years agoAdd all client api commands in new CLI
Stavros Sachtouris [Tue, 7 Aug 2012 15:31:33 +0000 (18:31 +0300)]
Add all client api commands in new CLI

11 years agoCreate CLIError class, use it in pithos_cli
Stavros Sachtouris [Mon, 6 Aug 2012 15:49:11 +0000 (18:49 +0300)]
Create CLIError class, use it in pithos_cli

11 years agoSiplify interface loading, add existing apis
Stavros Sachtouris [Mon, 6 Aug 2012 13:02:05 +0000 (16:02 +0300)]
Siplify interface loading, add existing apis

Old apis are added with new organization. For each api
a new _cli.py file provides all relevant cli commands

11 years agoDetach CLI from client libs
Stavros Sachtouris [Fri, 3 Aug 2012 16:44:56 +0000 (19:44 +0300)]
Detach CLI from client libs

Allow custom libs to be easily loaded to kamaki CLI
At the moment, everything is given in a conf file and
pre-imported