kamaki
11 years agoUnitest purge, create_by_manifestation, versionlst
Stavros Sachtouris [Thu, 20 Sep 2012 09:26:32 +0000 (12:26 +0300)]
Unitest purge, create_by_manifestation, versionlst

11 years agoSupport range at file (threaded) download
Stavros Sachtouris [Wed, 19 Sep 2012 14:17:21 +0000 (17:17 +0300)]
Support range at file (threaded) download

11 years agoAdd range in stream download
Stavros Sachtouris [Wed, 19 Sep 2012 13:43:45 +0000 (16:43 +0300)]
Add range in stream download

11 years agoGet rid of pithos_sh
Stavros Sachtouris [Wed, 19 Sep 2012 11:06:12 +0000 (14:06 +0300)]
Get rid of pithos_sh

The old profecy "there will be only one [Pithos Client]" is finally
fullfilled

11 years agoKamaki CLI/clients sharers implementation
Stavros Sachtouris [Wed, 19 Sep 2012 10:42:41 +0000 (13:42 +0300)]
Kamaki CLI/clients sharers implementation

mimics pithos_sh account sharers

11 years agoGet rid of pithos_sh hash methods in download
Stavros Sachtouris [Tue, 18 Sep 2012 15:31:45 +0000 (18:31 +0300)]
Get rid of pithos_sh hash methods in download

11 years agoMerge branch 'develop' of https://code.grnet.gr/git/kamaki into develop
Stavros Sachtouris [Tue, 18 Sep 2012 15:13:42 +0000 (18:13 +0300)]
Merge branch 'develop' of https://code.grnet.gr/git/kamaki into develop

Conflicts:
kamaki/clients/pithos.py

11 years agoMuch faster download resume
Stavros Sachtouris [Tue, 18 Sep 2012 15:10:09 +0000 (18:10 +0300)]
Much faster download resume

Don't preload local file blocks, but load each one dynamically
only before it is downloaded, and compare

11 years agoMuch faster resume in download
Stavros Sachtouris [Tue, 18 Sep 2012 14:58:49 +0000 (17:58 +0300)]
Much faster resume in download

11 years agoMinor CLI download behavior fixes
Stavros Sachtouris [Tue, 18 Sep 2012 14:29:17 +0000 (17:29 +0300)]
Minor CLI download behavior fixes

11 years agoPithos download supports resume (again)
Stavros Sachtouris [Tue, 18 Sep 2012 13:58:41 +0000 (16:58 +0300)]
Pithos download supports resume (again)

11 years agoVoodo-fix mysterious header-destroying request bug
Stavros Sachtouris [Tue, 18 Sep 2012 12:55:05 +0000 (15:55 +0300)]
Voodo-fix mysterious header-destroying request bug

11 years agoFix safe headers/params bug, pithos download bug
Stavros Sachtouris [Tue, 18 Sep 2012 11:07:03 +0000 (14:07 +0300)]
Fix safe headers/params bug, pithos download bug

11 years agoGreenlet/thread safe header/param requests
Stavros Sachtouris [Tue, 18 Sep 2012 09:11:48 +0000 (12:11 +0300)]
Greenlet/thread safe header/param requests

Requests can now distinguish between "global" headers/params
and thread-specific.

11 years agoRefactor pithos+ download
Stavros Sachtouris [Fri, 14 Sep 2012 12:50:47 +0000 (15:50 +0300)]
Refactor pithos+ download

3-modes:
a sequential
b sequential with resume
c asynchronous/parallel
bug: Still can't multi-download correctly

11 years agoWorkarround an eventlist random bug in downloading
Stavros Sachtouris [Thu, 13 Sep 2012 10:28:44 +0000 (13:28 +0300)]
Workarround an eventlist random bug in downloading

11 years agoMake object-download code readable
Stavros Sachtouris [Thu, 13 Sep 2012 09:47:31 +0000 (12:47 +0300)]
Make object-download code readable

11 years agoSeperate pithos rest api from pithos lib
Stavros Sachtouris [Wed, 12 Sep 2012 15:48:18 +0000 (18:48 +0300)]
Seperate pithos rest api from pithos lib

11 years agoMild refactoring to download and upload @pithos.py
Stavros Sachtouris [Wed, 12 Sep 2012 15:47:28 +0000 (18:47 +0300)]
Mild refactoring to download and upload @pithos.py

11 years agoFully integrate http connection modifications
Stavros Sachtouris [Wed, 12 Sep 2012 12:03:55 +0000 (15:03 +0300)]
Fully integrate http connection modifications

11 years agoFix gevent bug, move release action to connection
Stavros Sachtouris [Wed, 12 Sep 2012 10:21:01 +0000 (13:21 +0300)]
Fix gevent bug, move release action to connection

11 years agoMinor bugfixes
Stavros Sachtouris [Wed, 12 Sep 2012 09:16:27 +0000 (12:16 +0300)]
Minor bugfixes

11 years agoImplement kamakicon, use it
Stavros Sachtouris [Tue, 11 Sep 2012 15:10:34 +0000 (18:10 +0300)]
Implement kamakicon, use it

kamakicon: an httplib/ObjectPool based connection class

11 years agoMinor bugfixes
Stavros Sachtouris [Mon, 10 Sep 2012 13:30:04 +0000 (16:30 +0300)]
Minor bugfixes

11 years agoPool connections
Stavros Sachtouris [Mon, 10 Sep 2012 09:18:29 +0000 (12:18 +0300)]
Pool connections

Requests also block if pool is full (used to be just for
responses)

11 years agoUse connection pool after redesigning http connect
Stavros Sachtouris [Fri, 7 Sep 2012 09:51:18 +0000 (12:51 +0300)]
Use connection pool after redesigning http connect

HTTPRequestsXxx objects now use connection pooling
Atually, connections are not pooled, but responses are.

Implementation of connection pooling with httplib not ready yet

Pooling tested in uploads

11 years agoHTTPConnection can support pooling implementations
Stavros Sachtouris [Wed, 5 Sep 2012 11:56:33 +0000 (14:56 +0300)]
HTTPConnection can support pooling implementations

11 years agoHTTP Response args are now properties
Stavros Sachtouris [Tue, 4 Sep 2012 16:25:26 +0000 (19:25 +0300)]
HTTP Response args are now properties

11 years agoCorrect repackaging, minor server list improvement
Stavros Sachtouris [Tue, 4 Sep 2012 15:57:39 +0000 (18:57 +0300)]
Correct repackaging, minor server list improvement

11 years agoNew package CLI (repackaging), minor bugfixes
Stavros Sachtouris [Tue, 4 Sep 2012 15:43:54 +0000 (18:43 +0300)]
New package CLI (repackaging), minor bugfixes

kamaki now has two packages: cli and clients
cli contains all command line interface code
clients is an indepentand lib that can also used by 3rd parties
minor bugs in comput lib

11 years agoEquilize store mkdir with create for directories
Stavros Sachtouris [Tue, 4 Sep 2012 09:14:00 +0000 (12:14 +0300)]
Equilize store mkdir with create for directories

11 years agoMinor fixes
Stavros Sachtouris [Mon, 3 Sep 2012 15:28:36 +0000 (18:28 +0300)]
Minor fixes

11 years agoGeneric methods implementation in OOS Compute
Stavros Sachtouris [Mon, 3 Sep 2012 15:24:08 +0000 (18:24 +0300)]
Generic methods implementation in OOS Compute

added flavors_get, images_get/delete/post/put

11 years agoIntroduce general methods for cyclades poking
Stavros Sachtouris [Mon, 3 Sep 2012 14:26:06 +0000 (17:26 +0300)]
Introduce general methods for cyclades poking

servers_get/post, networks_get/delete/post/put with generic
arguments id and command are now used by oldern, convenience
calls. E.g.
    networks_get(100, 'action') with try
    GET http:.../networks/100/action
so it is used by list_networks

11 years agoMinor convenienve fixes
Stavros Sachtouris [Fri, 31 Aug 2012 15:53:48 +0000 (18:53 +0300)]
Minor convenienve fixes

11 years agoMinor test bug
Stavros Sachtouris [Fri, 31 Aug 2012 15:44:12 +0000 (18:44 +0300)]
Minor test bug

11 years agoAdd server_details, image_details tests
Stavros Sachtouris [Fri, 31 Aug 2012 15:36:54 +0000 (18:36 +0300)]
Add server_details, image_details tests

11 years agoImprove vm control during testing
Stavros Sachtouris [Fri, 31 Aug 2012 14:40:52 +0000 (17:40 +0300)]
Improve vm control during testing

11 years agoDelete used VMs after testing
Stavros Sachtouris [Fri, 31 Aug 2012 14:10:51 +0000 (17:10 +0300)]
Delete used VMs after testing

11 years agoPretify server list, test server list and create
Stavros Sachtouris [Thu, 30 Aug 2012 16:12:56 +0000 (19:12 +0300)]
Pretify server list, test server list and create

11 years agoImproced testing, started tests for cyclades
Stavros Sachtouris [Thu, 30 Aug 2012 15:30:09 +0000 (18:30 +0300)]
Improced testing, started tests for cyclades

11 years agoHandle requests exceptions
Stavros Sachtouris [Thu, 30 Aug 2012 12:51:36 +0000 (15:51 +0300)]
Handle requests exceptions

11 years agoReset headers and params at every request
Stavros Sachtouris [Wed, 29 Aug 2012 16:31:31 +0000 (19:31 +0300)]
Reset headers and params at every request

11 years agoMinor big fix
Stavros Sachtouris [Wed, 29 Aug 2012 16:17:02 +0000 (19:17 +0300)]
Minor big fix

11 years agoMinor arangements for error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:44:52 +0000 (18:44 +0300)]
Minor arangements for error handling

11 years agoMinor bug fixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:14:40 +0000 (18:14 +0300)]
Minor bug fixes in error handling

11 years agoMinor bigfixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:08:22 +0000 (18:08 +0300)]
Minor bigfixes in error handling

11 years agoAvoid veification (workarround for image list bug)
Stavros Sachtouris [Wed, 29 Aug 2012 14:40:54 +0000 (17:40 +0300)]
Avoid veification (workarround for image list bug)

11 years agoMajor changes in client, fixed setup
Stavros Sachtouris [Wed, 29 Aug 2012 14:26:56 +0000 (17:26 +0300)]
Major changes in client, fixed setup

Seperate Client to Client and HTTPConnection
The later is put in a separate package kamaki.client.connection
It manages headers, params, method, url and data of a connection
but the actuall http connection is not implemented at this
abstract level
There is an HTTPRequest class extention of HTTPConnection in the
same package. It implements connection using requests package
so basicaly it replicates the connection procedure that was used
in kamaki so far.
Minor modifications were nessacary at every client lib package

Setup is now aware of gevent and commands package

11 years agoImplement perform_request for HTTPRequest
Stavros Sachtouris [Tue, 28 Aug 2012 15:49:32 +0000 (18:49 +0300)]
Implement perform_request for HTTPRequest

11 years agoCreate HTTPRequest class
Stavros Sachtouris [Tue, 28 Aug 2012 15:48:04 +0000 (18:48 +0300)]
Create HTTPRequest class

Implements HTTPConnection using the requests pypi package

11 years agoConnection interface
Stavros Sachtouris [Tue, 28 Aug 2012 14:37:53 +0000 (17:37 +0300)]
Connection interface

11 years agoSeperate commands specs and connection packages
Stavros Sachtouris [Tue, 28 Aug 2012 14:22:10 +0000 (17:22 +0300)]
Seperate commands specs and connection packages

11 years agoImporove meta methods
Stavros Sachtouris [Tue, 28 Aug 2012 10:27:13 +0000 (13:27 +0300)]
Imporove meta methods

11 years agoImprove setmeta syntax
Stavros Sachtouris [Tue, 28 Aug 2012 09:40:08 +0000 (12:40 +0300)]
Improve setmeta syntax

11 years agoMinor bug fixes
Stavros Sachtouris [Tue, 28 Aug 2012 09:17:43 +0000 (12:17 +0300)]
Minor bug fixes

11 years agoOptionaly use --container instead of cont:
Stavros Sachtouris [Mon, 27 Aug 2012 15:14:03 +0000 (18:14 +0300)]
Optionaly use --container instead of cont:

11 years agoAdd more functionalities to dnl/hashmap/versions
Stavros Sachtouris [Fri, 24 Aug 2012 14:51:30 +0000 (17:51 +0300)]
Add more functionalities to dnl/hashmap/versions

download: progressbar control, overide file, resume (default)
all: extra options for conditional retrieval

11 years agoFixed bug with reset_headers
Stavros Sachtouris [Fri, 24 Aug 2012 10:46:01 +0000 (13:46 +0300)]
Fixed bug with reset_headers

Now headers are reset after each request by default
but there is an option for not reseting headers, in low
level

11 years agoVersions in download
Stavros Sachtouris [Thu, 23 Aug 2012 16:35:15 +0000 (19:35 +0300)]
Versions in download

11 years agoImproved incremental download, hashmap, versions
Stavros Sachtouris [Thu, 23 Aug 2012 16:15:44 +0000 (19:15 +0300)]
Improved incremental download, hashmap, versions

11 years agoAdd sharers from pithos_sh
Stavros Sachtouris [Thu, 23 Aug 2012 09:03:48 +0000 (12:03 +0300)]
Add sharers from pithos_sh

sharers shows the accounts that share objects with cur account

11 years agoAdd full pithos+ move in client.pithos
Stavros Sachtouris [Thu, 23 Aug 2012 08:33:03 +0000 (11:33 +0300)]
Add full pithos+ move in client.pithos

11 years agoFull pithos+ copy in clients.pithos
Stavros Sachtouris [Wed, 22 Aug 2012 15:25:31 +0000 (18:25 +0300)]
Full pithos+ copy in clients.pithos

11 years agoAdd pithos_sh GetObject as download
Stavros Sachtouris [Wed, 22 Aug 2012 13:58:40 +0000 (16:58 +0300)]
Add pithos_sh GetObject as download

pithos_sh download is incremental, therefore better than kamaki download

11 years agoCorrect some typos
Stavros Sachtouris [Tue, 21 Aug 2012 13:25:06 +0000 (16:25 +0300)]
Correct some typos

11 years agoAdd arguments/options to upload
Stavros Sachtouris [Thu, 9 Aug 2012 15:23:49 +0000 (18:23 +0300)]
Add arguments/options to upload

manifest is now a seperated method for uploading
old, naive upload is preserved with --unchunked option

11 years agoAdd options to store_delete
Stavros Sachtouris [Thu, 9 Aug 2012 12:32:59 +0000 (15:32 +0300)]
Add options to store_delete

11 years agoCreate supports meta
Stavros Sachtouris [Thu, 9 Aug 2012 11:16:10 +0000 (14:16 +0300)]
Create supports meta

11 years agoAdd options to create, add mkdir as seperate cmd
Stavros Sachtouris [Thu, 9 Aug 2012 11:05:11 +0000 (14:05 +0300)]
Add options to create, add mkdir as seperate cmd

11 years agoAdd options to meta
Stavros Sachtouris [Thu, 9 Aug 2012 10:28:01 +0000 (13:28 +0300)]
Add options to meta

11 years agoComplete store_list is superset of pithos_sh List
Stavros Sachtouris [Wed, 8 Aug 2012 18:15:21 +0000 (21:15 +0300)]
Complete store_list is superset of pithos_sh List

11 years agoAdd options to store_list
Stavros Sachtouris [Wed, 8 Aug 2012 16:06:59 +0000 (19:06 +0300)]
Add options to store_list

11 years agoRediculusly pretty store_list
Stavros Sachtouris [Wed, 8 Aug 2012 14:44:01 +0000 (17:44 +0300)]
Rediculusly pretty store_list

11 years agoMake container/object listing even more pretty!!!
Stavros Sachtouris [Wed, 8 Aug 2012 14:29:07 +0000 (17:29 +0300)]
Make container/object listing even more pretty!!!

11 years agoNew store_list with -l (detail) and bold
Stavros Sachtouris [Wed, 8 Aug 2012 14:04:56 +0000 (17:04 +0300)]
New store_list with -l (detail) and bold

11 years agoAllow cli arguments everywhere in command phrase
Stavros Sachtouris [Wed, 8 Aug 2012 10:54:32 +0000 (13:54 +0300)]
Allow cli arguments everywhere in command phrase

Changed behavior of CLI arguments that are command specific
e.g.
    kamaki server -l list
or
    kamaki -l server list
is now a valid kamaki command

11 years agoAdd all client api commands in new CLI
Stavros Sachtouris [Tue, 7 Aug 2012 15:31:33 +0000 (18:31 +0300)]
Add all client api commands in new CLI

11 years agoCreate CLIError class, use it in pithos_cli
Stavros Sachtouris [Mon, 6 Aug 2012 15:49:11 +0000 (18:49 +0300)]
Create CLIError class, use it in pithos_cli

11 years agoSiplify interface loading, add existing apis
Stavros Sachtouris [Mon, 6 Aug 2012 13:02:05 +0000 (16:02 +0300)]
Siplify interface loading, add existing apis

Old apis are added with new organization. For each api
a new _cli.py file provides all relevant cli commands

11 years agoDetach CLI from client libs
Stavros Sachtouris [Fri, 3 Aug 2012 16:44:56 +0000 (19:44 +0300)]
Detach CLI from client libs

Allow custom libs to be easily loaded to kamaki CLI
At the moment, everything is given in a conf file and
pre-imported

11 years agoAsynchronous uploads with gevent-greenlet
Stavros Sachtouris [Wed, 1 Aug 2012 14:48:21 +0000 (17:48 +0300)]
Asynchronous uploads with gevent-greenlet

Merge with koukis-fix

11 years agoStart unittest for large file pithos operations
Stavros Sachtouris [Tue, 31 Jul 2012 14:09:56 +0000 (17:09 +0300)]
Start unittest for large file pithos operations

11 years ago(Almost) complete pithos client unittesting
Stavros Sachtouris [Mon, 30 Jul 2012 15:49:47 +0000 (18:49 +0300)]
(Almost) complete pithos client unittesting

transfer_encoding still unchecked

11 years agoAdjust unit-test object_head/get/put/copy +bugs
Stavros Sachtouris [Fri, 27 Jul 2012 15:09:01 +0000 (18:09 +0300)]
Adjust unit-test object_head/get/put/copy +bugs

Missing:
- account_quota/versioning
- container_post with transfer-encoding
- object_put with transfer-encoding
- object_copy with manifest
- adjust object_move/post/delete

11 years agoComplete unittesting for container level pithos
Stavros Sachtouris [Thu, 26 Jul 2012 16:05:14 +0000 (19:05 +0300)]
Complete unittesting for container level pithos

11 years agoAdjusting account/container opps + bug fixes
Stavros Sachtouris [Thu, 26 Jul 2012 12:36:34 +0000 (15:36 +0300)]
Adjusting account/container opps + bug fixes

11 years agoFixed bug with large file uploads
Stavros Sachtouris [Thu, 26 Jul 2012 09:04:15 +0000 (12:04 +0300)]
Fixed bug with large file uploads

11 years agoSmall progress
Stavros Sachtouris [Wed, 25 Jul 2012 16:11:57 +0000 (19:11 +0300)]
Small progress

11 years agoCompleted tests for pithos+ starting improves
Stavros Sachtouris [Wed, 25 Jul 2012 15:36:59 +0000 (18:36 +0300)]
Completed tests for pithos+ starting improves

TODO Improvements for tests, like creating and destroying
containers and adjusting all tests to use only these temp
containers

11 years agoAdded test_object_delete
Stavros Sachtouris [Wed, 25 Jul 2012 14:00:13 +0000 (17:00 +0300)]
Added test_object_delete

11 years agoAdded objectcopy/move/post _ minor bugfixes
Stavros Sachtouris [Wed, 25 Jul 2012 13:37:43 +0000 (16:37 +0300)]
Added objectcopy/move/post _ minor bugfixes

11 years agoStarted testing object_copy +minor fixes
Stavros Sachtouris [Tue, 24 Jul 2012 16:06:00 +0000 (19:06 +0300)]
Started testing object_copy +minor fixes

11 years agoAdded tests for object_put + minor bug fixes
Stavros Sachtouris [Tue, 24 Jul 2012 14:37:16 +0000 (17:37 +0300)]
Added tests for object_put + minor bug fixes

11 years agoMore testing in storage
Stavros Sachtouris [Thu, 19 Jul 2012 15:27:13 +0000 (18:27 +0300)]
More testing in storage

Completed testing at container level, started at object level

11 years agoFixed image register CLI bug
Stavros Sachtouris [Thu, 19 Jul 2012 10:10:47 +0000 (13:10 +0300)]
Fixed image register CLI bug

11 years agoImplemented tests (Pithos+, partial, for now)
Stavros Sachtouris [Wed, 18 Jul 2012 15:58:28 +0000 (18:58 +0300)]
Implemented tests (Pithos+, partial, for now)

Used unittest, implemented tests for all account level Pithos+
operations and some container level operations
TBC

11 years agoPretyfication adjustments
Stavros Sachtouris [Wed, 18 Jul 2012 12:06:04 +0000 (15:06 +0300)]
Pretyfication adjustments

Fixed colors in flavor and image error messages
Pretyfied image client code

11 years agoFixed and modified disconnect network
Stavros Sachtouris [Tue, 17 Jul 2012 16:12:45 +0000 (19:12 +0300)]
Fixed and modified disconnect network

Fixed bug with return value
Modified disconnect to take only nic_id as arg

11 years agoFull Pithos+ support at object level
Stavros Sachtouris [Tue, 17 Jul 2012 11:59:17 +0000 (14:59 +0300)]
Full Pithos+ support at object level

Rest calls HEAD GET PUT COPY MOVE POST DELETE at object level fully
support Pithos+ capabilities by adding generic methods. Adjusted
existing methods to take advantage of these
Not thoroughly tested...