Stavros Sachtouris [Thu, 20 Sep 2012 09:26:32 +0000 (12:26 +0300)]
Unitest purge, create_by_manifestation, versionlst
Stavros Sachtouris [Wed, 19 Sep 2012 14:17:21 +0000 (17:17 +0300)]
Support range at file (threaded) download
Stavros Sachtouris [Wed, 19 Sep 2012 13:43:45 +0000 (16:43 +0300)]
Add range in stream download
Stavros Sachtouris [Wed, 19 Sep 2012 11:06:12 +0000 (14:06 +0300)]
Get rid of pithos_sh
The old profecy "there will be only one [Pithos Client]" is finally
fullfilled
Stavros Sachtouris [Wed, 19 Sep 2012 10:42:41 +0000 (13:42 +0300)]
Kamaki CLI/clients sharers implementation
mimics pithos_sh account sharers
Stavros Sachtouris [Tue, 18 Sep 2012 15:31:45 +0000 (18:31 +0300)]
Get rid of pithos_sh hash methods in download
Stavros Sachtouris [Tue, 18 Sep 2012 15:13:42 +0000 (18:13 +0300)]
Merge branch 'develop' of https://code.grnet.gr/git/kamaki into develop
Conflicts:
kamaki/clients/pithos.py
Stavros Sachtouris [Tue, 18 Sep 2012 15:10:09 +0000 (18:10 +0300)]
Much faster download resume
Don't preload local file blocks, but load each one dynamically
only before it is downloaded, and compare
Stavros Sachtouris [Tue, 18 Sep 2012 14:58:49 +0000 (17:58 +0300)]
Much faster resume in download
Stavros Sachtouris [Tue, 18 Sep 2012 14:29:17 +0000 (17:29 +0300)]
Minor CLI download behavior fixes
Stavros Sachtouris [Tue, 18 Sep 2012 13:58:41 +0000 (16:58 +0300)]
Pithos download supports resume (again)
Stavros Sachtouris [Tue, 18 Sep 2012 12:55:05 +0000 (15:55 +0300)]
Voodo-fix mysterious header-destroying request bug
Stavros Sachtouris [Tue, 18 Sep 2012 11:07:03 +0000 (14:07 +0300)]
Fix safe headers/params bug, pithos download bug
Stavros Sachtouris [Tue, 18 Sep 2012 09:11:48 +0000 (12:11 +0300)]
Greenlet/thread safe header/param requests
Requests can now distinguish between "global" headers/params
and thread-specific.
Stavros Sachtouris [Fri, 14 Sep 2012 12:50:47 +0000 (15:50 +0300)]
Refactor pithos+ download
3-modes:
a sequential
b sequential with resume
c asynchronous/parallel
bug: Still can't multi-download correctly
Stavros Sachtouris [Thu, 13 Sep 2012 10:28:44 +0000 (13:28 +0300)]
Workarround an eventlist random bug in downloading
Stavros Sachtouris [Thu, 13 Sep 2012 09:47:31 +0000 (12:47 +0300)]
Make object-download code readable
Stavros Sachtouris [Wed, 12 Sep 2012 15:48:18 +0000 (18:48 +0300)]
Seperate pithos rest api from pithos lib
Stavros Sachtouris [Wed, 12 Sep 2012 15:47:28 +0000 (18:47 +0300)]
Mild refactoring to download and upload @pithos.py
Stavros Sachtouris [Wed, 12 Sep 2012 12:03:55 +0000 (15:03 +0300)]
Fully integrate http connection modifications
Stavros Sachtouris [Wed, 12 Sep 2012 10:21:01 +0000 (13:21 +0300)]
Fix gevent bug, move release action to connection
Stavros Sachtouris [Wed, 12 Sep 2012 09:16:27 +0000 (12:16 +0300)]
Minor bugfixes
Stavros Sachtouris [Tue, 11 Sep 2012 15:10:34 +0000 (18:10 +0300)]
Implement kamakicon, use it
kamakicon: an httplib/ObjectPool based connection class
Stavros Sachtouris [Mon, 10 Sep 2012 13:30:04 +0000 (16:30 +0300)]
Minor bugfixes
Stavros Sachtouris [Mon, 10 Sep 2012 09:18:29 +0000 (12:18 +0300)]
Pool connections
Requests also block if pool is full (used to be just for
responses)
Stavros Sachtouris [Fri, 7 Sep 2012 09:51:18 +0000 (12:51 +0300)]
Use connection pool after redesigning http connect
HTTPRequestsXxx objects now use connection pooling
Atually, connections are not pooled, but responses are.
Implementation of connection pooling with httplib not ready yet
Pooling tested in uploads
Stavros Sachtouris [Wed, 5 Sep 2012 11:56:33 +0000 (14:56 +0300)]
HTTPConnection can support pooling implementations
Stavros Sachtouris [Tue, 4 Sep 2012 16:25:26 +0000 (19:25 +0300)]
HTTP Response args are now properties
Stavros Sachtouris [Tue, 4 Sep 2012 15:57:39 +0000 (18:57 +0300)]
Correct repackaging, minor server list improvement
Stavros Sachtouris [Tue, 4 Sep 2012 15:43:54 +0000 (18:43 +0300)]
New package CLI (repackaging), minor bugfixes
kamaki now has two packages: cli and clients
cli contains all command line interface code
clients is an indepentand lib that can also used by 3rd parties
minor bugs in comput lib
Stavros Sachtouris [Tue, 4 Sep 2012 09:14:00 +0000 (12:14 +0300)]
Equilize store mkdir with create for directories
Stavros Sachtouris [Mon, 3 Sep 2012 15:28:36 +0000 (18:28 +0300)]
Minor fixes
Stavros Sachtouris [Mon, 3 Sep 2012 15:24:08 +0000 (18:24 +0300)]
Generic methods implementation in OOS Compute
added flavors_get, images_get/delete/post/put
Stavros Sachtouris [Mon, 3 Sep 2012 14:26:06 +0000 (17:26 +0300)]
Introduce general methods for cyclades poking
servers_get/post, networks_get/delete/post/put with generic
arguments id and command are now used by oldern, convenience
calls. E.g.
networks_get(100, 'action') with try
GET http:.../networks/100/action
so it is used by list_networks
Stavros Sachtouris [Fri, 31 Aug 2012 15:53:48 +0000 (18:53 +0300)]
Minor convenienve fixes
Stavros Sachtouris [Fri, 31 Aug 2012 15:44:12 +0000 (18:44 +0300)]
Minor test bug
Stavros Sachtouris [Fri, 31 Aug 2012 15:36:54 +0000 (18:36 +0300)]
Add server_details, image_details tests
Stavros Sachtouris [Fri, 31 Aug 2012 14:40:52 +0000 (17:40 +0300)]
Improve vm control during testing
Stavros Sachtouris [Fri, 31 Aug 2012 14:10:51 +0000 (17:10 +0300)]
Delete used VMs after testing
Stavros Sachtouris [Thu, 30 Aug 2012 16:12:56 +0000 (19:12 +0300)]
Pretify server list, test server list and create
Stavros Sachtouris [Thu, 30 Aug 2012 15:30:09 +0000 (18:30 +0300)]
Improced testing, started tests for cyclades
Stavros Sachtouris [Thu, 30 Aug 2012 12:51:36 +0000 (15:51 +0300)]
Handle requests exceptions
Stavros Sachtouris [Wed, 29 Aug 2012 16:31:31 +0000 (19:31 +0300)]
Reset headers and params at every request
Stavros Sachtouris [Wed, 29 Aug 2012 16:17:02 +0000 (19:17 +0300)]
Minor big fix
Stavros Sachtouris [Wed, 29 Aug 2012 15:44:52 +0000 (18:44 +0300)]
Minor arangements for error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:14:40 +0000 (18:14 +0300)]
Minor bug fixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:08:22 +0000 (18:08 +0300)]
Minor bigfixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 14:40:54 +0000 (17:40 +0300)]
Avoid veification (workarround for image list bug)
Stavros Sachtouris [Wed, 29 Aug 2012 14:26:56 +0000 (17:26 +0300)]
Major changes in client, fixed setup
Seperate Client to Client and HTTPConnection
The later is put in a separate package kamaki.client.connection
It manages headers, params, method, url and data of a connection
but the actuall http connection is not implemented at this
abstract level
There is an HTTPRequest class extention of HTTPConnection in the
same package. It implements connection using requests package
so basicaly it replicates the connection procedure that was used
in kamaki so far.
Minor modifications were nessacary at every client lib package
Setup is now aware of gevent and commands package
Stavros Sachtouris [Tue, 28 Aug 2012 15:49:32 +0000 (18:49 +0300)]
Implement perform_request for HTTPRequest
Stavros Sachtouris [Tue, 28 Aug 2012 15:48:04 +0000 (18:48 +0300)]
Create HTTPRequest class
Implements HTTPConnection using the requests pypi package
Stavros Sachtouris [Tue, 28 Aug 2012 14:37:53 +0000 (17:37 +0300)]
Connection interface
Stavros Sachtouris [Tue, 28 Aug 2012 14:22:10 +0000 (17:22 +0300)]
Seperate commands specs and connection packages
Stavros Sachtouris [Tue, 28 Aug 2012 10:27:13 +0000 (13:27 +0300)]
Imporove meta methods
Stavros Sachtouris [Tue, 28 Aug 2012 09:40:08 +0000 (12:40 +0300)]
Improve setmeta syntax
Stavros Sachtouris [Tue, 28 Aug 2012 09:17:43 +0000 (12:17 +0300)]
Minor bug fixes
Stavros Sachtouris [Mon, 27 Aug 2012 15:14:03 +0000 (18:14 +0300)]
Optionaly use --container instead of cont:
Stavros Sachtouris [Fri, 24 Aug 2012 14:51:30 +0000 (17:51 +0300)]
Add more functionalities to dnl/hashmap/versions
download: progressbar control, overide file, resume (default)
all: extra options for conditional retrieval
Stavros Sachtouris [Fri, 24 Aug 2012 10:46:01 +0000 (13:46 +0300)]
Fixed bug with reset_headers
Now headers are reset after each request by default
but there is an option for not reseting headers, in low
level
Stavros Sachtouris [Thu, 23 Aug 2012 16:35:15 +0000 (19:35 +0300)]
Versions in download
Stavros Sachtouris [Thu, 23 Aug 2012 16:15:44 +0000 (19:15 +0300)]
Improved incremental download, hashmap, versions
Stavros Sachtouris [Thu, 23 Aug 2012 09:03:48 +0000 (12:03 +0300)]
Add sharers from pithos_sh
sharers shows the accounts that share objects with cur account
Stavros Sachtouris [Thu, 23 Aug 2012 08:33:03 +0000 (11:33 +0300)]
Add full pithos+ move in client.pithos
Stavros Sachtouris [Wed, 22 Aug 2012 15:25:31 +0000 (18:25 +0300)]
Full pithos+ copy in clients.pithos
Stavros Sachtouris [Wed, 22 Aug 2012 13:58:40 +0000 (16:58 +0300)]
Add pithos_sh GetObject as download
pithos_sh download is incremental, therefore better than kamaki download
Stavros Sachtouris [Tue, 21 Aug 2012 13:25:06 +0000 (16:25 +0300)]
Correct some typos
Stavros Sachtouris [Thu, 9 Aug 2012 15:23:49 +0000 (18:23 +0300)]
Add arguments/options to upload
manifest is now a seperated method for uploading
old, naive upload is preserved with --unchunked option
Stavros Sachtouris [Thu, 9 Aug 2012 12:32:59 +0000 (15:32 +0300)]
Add options to store_delete
Stavros Sachtouris [Thu, 9 Aug 2012 11:16:10 +0000 (14:16 +0300)]
Create supports meta
Stavros Sachtouris [Thu, 9 Aug 2012 11:05:11 +0000 (14:05 +0300)]
Add options to create, add mkdir as seperate cmd
Stavros Sachtouris [Thu, 9 Aug 2012 10:28:01 +0000 (13:28 +0300)]
Add options to meta
Stavros Sachtouris [Wed, 8 Aug 2012 18:15:21 +0000 (21:15 +0300)]
Complete store_list is superset of pithos_sh List
Stavros Sachtouris [Wed, 8 Aug 2012 16:06:59 +0000 (19:06 +0300)]
Add options to store_list
Stavros Sachtouris [Wed, 8 Aug 2012 14:44:01 +0000 (17:44 +0300)]
Rediculusly pretty store_list
Stavros Sachtouris [Wed, 8 Aug 2012 14:29:07 +0000 (17:29 +0300)]
Make container/object listing even more pretty!!!
Stavros Sachtouris [Wed, 8 Aug 2012 14:04:56 +0000 (17:04 +0300)]
New store_list with -l (detail) and bold
Stavros Sachtouris [Wed, 8 Aug 2012 10:54:32 +0000 (13:54 +0300)]
Allow cli arguments everywhere in command phrase
Changed behavior of CLI arguments that are command specific
e.g.
kamaki server -l list
or
kamaki -l server list
is now a valid kamaki command
Stavros Sachtouris [Tue, 7 Aug 2012 15:31:33 +0000 (18:31 +0300)]
Add all client api commands in new CLI
Stavros Sachtouris [Mon, 6 Aug 2012 15:49:11 +0000 (18:49 +0300)]
Create CLIError class, use it in pithos_cli
Stavros Sachtouris [Mon, 6 Aug 2012 13:02:05 +0000 (16:02 +0300)]
Siplify interface loading, add existing apis
Old apis are added with new organization. For each api
a new _cli.py file provides all relevant cli commands
Stavros Sachtouris [Fri, 3 Aug 2012 16:44:56 +0000 (19:44 +0300)]
Detach CLI from client libs
Allow custom libs to be easily loaded to kamaki CLI
At the moment, everything is given in a conf file and
pre-imported
Stavros Sachtouris [Wed, 1 Aug 2012 14:48:21 +0000 (17:48 +0300)]
Asynchronous uploads with gevent-greenlet
Merge with koukis-fix
Stavros Sachtouris [Tue, 31 Jul 2012 14:09:56 +0000 (17:09 +0300)]
Start unittest for large file pithos operations
Stavros Sachtouris [Mon, 30 Jul 2012 15:49:47 +0000 (18:49 +0300)]
(Almost) complete pithos client unittesting
transfer_encoding still unchecked
Stavros Sachtouris [Fri, 27 Jul 2012 15:09:01 +0000 (18:09 +0300)]
Adjust unit-test object_head/get/put/copy +bugs
Missing:
- account_quota/versioning
- container_post with transfer-encoding
- object_put with transfer-encoding
- object_copy with manifest
- adjust object_move/post/delete
Stavros Sachtouris [Thu, 26 Jul 2012 16:05:14 +0000 (19:05 +0300)]
Complete unittesting for container level pithos
Stavros Sachtouris [Thu, 26 Jul 2012 12:36:34 +0000 (15:36 +0300)]
Adjusting account/container opps + bug fixes
Stavros Sachtouris [Thu, 26 Jul 2012 09:04:15 +0000 (12:04 +0300)]
Fixed bug with large file uploads
Stavros Sachtouris [Wed, 25 Jul 2012 16:11:57 +0000 (19:11 +0300)]
Small progress
Stavros Sachtouris [Wed, 25 Jul 2012 15:36:59 +0000 (18:36 +0300)]
Completed tests for pithos+ starting improves
TODO Improvements for tests, like creating and destroying
containers and adjusting all tests to use only these temp
containers
Stavros Sachtouris [Wed, 25 Jul 2012 14:00:13 +0000 (17:00 +0300)]
Added test_object_delete
Stavros Sachtouris [Wed, 25 Jul 2012 13:37:43 +0000 (16:37 +0300)]
Added objectcopy/move/post _ minor bugfixes
Stavros Sachtouris [Tue, 24 Jul 2012 16:06:00 +0000 (19:06 +0300)]
Started testing object_copy +minor fixes
Stavros Sachtouris [Tue, 24 Jul 2012 14:37:16 +0000 (17:37 +0300)]
Added tests for object_put + minor bug fixes
Stavros Sachtouris [Thu, 19 Jul 2012 15:27:13 +0000 (18:27 +0300)]
More testing in storage
Completed testing at container level, started at object level
Stavros Sachtouris [Thu, 19 Jul 2012 10:10:47 +0000 (13:10 +0300)]
Fixed image register CLI bug
Stavros Sachtouris [Wed, 18 Jul 2012 15:58:28 +0000 (18:58 +0300)]
Implemented tests (Pithos+, partial, for now)
Used unittest, implemented tests for all account level Pithos+
operations and some container level operations
TBC
Stavros Sachtouris [Wed, 18 Jul 2012 12:06:04 +0000 (15:06 +0300)]
Pretyfication adjustments
Fixed colors in flavor and image error messages
Pretyfied image client code
Stavros Sachtouris [Tue, 17 Jul 2012 16:12:45 +0000 (19:12 +0300)]
Fixed and modified disconnect network
Fixed bug with return value
Modified disconnect to take only nic_id as arg
Stavros Sachtouris [Tue, 17 Jul 2012 11:59:17 +0000 (14:59 +0300)]
Full Pithos+ support at object level
Rest calls HEAD GET PUT COPY MOVE POST DELETE at object level fully
support Pithos+ capabilities by adding generic methods. Adjusted
existing methods to take advantage of these
Not thoroughly tested...