Stavros Sachtouris [Fri, 7 Sep 2012 09:51:18 +0000 (12:51 +0300)]
Use connection pool after redesigning http connect
HTTPRequestsXxx objects now use connection pooling
Atually, connections are not pooled, but responses are.
Implementation of connection pooling with httplib not ready yet
Pooling tested in uploads
Stavros Sachtouris [Wed, 5 Sep 2012 11:56:33 +0000 (14:56 +0300)]
HTTPConnection can support pooling implementations
Stavros Sachtouris [Tue, 4 Sep 2012 16:25:26 +0000 (19:25 +0300)]
HTTP Response args are now properties
Stavros Sachtouris [Tue, 4 Sep 2012 15:57:39 +0000 (18:57 +0300)]
Correct repackaging, minor server list improvement
Stavros Sachtouris [Tue, 4 Sep 2012 15:43:54 +0000 (18:43 +0300)]
New package CLI (repackaging), minor bugfixes
kamaki now has two packages: cli and clients
cli contains all command line interface code
clients is an indepentand lib that can also used by 3rd parties
minor bugs in comput lib
Stavros Sachtouris [Tue, 4 Sep 2012 09:14:00 +0000 (12:14 +0300)]
Equilize store mkdir with create for directories
Stavros Sachtouris [Mon, 3 Sep 2012 15:28:36 +0000 (18:28 +0300)]
Minor fixes
Stavros Sachtouris [Mon, 3 Sep 2012 15:24:08 +0000 (18:24 +0300)]
Generic methods implementation in OOS Compute
added flavors_get, images_get/delete/post/put
Stavros Sachtouris [Mon, 3 Sep 2012 14:26:06 +0000 (17:26 +0300)]
Introduce general methods for cyclades poking
servers_get/post, networks_get/delete/post/put with generic
arguments id and command are now used by oldern, convenience
calls. E.g.
networks_get(100, 'action') with try
GET http:.../networks/100/action
so it is used by list_networks
Stavros Sachtouris [Fri, 31 Aug 2012 15:53:48 +0000 (18:53 +0300)]
Minor convenienve fixes
Stavros Sachtouris [Fri, 31 Aug 2012 15:44:12 +0000 (18:44 +0300)]
Minor test bug
Stavros Sachtouris [Fri, 31 Aug 2012 15:36:54 +0000 (18:36 +0300)]
Add server_details, image_details tests
Stavros Sachtouris [Fri, 31 Aug 2012 14:40:52 +0000 (17:40 +0300)]
Improve vm control during testing
Stavros Sachtouris [Fri, 31 Aug 2012 14:10:51 +0000 (17:10 +0300)]
Delete used VMs after testing
Stavros Sachtouris [Thu, 30 Aug 2012 16:12:56 +0000 (19:12 +0300)]
Pretify server list, test server list and create
Stavros Sachtouris [Thu, 30 Aug 2012 15:30:09 +0000 (18:30 +0300)]
Improced testing, started tests for cyclades
Stavros Sachtouris [Thu, 30 Aug 2012 12:51:36 +0000 (15:51 +0300)]
Handle requests exceptions
Stavros Sachtouris [Wed, 29 Aug 2012 16:31:31 +0000 (19:31 +0300)]
Reset headers and params at every request
Stavros Sachtouris [Wed, 29 Aug 2012 16:17:02 +0000 (19:17 +0300)]
Minor big fix
Stavros Sachtouris [Wed, 29 Aug 2012 15:44:52 +0000 (18:44 +0300)]
Minor arangements for error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:14:40 +0000 (18:14 +0300)]
Minor bug fixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:08:22 +0000 (18:08 +0300)]
Minor bigfixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 14:40:54 +0000 (17:40 +0300)]
Avoid veification (workarround for image list bug)
Stavros Sachtouris [Wed, 29 Aug 2012 14:26:56 +0000 (17:26 +0300)]
Major changes in client, fixed setup
Seperate Client to Client and HTTPConnection
The later is put in a separate package kamaki.client.connection
It manages headers, params, method, url and data of a connection
but the actuall http connection is not implemented at this
abstract level
There is an HTTPRequest class extention of HTTPConnection in the
same package. It implements connection using requests package
so basicaly it replicates the connection procedure that was used
in kamaki so far.
Minor modifications were nessacary at every client lib package
Setup is now aware of gevent and commands package
Stavros Sachtouris [Tue, 28 Aug 2012 15:49:32 +0000 (18:49 +0300)]
Implement perform_request for HTTPRequest
Stavros Sachtouris [Tue, 28 Aug 2012 15:48:04 +0000 (18:48 +0300)]
Create HTTPRequest class
Implements HTTPConnection using the requests pypi package
Stavros Sachtouris [Tue, 28 Aug 2012 14:37:53 +0000 (17:37 +0300)]
Connection interface
Stavros Sachtouris [Tue, 28 Aug 2012 14:22:10 +0000 (17:22 +0300)]
Seperate commands specs and connection packages
Stavros Sachtouris [Tue, 28 Aug 2012 10:27:13 +0000 (13:27 +0300)]
Imporove meta methods
Stavros Sachtouris [Tue, 28 Aug 2012 09:40:08 +0000 (12:40 +0300)]
Improve setmeta syntax
Stavros Sachtouris [Tue, 28 Aug 2012 09:17:43 +0000 (12:17 +0300)]
Minor bug fixes
Stavros Sachtouris [Mon, 27 Aug 2012 15:14:03 +0000 (18:14 +0300)]
Optionaly use --container instead of cont:
Stavros Sachtouris [Fri, 24 Aug 2012 14:51:30 +0000 (17:51 +0300)]
Add more functionalities to dnl/hashmap/versions
download: progressbar control, overide file, resume (default)
all: extra options for conditional retrieval
Stavros Sachtouris [Fri, 24 Aug 2012 10:46:01 +0000 (13:46 +0300)]
Fixed bug with reset_headers
Now headers are reset after each request by default
but there is an option for not reseting headers, in low
level
Stavros Sachtouris [Thu, 23 Aug 2012 16:35:15 +0000 (19:35 +0300)]
Versions in download
Stavros Sachtouris [Thu, 23 Aug 2012 16:15:44 +0000 (19:15 +0300)]
Improved incremental download, hashmap, versions
Stavros Sachtouris [Thu, 23 Aug 2012 09:03:48 +0000 (12:03 +0300)]
Add sharers from pithos_sh
sharers shows the accounts that share objects with cur account
Stavros Sachtouris [Thu, 23 Aug 2012 08:33:03 +0000 (11:33 +0300)]
Add full pithos+ move in client.pithos
Stavros Sachtouris [Wed, 22 Aug 2012 15:25:31 +0000 (18:25 +0300)]
Full pithos+ copy in clients.pithos
Stavros Sachtouris [Wed, 22 Aug 2012 13:58:40 +0000 (16:58 +0300)]
Add pithos_sh GetObject as download
pithos_sh download is incremental, therefore better than kamaki download
Stavros Sachtouris [Tue, 21 Aug 2012 13:25:06 +0000 (16:25 +0300)]
Correct some typos
Stavros Sachtouris [Thu, 9 Aug 2012 15:23:49 +0000 (18:23 +0300)]
Add arguments/options to upload
manifest is now a seperated method for uploading
old, naive upload is preserved with --unchunked option
Stavros Sachtouris [Thu, 9 Aug 2012 12:32:59 +0000 (15:32 +0300)]
Add options to store_delete
Stavros Sachtouris [Thu, 9 Aug 2012 11:16:10 +0000 (14:16 +0300)]
Create supports meta
Stavros Sachtouris [Thu, 9 Aug 2012 11:05:11 +0000 (14:05 +0300)]
Add options to create, add mkdir as seperate cmd
Stavros Sachtouris [Thu, 9 Aug 2012 10:28:01 +0000 (13:28 +0300)]
Add options to meta
Stavros Sachtouris [Wed, 8 Aug 2012 18:15:21 +0000 (21:15 +0300)]
Complete store_list is superset of pithos_sh List
Stavros Sachtouris [Wed, 8 Aug 2012 16:06:59 +0000 (19:06 +0300)]
Add options to store_list
Stavros Sachtouris [Wed, 8 Aug 2012 14:44:01 +0000 (17:44 +0300)]
Rediculusly pretty store_list
Stavros Sachtouris [Wed, 8 Aug 2012 14:29:07 +0000 (17:29 +0300)]
Make container/object listing even more pretty!!!
Stavros Sachtouris [Wed, 8 Aug 2012 14:04:56 +0000 (17:04 +0300)]
New store_list with -l (detail) and bold
Stavros Sachtouris [Wed, 8 Aug 2012 10:54:32 +0000 (13:54 +0300)]
Allow cli arguments everywhere in command phrase
Changed behavior of CLI arguments that are command specific
e.g.
kamaki server -l list
or
kamaki -l server list
is now a valid kamaki command
Stavros Sachtouris [Tue, 7 Aug 2012 15:31:33 +0000 (18:31 +0300)]
Add all client api commands in new CLI
Stavros Sachtouris [Mon, 6 Aug 2012 15:49:11 +0000 (18:49 +0300)]
Create CLIError class, use it in pithos_cli
Stavros Sachtouris [Mon, 6 Aug 2012 13:02:05 +0000 (16:02 +0300)]
Siplify interface loading, add existing apis
Old apis are added with new organization. For each api
a new _cli.py file provides all relevant cli commands
Stavros Sachtouris [Fri, 3 Aug 2012 16:44:56 +0000 (19:44 +0300)]
Detach CLI from client libs
Allow custom libs to be easily loaded to kamaki CLI
At the moment, everything is given in a conf file and
pre-imported
Stavros Sachtouris [Wed, 1 Aug 2012 14:48:21 +0000 (17:48 +0300)]
Asynchronous uploads with gevent-greenlet
Merge with koukis-fix
Stavros Sachtouris [Tue, 31 Jul 2012 14:09:56 +0000 (17:09 +0300)]
Start unittest for large file pithos operations
Stavros Sachtouris [Mon, 30 Jul 2012 15:49:47 +0000 (18:49 +0300)]
(Almost) complete pithos client unittesting
transfer_encoding still unchecked
Stavros Sachtouris [Fri, 27 Jul 2012 15:09:01 +0000 (18:09 +0300)]
Adjust unit-test object_head/get/put/copy +bugs
Missing:
- account_quota/versioning
- container_post with transfer-encoding
- object_put with transfer-encoding
- object_copy with manifest
- adjust object_move/post/delete
Stavros Sachtouris [Thu, 26 Jul 2012 16:05:14 +0000 (19:05 +0300)]
Complete unittesting for container level pithos
Stavros Sachtouris [Thu, 26 Jul 2012 12:36:34 +0000 (15:36 +0300)]
Adjusting account/container opps + bug fixes
Stavros Sachtouris [Thu, 26 Jul 2012 09:04:15 +0000 (12:04 +0300)]
Fixed bug with large file uploads
Stavros Sachtouris [Wed, 25 Jul 2012 16:11:57 +0000 (19:11 +0300)]
Small progress
Stavros Sachtouris [Wed, 25 Jul 2012 15:36:59 +0000 (18:36 +0300)]
Completed tests for pithos+ starting improves
TODO Improvements for tests, like creating and destroying
containers and adjusting all tests to use only these temp
containers
Stavros Sachtouris [Wed, 25 Jul 2012 14:00:13 +0000 (17:00 +0300)]
Added test_object_delete
Stavros Sachtouris [Wed, 25 Jul 2012 13:37:43 +0000 (16:37 +0300)]
Added objectcopy/move/post _ minor bugfixes
Stavros Sachtouris [Tue, 24 Jul 2012 16:06:00 +0000 (19:06 +0300)]
Started testing object_copy +minor fixes
Stavros Sachtouris [Tue, 24 Jul 2012 14:37:16 +0000 (17:37 +0300)]
Added tests for object_put + minor bug fixes
Stavros Sachtouris [Thu, 19 Jul 2012 15:27:13 +0000 (18:27 +0300)]
More testing in storage
Completed testing at container level, started at object level
Stavros Sachtouris [Thu, 19 Jul 2012 10:10:47 +0000 (13:10 +0300)]
Fixed image register CLI bug
Stavros Sachtouris [Wed, 18 Jul 2012 15:58:28 +0000 (18:58 +0300)]
Implemented tests (Pithos+, partial, for now)
Used unittest, implemented tests for all account level Pithos+
operations and some container level operations
TBC
Stavros Sachtouris [Wed, 18 Jul 2012 12:06:04 +0000 (15:06 +0300)]
Pretyfication adjustments
Fixed colors in flavor and image error messages
Pretyfied image client code
Stavros Sachtouris [Tue, 17 Jul 2012 16:12:45 +0000 (19:12 +0300)]
Fixed and modified disconnect network
Fixed bug with return value
Modified disconnect to take only nic_id as arg
Stavros Sachtouris [Tue, 17 Jul 2012 11:59:17 +0000 (14:59 +0300)]
Full Pithos+ support at object level
Rest calls HEAD GET PUT COPY MOVE POST DELETE at object level fully
support Pithos+ capabilities by adding generic methods. Adjusted
existing methods to take advantage of these
Not thoroughly tested...
Stavros Sachtouris [Mon, 16 Jul 2012 13:06:00 +0000 (16:06 +0300)]
Full pithos+ support at container level
Full pithos+ support with ne container_<REST> methods
Old methods adjusted to use this functionality
No changes on CLI
Stavros Sachtouris [Mon, 16 Jul 2012 10:49:01 +0000 (13:49 +0300)]
Modified pithos method signatures
Introduced generic account_head/post/get methods that the other
more specific methods call
Stavros Sachtouris [Mon, 16 Jul 2012 10:31:53 +0000 (13:31 +0300)]
Completed full pithos+ support at account level
Added full support for pithos+ headers and params for account
POST based operations, modified existing methods to take
advantage of this change
Stavros Sachtouris [Mon, 16 Jul 2012 09:30:25 +0000 (12:30 +0300)]
Added full pithos support to list_containers
In pithos, added full support for optional parameters and headers supported
in Pithos API in list_containers() (account get)
Stavros Sachtouris [Mon, 16 Jul 2012 09:00:57 +0000 (12:00 +0300)]
Pithos level extentions added
get_account_info now supports until parameter, and if-(un)modified-since headers
in request
Stavros Sachtouris [Mon, 16 Jul 2012 08:36:58 +0000 (11:36 +0300)]
Minor error handling in cli
Stavros Sachtouris [Fri, 13 Jul 2012 15:24:47 +0000 (18:24 +0300)]
Modifications in store CLI syntax
Support for the form
kamaki store <command> <container:path>
e.g.
kamaki store list [container[:path]]
Stavros Sachtouris [Fri, 13 Jul 2012 07:49:37 +0000 (10:49 +0300)]
dict-list printing is sorted + some tests
Stavros Sachtouris [Wed, 11 Jul 2012 12:34:56 +0000 (15:34 +0300)]
Minor adjustments to recent changes
Stavros Sachtouris [Wed, 11 Jul 2012 12:03:30 +0000 (15:03 +0300)]
Minor bug in CLI printing
Stavros Sachtouris [Wed, 11 Jul 2012 11:51:15 +0000 (14:51 +0300)]
Unicode issue in CLI
Stavros Sachtouris [Wed, 11 Jul 2012 11:44:00 +0000 (14:44 +0300)]
Compatibility with python2.6
Stavros Sachtouris [Wed, 11 Jul 2012 09:14:46 +0000 (12:14 +0300)]
Adjusted network and server opps to recent changes
Stavros Sachtouris [Wed, 11 Jul 2012 08:35:44 +0000 (11:35 +0300)]
Minor bug fixes
Stavros Sachtouris [Tue, 10 Jul 2012 15:43:38 +0000 (18:43 +0300)]
Adjusted disconnect server
Stavros Sachtouris [Tue, 10 Jul 2012 15:11:40 +0000 (18:11 +0300)]
Simplified command client printing
- Replaced print_dict in kamaki/utils with a simpler method that prints dicts or lists recursively, and non iterrable objects
- Introduced print_list in kamaki/utils in a similar fashion
- fixed server_addr / adjusted to new utils functionality
Stavros Sachtouris [Tue, 10 Jul 2012 14:36:49 +0000 (17:36 +0300)]
Minor improvements, adjusted network info
In compute and cyclades replaced raw paths with paths generated by path4url method
In kamaki/utils adjusted print_addresses to fit recente changes in cyclades API
Stavros Sachtouris [Tue, 10 Jul 2012 10:15:27 +0000 (13:15 +0300)]
Fixed and optiomized delmeta for objects
In storage, fixed delmeta which was disfunctional
In pithos added an optimized implementation using the pithos update parameter
Stavros Sachtouris [Tue, 10 Jul 2012 09:46:00 +0000 (12:46 +0300)]
Added progress bar
In CLI store_overwrite with prgress bar, added progress bar at store_append
In pithos added generator watcher method support
Stavros Sachtouris [Tue, 10 Jul 2012 09:33:12 +0000 (12:33 +0300)]
Implemented overwrite
In CLI added store_overwrite
In pithos added overwrite_object which, in case of large updates, overwrites block by block
Stavros Sachtouris [Tue, 10 Jul 2012 09:16:36 +0000 (12:16 +0300)]
Optimised truncate
In pithos added truncate_object that truncates and object using pithos-enabled headers
Stavros Sachtouris [Tue, 10 Jul 2012 09:06:01 +0000 (12:06 +0300)]
Optimised append
In pithos a new append_object is introduced, that appends a file in blocks
Stavros Sachtouris [Mon, 9 Jul 2012 16:03:22 +0000 (19:03 +0300)]
Not optimal append and truncate
In CLI added append and truncate for objects
In storage added update_object which acts as a multifunction. It currently loads the whole file on memory, so it needs optimization
Stavros Sachtouris [Mon, 9 Jul 2012 12:07:24 +0000 (15:07 +0300)]
Implemented setpermitions and delpermitions
In CLI added setpermitions and delpermitions
In pithos added set_object_sharing and shortcut method erase_object_sharing
Stavros Sachtouris [Mon, 9 Jul 2012 10:00:47 +0000 (13:00 +0300)]
Implemented move
In CLI added store_move for moving objects from container/path to destination container/path
In storage added move_object in OOS style