kamaki
11 years agoUse connection pool after redesigning http connect
Stavros Sachtouris [Fri, 7 Sep 2012 09:51:18 +0000 (12:51 +0300)]
Use connection pool after redesigning http connect

HTTPRequestsXxx objects now use connection pooling
Atually, connections are not pooled, but responses are.

Implementation of connection pooling with httplib not ready yet

Pooling tested in uploads

11 years agoHTTPConnection can support pooling implementations
Stavros Sachtouris [Wed, 5 Sep 2012 11:56:33 +0000 (14:56 +0300)]
HTTPConnection can support pooling implementations

11 years agoHTTP Response args are now properties
Stavros Sachtouris [Tue, 4 Sep 2012 16:25:26 +0000 (19:25 +0300)]
HTTP Response args are now properties

11 years agoCorrect repackaging, minor server list improvement
Stavros Sachtouris [Tue, 4 Sep 2012 15:57:39 +0000 (18:57 +0300)]
Correct repackaging, minor server list improvement

11 years agoNew package CLI (repackaging), minor bugfixes
Stavros Sachtouris [Tue, 4 Sep 2012 15:43:54 +0000 (18:43 +0300)]
New package CLI (repackaging), minor bugfixes

kamaki now has two packages: cli and clients
cli contains all command line interface code
clients is an indepentand lib that can also used by 3rd parties
minor bugs in comput lib

11 years agoEquilize store mkdir with create for directories
Stavros Sachtouris [Tue, 4 Sep 2012 09:14:00 +0000 (12:14 +0300)]
Equilize store mkdir with create for directories

11 years agoMinor fixes
Stavros Sachtouris [Mon, 3 Sep 2012 15:28:36 +0000 (18:28 +0300)]
Minor fixes

11 years agoGeneric methods implementation in OOS Compute
Stavros Sachtouris [Mon, 3 Sep 2012 15:24:08 +0000 (18:24 +0300)]
Generic methods implementation in OOS Compute

added flavors_get, images_get/delete/post/put

11 years agoIntroduce general methods for cyclades poking
Stavros Sachtouris [Mon, 3 Sep 2012 14:26:06 +0000 (17:26 +0300)]
Introduce general methods for cyclades poking

servers_get/post, networks_get/delete/post/put with generic
arguments id and command are now used by oldern, convenience
calls. E.g.
    networks_get(100, 'action') with try
    GET http:.../networks/100/action
so it is used by list_networks

11 years agoMinor convenienve fixes
Stavros Sachtouris [Fri, 31 Aug 2012 15:53:48 +0000 (18:53 +0300)]
Minor convenienve fixes

11 years agoMinor test bug
Stavros Sachtouris [Fri, 31 Aug 2012 15:44:12 +0000 (18:44 +0300)]
Minor test bug

11 years agoAdd server_details, image_details tests
Stavros Sachtouris [Fri, 31 Aug 2012 15:36:54 +0000 (18:36 +0300)]
Add server_details, image_details tests

11 years agoImprove vm control during testing
Stavros Sachtouris [Fri, 31 Aug 2012 14:40:52 +0000 (17:40 +0300)]
Improve vm control during testing

11 years agoDelete used VMs after testing
Stavros Sachtouris [Fri, 31 Aug 2012 14:10:51 +0000 (17:10 +0300)]
Delete used VMs after testing

11 years agoPretify server list, test server list and create
Stavros Sachtouris [Thu, 30 Aug 2012 16:12:56 +0000 (19:12 +0300)]
Pretify server list, test server list and create

11 years agoImproced testing, started tests for cyclades
Stavros Sachtouris [Thu, 30 Aug 2012 15:30:09 +0000 (18:30 +0300)]
Improced testing, started tests for cyclades

11 years agoHandle requests exceptions
Stavros Sachtouris [Thu, 30 Aug 2012 12:51:36 +0000 (15:51 +0300)]
Handle requests exceptions

11 years agoReset headers and params at every request
Stavros Sachtouris [Wed, 29 Aug 2012 16:31:31 +0000 (19:31 +0300)]
Reset headers and params at every request

11 years agoMinor big fix
Stavros Sachtouris [Wed, 29 Aug 2012 16:17:02 +0000 (19:17 +0300)]
Minor big fix

11 years agoMinor arangements for error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:44:52 +0000 (18:44 +0300)]
Minor arangements for error handling

11 years agoMinor bug fixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:14:40 +0000 (18:14 +0300)]
Minor bug fixes in error handling

11 years agoMinor bigfixes in error handling
Stavros Sachtouris [Wed, 29 Aug 2012 15:08:22 +0000 (18:08 +0300)]
Minor bigfixes in error handling

11 years agoAvoid veification (workarround for image list bug)
Stavros Sachtouris [Wed, 29 Aug 2012 14:40:54 +0000 (17:40 +0300)]
Avoid veification (workarround for image list bug)

11 years agoMajor changes in client, fixed setup
Stavros Sachtouris [Wed, 29 Aug 2012 14:26:56 +0000 (17:26 +0300)]
Major changes in client, fixed setup

Seperate Client to Client and HTTPConnection
The later is put in a separate package kamaki.client.connection
It manages headers, params, method, url and data of a connection
but the actuall http connection is not implemented at this
abstract level
There is an HTTPRequest class extention of HTTPConnection in the
same package. It implements connection using requests package
so basicaly it replicates the connection procedure that was used
in kamaki so far.
Minor modifications were nessacary at every client lib package

Setup is now aware of gevent and commands package

11 years agoImplement perform_request for HTTPRequest
Stavros Sachtouris [Tue, 28 Aug 2012 15:49:32 +0000 (18:49 +0300)]
Implement perform_request for HTTPRequest

11 years agoCreate HTTPRequest class
Stavros Sachtouris [Tue, 28 Aug 2012 15:48:04 +0000 (18:48 +0300)]
Create HTTPRequest class

Implements HTTPConnection using the requests pypi package

11 years agoConnection interface
Stavros Sachtouris [Tue, 28 Aug 2012 14:37:53 +0000 (17:37 +0300)]
Connection interface

11 years agoSeperate commands specs and connection packages
Stavros Sachtouris [Tue, 28 Aug 2012 14:22:10 +0000 (17:22 +0300)]
Seperate commands specs and connection packages

11 years agoImporove meta methods
Stavros Sachtouris [Tue, 28 Aug 2012 10:27:13 +0000 (13:27 +0300)]
Imporove meta methods

11 years agoImprove setmeta syntax
Stavros Sachtouris [Tue, 28 Aug 2012 09:40:08 +0000 (12:40 +0300)]
Improve setmeta syntax

11 years agoMinor bug fixes
Stavros Sachtouris [Tue, 28 Aug 2012 09:17:43 +0000 (12:17 +0300)]
Minor bug fixes

11 years agoOptionaly use --container instead of cont:
Stavros Sachtouris [Mon, 27 Aug 2012 15:14:03 +0000 (18:14 +0300)]
Optionaly use --container instead of cont:

11 years agoAdd more functionalities to dnl/hashmap/versions
Stavros Sachtouris [Fri, 24 Aug 2012 14:51:30 +0000 (17:51 +0300)]
Add more functionalities to dnl/hashmap/versions

download: progressbar control, overide file, resume (default)
all: extra options for conditional retrieval

11 years agoFixed bug with reset_headers
Stavros Sachtouris [Fri, 24 Aug 2012 10:46:01 +0000 (13:46 +0300)]
Fixed bug with reset_headers

Now headers are reset after each request by default
but there is an option for not reseting headers, in low
level

11 years agoVersions in download
Stavros Sachtouris [Thu, 23 Aug 2012 16:35:15 +0000 (19:35 +0300)]
Versions in download

11 years agoImproved incremental download, hashmap, versions
Stavros Sachtouris [Thu, 23 Aug 2012 16:15:44 +0000 (19:15 +0300)]
Improved incremental download, hashmap, versions

11 years agoAdd sharers from pithos_sh
Stavros Sachtouris [Thu, 23 Aug 2012 09:03:48 +0000 (12:03 +0300)]
Add sharers from pithos_sh

sharers shows the accounts that share objects with cur account

11 years agoAdd full pithos+ move in client.pithos
Stavros Sachtouris [Thu, 23 Aug 2012 08:33:03 +0000 (11:33 +0300)]
Add full pithos+ move in client.pithos

11 years agoFull pithos+ copy in clients.pithos
Stavros Sachtouris [Wed, 22 Aug 2012 15:25:31 +0000 (18:25 +0300)]
Full pithos+ copy in clients.pithos

11 years agoAdd pithos_sh GetObject as download
Stavros Sachtouris [Wed, 22 Aug 2012 13:58:40 +0000 (16:58 +0300)]
Add pithos_sh GetObject as download

pithos_sh download is incremental, therefore better than kamaki download

11 years agoCorrect some typos
Stavros Sachtouris [Tue, 21 Aug 2012 13:25:06 +0000 (16:25 +0300)]
Correct some typos

11 years agoAdd arguments/options to upload
Stavros Sachtouris [Thu, 9 Aug 2012 15:23:49 +0000 (18:23 +0300)]
Add arguments/options to upload

manifest is now a seperated method for uploading
old, naive upload is preserved with --unchunked option

11 years agoAdd options to store_delete
Stavros Sachtouris [Thu, 9 Aug 2012 12:32:59 +0000 (15:32 +0300)]
Add options to store_delete

11 years agoCreate supports meta
Stavros Sachtouris [Thu, 9 Aug 2012 11:16:10 +0000 (14:16 +0300)]
Create supports meta

11 years agoAdd options to create, add mkdir as seperate cmd
Stavros Sachtouris [Thu, 9 Aug 2012 11:05:11 +0000 (14:05 +0300)]
Add options to create, add mkdir as seperate cmd

11 years agoAdd options to meta
Stavros Sachtouris [Thu, 9 Aug 2012 10:28:01 +0000 (13:28 +0300)]
Add options to meta

11 years agoComplete store_list is superset of pithos_sh List
Stavros Sachtouris [Wed, 8 Aug 2012 18:15:21 +0000 (21:15 +0300)]
Complete store_list is superset of pithos_sh List

11 years agoAdd options to store_list
Stavros Sachtouris [Wed, 8 Aug 2012 16:06:59 +0000 (19:06 +0300)]
Add options to store_list

11 years agoRediculusly pretty store_list
Stavros Sachtouris [Wed, 8 Aug 2012 14:44:01 +0000 (17:44 +0300)]
Rediculusly pretty store_list

11 years agoMake container/object listing even more pretty!!!
Stavros Sachtouris [Wed, 8 Aug 2012 14:29:07 +0000 (17:29 +0300)]
Make container/object listing even more pretty!!!

11 years agoNew store_list with -l (detail) and bold
Stavros Sachtouris [Wed, 8 Aug 2012 14:04:56 +0000 (17:04 +0300)]
New store_list with -l (detail) and bold

11 years agoAllow cli arguments everywhere in command phrase
Stavros Sachtouris [Wed, 8 Aug 2012 10:54:32 +0000 (13:54 +0300)]
Allow cli arguments everywhere in command phrase

Changed behavior of CLI arguments that are command specific
e.g.
    kamaki server -l list
or
    kamaki -l server list
is now a valid kamaki command

11 years agoAdd all client api commands in new CLI
Stavros Sachtouris [Tue, 7 Aug 2012 15:31:33 +0000 (18:31 +0300)]
Add all client api commands in new CLI

11 years agoCreate CLIError class, use it in pithos_cli
Stavros Sachtouris [Mon, 6 Aug 2012 15:49:11 +0000 (18:49 +0300)]
Create CLIError class, use it in pithos_cli

11 years agoSiplify interface loading, add existing apis
Stavros Sachtouris [Mon, 6 Aug 2012 13:02:05 +0000 (16:02 +0300)]
Siplify interface loading, add existing apis

Old apis are added with new organization. For each api
a new _cli.py file provides all relevant cli commands

11 years agoDetach CLI from client libs
Stavros Sachtouris [Fri, 3 Aug 2012 16:44:56 +0000 (19:44 +0300)]
Detach CLI from client libs

Allow custom libs to be easily loaded to kamaki CLI
At the moment, everything is given in a conf file and
pre-imported

11 years agoAsynchronous uploads with gevent-greenlet
Stavros Sachtouris [Wed, 1 Aug 2012 14:48:21 +0000 (17:48 +0300)]
Asynchronous uploads with gevent-greenlet

Merge with koukis-fix

11 years agoStart unittest for large file pithos operations
Stavros Sachtouris [Tue, 31 Jul 2012 14:09:56 +0000 (17:09 +0300)]
Start unittest for large file pithos operations

11 years ago(Almost) complete pithos client unittesting
Stavros Sachtouris [Mon, 30 Jul 2012 15:49:47 +0000 (18:49 +0300)]
(Almost) complete pithos client unittesting

transfer_encoding still unchecked

11 years agoAdjust unit-test object_head/get/put/copy +bugs
Stavros Sachtouris [Fri, 27 Jul 2012 15:09:01 +0000 (18:09 +0300)]
Adjust unit-test object_head/get/put/copy +bugs

Missing:
- account_quota/versioning
- container_post with transfer-encoding
- object_put with transfer-encoding
- object_copy with manifest
- adjust object_move/post/delete

11 years agoComplete unittesting for container level pithos
Stavros Sachtouris [Thu, 26 Jul 2012 16:05:14 +0000 (19:05 +0300)]
Complete unittesting for container level pithos

11 years agoAdjusting account/container opps + bug fixes
Stavros Sachtouris [Thu, 26 Jul 2012 12:36:34 +0000 (15:36 +0300)]
Adjusting account/container opps + bug fixes

11 years agoFixed bug with large file uploads
Stavros Sachtouris [Thu, 26 Jul 2012 09:04:15 +0000 (12:04 +0300)]
Fixed bug with large file uploads

11 years agoSmall progress
Stavros Sachtouris [Wed, 25 Jul 2012 16:11:57 +0000 (19:11 +0300)]
Small progress

11 years agoCompleted tests for pithos+ starting improves
Stavros Sachtouris [Wed, 25 Jul 2012 15:36:59 +0000 (18:36 +0300)]
Completed tests for pithos+ starting improves

TODO Improvements for tests, like creating and destroying
containers and adjusting all tests to use only these temp
containers

11 years agoAdded test_object_delete
Stavros Sachtouris [Wed, 25 Jul 2012 14:00:13 +0000 (17:00 +0300)]
Added test_object_delete

11 years agoAdded objectcopy/move/post _ minor bugfixes
Stavros Sachtouris [Wed, 25 Jul 2012 13:37:43 +0000 (16:37 +0300)]
Added objectcopy/move/post _ minor bugfixes

11 years agoStarted testing object_copy +minor fixes
Stavros Sachtouris [Tue, 24 Jul 2012 16:06:00 +0000 (19:06 +0300)]
Started testing object_copy +minor fixes

11 years agoAdded tests for object_put + minor bug fixes
Stavros Sachtouris [Tue, 24 Jul 2012 14:37:16 +0000 (17:37 +0300)]
Added tests for object_put + minor bug fixes

11 years agoMore testing in storage
Stavros Sachtouris [Thu, 19 Jul 2012 15:27:13 +0000 (18:27 +0300)]
More testing in storage

Completed testing at container level, started at object level

11 years agoFixed image register CLI bug
Stavros Sachtouris [Thu, 19 Jul 2012 10:10:47 +0000 (13:10 +0300)]
Fixed image register CLI bug

11 years agoImplemented tests (Pithos+, partial, for now)
Stavros Sachtouris [Wed, 18 Jul 2012 15:58:28 +0000 (18:58 +0300)]
Implemented tests (Pithos+, partial, for now)

Used unittest, implemented tests for all account level Pithos+
operations and some container level operations
TBC

11 years agoPretyfication adjustments
Stavros Sachtouris [Wed, 18 Jul 2012 12:06:04 +0000 (15:06 +0300)]
Pretyfication adjustments

Fixed colors in flavor and image error messages
Pretyfied image client code

11 years agoFixed and modified disconnect network
Stavros Sachtouris [Tue, 17 Jul 2012 16:12:45 +0000 (19:12 +0300)]
Fixed and modified disconnect network

Fixed bug with return value
Modified disconnect to take only nic_id as arg

11 years agoFull Pithos+ support at object level
Stavros Sachtouris [Tue, 17 Jul 2012 11:59:17 +0000 (14:59 +0300)]
Full Pithos+ support at object level

Rest calls HEAD GET PUT COPY MOVE POST DELETE at object level fully
support Pithos+ capabilities by adding generic methods. Adjusted
existing methods to take advantage of these
Not thoroughly tested...

11 years agoFull pithos+ support at container level
Stavros Sachtouris [Mon, 16 Jul 2012 13:06:00 +0000 (16:06 +0300)]
Full pithos+ support at container level

Full pithos+ support with ne container_<REST> methods
Old methods adjusted to use this functionality
No changes on CLI

11 years agoModified pithos method signatures
Stavros Sachtouris [Mon, 16 Jul 2012 10:49:01 +0000 (13:49 +0300)]
Modified pithos method signatures

Introduced generic account_head/post/get methods that the other
more specific methods call

11 years agoCompleted full pithos+ support at account level
Stavros Sachtouris [Mon, 16 Jul 2012 10:31:53 +0000 (13:31 +0300)]
Completed full pithos+ support at account level

Added full support for pithos+ headers and params for account
POST based operations, modified existing methods to take
advantage of this change

11 years agoAdded full pithos support to list_containers
Stavros Sachtouris [Mon, 16 Jul 2012 09:30:25 +0000 (12:30 +0300)]
Added full pithos support to list_containers

In pithos, added full support for optional parameters and headers supported
in Pithos API in list_containers() (account get)

11 years agoPithos level extentions added
Stavros Sachtouris [Mon, 16 Jul 2012 09:00:57 +0000 (12:00 +0300)]
Pithos level extentions added

get_account_info now supports until parameter, and if-(un)modified-since headers
in request

11 years agoMinor error handling in cli
Stavros Sachtouris [Mon, 16 Jul 2012 08:36:58 +0000 (11:36 +0300)]
Minor error handling in cli

11 years agoModifications in store CLI syntax
Stavros Sachtouris [Fri, 13 Jul 2012 15:24:47 +0000 (18:24 +0300)]
Modifications in store CLI syntax

Support for the form
    kamaki store <command> <container:path>
e.g.
    kamaki store list [container[:path]]

11 years agodict-list printing is sorted + some tests
Stavros Sachtouris [Fri, 13 Jul 2012 07:49:37 +0000 (10:49 +0300)]
dict-list printing is sorted + some tests

11 years agoMinor adjustments to recent changes
Stavros Sachtouris [Wed, 11 Jul 2012 12:34:56 +0000 (15:34 +0300)]
Minor adjustments to recent changes

11 years agoMinor bug in CLI printing
Stavros Sachtouris [Wed, 11 Jul 2012 12:03:30 +0000 (15:03 +0300)]
Minor bug in CLI printing

11 years agoUnicode issue in CLI
Stavros Sachtouris [Wed, 11 Jul 2012 11:51:15 +0000 (14:51 +0300)]
Unicode issue in CLI

11 years agoCompatibility with python2.6
Stavros Sachtouris [Wed, 11 Jul 2012 11:44:00 +0000 (14:44 +0300)]
Compatibility with python2.6

11 years agoAdjusted network and server opps to recent changes
Stavros Sachtouris [Wed, 11 Jul 2012 09:14:46 +0000 (12:14 +0300)]
Adjusted network and server opps to recent changes

11 years agoMinor bug fixes
Stavros Sachtouris [Wed, 11 Jul 2012 08:35:44 +0000 (11:35 +0300)]
Minor bug fixes

11 years agoAdjusted disconnect server
Stavros Sachtouris [Tue, 10 Jul 2012 15:43:38 +0000 (18:43 +0300)]
Adjusted disconnect server

11 years agoSimplified command client printing
Stavros Sachtouris [Tue, 10 Jul 2012 15:11:40 +0000 (18:11 +0300)]
Simplified command client printing

- Replaced print_dict in kamaki/utils with a simpler method that prints dicts or lists recursively, and non iterrable objects
- Introduced print_list in kamaki/utils in a similar fashion
- fixed server_addr / adjusted to new utils functionality

11 years agoMinor improvements, adjusted network info
Stavros Sachtouris [Tue, 10 Jul 2012 14:36:49 +0000 (17:36 +0300)]
Minor improvements, adjusted network info

In compute and cyclades replaced raw paths with paths generated by path4url method
In kamaki/utils adjusted print_addresses to fit recente changes in cyclades API

11 years agoFixed and optiomized delmeta for objects
Stavros Sachtouris [Tue, 10 Jul 2012 10:15:27 +0000 (13:15 +0300)]
Fixed and optiomized delmeta for objects

In storage, fixed delmeta which was disfunctional
In pithos added an optimized implementation using the pithos update parameter

11 years agoAdded progress bar
Stavros Sachtouris [Tue, 10 Jul 2012 09:46:00 +0000 (12:46 +0300)]
Added progress bar

In CLI store_overwrite with prgress bar, added progress bar at store_append
In pithos added generator watcher method support

11 years agoImplemented overwrite
Stavros Sachtouris [Tue, 10 Jul 2012 09:33:12 +0000 (12:33 +0300)]
Implemented overwrite

In CLI added store_overwrite

In pithos added overwrite_object which, in case of large updates, overwrites block by block

11 years agoOptimised truncate
Stavros Sachtouris [Tue, 10 Jul 2012 09:16:36 +0000 (12:16 +0300)]
Optimised truncate

In pithos added truncate_object that truncates and object using pithos-enabled headers

11 years agoOptimised append
Stavros Sachtouris [Tue, 10 Jul 2012 09:06:01 +0000 (12:06 +0300)]
Optimised append

In pithos a new append_object is introduced, that appends a file in blocks

11 years agoNot optimal append and truncate
Stavros Sachtouris [Mon, 9 Jul 2012 16:03:22 +0000 (19:03 +0300)]
Not optimal append and truncate

In CLI added append and truncate for objects

In storage added update_object which acts as a multifunction. It currently loads the whole file on memory, so it needs optimization

11 years agoImplemented setpermitions and delpermitions
Stavros Sachtouris [Mon, 9 Jul 2012 12:07:24 +0000 (15:07 +0300)]
Implemented setpermitions and delpermitions

In CLI added setpermitions and delpermitions

In pithos added set_object_sharing and shortcut method erase_object_sharing

11 years agoImplemented move
Stavros Sachtouris [Mon, 9 Jul 2012 10:00:47 +0000 (13:00 +0300)]
Implemented move

In CLI added store_move for moving objects from container/path to destination container/path
In storage added move_object in OOS style