kamaki
11 years agoAsynchronous uploads with gevent-greenlet
Stavros Sachtouris [Wed, 1 Aug 2012 14:48:21 +0000 (17:48 +0300)]
Asynchronous uploads with gevent-greenlet

Merge with koukis-fix

11 years agoStart unittest for large file pithos operations
Stavros Sachtouris [Tue, 31 Jul 2012 14:09:56 +0000 (17:09 +0300)]
Start unittest for large file pithos operations

11 years ago(Almost) complete pithos client unittesting
Stavros Sachtouris [Mon, 30 Jul 2012 15:49:47 +0000 (18:49 +0300)]
(Almost) complete pithos client unittesting

transfer_encoding still unchecked

11 years agoAdjust unit-test object_head/get/put/copy +bugs
Stavros Sachtouris [Fri, 27 Jul 2012 15:09:01 +0000 (18:09 +0300)]
Adjust unit-test object_head/get/put/copy +bugs

Missing:
- account_quota/versioning
- container_post with transfer-encoding
- object_put with transfer-encoding
- object_copy with manifest
- adjust object_move/post/delete

11 years agoComplete unittesting for container level pithos
Stavros Sachtouris [Thu, 26 Jul 2012 16:05:14 +0000 (19:05 +0300)]
Complete unittesting for container level pithos

11 years agoAdjusting account/container opps + bug fixes
Stavros Sachtouris [Thu, 26 Jul 2012 12:36:34 +0000 (15:36 +0300)]
Adjusting account/container opps + bug fixes

11 years agoFixed bug with large file uploads
Stavros Sachtouris [Thu, 26 Jul 2012 09:04:15 +0000 (12:04 +0300)]
Fixed bug with large file uploads

11 years agoSmall progress
Stavros Sachtouris [Wed, 25 Jul 2012 16:11:57 +0000 (19:11 +0300)]
Small progress

11 years agoCompleted tests for pithos+ starting improves
Stavros Sachtouris [Wed, 25 Jul 2012 15:36:59 +0000 (18:36 +0300)]
Completed tests for pithos+ starting improves

TODO Improvements for tests, like creating and destroying
containers and adjusting all tests to use only these temp
containers

11 years agoAdded test_object_delete
Stavros Sachtouris [Wed, 25 Jul 2012 14:00:13 +0000 (17:00 +0300)]
Added test_object_delete

11 years agoAdded objectcopy/move/post _ minor bugfixes
Stavros Sachtouris [Wed, 25 Jul 2012 13:37:43 +0000 (16:37 +0300)]
Added objectcopy/move/post _ minor bugfixes

11 years agoStarted testing object_copy +minor fixes
Stavros Sachtouris [Tue, 24 Jul 2012 16:06:00 +0000 (19:06 +0300)]
Started testing object_copy +minor fixes

11 years agoAdded tests for object_put + minor bug fixes
Stavros Sachtouris [Tue, 24 Jul 2012 14:37:16 +0000 (17:37 +0300)]
Added tests for object_put + minor bug fixes

12 years agoMore testing in storage
Stavros Sachtouris [Thu, 19 Jul 2012 15:27:13 +0000 (18:27 +0300)]
More testing in storage

Completed testing at container level, started at object level

12 years agoFixed image register CLI bug
Stavros Sachtouris [Thu, 19 Jul 2012 10:10:47 +0000 (13:10 +0300)]
Fixed image register CLI bug

12 years agoImplemented tests (Pithos+, partial, for now)
Stavros Sachtouris [Wed, 18 Jul 2012 15:58:28 +0000 (18:58 +0300)]
Implemented tests (Pithos+, partial, for now)

Used unittest, implemented tests for all account level Pithos+
operations and some container level operations
TBC

12 years agoPretyfication adjustments
Stavros Sachtouris [Wed, 18 Jul 2012 12:06:04 +0000 (15:06 +0300)]
Pretyfication adjustments

Fixed colors in flavor and image error messages
Pretyfied image client code

12 years agoFixed and modified disconnect network
Stavros Sachtouris [Tue, 17 Jul 2012 16:12:45 +0000 (19:12 +0300)]
Fixed and modified disconnect network

Fixed bug with return value
Modified disconnect to take only nic_id as arg

12 years agoFull Pithos+ support at object level
Stavros Sachtouris [Tue, 17 Jul 2012 11:59:17 +0000 (14:59 +0300)]
Full Pithos+ support at object level

Rest calls HEAD GET PUT COPY MOVE POST DELETE at object level fully
support Pithos+ capabilities by adding generic methods. Adjusted
existing methods to take advantage of these
Not thoroughly tested...

12 years agoFull pithos+ support at container level
Stavros Sachtouris [Mon, 16 Jul 2012 13:06:00 +0000 (16:06 +0300)]
Full pithos+ support at container level

Full pithos+ support with ne container_<REST> methods
Old methods adjusted to use this functionality
No changes on CLI

12 years agoModified pithos method signatures
Stavros Sachtouris [Mon, 16 Jul 2012 10:49:01 +0000 (13:49 +0300)]
Modified pithos method signatures

Introduced generic account_head/post/get methods that the other
more specific methods call

12 years agoCompleted full pithos+ support at account level
Stavros Sachtouris [Mon, 16 Jul 2012 10:31:53 +0000 (13:31 +0300)]
Completed full pithos+ support at account level

Added full support for pithos+ headers and params for account
POST based operations, modified existing methods to take
advantage of this change

12 years agoAdded full pithos support to list_containers
Stavros Sachtouris [Mon, 16 Jul 2012 09:30:25 +0000 (12:30 +0300)]
Added full pithos support to list_containers

In pithos, added full support for optional parameters and headers supported
in Pithos API in list_containers() (account get)

12 years agoPithos level extentions added
Stavros Sachtouris [Mon, 16 Jul 2012 09:00:57 +0000 (12:00 +0300)]
Pithos level extentions added

get_account_info now supports until parameter, and if-(un)modified-since headers
in request

12 years agoMinor error handling in cli
Stavros Sachtouris [Mon, 16 Jul 2012 08:36:58 +0000 (11:36 +0300)]
Minor error handling in cli

12 years agoModifications in store CLI syntax
Stavros Sachtouris [Fri, 13 Jul 2012 15:24:47 +0000 (18:24 +0300)]
Modifications in store CLI syntax

Support for the form
    kamaki store <command> <container:path>
e.g.
    kamaki store list [container[:path]]

12 years agodict-list printing is sorted + some tests
Stavros Sachtouris [Fri, 13 Jul 2012 07:49:37 +0000 (10:49 +0300)]
dict-list printing is sorted + some tests

12 years agoMinor adjustments to recent changes
Stavros Sachtouris [Wed, 11 Jul 2012 12:34:56 +0000 (15:34 +0300)]
Minor adjustments to recent changes

12 years agoMinor bug in CLI printing
Stavros Sachtouris [Wed, 11 Jul 2012 12:03:30 +0000 (15:03 +0300)]
Minor bug in CLI printing

12 years agoUnicode issue in CLI
Stavros Sachtouris [Wed, 11 Jul 2012 11:51:15 +0000 (14:51 +0300)]
Unicode issue in CLI

12 years agoCompatibility with python2.6
Stavros Sachtouris [Wed, 11 Jul 2012 11:44:00 +0000 (14:44 +0300)]
Compatibility with python2.6

12 years agoAdjusted network and server opps to recent changes
Stavros Sachtouris [Wed, 11 Jul 2012 09:14:46 +0000 (12:14 +0300)]
Adjusted network and server opps to recent changes

12 years agoMinor bug fixes
Stavros Sachtouris [Wed, 11 Jul 2012 08:35:44 +0000 (11:35 +0300)]
Minor bug fixes

12 years agoAdjusted disconnect server
Stavros Sachtouris [Tue, 10 Jul 2012 15:43:38 +0000 (18:43 +0300)]
Adjusted disconnect server

12 years agoSimplified command client printing
Stavros Sachtouris [Tue, 10 Jul 2012 15:11:40 +0000 (18:11 +0300)]
Simplified command client printing

- Replaced print_dict in kamaki/utils with a simpler method that prints dicts or lists recursively, and non iterrable objects
- Introduced print_list in kamaki/utils in a similar fashion
- fixed server_addr / adjusted to new utils functionality

12 years agoMinor improvements, adjusted network info
Stavros Sachtouris [Tue, 10 Jul 2012 14:36:49 +0000 (17:36 +0300)]
Minor improvements, adjusted network info

In compute and cyclades replaced raw paths with paths generated by path4url method
In kamaki/utils adjusted print_addresses to fit recente changes in cyclades API

12 years agoFixed and optiomized delmeta for objects
Stavros Sachtouris [Tue, 10 Jul 2012 10:15:27 +0000 (13:15 +0300)]
Fixed and optiomized delmeta for objects

In storage, fixed delmeta which was disfunctional
In pithos added an optimized implementation using the pithos update parameter

12 years agoAdded progress bar
Stavros Sachtouris [Tue, 10 Jul 2012 09:46:00 +0000 (12:46 +0300)]
Added progress bar

In CLI store_overwrite with prgress bar, added progress bar at store_append
In pithos added generator watcher method support

12 years agoImplemented overwrite
Stavros Sachtouris [Tue, 10 Jul 2012 09:33:12 +0000 (12:33 +0300)]
Implemented overwrite

In CLI added store_overwrite

In pithos added overwrite_object which, in case of large updates, overwrites block by block

12 years agoOptimised truncate
Stavros Sachtouris [Tue, 10 Jul 2012 09:16:36 +0000 (12:16 +0300)]
Optimised truncate

In pithos added truncate_object that truncates and object using pithos-enabled headers

12 years agoOptimised append
Stavros Sachtouris [Tue, 10 Jul 2012 09:06:01 +0000 (12:06 +0300)]
Optimised append

In pithos a new append_object is introduced, that appends a file in blocks

12 years agoNot optimal append and truncate
Stavros Sachtouris [Mon, 9 Jul 2012 16:03:22 +0000 (19:03 +0300)]
Not optimal append and truncate

In CLI added append and truncate for objects

In storage added update_object which acts as a multifunction. It currently loads the whole file on memory, so it needs optimization

12 years agoImplemented setpermitions and delpermitions
Stavros Sachtouris [Mon, 9 Jul 2012 12:07:24 +0000 (15:07 +0300)]
Implemented setpermitions and delpermitions

In CLI added setpermitions and delpermitions

In pithos added set_object_sharing and shortcut method erase_object_sharing

12 years agoImplemented move
Stavros Sachtouris [Mon, 9 Jul 2012 10:00:47 +0000 (13:00 +0300)]
Implemented move

In CLI added store_move for moving objects from container/path to destination container/path
In storage added move_object in OOS style

12 years agoImplemented group, delgroup and copy
Stavros Sachtouris [Mon, 9 Jul 2012 09:38:50 +0000 (12:38 +0300)]
Implemented group, delgroup and copy

In CLI:
    - added store group to retrieve user grouos of account
    - added store delgroup to delete a user group by groupname
    - added store copy to copy an object from container/path to destination container/path

In pithos:
    -added get/del_account_group for group/delgroup operations resp.

In storage:
    - added copy_object in OOS style

12 years agoAdded set_account_group
Stavros Sachtouris [Fri, 6 Jul 2012 14:25:57 +0000 (17:25 +0300)]
Added set_account_group

Adds a custom group of users

12 years agoAdded policy handling
Stavros Sachtouris [Fri, 6 Jul 2012 13:44:34 +0000 (16:44 +0300)]
Added policy handling

In CLI setversioning, versioning, setquota, quota for account and container
In storage(pithos) set_container_versioning, set_container_quota, set_account_versioning, set_account_quota
    also get_*_policy methods are split to get_*_versioning and get_*_quota

12 years agoSimplified Client code
Stavros Sachtouris [Fri, 6 Jul 2012 12:29:17 +0000 (15:29 +0300)]
Simplified  Client code

Added set_header method then replaced code that pushes headers to the query with calls to this much simpler method

12 years agoAdded un/publish object
Stavros Sachtouris [Fri, 6 Jul 2012 10:09:33 +0000 (13:09 +0300)]
Added un/publish object

12 years agoAdded store_delmenta (delete specific meta)
Stavros Sachtouris [Thu, 5 Jul 2012 15:16:31 +0000 (18:16 +0300)]
Added store_delmenta (delete specific meta)

    In CLI:
        - store_delmeta for account, container, object

    In storage,pithos:
        - store_account_delmeta
        - store_container_delemeta
        - store_object_delmeta (is buggy, hope to fix it soon)
        - moved all *meta methods to pithos, as they are all implementation of the pithos API

12 years agoRemoved store_set_account/container_meta
Stavros Sachtouris [Thu, 5 Jul 2012 13:52:46 +0000 (16:52 +0300)]
Removed store_set_account/container_meta

Both methods have been replaced by store_setmeta, semanticaly speaking

12 years agoAdded store_setmeta (pithos API implementation)
Stavros Sachtouris [Thu, 5 Jul 2012 13:47:48 +0000 (16:47 +0300)]
Added store_setmeta (pithos API implementation)

-In CLI:
    - store_meta for account, container and/or object
    - minor fixes to meta

In storage,pithos:
    - methods replace_account/container/object_meta in storage (OpenStack API)
    - methods set_account/container/object_meta in pithos (Pithos API)
    - minor bugfixes in client/untils and Client.request

12 years agoAdded set_account_meta
Stavros Sachtouris [Thu, 5 Jul 2012 10:20:57 +0000 (13:20 +0300)]
Added set_account_meta

In CLI:
    - added store_set_account_meta
    - added auxiliary dict_from_args in utils.py

In storage:
    - added set_account_meta
    - created client/util.py to store auxiliary methods semantically indepented Client
    - added auxiliary prefix_keys to client/utils.py
    - adjusted Client.request method to handle POST/PUT meta headers

12 years agoAdded meta to retrieve custom metacontent
Stavros Sachtouris [Wed, 4 Jul 2012 15:13:52 +0000 (18:13 +0300)]
Added meta to retrieve custom metacontent

In CLI added store_meta for retrieving custom metacontent for account, container or object

In storage added:
    - auxiliary method filter_dict_with_prefix
    - get_account_meta
    - get_container_meta
    - get_object_meta

12 years agoAdjusted store_download and store_upload params
Stavros Sachtouris [Wed, 4 Jul 2012 14:15:33 +0000 (17:15 +0300)]
Adjusted store_download and store_upload params

12 years agoMerged store create operations
Stavros Sachtouris [Wed, 4 Jul 2012 13:02:26 +0000 (16:02 +0300)]
Merged store create operations

In CLI, store_create_container and store_create_object(directory) are merged as "create"
The function "store_upload" remains due to different semantics

12 years agoMerged delete operations
Stavros Sachtouris [Wed, 4 Jul 2012 12:27:46 +0000 (15:27 +0300)]
Merged delete operations

In CLI:
    - store_delete merged with store_delete_container

In storage:
    - Error message fix

12 years agoMerged store list*, fixed bug
Stavros Sachtouris [Wed, 4 Jul 2012 11:23:32 +0000 (14:23 +0300)]
Merged store list*, fixed bug

In CLI:
    - methods list, list_containers, list_object are now merged in list, with slighlty different syntax

In storage:
    - fixed bug in error message

12 years agoMerged store info command, fixed bug
Stavros Sachtouris [Wed, 4 Jul 2012 10:54:18 +0000 (13:54 +0300)]
Merged store info command, fixed bug

In CLI:
    - store info, container_info and object_info are merged in one command, namely store info

In storage:
    - Fixed get_object_info return object to Response.headers

12 years agoAdded store info
Stavros Sachtouris [Wed, 4 Jul 2012 10:19:19 +0000 (13:19 +0300)]
Added store info

In CLI:
    - store_info added

In storage:
    - get_account_info added

12 years agoStore list_path renamed and optimised
Stavros Sachtouris [Tue, 3 Jul 2012 15:22:44 +0000 (18:22 +0300)]
Store list_path renamed and optimised

    In CLI store_list_object became store_list_path
    In storage list_objects_in_path was optimised to used path option in query

12 years agoError code handling
Stavros Sachtouris [Tue, 3 Jul 2012 15:05:24 +0000 (18:05 +0300)]
Error code handling

In storage delete_container and list_object

12 years agoAdded delete_container (remove an empty container)
Stavros Sachtouris [Tue, 3 Jul 2012 14:18:59 +0000 (17:18 +0300)]
Added delete_container (remove an empty container)

In CLI:
    - Added store_delete_container

In storage:
    - Added delete_container

12 years agoAdded store_object_info, container_info name fixed
Stavros Sachtouris [Tue, 3 Jul 2012 12:47:09 +0000 (15:47 +0300)]
Added store_object_info, container_info name fixed

In CLI:
    - Added store_object_info functionality
    - Store_container renamed to store_container_info

In storage:
    - Created method get_object_info
    - Renamed get_container_meta to get_container_info

12 years agoAdded list_object
Stavros Sachtouris [Tue, 3 Jul 2012 11:46:30 +0000 (14:46 +0300)]
Added list_object

In CLI:
    - created store_list_object
    - removed unused optional path option from store_list

In storage:
    - added list_objects_in_path, similar to list_objects but parses out objects that are not prefixed with path

12 years agoUnicode support in results
Stavros Sachtouris [Mon, 2 Jul 2012 15:16:56 +0000 (18:16 +0300)]
Unicode support in results

Replaced str() with unicode() in kamaki/utils

12 years agoAdded store list_containers and a minor CLI fix
Stavros Sachtouris [Mon, 2 Jul 2012 13:53:38 +0000 (16:53 +0300)]
Added store list_containers and a minor CLI fix

Exposed list_containers from storage to CLI as
    kamaki store list_containers

Moved method format_size from store_list to util, since it is semantically unreleated and
it was needed by list_ containers (and, possibly, other functions in the future)

Not tested yet

12 years agoAdded list_containers in storage
Stavros Sachtouris [Mon, 2 Jul 2012 13:37:38 +0000 (16:37 +0300)]
Added list_containers in storage

Not tested yet

12 years agoAdded mkdir functionality to storage
Stavros Sachtouris [Fri, 29 Jun 2012 08:53:48 +0000 (11:53 +0300)]
Added mkdir functionality to storage

12 years agoVersion bump
Kostas Papadimitriou [Mon, 11 Jun 2012 16:16:03 +0000 (19:16 +0300)]
Version bump

12 years agoDocumentation fixes
Kostas Papadimitriou [Fri, 8 Jun 2012 12:45:37 +0000 (15:45 +0300)]
Documentation fixes

- append parent path to sys.path for automodule to work
-

12 years agoMake source PEP8 compliant
Giorgos Verigakis [Thu, 17 May 2012 12:36:48 +0000 (15:36 +0300)]
Make source PEP8 compliant

12 years agoMove OrderedDict import where it is actually used
Giorgos Verigakis [Thu, 17 May 2012 12:23:10 +0000 (15:23 +0300)]
Move OrderedDict import where it is actually used

12 years agoDon't use default owner/group/mode values in personalities
Giorgos Verigakis [Thu, 17 May 2012 11:50:48 +0000 (14:50 +0300)]
Don't use default owner/group/mode values in personalities

12 years agoFallback to default raise_for_status if response is not valid
Giorgos Verigakis [Mon, 14 May 2012 15:02:46 +0000 (18:02 +0300)]
Fallback to default raise_for_status if response is not valid

12 years agoMove to requests 0.12.1
Giorgos Verigakis [Mon, 14 May 2012 13:43:48 +0000 (16:43 +0300)]
Move to requests 0.12.1

12 years agov0.5
Giorgos Verigakis [Wed, 9 May 2012 10:18:07 +0000 (13:18 +0300)]
v0.5

12 years agoUpdate docs
Kostas Papadimitriou [Tue, 8 May 2012 14:28:16 +0000 (17:28 +0300)]
Update docs

- Update copyright
- Include initial man page

12 years agoAdd COPYRIGHT
Kostas Papadimitriou [Tue, 8 May 2012 14:27:30 +0000 (17:27 +0300)]
Add COPYRIGHT

12 years agoChange contact email in docs/overview.rst
Constantinos Venetsanopoulos [Thu, 19 Apr 2012 16:20:59 +0000 (19:20 +0300)]
Change contact email in docs/overview.rst

12 years agoRemove clint dependency
Giorgos Verigakis [Tue, 24 Apr 2012 15:10:55 +0000 (18:10 +0300)]
Remove clint dependency

Add argparse and ordereddict dependency if Python < 2.7

12 years agoFix `var not defined' bug introduced in 31231dee4f
Nikos Skalkotos [Tue, 24 Apr 2012 10:42:57 +0000 (13:42 +0300)]
Fix `var not defined' bug introduced in 31231dee4f

12 years agoDo not read more than the given size
Giorgos Verigakis [Tue, 24 Apr 2012 10:18:30 +0000 (13:18 +0300)]
Do not read more than the given size

12 years agoChange default image URL
Giorgos Verigakis [Tue, 24 Apr 2012 08:51:10 +0000 (11:51 +0300)]
Change default image URL

12 years agoSwitch to progress for progress bars
Giorgos Verigakis [Mon, 23 Apr 2012 12:21:19 +0000 (15:21 +0300)]
Switch to progress for progress bars

12 years agoUse print instead of clint.textui methods
Giorgos Verigakis [Fri, 20 Apr 2012 13:46:19 +0000 (16:46 +0300)]
Use print instead of clint.textui methods

12 years agoUse ansicolors for colors
Giorgos Verigakis [Fri, 20 Apr 2012 13:33:56 +0000 (16:33 +0300)]
Use ansicolors for colors

12 years agoCall superclass __init__ in ClientError
Giorgos Verigakis [Thu, 19 Apr 2012 16:21:08 +0000 (19:21 +0300)]
Call superclass __init__ in ClientError

12 years agoSmall update to docs
Giorgos Verigakis [Thu, 19 Apr 2012 15:57:45 +0000 (18:57 +0300)]
Small update to docs

12 years agoAdd missing headers in PUT
Giorgos Verigakis [Thu, 19 Apr 2012 15:17:28 +0000 (18:17 +0300)]
Add missing headers in PUT

12 years agoAdd status_code in Container already exists exception
Giorgos Verigakis [Thu, 19 Apr 2012 11:37:13 +0000 (14:37 +0300)]
Add status_code in Container already exists exception

12 years agoMove default config paths inside config module
Giorgos Verigakis [Wed, 11 Apr 2012 10:58:15 +0000 (13:58 +0300)]
Move default config paths inside config module

12 years agoAdd Content-Length header when sending data
Giorgos Verigakis [Wed, 4 Apr 2012 09:55:58 +0000 (12:55 +0300)]
Add Content-Length header when sending data

12 years agoSend application/octet-stream Content-Type on create_object
Giorgos Verigakis [Wed, 4 Apr 2012 09:54:19 +0000 (12:54 +0300)]
Send application/octet-stream Content-Type on create_object

12 years agoData corruption fix
Giorgos Verigakis [Wed, 4 Apr 2012 09:29:15 +0000 (12:29 +0300)]
Data corruption fix

Duplicate blocks were added once to the hash map.

12 years agoAdd a purge command
Giorgos Verigakis [Fri, 23 Mar 2012 13:50:03 +0000 (15:50 +0200)]
Add a purge command

12 years agopyflakes reported fixes
Giorgos Verigakis [Fri, 23 Mar 2012 13:24:37 +0000 (15:24 +0200)]
pyflakes reported fixes

12 years agoUse prints, log was never defined
Giorgos Verigakis [Fri, 23 Mar 2012 13:08:30 +0000 (15:08 +0200)]
Use prints, log was never defined

12 years agoAdd an optional size argument in create_object
Giorgos Verigakis [Mon, 19 Mar 2012 16:33:54 +0000 (18:33 +0200)]
Add an optional size argument in create_object

12 years agoDisable certificate verification
Giorgos Verigakis [Mon, 19 Mar 2012 16:33:33 +0000 (18:33 +0200)]
Disable certificate verification

Was failing with the production server