Statistics
| Branch: | Tag: | Revision:

root / kamaki @ 0fbc8a52

# Date Author Comment
0fbc8a52 05/16/2013 05:17 pm Stavros Sachtouris

Optimize download_to_string by using threads

Refs: #3608

49cc29b2 05/16/2013 04:31 pm Stavros Sachtouris

Implement download_to_string in pithos client

The download_to_string method downloads a remote object from pithos into a
string, which is then returned.

Also, implemented unit and functional tests. Changelog is updated

Refs: #3608

1d3f006b 05/15/2013 07:39 pm Stavros Sachtouris

Allow copy of deleted objects by refering to older

Also disallow moving deleted objects by version The later was implemented by
accident, due to the symetry between move and copy

Refs: #3737

e2d7b883 05/15/2013 06:32 pm Stavros Sachtouris

Fix typo dst_path instead of ds_path

Refs: 3737

ed9af02c 05/15/2013 05:36 pm Stavros Sachtouris

Add enumeration as optional for all list cmds

Refs: #3739

030c0d3a 05/15/2013 04:12 pm Stavros Sachtouris

Restore 2nd level command sysntax in shell

Refs: #3736

74c65e80 05/15/2013 03:44 pm Stavros Sachtouris

Cache container info request per upload session

Refs: #3735

14c72dbd 05/15/2013 03:12 pm Stavros Sachtouris

Adjust pithos livetest to use container_info_cache

Refs: #3707

0ef0db9f 05/15/2013 02:23 pm Stavros Sachtouris

Update unitest to include container_info_cache

Refs: 3707

76ebf97c 05/15/2013 02:06 pm Stavros Sachtouris

Add a container_infor_cache param to upload_object

Each upload involves a request that retrieves block size and hash information.
In higher level applications, this request is redudant after the first upload.
This feature allows higher level operations to cache retrieved container info...

0e728dcb 05/14/2013 07:30 pm Stavros Sachtouris

Add a -l option to upload: list uploaded details

If the upload is successfull, if the -l or --details argument is present,
kamaki lists all uploaded objects with all details returned by the server
(e.g. object version, date of creation, etc)

Refs: #3730

cb010e3e 05/14/2013 07:00 pm Stavros Sachtouris

Update livetest for upload return modification

Refs: #3656

3c216009 05/14/2013 06:52 pm Stavros Sachtouris

Modify upload methods to return created obj info

Methods affected:
upload_object
upload_object_unchunked
upload_object_by_manifestation

unittests modified accordingly

Refs: #3656

be4a8ccd 05/14/2013 06:22 pm Stavros Sachtouris

Implement purging a non-empty container

kamaki file purge <container> -F

will automatically empty a container before purging it

Refs: #3662

4fbc9d34 05/14/2013 05:39 pm Stavros Sachtouris

Implement livetest for image unregister

Refs: #3728

4a17d307 05/14/2013 05:12 pm Stavros Sachtouris

Expose image-unregister to cli and unittest it

fd6608bd 05/14/2013 04:40 pm Stavros Sachtouris

Implement image unregister in kamaki.clients

Refs: #3728

e3c2c890 05/13/2013 04:53 pm Stavros Sachtouris

Allow runtime args when invoking interactive shell

Refs: #3716

Behavior After This:
kamaki -XXX -YY ... parses -XXX -YY
If not recognized: syntax error
If recognized, group them into shell args (e.g. -h) and command args (e.g. -d)
Whenever a command is run in this shell instance, apply the command args...

334338ce 05/13/2013 02:13 pm Stavros Sachtouris

Raise a descriptive error for misconfigured cmds

Refs: #3663

A command group that is declared in the config file is not supported
by valid command specification code or the specification code is not
pointed at by <command>.cli configure variable

58850eb0 05/13/2013 12:55 pm Stavros Sachtouris

Log initial call arguments in first log

ef4357c1 05/10/2013 07:25 pm Stavros Sachtouris

Merge branch 'feature-logging' into develop

7637d600 05/10/2013 07:24 pm Stavros Sachtouris

Move logger module to kamaki.cli

c4d51ec9 05/10/2013 07:16 pm Stavros Sachtouris

Make kamaki.clients unware of kamaki.logger

use logging for getting the loggers

0d4a6d0a 05/10/2013 06:33 pm Stavros Sachtouris

Stop shell from destroying config instance

This caused warnings about preset variables

d761839f 05/10/2013 05:51 pm Stavros Sachtouris

Update Changelog to reflect #3715 changes

9dc724e5 05/10/2013 05:38 pm Stavros Sachtouris

Allow activation/deactivation of specific loggers

refs: #3715
Logger settings are not aborted and will be restored at deactivation

Also, remove all logger creation functionality from kamaki.clients
A file or stream logger should be created an the kamaki.clients caller side...

24be4a50 05/10/2013 01:45 pm Stavros Sachtouris

Merge branch 'feature-logging' into develop

c4563114 05/10/2013 01:45 pm Stavros Sachtouris

Remove log redaduncy when logging in a file

6e1f863b 05/09/2013 07:18 pm Stavros Sachtouris

Use < and > in stream logger for send/recv resp.

9986e569 05/09/2013 07:06 pm Stavros Sachtouris

Globalize logger usage

Unsolved bug: redudant info in logfile

a5077876 05/09/2013 05:49 pm Stavros Sachtouris

Wipe logger add_file_logger

c6cec5e1 05/09/2013 05:12 pm Stavros Sachtouris

Fix typo in _create_or_get_missing_hashes call

b349b84b 05/09/2013 05:03 pm Stavros Sachtouris

Honour if_(none_)match even if all blocks are up

Refs: bug #3708

e9db8806 05/09/2013 04:45 pm Stavros Sachtouris

Expand logger to support stream logging, simplify

1a7f53e9 04/30/2013 05:44 pm Stavros Sachtouris

Adjust expected values in fanctional client tests

9f783a51 04/30/2013 01:54 pm Stavros Sachtouris

Make containerlimit set/get aware of 0==unlimited

containerlimit set -h will tell users to use 0 for unlimited
containerlimit get will print "unlimited" if received a 0 value

c8d8c6c9 04/30/2013 01:37 pm Stavros Sachtouris

Alow uploading to container with limit 0

Container limit 0 means "unlimited"

8b516110 04/25/2013 01:25 pm Stavros Sachtouris

Move addproperty from image to image compute

1736e06d 04/24/2013 03:35 pm Stavros Sachtouris

Fix typo with --config and --property args (#3658)

005d3f25 04/19/2013 01:21 pm Stavros Sachtouris

Connect request-response threads in logs

The connection between kamaki request attempt and httplib response was
logged, but the connection between httplib response and kamaki response
managment was not logged.

9e87e4bb 04/18/2013 06:18 pm Stavros Sachtouris

Remove extra logging options

One default: ~/.kamaki.log
User can use a custom: kamaki config set log_file <custom log file>

bfb54881 04/18/2013 06:05 pm Stavros Sachtouris

Fix mispeled import cyclades_cli --> cyclades

edf00ab3 04/18/2013 03:59 pm Stavros Sachtouris

Set ~/.kamaki.log with mode 0600 as default

Refs: #3610

2d158d8b 04/17/2013 12:01 pm Stavros Sachtouris

Make recursive upload non-default, rearange checks

Alloow recursive upload with R
Rearange pre-upload checks as shown bellow:
check first if it is recursive & direcory
- check if object exists or forced to overwrite
- check container limit and used size...

2b74fc1d 04/17/2013 11:45 am Stavros Sachtouris

Take into account container used bytes in upload

Before uploading, check if there is enough remaining space on container
remaning space = container limit - container used bytes

58743792 04/16/2013 06:29 pm Stavros Sachtouris

Merge branch 'feature-store' into develop

14b25e00 04/16/2013 05:26 pm Stavros Sachtouris

Prevent upload if uploads exceed container limit

Feature #3536

b666ef82 04/16/2013 03:45 pm Stavros Sachtouris

Implement a recursive upload

kamaki file upload <directory> <container>[:remote-dir]

where remote-dir either is a dir or does not exist

Feature #3536

76e7661e 04/15/2013 06:14 pm Stavros Sachtouris

Update docs to use the term Synnefo where needed

In some cases, the term 'GRNET development team' was replaced with 'Synnefo' or
'Synnefo development team'

3f7e4e14 04/15/2013 05:52 pm Stavros Sachtouris

Add some parameters to storage.list_object

:param limit: (int) The amount of results requested

:param marker: (str) Return containers with name lexicographically
after marker

:param prefix: (str) Return objects starting with prefix

:param format: (str) reply format can be json or xml (default:json)...

faeccbf9 04/15/2013 04:31 pm Stavros Sachtouris

Add some client-side filters to image list

--owner=<uuid> : print only images with given owner

--name-prefix=

  :  print only images with name starting with <prefix>
--name-suffix=<suffix>  :  print only images with name starting with <suffix>
--name-like=<part>      :  print only images with name containing <part>...

f9457c89 04/15/2013 03:57 pm Stavros Sachtouris

Filter image listing results by owner

Introduce the --owner parameter to kamaki image list (was: image public)
If given, only images of given owner will be pronted on console. This is a
client side filtering, as oposed to the other filters of the command.

f6f81cd3 04/15/2013 02:37 pm Stavros Sachtouris

Set a default network type when creating nets

Default type is MAX_FILTERED

Support #3514

3ed6dbde 04/15/2013 02:11 pm Stavros Sachtouris

Split file-quota semantics for account and contner

kamaki file quota --> only for account
kamaki file quota <container> --> kamaki file containerlimit get [container]

Support #3541

326a79b9 04/15/2013 01:32 pm Stavros Sachtouris

Rename file setquota to file containerlimit set

Also, do not allow user to set account quota

a29d2f88 04/15/2013 12:12 pm Stavros Sachtouris

Apply uniform descriptions to all client commands

<GRNET name>/<OS name> API <actuall api> commands

e.g.
Cyclades/Compute API server commands
or
Pithos+/Storage API commands

Commands file names are named after the API they implement, not the command interface....

737c7deb 04/15/2013 11:28 am Stavros Sachtouris

Fix astakos client functional test

Use 'user.token' instead of 'astakos.token'

1792ed1d 04/15/2013 11:22 am Stavros Sachtouris

Remove quotaholder from kamaki

This affects the cli:
- remove the quotaholder commands set
- remove the commissioning system (automatic command retrieval)

This affevts the clients:
- remove the quotaholder client
- remove the clients commissioning system...

0ea31480 04/12/2013 06:27 pm Stavros Sachtouris

Update docs, rename kamaki.cli.commands/*

Documentation updates: reflect the changes in command groups
astakos --> user, store --> file

File renaming: remove the _cli suffix from modules in kamaki.cli.commands

Feature #3566

3ae60112 04/12/2013 05:34 pm Stavros Sachtouris

Rename store command group to file

Feature #3566

4018326d 04/12/2013 05:10 pm Stavros Sachtouris

Rename command group astakos to user

The client is still called 'astakos', but the command group is now 'user'

Feature #3566

e9ac514e 04/12/2013 03:37 pm Stavros Sachtouris

Add if-etag-match to pithos client upload

2ec852fc 04/12/2013 03:24 pm Stavros Sachtouris

Merge branch 'feature-store' into develop

524d9cdd 04/12/2013 03:18 pm Stavros Sachtouris

Add option to fail upload if remote file exists

The if-none-match header option with '*' is used in that case.
This is exposed as 'if_not_exist' in PithosClient.upload_object

Feature #3574

31a30991 04/12/2013 01:46 pm Stavros Sachtouris

Update documentation for logger changes

f47417e7 04/12/2013 01:14 pm Stavros Sachtouris

Pametrize log file, make it globaly available

Kamaki logger module is now available to both cli and clients packages
Users may set the log_file option in configuration file
kamaki config set log_file ...

Support #3441

7b6e977c 04/11/2013 06:43 pm Stavros Sachtouris

Return image details as headers, in image register

Feature #3512

cae76f25 04/11/2013 05:50 pm Stavros Sachtouris

Increase timeout in upload thread canceling

b78ee581 04/11/2013 04:55 pm Stavros Sachtouris

Make download canceling more responsive

This does not make download canceling faster, if anything, it makes it slower
but probably more gracefull for end users. Instead of just waiting the threads
to finish, users now see messages that descibe the attempts made by kamaki to...

50165863 04/11/2013 04:11 pm Stavros Sachtouris

Make --public and --sharing to work in upload

Bug #3509

08aad6db 04/11/2013 03:22 pm Stavros Sachtouris

Fix typo in commands.errors (self-->this)

This typo caused undesired behavior when deleting a deleted network

Bug #3547

c5b9380c 04/11/2013 02:41 pm Stavros Sachtouris

Allow users to set maximum thread limit

This is implemented as a configuration option in cli
Developers may set it as kamaki.clients.Client.MAX_THREADS = <limit>

Adjust documentation acoordingly

Feature #3546

9d9ad424 04/11/2013 11:44 am Stavros Sachtouris

Stop create_server from crushing by a faulty image

If the image is missing the (os, users) metadata, the create_server method
used to crush anexpectingly

a863029c 04/09/2013 12:40 pm Stavros Sachtouris

Add a NL to logs to make them more readable

e5c76b1a 04/08/2013 07:08 pm Stavros Sachtouris

Fix typo in using download progress bar

28cbc3c2 04/08/2013 06:50 pm Stavros Sachtouris

Minimize requeests whn dnlding same block

If a file has multiple same blocks, download one of them and copy it to local
file locations

ca7f78c0 04/08/2013 04:45 pm Stavros Sachtouris

fixbug 3555: blcks missing if same to other blcks

d187ba37 04/08/2013 03:53 pm Stavros Sachtouris

Create a livetest that catches bug #3555

A boring file is a file with at least two same blocks
Kamaki fails to download more than 1 same blocks, therefore the downloaded
file is corrupted
This test fixes the bug

b3bb083f 04/05/2013 04:47 pm Stavros Sachtouris

DISABLE config log options in interactive shell

to avoid kamaki failures due to logging problems

5fdccdec 04/05/2013 04:24 pm Stavros Sachtouris

Allow config to switch some options on or off

- LOG_TOKEN: whether to log user token in http requests (default: off)
- LOG_DATA: whether to log http body (send or secv - default: off)

config options: log_token=off, log_data=off

34b88989 04/05/2013 02:54 pm Stavros Sachtouris

Fix typos in logging mechanism

008a5db5 04/05/2013 12:26 pm Stavros Sachtouris

Move http response logging to ResponseManager

21871fb2 04/05/2013 12:15 pm Stavros Sachtouris

Move http request logging to RequestManager

64c26817 04/04/2013 07:20 pm Stavros Sachtouris

Wip kamaki.clients.test.py

f8eea8ec 04/04/2013 07:12 pm Stavros Sachtouris

Unittest ResponseManager

7fa5c263 04/04/2013 05:57 pm Stavros Sachtouris

Unittest kamaki.clients.RequestManager

c2b5da2f 04/04/2013 04:37 pm Stavros Sachtouris

Redesign http connection module

Merge everything to kamaki.clients

Remove multiple hierarchies of connection classes (== abandon support for
alternative connection methods, e.g. for requests from pypi)

New connection classes are
- RequestManager
- ResponseManager...

5b32d978 04/02/2013 02:24 pm Stavros Sachtouris

Remove testing code

2dc39c27 04/02/2013 02:23 pm Stavros Sachtouris

Remove invalid header values in image register

573be34f 04/02/2013 01:27 pm Stavros Sachtouris

Cover image-compute command group in documentation

8741c407 04/02/2013 12:46 pm Stavros Sachtouris

Create an image compute cmd group, make it work

- image compute group contains all Compute Image API commands, as oposed to
Plankton API commands.

- definition of a kamaki cli command slightly changed: a command with
subcommands can have a class without being a command itself, as long as it has...

e8af27f4 03/26/2013 12:40 pm Stavros Sachtouris

Add a ClientError logger to kamaki.clients

42115b51 03/26/2013 12:23 pm Stavros Sachtouris

Move logger operations to a seperate file/pkg

2406db97 03/22/2013 07:06 pm Stavros Sachtouris

Disable token logging (synnefo bug #3480)

f09da8c8 03/22/2013 06:55 pm Stavros Sachtouris

Add logging to file functionality (#3441)

61ca0ecd 03/22/2013 04:44 pm Stavros Sachtouris

Create get_logger, add_logger methods in clients

3c50df2e 03/22/2013 03:42 pm Stavros Sachtouris

Apply a simple naming convention for unit tests

Naming convention:

Actual functionality:

In package kamaki.clients.pkg there is class C containing a method M
Test it in a package kamaki.clients.pkg.test, with a class C + a method test_M
Command line run:...

f40f0cb7 03/22/2013 11:41 am Stavros Sachtouris

Ensure uniform runtime args in cli (feature #3456)

91e9bf7f 03/21/2013 06:57 pm Stavros Sachtouris

Add redudant -c argument to mean --config (global)

7cac95a7 03/21/2013 06:37 pm Stavros Sachtouris

Re-allow empty paths to clients.Client.request