| Branch: | Tag: | Revision:

root / kamaki @ 5482bc0a

# Date Author Comment
5482bc0a 06/04/2013 06:11 pm Stavros Sachtouris

Implement Config.guess_version for config files

3f0eae61 06/04/2013 06:11 pm Stavros Sachtouris

Implement the Config.guess_version method

201baa17 06/04/2013 02:03 pm Stavros Sachtouris

A. Hardcode the new kamaki config file

Refs: #3934

Breaks compatibility, implements a remotes-based config file

f5c28bfa 06/04/2013 12:30 pm Stavros Sachtouris

Backwards compatibility for configuraiton file

Compatible with kamaki config files v2

user.url, file.url, compute.url and image.url
are now valid and of higher priority to
astakos.url, pithos.url, cyclades.url, plankton.url
which are also valid

All these are ignored iff [global].auth_url is given

9d8737a2 06/03/2013 05:29 pm Stavros Sachtouris

Fix typos in default and expected values

819311d3 06/03/2013 05:19 pm Stavros Sachtouris

Handle url proccessing even if url is unicode

Also, fix typos and default values for service configurations

e7884f25 06/03/2013 04:49 pm Stavros Sachtouris

Fix typo in astakos client: version_id-->versionId

3950a864 06/03/2013 04:06 pm Stavros Sachtouris

Adjust cached auth info reading to recent changes

82e32e50 06/03/2013 03:14 pm Stavros Sachtouris

Fix typos in user command flow

ef00bc31 06/03/2013 02:37 pm Stavros Sachtouris

Apply servce.url options to cross-sercice calls

Refs: #3874

Let cross-service initializations to use explicit service endpoint urls if
there is no single authentication url.
- In Image commands, there are calls that use astakos and pithos clients
- In pithos there are calls that use astakos client

8cec3671 06/03/2013 02:22 pm Stavros Sachtouris

Use explicitely set services urls if no auth_url

Refs: #3874

In current configuration, kamaki checks for auth_url. If that fails,
it raises an error. If it is not set, it prints a warning and attempts
to read the <service>.url option from the configuration file....

cb4a5d9c 06/03/2013 12:58 pm Stavros Sachtouris

Implement --cloud arg to switch between clouds

Refs: #3913

Config file can (optionaly) contain:

example =
old_version =

Now, user can explicitely request for a remote cloud authentication URI:...

f724cd35 05/31/2013 05:37 pm Stavros Sachtouris

Get endpoint urls for all CLI operations

Refs: #3874

Use kamaki.clients.astakos.AstakosClient as a cached astakos client to get
user information and, most importantly, endpoints. Allow users to authenticate
multiple tokens on the same session. In every session there must be at most...

05e144e2 05/31/2013 01:29 pm Stavros Sachtouris

Create config file version 3

Refs: #3874

Minimum config file:
token = <user token>


- Only one field "cli" for user command specs, to map command groups to CLIs:

user = astakos
file = pithos
server = cyclades

- Specify client services/apis and versions....

528550d9 05/30/2013 04:35 pm Stavros Sachtouris

Enrich/rename astakos client calls with endpoints

Refs: #3874

Kamaki.clients.astakos.AstakosClient is now a high-level client lib that
offers access to token-authenticated astakos-aquired cached information.
Users who need an astakos client should use the snf-astakosclient instead....

7983398f 05/28/2013 11:45 am Stavros Sachtouris

Merge branch 'feature-expose-astakosclient' into develop

6f04d079 05/28/2013 11:45 am Stavros Sachtouris

Merge branch 'feature-osv2-compatibility' into develop

683335b1 05/27/2013 05:07 pm Stavros Sachtouris

Expose some basix astakosclient methods to cli

Methods exposed:

get_user_info as authenticate
get_uuid[s] as uuid
get_username[s] as username
get_quotas as quotas
services_get_uuid[s]/username[s]/quotas as service uuid/username/quotas

b79ae40b 05/27/2013 03:35 pm Stavros Sachtouris

Adjust astakos authenticate to snf-0.14 url sheme

97fc1e06 05/27/2013 03:23 pm Stavros Sachtouris

Setup a snf-astakos command set

f0415090 05/24/2013 05:40 pm Stavros Sachtouris

Update config file version tag

137c51f5 05/24/2013 05:24 pm Stavros Sachtouris

Fix typo in kamak.cli.logger import

bcef3ac9 05/24/2013 04:47 pm Stavros Sachtouris

Rename meta-->metadata and remove values @CLI

Refs: #3633

fab9b17f 05/23/2013 06:42 pm Stavros Sachtouris

Rename meta-->metadata and remove values @lib

- Meta-->metadata in some cases, according to the expected cyclades API
- remove values level from requests and responses @ cyclades lib

Refs: #3633

13c02904 05/23/2013 05:46 pm Stavros Sachtouris

Fix expected "public" header params in tests

aa82dd5a 05/23/2013 05:25 pm Stavros Sachtouris

Add metadata management to image register

- validate image metadata format
- read metadata from file
- merge file-loaded metadata with runtimes
- store metadata file on pithos, check existance, overwrite with f
raise helpful error messages when there fail...

17b255c7 05/23/2013 02:01 pm Stavros Sachtouris

Use _format_image_headers: image_register,get_meta

- Ensure uniform image meta output
- Easy to apply the correct meta format

Refs: #3797

4e424eaa 05/22/2013 06:25 pm Stavros Sachtouris

Restore thread-wait for append

e4ff4453 05/22/2013 06:15 pm Stavros Sachtouris

Fix typo (permition --> permission)

117ca598 05/22/2013 06:05 pm Stavros Sachtouris

Merge branch 'feature-json-output' into develop


Also, take care of pep8 issues

d9301a7a 05/22/2013 06:01 pm Stavros Sachtouris

Fix typo in pithos upload output

3ec5c230 05/22/2013 05:48 pm Stavros Sachtouris

Wait threads to finish in pithos append_object

545c6c29 05/22/2013 05:26 pm Stavros Sachtouris

Implement an optional json output 4 outputing cmds

Refs: #3732

6dfd55cb 05/22/2013 01:42 pm Stavros Sachtouris

Add json/optional output to astakos cmds

Refs: #3732

1b73b4c1 05/22/2013 01:38 pm Stavros Sachtouris

Add json/optional responses to flavor/network cmds

Refs: #3732

cd295a1d 05/22/2013 01:07 pm Stavros Sachtouris

Add json/optional outputs to server commands

Refs: #3732

6aadd6e1 05/21/2013 07:47 pm Stavros Sachtouris

Do not unpublish by default @ pithos rest calls

Refs: #3780

c4aefeaf 05/21/2013 07:32 pm Stavros Sachtouris

Update and enrich error messages in image register

Parse ivalid property file and guide users to correct it
Guide users to pass valid container:path parameters


9553da85 05/21/2013 06:26 pm Stavros Sachtouris

Print full and nice response in image register

f17121cd 05/21/2013 06:10 pm Stavros Sachtouris

Do not recalculate #blocks in upload_from_string

Refs: #3608

f7a37648 05/21/2013 06:04 pm Stavros Sachtouris

Make sure registered properties are unique

Refs: #3769

00336c85 05/21/2013 05:08 pm Stavros Sachtouris

Store image properties after image registration

Log of changes:
- Properties are stored in a remote file on Pithos+
- File name is <image-file>.meta
- Feature can be switched off with --no-property-file-upload
- If remote property file exists, registration is aborted...

623a4ceb 05/21/2013 03:23 pm Stavros Sachtouris

Optionaly load images properties from file

Refs: #3769

395fbf9e 05/20/2013 06:40 pm Stavros Sachtouris

Update documentation to reflect changes in output

Refs: #3756

f5f35422 05/20/2013 05:54 pm Stavros Sachtouris

Apply option outputs to image commands + renames

- Add image.add_member missing content-length header
- Rename image-[add|del]member commands to members-[add|delete]
- Remove update option from image-register
- In image-compute split properties to properties-list and properties-get...

915b99b5 05/20/2013 01:21 pm Stavros Sachtouris

Apply optional output to kamaki file commands

Apply the feature wherever is applicable
Generalize the feature by moving the corresponding code to _command_init

5655d560 05/17/2013 07:11 pm Stavros Sachtouris

Update file operations and their output

Refs: #3756 #3732

- Add optional output for file methods: mkdir, touch, create, move, create,
copy, move, append, delete, purge, info, meta, upload
- Transliterate permissions and metadata methods to apear as get/set/delete...
55c75058 05/17/2013 03:49 pm Stavros Sachtouris

Add output to file copy/move

Also, kamaki.clients.pithos.copy/move_object returns response headers

Refs: #3756 #3732

94bedc5b 05/17/2013 02:48 pm Stavros Sachtouris

Add output support to create methods

Refs: #3756 #3732

In kamaki.clients
- storage.create_directory returns response headers
- implement pithos.create_container

In kamaki.cli.pithos
- add flag --with_output for optional output...

0399ac7e 05/17/2013 01:48 pm Stavros Sachtouris

Add json formated output for file list

- Implement a print_json auxiliary method in kamaki.cli.utils
- Add a (j, --json) flag to file list
When -j or --json flag is on, only json is printed

Refs: #3732

dcfe7455 05/16/2013 08:25 pm Stavros Sachtouris

Update changelog, unittests for upload_from_string

Refs: #3608

6fa30b1b 05/16/2013 08:14 pm Stavros Sachtouris

Functional test and debug for upload_from_string

Refs: #3608

9d502497 05/16/2013 07:27 pm Stavros Sachtouris

Implement upload_from_string

Implemented with threads

Refs: #3608

0fbc8a52 05/16/2013 05:17 pm Stavros Sachtouris

Optimize download_to_string by using threads

Refs: #3608

49cc29b2 05/16/2013 04:31 pm Stavros Sachtouris

Implement download_to_string in pithos client

The download_to_string method downloads a remote object from pithos into a
string, which is then returned.

Also, implemented unit and functional tests. Changelog is updated

Refs: #3608

1d3f006b 05/15/2013 07:39 pm Stavros Sachtouris

Allow copy of deleted objects by refering to older

Also disallow moving deleted objects by version The later was implemented by
accident, due to the symetry between move and copy

Refs: #3737

e2d7b883 05/15/2013 06:32 pm Stavros Sachtouris

Fix typo dst_path instead of ds_path

Refs: 3737

ed9af02c 05/15/2013 05:36 pm Stavros Sachtouris

Add enumeration as optional for all list cmds

Refs: #3739

030c0d3a 05/15/2013 04:12 pm Stavros Sachtouris

Restore 2nd level command sysntax in shell

Refs: #3736

74c65e80 05/15/2013 03:44 pm Stavros Sachtouris

Cache container info request per upload session

Refs: #3735

14c72dbd 05/15/2013 03:12 pm Stavros Sachtouris

Adjust pithos livetest to use container_info_cache

Refs: #3707

0ef0db9f 05/15/2013 02:23 pm Stavros Sachtouris

Update unitest to include container_info_cache

Refs: 3707

76ebf97c 05/15/2013 02:06 pm Stavros Sachtouris

Add a container_infor_cache param to upload_object

Each upload involves a request that retrieves block size and hash information.
In higher level applications, this request is redudant after the first upload.
This feature allows higher level operations to cache retrieved container info...

0e728dcb 05/14/2013 07:30 pm Stavros Sachtouris

Add a -l option to upload: list uploaded details

If the upload is successfull, if the -l or --details argument is present,
kamaki lists all uploaded objects with all details returned by the server
(e.g. object version, date of creation, etc)

Refs: #3730

cb010e3e 05/14/2013 07:00 pm Stavros Sachtouris

Update livetest for upload return modification

Refs: #3656

3c216009 05/14/2013 06:52 pm Stavros Sachtouris

Modify upload methods to return created obj info

Methods affected:

unittests modified accordingly

Refs: #3656

be4a8ccd 05/14/2013 06:22 pm Stavros Sachtouris

Implement purging a non-empty container

kamaki file purge <container> -F

will automatically empty a container before purging it

Refs: #3662

4fbc9d34 05/14/2013 05:39 pm Stavros Sachtouris

Implement livetest for image unregister

Refs: #3728

4a17d307 05/14/2013 05:12 pm Stavros Sachtouris

Expose image-unregister to cli and unittest it

fd6608bd 05/14/2013 04:40 pm Stavros Sachtouris

Implement image unregister in kamaki.clients

Refs: #3728

e3c2c890 05/13/2013 04:53 pm Stavros Sachtouris

Allow runtime args when invoking interactive shell

Refs: #3716

Behavior After This:
kamaki -XXX -YY ... parses -XXX -YY
If not recognized: syntax error
If recognized, group them into shell args (e.g. -h) and command args (e.g. -d)
Whenever a command is run in this shell instance, apply the command args...

334338ce 05/13/2013 02:13 pm Stavros Sachtouris

Raise a descriptive error for misconfigured cmds

Refs: #3663

A command group that is declared in the config file is not supported
by valid command specification code or the specification code is not
pointed at by <command>.cli configure variable

58850eb0 05/13/2013 12:55 pm Stavros Sachtouris

Log initial call arguments in first log

ef4357c1 05/10/2013 07:25 pm Stavros Sachtouris

Merge branch 'feature-logging' into develop

7637d600 05/10/2013 07:24 pm Stavros Sachtouris

Move logger module to kamaki.cli

c4d51ec9 05/10/2013 07:16 pm Stavros Sachtouris

Make kamaki.clients unware of kamaki.logger

use logging for getting the loggers

0d4a6d0a 05/10/2013 06:33 pm Stavros Sachtouris

Stop shell from destroying config instance

This caused warnings about preset variables

d761839f 05/10/2013 05:51 pm Stavros Sachtouris

Update Changelog to reflect #3715 changes

9dc724e5 05/10/2013 05:38 pm Stavros Sachtouris

Allow activation/deactivation of specific loggers

refs: #3715
Logger settings are not aborted and will be restored at deactivation

Also, remove all logger creation functionality from kamaki.clients
A file or stream logger should be created an the kamaki.clients caller side...

24be4a50 05/10/2013 01:45 pm Stavros Sachtouris

Merge branch 'feature-logging' into develop

c4563114 05/10/2013 01:45 pm Stavros Sachtouris

Remove log redaduncy when logging in a file

6e1f863b 05/09/2013 07:18 pm Stavros Sachtouris

Use < and > in stream logger for send/recv resp.

9986e569 05/09/2013 07:06 pm Stavros Sachtouris

Globalize logger usage

Unsolved bug: redudant info in logfile

a5077876 05/09/2013 05:49 pm Stavros Sachtouris

Wipe logger add_file_logger

c6cec5e1 05/09/2013 05:12 pm Stavros Sachtouris

Fix typo in _create_or_get_missing_hashes call

b349b84b 05/09/2013 05:03 pm Stavros Sachtouris

Honour if_(none_)match even if all blocks are up

Refs: bug #3708

e9db8806 05/09/2013 04:45 pm Stavros Sachtouris

Expand logger to support stream logging, simplify

1a7f53e9 04/30/2013 05:44 pm Stavros Sachtouris

Adjust expected values in fanctional client tests

9f783a51 04/30/2013 01:54 pm Stavros Sachtouris

Make containerlimit set/get aware of 0==unlimited

containerlimit set -h will tell users to use 0 for unlimited
containerlimit get will print "unlimited" if received a 0 value

c8d8c6c9 04/30/2013 01:37 pm Stavros Sachtouris

Alow uploading to container with limit 0

Container limit 0 means "unlimited"

8b516110 04/25/2013 01:25 pm Stavros Sachtouris

Move addproperty from image to image compute

1736e06d 04/24/2013 03:35 pm Stavros Sachtouris

Fix typo with --config and --property args (#3658)

005d3f25 04/19/2013 01:21 pm Stavros Sachtouris

Connect request-response threads in logs

The connection between kamaki request attempt and httplib response was
logged, but the connection between httplib response and kamaki response
managment was not logged.

9e87e4bb 04/18/2013 06:18 pm Stavros Sachtouris

Remove extra logging options

One default: ~/.kamaki.log
User can use a custom: kamaki config set log_file <custom log file>

bfb54881 04/18/2013 06:05 pm Stavros Sachtouris

Fix mispeled import cyclades_cli --> cyclades

edf00ab3 04/18/2013 03:59 pm Stavros Sachtouris

Set ~/.kamaki.log with mode 0600 as default

Refs: #3610

2d158d8b 04/17/2013 12:01 pm Stavros Sachtouris

Make recursive upload non-default, rearange checks

Alloow recursive upload with R
Rearange pre-upload checks as shown bellow:
check first if it is recursive & direcory
- check if object exists or forced to overwrite
- check container limit and used size...

2b74fc1d 04/17/2013 11:45 am Stavros Sachtouris

Take into account container used bytes in upload

Before uploading, check if there is enough remaining space on container
remaning space = container limit - container used bytes

58743792 04/16/2013 06:29 pm Stavros Sachtouris

Merge branch 'feature-store' into develop

14b25e00 04/16/2013 05:26 pm Stavros Sachtouris

Prevent upload if uploads exceed container limit

Feature #3536