kamaki
11 years agoMake download canceling more responsive
Stavros Sachtouris [Thu, 11 Apr 2013 13:55:45 +0000 (16:55 +0300)]
Make download canceling more responsive

This does not make download canceling faster, if anything, it makes it slower
but probably more gracefull for end users. Instead of just waiting the threads
to finish, users now see messages that descibe the attempts made by kamaki to
cancel them. Each cancelation gets a timeout of 0.5 seconds, so that users
will not wait too long (although they might wait more overall)

Bug #3457

11 years agoMake --public and --sharing to work in upload
Stavros Sachtouris [Thu, 11 Apr 2013 13:11:59 +0000 (16:11 +0300)]
Make --public and --sharing to work in upload

Bug #3509

11 years agoFix typo in commands.errors (self-->this)
Stavros Sachtouris [Thu, 11 Apr 2013 12:22:07 +0000 (15:22 +0300)]
Fix typo in commands.errors (self-->this)

This typo caused undesired behavior when deleting a deleted network

Bug #3547

11 years agoMerge branch 'feature-threads' into develop
Stavros Sachtouris [Thu, 11 Apr 2013 12:07:48 +0000 (15:07 +0300)]
Merge branch 'feature-threads' into develop

11 years agoAllow users to set maximum thread limit
Stavros Sachtouris [Thu, 11 Apr 2013 11:41:40 +0000 (14:41 +0300)]
Allow users to set maximum thread limit

This is implemented as a configuration option in cli
Developers may set it as kamaki.clients.Client.MAX_THREADS = <limit>

Adjust documentation acoordingly

Feature #3546

11 years agoFix typo in kamaki quick setup guide
Stavros Sachtouris [Thu, 11 Apr 2013 09:24:35 +0000 (12:24 +0300)]
Fix typo in kamaki quick setup guide

WAS: kamaki set token ....
NOW: kamaki config set token ...

11 years agoStop create_server from crushing by a faulty image
Stavros Sachtouris [Thu, 11 Apr 2013 08:44:59 +0000 (11:44 +0300)]
Stop create_server from crushing by a faulty image

If the image is missing the (os, users) metadata, the create_server method
used to crush anexpectingly

11 years agoAdd a NL to logs to make them more readable
Stavros Sachtouris [Tue, 9 Apr 2013 09:40:29 +0000 (12:40 +0300)]
Add a NL to logs to make them more readable

11 years agoMerge branch 'feature-store' into develop
Stavros Sachtouris [Mon, 8 Apr 2013 16:09:30 +0000 (19:09 +0300)]
Merge branch 'feature-store' into develop

11 years agoFix typo in using download progress bar
Stavros Sachtouris [Mon, 8 Apr 2013 16:08:51 +0000 (19:08 +0300)]
Fix typo in using download progress bar

11 years agoMinimize requeests whn dnlding same block
Stavros Sachtouris [Mon, 8 Apr 2013 15:50:01 +0000 (18:50 +0300)]
Minimize requeests whn dnlding same block

If a file has multiple same blocks, download one of them and copy it to local
file locations

11 years agofixbug 3555: blcks missing if same to other blcks
Stavros Sachtouris [Mon, 8 Apr 2013 13:45:33 +0000 (16:45 +0300)]
fixbug 3555: blcks missing if same to other blcks

11 years agoCreate a livetest that catches bug #3555
Stavros Sachtouris [Mon, 8 Apr 2013 12:53:58 +0000 (15:53 +0300)]
Create a livetest that catches bug #3555

A boring file is a file with at least two same blocks
Kamaki fails to download more than 1 same blocks, therefore the downloaded
file is corrupted
This test fixes the bug

11 years agoMerge branch 'develop' into feature-store
Stavros Sachtouris [Mon, 8 Apr 2013 11:42:11 +0000 (14:42 +0300)]
Merge branch 'develop' into feature-store

11 years agoMerge branch 'feature-logging' into develop
Stavros Sachtouris [Fri, 5 Apr 2013 13:49:44 +0000 (16:49 +0300)]
Merge branch 'feature-logging' into develop

11 years agoDISABLE config log options in interactive shell
Stavros Sachtouris [Fri, 5 Apr 2013 13:47:43 +0000 (16:47 +0300)]
DISABLE config log options in interactive shell

to avoid kamaki failures due to logging problems

11 years agoMerge branch 'feature-logging' into develop
Stavros Sachtouris [Fri, 5 Apr 2013 13:44:05 +0000 (16:44 +0300)]
Merge branch 'feature-logging' into develop

11 years agoAllow config to switch some options on or off
Stavros Sachtouris [Fri, 5 Apr 2013 13:24:57 +0000 (16:24 +0300)]
Allow config to switch some options on or off

- LOG_TOKEN: whether to log user token in http requests (default: off)
- LOG_DATA: whether to log http body (send or secv - default: off)

config options: log_token=off, log_data=off

11 years agoFix typos in logging mechanism
Stavros Sachtouris [Fri, 5 Apr 2013 11:54:06 +0000 (14:54 +0300)]
Fix typos in logging mechanism

11 years agoMove http response logging to ResponseManager
Stavros Sachtouris [Fri, 5 Apr 2013 09:26:30 +0000 (12:26 +0300)]
Move http response logging to ResponseManager

11 years agoMove http request logging to RequestManager
Stavros Sachtouris [Fri, 5 Apr 2013 09:15:44 +0000 (12:15 +0300)]
Move http request logging to RequestManager

11 years agoMerge branch 'develop' into feature-logging
Stavros Sachtouris [Fri, 5 Apr 2013 08:22:21 +0000 (11:22 +0300)]
Merge branch 'develop' into feature-logging

11 years agoMerge branch 'feature-connection' into develop
Stavros Sachtouris [Thu, 4 Apr 2013 16:29:01 +0000 (19:29 +0300)]
Merge branch 'feature-connection' into develop

11 years agoAdjust docs to recent changes, fix missing config
Stavros Sachtouris [Thu, 4 Apr 2013 16:27:05 +0000 (19:27 +0300)]
Adjust docs to recent changes, fix missing config

Missing config: at setup, in the first example (Quick Setup) it was
kamaki set ...
while it should have been
kamaki config set

11 years agoWip kamaki.clients.test.py
Stavros Sachtouris [Thu, 4 Apr 2013 16:20:26 +0000 (19:20 +0300)]
Wip kamaki.clients.test.py

11 years agoUnittest ResponseManager
Stavros Sachtouris [Thu, 4 Apr 2013 16:12:41 +0000 (19:12 +0300)]
Unittest ResponseManager

11 years agoUnittest kamaki.clients.RequestManager
Stavros Sachtouris [Thu, 4 Apr 2013 14:57:53 +0000 (17:57 +0300)]
Unittest kamaki.clients.RequestManager

11 years agoRedesign http connection module
Stavros Sachtouris [Thu, 4 Apr 2013 13:37:46 +0000 (16:37 +0300)]
Redesign http connection module

Merge everything to kamaki.clients

Remove multiple hierarchies of connection classes (== abandon support for
    alternative connection methods, e.g. for requests from pypi)

New connection classes are
- RequestManager
- ResponseManager
Semantics:
    RequestManager constructor commits a request without performing it
      but it performs all sanity checks for url, path, method and params
    RequestManager.perform will perform the commited request, if called
    ResponseManager constructor needs a RequestManager instance
    ResponseManager.(various properties)
        request is pooled from a ContextManagerPool (objpool) when needed.
        Results are cached and used as long as the ResponseManager instance
        is alive

Remove KamakiConnection/ResponseErrors, use ClientError wrapers for everything

Remove the connection livetest

TODO: Adjust unittests

11 years agoEnforce objpool>=0.2, break kamaki, fix it soon
Stavros Sachtouris [Wed, 3 Apr 2013 15:21:35 +0000 (18:21 +0300)]
Enforce objpool>=0.2, break kamaki, fix it soon

11 years agoMerge branch 'develop' into feature-connection
Stavros Sachtouris [Wed, 3 Apr 2013 14:43:02 +0000 (17:43 +0300)]
Merge branch 'develop' into feature-connection

11 years agoRemove testing code
Stavros Sachtouris [Tue, 2 Apr 2013 11:24:24 +0000 (14:24 +0300)]
Remove testing code

11 years agoRemove invalid header values in image register
Stavros Sachtouris [Tue, 2 Apr 2013 11:23:21 +0000 (14:23 +0300)]
Remove invalid header values in image register

11 years agoMerge branch 'develop' of https://code.grnet.gr/git/kamaki into develop
Stavros Sachtouris [Tue, 2 Apr 2013 10:44:15 +0000 (13:44 +0300)]
Merge branch 'develop' of https://code.grnet.gr/git/kamaki into develop

11 years agoMerge branch 'feature-separate-image-commands' into develop
Stavros Sachtouris [Tue, 2 Apr 2013 10:43:54 +0000 (13:43 +0300)]
Merge branch 'feature-separate-image-commands' into develop

11 years agoCover image-compute command group in documentation
Stavros Sachtouris [Tue, 2 Apr 2013 10:27:28 +0000 (13:27 +0300)]
Cover image-compute command group in documentation

11 years agoCreate an image compute cmd group, make it work
Stavros Sachtouris [Tue, 2 Apr 2013 09:46:55 +0000 (12:46 +0300)]
Create an image compute cmd group, make it work

- image compute group contains all Compute Image API commands, as oposed to
Plankton API commands.

- definition of a kamaki cli command slightly changed: a command with
subcommands can have a class without being a command itself, as long as it has
subcommands! Thus a subcommand group can be defined with docs and everything.

- image public is not image list (docs not updated yet)

11 years agoFix store_upload typo in progress argument
Stavros Sachtouris [Fri, 29 Mar 2013 10:32:10 +0000 (12:32 +0200)]
Fix store_upload typo in progress argument

11 years agoMerge branch 'feature-logging' into develop
Stavros Sachtouris [Tue, 26 Mar 2013 10:51:13 +0000 (12:51 +0200)]
Merge branch 'feature-logging' into develop

11 years agoAdd a ClientError logger to kamaki.clients
Stavros Sachtouris [Tue, 26 Mar 2013 10:40:48 +0000 (12:40 +0200)]
Add a ClientError logger to kamaki.clients

11 years agoMove logger operations to a seperate file/pkg
Stavros Sachtouris [Tue, 26 Mar 2013 10:23:57 +0000 (12:23 +0200)]
Move logger operations to a seperate file/pkg

11 years agoDisable token logging (synnefo bug #3480)
Stavros Sachtouris [Fri, 22 Mar 2013 17:06:40 +0000 (19:06 +0200)]
Disable token logging (synnefo bug #3480)

11 years agoAdd logging to file functionality (#3441)
Stavros Sachtouris [Fri, 22 Mar 2013 16:55:35 +0000 (18:55 +0200)]
Add logging to file functionality (#3441)

11 years agoCreate get_logger, add_logger methods in clients
Stavros Sachtouris [Fri, 22 Mar 2013 14:44:11 +0000 (16:44 +0200)]
Create get_logger, add_logger methods in clients

11 years agoMerge branch 'feature-tests' into develop
Stavros Sachtouris [Fri, 22 Mar 2013 13:48:24 +0000 (15:48 +0200)]
Merge branch 'feature-tests' into develop

11 years agoApply a simple naming convention for unit tests
Stavros Sachtouris [Fri, 22 Mar 2013 13:42:20 +0000 (15:42 +0200)]
Apply a simple naming convention for unit tests

Naming convention:

Actual functionality:

In package kamaki.clients.pkg there is class C containing a method M
Test it in a package kamaki.clients.pkg.test, with a class C + a method test_M
Command line run:
    python ${kamaki}/kamaki/clients/pkg/test.py C M
or
    python ${kamaki}/kamaki/clients/test.py C M

In package kamaki.clients there is a module mod containing a method M
Test it in a package kamaki.clients.mod, with a class Mod + a method test_M
Command line run:
    python ${kamaki}/kamaki/clients/mod/test.py Mod M
or
    python ${kamaki}/kamaki/clients/test.py Mod M

11 years agoMerge branch 'develop' into feature-tests
Stavros Sachtouris [Fri, 22 Mar 2013 12:02:46 +0000 (14:02 +0200)]
Merge branch 'develop' into feature-tests

11 years agoDocument unittest mechanism, dependency changes
Stavros Sachtouris [Fri, 22 Mar 2013 11:49:26 +0000 (13:49 +0200)]
Document unittest mechanism, dependency changes

New dependency changes: progress is required, mock is optional
Changes are also documented

11 years agoEnsure uniform runtime args in cli (feature #3456)
Stavros Sachtouris [Fri, 22 Mar 2013 09:41:47 +0000 (11:41 +0200)]
Ensure uniform runtime args in cli (feature #3456)

11 years agoAdd redudant -c argument to mean --config (global)
Stavros Sachtouris [Thu, 21 Mar 2013 16:57:45 +0000 (18:57 +0200)]
Add redudant -c argument to mean --config (global)

11 years agoRe-allow empty paths to clients.Client.request
Stavros Sachtouris [Thu, 21 Mar 2013 16:37:20 +0000 (18:37 +0200)]
Re-allow empty paths to clients.Client.request

11 years agoFix typo in shell intro (bug #3444)
Stavros Sachtouris [Thu, 21 Mar 2013 16:07:09 +0000 (18:07 +0200)]
Fix typo in shell intro (bug #3444)

11 years agoMerge branch 'feature-tests' into develop
Stavros Sachtouris [Thu, 21 Mar 2013 16:03:40 +0000 (18:03 +0200)]
Merge branch 'feature-tests' into develop

11 years agoUnittest full kamaki.clients.Client
Stavros Sachtouris [Thu, 21 Mar 2013 15:48:21 +0000 (17:48 +0200)]
Unittest full kamaki.clients.Client

11 years agoRemove unused method set_default_headers
Stavros Sachtouris [Thu, 21 Mar 2013 13:24:35 +0000 (15:24 +0200)]
Remove unused method set_default_headers

11 years agoUnittest kamaki.clients.Client.set_param
Stavros Sachtouris [Thu, 21 Mar 2013 12:28:29 +0000 (14:28 +0200)]
Unittest kamaki.clients.Client.set_param

11 years agoUnittest kamaki.clients.Client.set_header
Stavros Sachtouris [Thu, 21 Mar 2013 12:23:46 +0000 (14:23 +0200)]
Unittest kamaki.clients.Client.set_header

11 years agoUnittest kamaki.clients.Client._raise_for_status
Stavros Sachtouris [Thu, 21 Mar 2013 12:04:19 +0000 (14:04 +0200)]
Unittest kamaki.clients.Client._raise_for_status

11 years agoUnittest kamaki.clients.Client._watch_thread_limit
Stavros Sachtouris [Wed, 20 Mar 2013 16:49:00 +0000 (18:49 +0200)]
Unittest kamaki.clients.Client._watch_thread_limit

11 years agoInitialize a kamaki.clients.Client unittest
Stavros Sachtouris [Wed, 20 Mar 2013 15:18:02 +0000 (17:18 +0200)]
Initialize a kamaki.clients.Client unittest

Onluy instatiation is tested so far

11 years agoFinetest kamaki.clients.SilentEvent
Stavros Sachtouris [Wed, 20 Mar 2013 15:02:43 +0000 (17:02 +0200)]
Finetest kamaki.clients.SilentEvent

11 years agoUnittest kamaki.clients ClientError
Stavros Sachtouris [Wed, 20 Mar 2013 13:58:25 +0000 (15:58 +0200)]
Unittest kamaki.clients ClientError

11 years agoMerge kamaki.clients.connection.test with clients
Stavros Sachtouris [Wed, 20 Mar 2013 12:20:19 +0000 (14:20 +0200)]
Merge kamaki.clients.connection.test with clients

11 years agoReport total # of tests and failures in bulk tests
Stavros Sachtouris [Wed, 20 Mar 2013 12:11:25 +0000 (14:11 +0200)]
Report total # of tests and failures in bulk tests

11 years agoComplete clients.utils unittests
Stavros Sachtouris [Wed, 20 Mar 2013 11:33:20 +0000 (13:33 +0200)]
Complete clients.utils unittests

11 years agoSetup unittests for clients.utils methods
Stavros Sachtouris [Wed, 20 Mar 2013 11:06:11 +0000 (13:06 +0200)]
Setup unittests for clients.utils methods

Methods tested so far: _matches, filter_in, filter_out

11 years agoUnittest PithosRest.object_delete and its over
Stavros Sachtouris [Tue, 19 Mar 2013 16:39:44 +0000 (18:39 +0200)]
Unittest PithosRest.object_delete and its over

11 years agoUnittest PithosRest.obejct_post
Stavros Sachtouris [Tue, 19 Mar 2013 16:32:13 +0000 (18:32 +0200)]
Unittest PithosRest.obejct_post

11 years agoUnittest PithosRest.object_move
Stavros Sachtouris [Tue, 19 Mar 2013 16:12:06 +0000 (18:12 +0200)]
Unittest PithosRest.object_move

11 years agoUnittest PithosRest.object_copy
Stavros Sachtouris [Tue, 19 Mar 2013 15:59:31 +0000 (17:59 +0200)]
Unittest PithosRest.object_copy

11 years agoUnittest PithosRest.object_put
Stavros Sachtouris [Tue, 19 Mar 2013 15:45:17 +0000 (17:45 +0200)]
Unittest PithosRest.object_put

11 years agoUnittest PithosRest.object_get
Stavros Sachtouris [Tue, 19 Mar 2013 14:23:56 +0000 (16:23 +0200)]
Unittest PithosRest.object_get

11 years agoUnittest PithosRest.object_head
Stavros Sachtouris [Tue, 19 Mar 2013 14:07:14 +0000 (16:07 +0200)]
Unittest PithosRest.object_head

11 years agoUnittest PithosRest.container_delete
Stavros Sachtouris [Tue, 19 Mar 2013 13:50:37 +0000 (15:50 +0200)]
Unittest PithosRest.container_delete

11 years agoUnittest PithosRest.container_post
Stavros Sachtouris [Tue, 19 Mar 2013 13:46:29 +0000 (15:46 +0200)]
Unittest PithosRest.container_post

11 years agoUnittest PithosRest.container_get
Stavros Sachtouris [Tue, 19 Mar 2013 13:25:08 +0000 (15:25 +0200)]
Unittest PithosRest.container_get

11 years agoUnittest PithorRest.container_get
Stavros Sachtouris [Tue, 19 Mar 2013 12:45:09 +0000 (14:45 +0200)]
Unittest PithorRest.container_get

11 years agoUnittest PithorRest.container_head
Stavros Sachtouris [Tue, 19 Mar 2013 12:02:14 +0000 (14:02 +0200)]
Unittest PithorRest.container_head

11 years agoMerge branch 'develop' into feature-tests
Stavros Sachtouris [Tue, 19 Mar 2013 11:50:06 +0000 (13:50 +0200)]
Merge branch 'develop' into feature-tests

11 years agoUpdate installation isntructions to suggest pypi
Stavros Sachtouris [Tue, 19 Mar 2013 10:14:18 +0000 (12:14 +0200)]
Update installation isntructions to suggest pypi

Problem: installation isntructions used to suggest installing kamaki from git repo
which is now designed for development only
Solution: Installation instructions now suggest users to install kamaki from pypi

Installing kamaki on debian and ubuntu through an apt-tools system is still suggested

Conflicts:

docs/installation.rst

11 years agoUnittest PithosRest.account_post
Stavros Sachtouris [Fri, 15 Mar 2013 16:40:50 +0000 (18:40 +0200)]
Unittest PithosRest.account_post

11 years agoUnittest PithosRest.account_get
Stavros Sachtouris [Fri, 15 Mar 2013 16:08:32 +0000 (18:08 +0200)]
Unittest PithosRest.account_get

11 years agoUnittest PithosRest.account_head
Stavros Sachtouris [Fri, 15 Mar 2013 15:39:23 +0000 (17:39 +0200)]
Unittest PithosRest.account_head

11 years agoPrepare PithorRest testcase for implementation
Stavros Sachtouris [Fri, 15 Mar 2013 14:58:33 +0000 (16:58 +0200)]
Prepare PithorRest testcase for implementation

11 years agoUnittest ComputeRestApi.networks_put 4theWIN
Stavros Sachtouris [Fri, 15 Mar 2013 14:26:59 +0000 (16:26 +0200)]
Unittest ComputeRestApi.networks_put 4theWIN

11 years agoUnittest CycladesRestApi.netowrks_post
Stavros Sachtouris [Fri, 15 Mar 2013 14:25:35 +0000 (16:25 +0200)]
Unittest CycladesRestApi.netowrks_post

11 years agoUnittest CycladesRestApi.networks_get
Stavros Sachtouris [Fri, 15 Mar 2013 14:21:16 +0000 (16:21 +0200)]
Unittest CycladesRestApi.networks_get

11 years agoUnittest CycladesRestApi.servers_get
Stavros Sachtouris [Fri, 15 Mar 2013 13:47:07 +0000 (15:47 +0200)]
Unittest CycladesRestApi.servers_get

11 years agoUnittest ComputeRestApi.images_put
Stavros Sachtouris [Fri, 15 Mar 2013 13:26:55 +0000 (15:26 +0200)]
Unittest ComputeRestApi.images_put

11 years agoUnittest ComputeRestApi.images_delete and improve
Stavros Sachtouris [Fri, 15 Mar 2013 13:20:11 +0000 (15:20 +0200)]
Unittest ComputeRestApi.images_delete and improve

improve: group common ComputeRestApi testing code in clients.compute.test

11 years agoUnittest Compute.flavors_get
Stavros Sachtouris [Fri, 15 Mar 2013 13:09:31 +0000 (15:09 +0200)]
Unittest Compute.flavors_get

11 years agoUnittest Compute.servers_put
Stavros Sachtouris [Fri, 15 Mar 2013 13:07:07 +0000 (15:07 +0200)]
Unittest Compute.servers_put

11 years agoUnittest ComputeRestApi.servers_post
Stavros Sachtouris [Fri, 15 Mar 2013 12:48:13 +0000 (14:48 +0200)]
Unittest ComputeRestApi.servers_post

11 years agoUnittest ComputeRestApi.servers_delete
Stavros Sachtouris [Fri, 15 Mar 2013 11:55:55 +0000 (13:55 +0200)]
Unittest ComputeRestApi.servers_delete

11 years agoMove compute_rest_api to compute.rest_api
Stavros Sachtouris [Fri, 15 Mar 2013 11:30:27 +0000 (13:30 +0200)]
Move compute_rest_api to compute.rest_api

kamaki.clients.compute_rest_api --> kamaki.clients.compute.rest_api

11 years agoUnittest ComputeRestApi.servers_get
Stavros Sachtouris [Fri, 15 Mar 2013 11:29:39 +0000 (13:29 +0200)]
Unittest ComputeRestApi.servers_get

11 years agoComplete Image.* fine testing
Stavros Sachtouris [Fri, 15 Mar 2013 10:23:00 +0000 (12:23 +0200)]
Complete Image.* fine testing

11 years agoFinetest Image.remove_member
Stavros Sachtouris [Fri, 15 Mar 2013 10:16:59 +0000 (12:16 +0200)]
Finetest Image.remove_member

11 years agoFinetest Image.add_member
Stavros Sachtouris [Fri, 15 Mar 2013 10:14:16 +0000 (12:14 +0200)]
Finetest Image.add_member

11 years agoFinetest Image.list_members
Stavros Sachtouris [Fri, 15 Mar 2013 10:11:32 +0000 (12:11 +0200)]
Finetest Image.list_members

11 years agoFinetest Image.set_members
Stavros Sachtouris [Fri, 15 Mar 2013 10:09:07 +0000 (12:09 +0200)]
Finetest Image.set_members