Using the Jetstream object store

This is a beta service!

The object store is only available via the API side of Jetstream. If you do not have API access, please see https://iujetstream.atlassian.net/wiki/spaces/JWT/pages/39682057/Using+the+Jetstream+API for instructions on getting access.

Please note that these instructions are not complete. This service is in beta.

Documentation will continue to evolve.

The Jetstream object store utilizes Openstack Swift and is fully S3 compatible. You can utilize it via Horizon or the command line interface (CLI).

Horizon instructions will be coming soon.

If the you want to use s3 compatibility, you’ll need to generate ec2 credentials. This assumes you already have the python-openstackclient installed. If you do not, you’ll need to install it. See https://iujetstream.atlassian.net/wiki/spaces/JWT/pages/35913730/OpenStack+command+line for more information.

The CLI command is:

openstack ec2 credentials create

You can save the creds in a config to use from the CLI/programatically. It's generally kept in the text file ~/.aws/config and looks like this:

1 2 3 4 [default] region=RegionOne aws_access_key_id=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx aws_secret_access_key=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

The endpoint you’ll need for S3 operations is https://iu.jetstream-cloud.org:8080/


To use the OpenStack CLI with the object store, you’ll need the Swift client. You can install it by doing:

pip install python-swiftclient

This assumes you already have the python-openstackclient installed. If you do not, you’ll need to install it. See https://iujetstream.atlassian.net/wiki/spaces/JWT/pages/35913730/OpenStack+command+line for more information.

Once you have the Swift client installed, you can test it by doing:

swift post ${OS_USERNAME}_test_bucket

which will create a storage container called "tacc-username_test_bucket". You can then list your buckets by doing:

swift list

If you want to delete the test bucket, you can do:

swift delete ${OS_USERNAME}_test_bucket

As with all Openstack clients, you can see the full list of commands with

swift help

You can also add, remove, and otherwise work with swift containers (buckets in the S3 vernacular) in Horizon on the Project → Object Store → Containers tab.