Data storage with S3¶
S3 (Simple Storage Service) is a cloud object storage service, first introduced in Amazon S3, offering high performance data management in a filesystem-like environment. Buckets are the root elements of an S3-System and hold the configuration on storage and access-policies for all underlying data. A bucket can contain any amount of folders, subdirectories and files, fitting in the designated bucket-storage-space. Folders inside a bucket can hold own access-policies, overwriting the parent policy for this and all underlying folders and files. Files can have any format. Data can be managed via a CLI or with a library.
The UFZ currently maintains a S3-System from Quantum ActiveScale instance as object storage solution.
Get access¶
In order to upload or download data to and from S3, you need an account for it and access to the folders you want to manage your data with.
Get an account and apply for a bucket
Just open a request in Allisa
Get or change access to a bucket
If you already have an account but need access to a new bucket or have an existing access-configuration modified (e.g. add upload rights), please contact the administrators via the ticket system wkdv-support@ufz.de with
- your name,
- the name(s) of the bucket(s) and
- what kind of access or changes you need.
To ensure, that only authorized persons get access to a bucket, either have the bucket-owner write the mail or add them in CC.
Usage¶
There is a repository where we provide a lot of details for the usage of our S3-system: