Skip to content
Snippets Groups Projects
README.md 995 B
Newer Older
Stefano Stalio's avatar
Stefano Stalio committed
# S3 Utils

Stefano Stalio's avatar
Stefano Stalio committed
This repository contains a set of bash shell scripts that can ease access to the HPC4DR S3 storage service, the storage service meant for the long term data archiving and distribution. 
Stefano Stalio's avatar
Stefano Stalio committed

## Getting started

Stefano Stalio's avatar
Stefano Stalio committed
### Requirements

Stefano Stalio's avatar
Stefano Stalio committed
The scripts inside this repository need the bash shell and the openstack client to be installed together with the swift client libraries 
Stefano Stalio's avatar
Stefano Stalio committed

### Usage

Stefano Stalio's avatar
Stefano Stalio committed
Presently the following scripts are available:
Stefano Stalio's avatar
Stefano Stalio committed

Stefano Stalio's avatar
Stefano Stalio committed
- **get_s3_credentials**
Stefano Stalio's avatar
Stefano Stalio committed
  - it retrieves existing S3 credentials for a user within a project or creates new credentials.
Stefano Stalio's avatar
Stefano Stalio committed
- **revoke_s3_credentials**
Stefano Stalio's avatar
Stefano Stalio committed
  - it revokes existing S3 credentials for a user within a project.
Stefano Stalio's avatar
Stefano Stalio committed
- **get_s3_usage**
Stefano Stalio's avatar
Stefano Stalio committed
  - it prints the present data usage for a project.
Stefano Stalio's avatar
Stefano Stalio committed
- **get_rclone_config**
Stefano Stalio's avatar
Stefano Stalio committed
  - it creates an rclone configuration for accessing your project data
Stefano Stalio's avatar
Stefano Stalio committed

Make sure you make all the scripts executable before running them:

```
Stefano Stalio's avatar
Stefano Stalio committed
chmod +x s3-utils/scripts/*
s3-utils/scripts/get_s3_credentials 
Stefano Stalio's avatar
Stefano Stalio committed
```
Stefano Stalio's avatar
Stefano Stalio committed

Stefano Stalio's avatar
Stefano Stalio committed
## Using with rclone
Stefano Stalio's avatar
Stefano Stalio committed

Stefano Stalio's avatar
Stefano Stalio committed
aaaaa
aaaa