Storage and data management
Datastores
Prospero has the following datastores:
Type |
Mount point |
Capacity |
For use by |
|---|---|---|---|
Homespace |
/users/ |
3.1 TB |
All |
Data storage |
/mnt/scratch |
3.6 PB |
All |
/mnt/data1 |
220 TB |
All |
|
/mnt/aridata1 |
233 TB |
ARI members |
Quotas
Each user’s homespace is limited to a quota of 30GB. Large datasets should be stored on the data volumes.
VSCode and Python environments such as conda can quickly fill your homespace with temporary hidden files (often caches) that may not show up with the du command. For example, check for directories such as .cache and .vscode-server. It is recommended that you move these directories to your personal user space on the scratch space /mnt/scratch/users/[USERNAME] and create softlinks from your homespace to these from their original location. For example:
$ cd ~
$ mv .vscode-server /mnt/scratch/users/[USERNAME]/
$ ln -s /mnt/scratch/users/[USERNAME]/.vscode-server .vscode-server
Backups
At present no volumes are backed up, so users are advised to keep their source code on a version control system and maintain their own backups. We hope to install a system to provide daily backups of the homespace during 2026.
Best practice
Please keep important code on the homespace and keep this backed up yourself. For most users, it is advised to keep data specific to personal projects in /mnt/scratch/users/[USERNAME]. Data for projects involving multiple users should be kept in /mnt/scratch/projects/[PROJECTNAME]. The volume /mnt/data1 is in principle available to all users but is a legacy system that predates the high-performance ClusterStor facility that hosts /mnt/archive.