One of the key features that was added to the cluster in 2024 was the Weka storage area. This new file system has an NVME based front end to satisfy even the most demanding high throughput and IOPS workloads researchers can muster. With snapshots of key storage locations taken regularly and stored in a separate building on campus.
To help ensure the functionality of this premium storage system a set of quotas have been applied to the different storage areas that are available to researchers workloads running on the cluster.
- The home directory /home/<login> has a 50G quota
- Intended for storing personal data only
- This space cannot be used to share data with a group
- 30 days of nightly snapshots
- The project directory /projects/<project_name> has a 1TB initial quota
- Intended for storing research related data
- Can be used to share data with a group
- 30 days of nightly snapshots
- The no-backup directory /nbu/<project_name> has a 1TB initial quota
- Intended for non-ephemeral data the should not be backed up
- Can be used to share data with a group
- No snapshots are taken of this data
- The scratch directory /scratch/<login> has a 1TB initial quota
- Intended for storing ephemeral data that can easily be replaced
- Data stored here should only be needed for a short time (e.g. While a job is running.)
- Is not intended for sharing data with a group
- No snapshots are taken of this data
While the 50G quota for home directories cannot be changed, initial quotas for the other areas can be increased by submitting a request to the Research Help page. Those needing storage capacity above 10TB in any of the paths above will be asked to provide details about the use case and duration of the need.
NOTE: Storage consumption is calculated for each Principle Investigator as a sum total of capacity allocated to all of their projects in /projects and /nbu.