Skip to end of metadata
Go to start of metadata

All HCC machines have two separate areas for every user to store data, each intended for a different purpose.   In addition, we have a transfer service that utilizes Globus Connect.

HCC currently has no storage that is suitable for HIPAA or other PID data sets.  Users are not permitted to store such data on HCC machines.

Home Directory

You can access your home directory quickly using the $HOME environmental variable (i.e. 'cd $HOME').

Your home directory (i.e. /home/[group]/[username]) is meant for items that take up relatively small amounts of space.  For example:  source code, program binaries, configuration files, etc.  This space is quota-limited to 20GB per user.  The home directories are backed up for the purposes of best-effort disaster recovery.  This space is not intended as an area for I/O to active jobs.  /home is mounted read-only on cluster worker nodes to enforce this policy.

High Performance Work Directory

You can access your work directory quickly using the $WORK environmental variable (i.e. 'cd $WORK').

Every user has a corresponding directory under /work using the same naming convention as /home (i.e. /work/[group]/[username]).  We encourage all users to use this space for I/O to running jobs.  This directory can also be used when larger amounts of space are temporarily needed.  There is a 50TB per group quota; space in /work is shared among all users.  It should be treated as short-term scratch space, and is not backed upPlease use the hcc-du command to check your own and your group's usage, and back up and clean up your files at reasonable intervals in $WORK.

Purge Policy

HCC has a purge policy on /work for files that become dormant.  After 6 months of inactivity on a file (26 weeks), an automated purge process will reclaim the used space of these dormant files.  HCC provides the hcc-purge utility to list both the summary and the actual file paths of files that have been dormant for 24 weeks.  This list is periodically generated; the timestamp of the last search is included in the default summary output when calling hcc-purge with no arguments.  No output from hcc-purge indicates the last scan did not find any dormant files.  hcc-purge -l will use the less pager to list the matching files for the user.  The candidate list can also be accessed at the following path: /lustre/purge/current/${USER}.list.  This list is updated twice a week, on Mondays and Thursdays.

/work is intended for recent job output and not long term storage. Evidence of circumventing the purge policy by users will result in consequences including account lockout.

 

If you have space requirements outside what is currently provided, please email hcc-support@unl.edu and we will gladly discuss alternatives.

Attic

Attic is a near line archive available for purchase at HCC.  Attic provides reliable large data storage that is designed to be more reliable then /work, and larger than /home. Access to Attic is done through Globus Connect.

More details on Attic can be found on HCC's Attic website.

Globus Connect

For moving large amounts of data into or out of HCC resources, users are highly encouraged to consider using Globus Connect.

Using Box

You can use your UNL Box.com account to download and upload files from any of the HCC clusters.