UNL has come to an arrangement with Box.com to provide unlimited cloud storage to every student, staff, and faculty member. This can be useful when used with jobs to automatically upload results when the job has completed. Combined with Box Sync, the uploaded files can be sync'd to your laptop or desktop upon job completion. The upload and download speed of Box is about 20 to 30 MB/s in good network traffic conditions. There are two programs that can be used to transfer files to/from Box -
lftp. Instructions are provided for both options.
Step-by-step guide for Cadaver
- You need to create your UNL Box.com account here.
- Since we are going to be using webdav protocol to access your Box.com storage, you need to create an External Password. In the Box.com interface, you can create it at Account Settings > Create External Password.
Create a .netrc file in order to automatically login to your box account without typing the password. The file needs to be in your home directory, ie
~/.netrc. You can easily create this file using the nano text editor by using the command:
The file should contain the following lines:
Once you have typed or pasted these lines into the file, press CTRL-X to exit. Follow the prompts to save the file as
Be sure to have the correct permissions on the file. You can change the permissions with the command:
Try out the webdav client by issuing the command:
It should give you a prompt like:
Within this prompt, you can view files and navigate through the file system using the usual Bash commands cd and ls. To download files from Box, use the command:
Or, alternately, to upload files to your Box, use:
To exit the prompt, press ctrl-d
Within a submit script, you can upload and download files by using commands such as:
- The files should automatically appear in your Box account, and be sync'd to your computer if you have the sync client installed.
Step-by-step guide for Lftp
- Create an external password for Box as described in steps 1 and 2 above.
Connect to Box using your full email as the username and external password you created:
Test the connection by running the
lscommand. You should see a listing of your Box files. Assuming it works, add a bookmark named "box" to use when connecting later:
quit. To reconnect later, use bookmark name:
To upload or download files, use the
putcommands. For example:
Lftp also supports using scripts to transfer files. This can be used to automatic downloading or uploading files during jobs. For example, create a file called "transfer.sh" with the following lines:
To run this script, do: