|
Quick Links
Globus is a service that makes it easy to move, sync, and share large amounts of data. Globus will manage file transfers, monitor performance,
retry failures, recover from faults automatically when possible, and report the status of your data transfer. Globus uses GridFTP for more reliable
and high-performance file transfer, and will queue file transfers to be performed asynchronously in the background.
| Globus was developed and is maintained at the University of Chicago and is used extensively at supercomputer centers and major research facilities. [Globus website] No matter how you transfer data in and out of our systems, be aware that PII and PHI data cannot be stored or transferred into the NIH HPC systems.
|
CIT has also funded Globus connectors for NIH-provided collaboration tools such as OneDrive and Box. See the sections below for details on how to use these connectors.
OneDrive is the Microsoft cloud service which is part of the NIH Microsoft 365 Subscription. The Globus OneDrive connector allows users to transfer data between their own NIH OneDrive storage and any other Globus endpoint, including the NIH HPC (Biowulf) endpoints.
- Point a web browser to https://app.globus.org/collections and search for 'NIH HPC OneDrive Collection'.
- Click on the link for the collection name. Click on the 'Credentials' tab.
- You should see 'Authentication/Consent Required'. Click on Continue.
- It will ask you to select an identity. Select your NIH identity (username@nih.gov). You will get to the familiar NIH login page. Log in with your PIV card (or Authenticator) as usual.
- Allow the Globus web app to manage the collection.
- On the 'Register a Credential' page, click 'Continue'.
- You should now see your credentials for the 'NIH HPC OneDrive Collection' as 'Active'.
- In the Globus File Manager tab, enter 'NIH HPC OneDrive Collection' as the Collection. You may be requested to authenticate again. Go ahead and log in via the usual NIH login process.
- You should now see your NIH OneDrive files, and can transfer them to any other endpoint, including the NIH HPC Data Transfer (Biowulf) endpoint.
Troubleshooting/Notes
- At peak times, you may get a timeout from OneDrive, and will need to try again.
- OneDrive will not let you overwrite a file with the same name. The Globus transfer will give the error:
Details: 500-Command failed. : code: "nameAlreadyExists"\r\n500-message: "A file with the same name is currently being uploaded. Change the filename and try to save again."\r\n500 End.\r\n
You will need to either delete the original file on OneDrive, or change the name of the source file. - Error:
Details: 500 globus_dsi_rest: libcurl error 23: Failed writing received data to disk/application\r\n
Box is one of the collaboration tools provided by NIH. It can be used for collaboration and file sharing with NIH users as well as users outside the NIH. The Globus Box connector will allow users to transfer data between their NIH Box and any other Globus endpoint, including the NIH HPC (Biowulf) endpoint.
The Globus Box connector is currently still being configured and set up. This webpage will be updated when it is available.