Vegetable Crops Research Unit Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
===== Transferring files between USDA Box account and SciNet =====

The rclone home page is https://rclone.org/

==== rclone installation on SciNet ====

  - Go to the web page at https://rclone.org/downloads/ and find the url for the **AMD64 - 64 Bit Linux** version, and download it //e.g.// <code>wget https://downloads.rclone.org/v1.48.0/rclone-v1.48.0-linux-amd64.zip</code>
  - Uncompress //e.g.// <code>unzip rclone-v1.48.0-linux-amd64.zip</code>
  - Put the rclone program in your bin directory, which will put it in your default PATH <code>mv rclone-v1.48.0-linux-amd64/rclone ~/bin/</code>
  - Install the rclone manual page (directory may not exist) <code>mkdir -p ~/man/man1 && mv rclone-v1.48.0-linux-amd64/rclone.1 ~/man/man1/</code>

==== rclone installation on Windows ====

You will have to install rclone on Windows so that you can generate an authentication token for Box with the USDA VPN and eAuthentication active

  - Go to the web page at https://rclone.org/downloads/ and find the Windows installer. Download it and install rclone
  - Open a Windows command prompt (**cmd**)
  - Type <code>rclone authorize "box"</code>
  - On the web page that shows up, click on **Use Single Sign On (SSO)**
  - Enter your USDA email address
  - Do the eAuthentication thing
  - Click on the **Grant access to Box** button
  - Go back to the command prompt window, an authentication token should be there. Copy the part between the braces {"access_token":"ABCDEF...}

==== rclone configuration on SciNet ====

  - Type <code>rclone config</code>
  - Type **n** for **n) New remote**
  - For **name>** enter any name //e.g.// **usdabox**
  - For **Storage>** you can find the number, but it's easier to just type **box**
  - For both **client_id>** and **client_secret>** leave blank, just hit enter
  - For **Edit advanced config** enter **n**
  - For **Remote config, Use auto config?** enter **n**
  - Paste the text from the last step from the section above that you got from your Windows computer
  - Type **y** for **y) Yes this is OK**
  - Type **q** to quit

==== Test ====

  - Test directory listing using the **name>** you selected earlier: <code>rclone lsd usdabox:</code>
  - Test file listing <code>rclone lsl usdabox: | head</code>

==== Commands ====

  - For description of commands available see https://rclone.org/docs/#subcommands
  - You installed the rclone manual page earlier, so you can also do <code>man rclone</code>
  - A common case might be to backup your SciNet project directory to box. You could do this with //e.g.// <code>rclone copy /project/bogus_genome usdabox:/scinetbackup/bogus_genome --verbose</code>