Data Archiving

We strongly recommend that you back up your raw data to a hard drive, NAS or even better to a tape system before you start analysing the data. Euler should be not used as a data archive. After an analysis has been finished, we highly recommend to transfer your data to your long term storage (LTS) to preserve it in a long term perspective. We can help you finding optimal archiving solutions for you data.

Important aspects that you should consider when you are archiving your data

  • Clean up your files and folders before archiving.
  • Archive your files and folders (tar or tar.gz).
  • Archive raw and processed data separately.
  • The size of one archive should be between 200 Gb and 500 Gb.
  • Keep metafiles and scripts on your local computer.
  • Deposit raw data on public archives like ENA or NCBI.
  • Keep the archives on disks with a RAID system - A simple usb hard drive is not optimal.
  • ETH is offering long-term storage solutions and people from eawag can use ERIC.
  • OpenBis can be used to automatically archive your data. Find more information here.