PB Storage

server with disk arrays

As storage backend for gene analysis project, A PB storage plan was introduced.

After a carefully calculation based on hardware prices, I found A tape library(LTO6) will outperform disk arrays if total amount of data is greater than about 300 TB.

For anallyzed data, a tape library was used to store all data.
For analysis result and other daily operation data, Raid 6 disk arrays were used.

Also, it seems using 7z with "Maximum" compression on 16 cores will bring the best recompression performance(balanced between time & size) after several tests.

Current Hardware

  • 2 * DELL R630 each with dual Intel Xeon E5-2678V3
  • 3 * HP DL380 G9 with dual Intel Xeon E5-2678V3
  • 1 * HP MSL2024 LTO6 Tape Library.
  • 1 * DELL R510 with dual Intel Xeon L5639

R630s were used to recompress data into smaller format.
DL380G9 & R510 were used to store results & other data.
Tape Library were used to storage analyzed data (cold data).

The Storage Rack

rack a storage rack