[CentOS] Can anyone talk infrastructure with me?

Karanbir Singh mail-lists at karan.org
Thu Jan 26 00:21:40 UTC 2012


On 01/25/2012 11:53 PM, Jason T. Slack-Moehrle wrote:
> Hi All,
> I started a 501c3 (not-for-profit) organization back in February 2011 to deal with information archival. A long vision here, I wont bore you with the details (if you really want to know, e-mail me privately) but the gist is I need to build an infrastructure to accommodate about 2PB of data that is database stuff, stored video, crawl data, static data sets, etc. Right now in my testing of the software I can easily bang down 300+gb a month of data. 

300gb a month is barely 2mbps...

2PiB is a whole different ballgame.

Most of what how you setup, network, maintain and then grow/manage into
the future will depend on what you want to do with the data, how you
want to expose it to the user and how much money you want to throw at
the issues.

Even using the most commodity of hardware, with 95 percentile psu's -
your garage is unlikely to have enough electricity to power a 2PiB
store. Or cool it.

Karanbir Singh
+44-207-0999389 | http://www.karan.org/ | twitter.com/kbsingh
ICQ: 2522219    | Yahoo IM: z00dax      | Gtalk: z00dax
GnuPG Key : http://www.karan.org/publickey.asc

More information about the CentOS mailing list