Announcing: Slashdot Deals - Explore geek apps, games, gadgets and more. (what is this?)

Thank you!

We are sorry to see you leave - Beta is different and we value the time you took to try it out. Before you decide to go, please take a look at some value-adds for Beta and learn more about it. Thank you for reading Slashdot, and for making the site better!

How Do You Backup 20TB of Data?

Unknown Lamer posted about 10 months ago | from the upload-it-to-ftp-and-... dept.

Data Storage 983

Sean0michael writes "Recently I had a friend lose their entire electronic collection of music and movies by erasing a RAID array on their home server. He had 20TB of data on his rack at home that had survived a dozen hard drive failures over the years. But he didn't have a good way to backup that much data, so he never took one. Now he wishes he had.

Asking around among our tech-savvy friends though, no one has a good answer to the question, 'how would you backup 20TB of data?'. It's not like you could just plug in an external drive, and using any cloud service would be terribly expensive. Blu-Ray discs can hold a lot of data, but that's a lot of time (and money) spent burning discs that you likely will never need. Tape drives are another possibility, but are they right for this kind of problem? I don' t know. There might be something else out there, but I still have no feasible solution.

So I ask fellow slashdotters: for a home user, how do you backup 20TB of Data?"
Even Amazon Glacier is pretty pricey for that much data.

Sorry! There are no comments related to the filter you selected.

Hmmm... (5, Funny)

Anonymous Coward | about 10 months ago | (#46462839)

I would say use floppies, but I'm kind of old and out of touch now.

Re:Hmmm... (2, Funny)

Anonymous Coward | about 10 months ago | (#46462889)

I would say use floppies, but I'm kind of old and out of touch now.

5 1/4" or 3 1/2"?

Re:Hmmm... (5, Funny)

Anonymous Coward | about 10 months ago | (#46462955)

5 1/4" or 3 1/2"?

8". How young are you?

Re:Hmmm... (-1)

Anonymous Coward | about 10 months ago | (#46463043)

You know, I gained about an inch on my penis after I lost 20 lbs. What say you?

Re:Hmmm... (2, Funny)

Grisstle (2798631) | about 10 months ago | (#46462961)

Neither, 8" floppies would be the way to go.

Re:Hmmm... (0)

Anonymous Coward | about 10 months ago | (#46462987)


Re:Hmmm... (4, Funny)

Primate Pete (2773471) | about 10 months ago | (#46463015)

You can do the job with a mere 128 million single sided, single density 160K disks, like the one on the original IBM PC. When in doubt, go with proven technologies. Assuming a stack of 4 disks is 1cm thick, you should get away with around 1000 m^3 storage space.

Re:Hmmm... (0)

Anonymous Coward | about 10 months ago | (#46463095)

please use standard units. How much is that in LoC?

Re:Hmmm... (0)

Anonymous Coward | about 10 months ago | (#46463037)

8" ss-sd

Re:Hmmm... (4, Funny)

DickBreath (207180) | about 10 months ago | (#46462919)

Punched paper tape has better longevity than either floppies or optical media. You just need a really big roll and a lot of time.

Re:Hmmm... (1)

Assmasher (456699) | about 10 months ago | (#46463013)

I wonder how much energy taping out 20TB of data would take...

Re:Hmmm... (1)

Bing Tsher E (943915) | about 10 months ago | (#46463165)

Make sure you use the mylar tape, not that failure prone paper tape.

Re: Hmmm... (1)

Anonymous Coward | about 10 months ago | (#46463143)

Backblaze has unlimited storage. It would take some time for the initial backup but future incrementals would be quick.

reduce the amount (3, Interesting)

JeffSh (71237) | about 10 months ago | (#46462841)

At home, I didn't feel like paying for 2 large arrays to store my data, so if I rip any media, I always rip it to DIVX. 800 MB for a DVD or even bluray rip is a great economy, saves me money on primary storage and also enables me to back it up. I accept the loss of quality as I can always reference the original media if I want.

Another option in the future may be subscription services which have HD content, thus eliminating my need to roll my own. We'll see what happens there.

Re:reduce the amount (0)

Anonymous Coward | about 10 months ago | (#46462931)

I always rip it to DIVX

2005 called, they want their crap back.

Another option in the future may be subscription services which have HD content

Assuming they have the content you want. Which they usually don't.
And assuming you live in the US, which 95% of the world population don't. There simply aren't useful services outside the US, if any.

Re:reduce the amount (0)

Anonymous Coward | about 10 months ago | (#46463141)

well, a vpn is a useful service outside of the us

Re:reduce the amount (3, Informative)

buchner.johannes (1139593) | about 10 months ago | (#46462977)

20TB is not out of the world. With a RAID of 4TB disks you can cover that at home, and it doesn't need to be on all the time. Maybe you can reduce the amount of disk usage by reducing duplicate content using bup [github.com] or an appropriate FS.

Re:reduce the amount (5, Funny)

cdrudge (68377) | about 10 months ago | (#46463093)

I always rip it to DIVX. 800 MB for a DVD or even bluray rip is a great economy,

I do the exact same thing with high res pictures. I immediately will take the full resolution raw image and convert it down to a 320px gif. Or maybe a 10% quality jpeg. You get great economy that way too. Who wants to keep a 30+MB image around when you can have almost the same thing in 10kB instead!

Re:reduce the amount (3, Insightful)

edxwelch (600979) | about 10 months ago | (#46463157)

> I always rip it to DIVX. 800 MB for a DVD or even bluray rip is a great economy
I do that as well, but I found out to my horror that all my DVD's had become unreadable over time. So, probably good idea to test your backups from time to time

no (-1)

Anonymous Coward | about 10 months ago | (#46462845)

fk u gay ass fgt

Crashplan (5, Informative)

rossjudson (97786) | about 10 months ago | (#46462849)

Crashplan has unlimited storage. I use their home plan; it's unlimited for up to 10 machines. I think I am backing up about 6TB there now.

Re:Crashplan (0)

Mr. Competence (18431) | about 10 months ago | (#46462853)


Re:Crashplan (0)

funwithBSD (245349) | about 10 months ago | (#46462877)


Re:Crashplan (1)

angularbanjo (1521611) | about 10 months ago | (#46463031)

Anything other than an NSA-approved offsite backup?

Re:Crashplan (2)

genghisjahn (1344927) | about 10 months ago | (#46463075)

You can backup(encrypted) to a friends computer and not use CP stuff at all. Check out the Local and Offsite plan. https://www.code42.com/store/ [code42.com]

Re:Crashplan (1)

Pichu0102 (916292) | about 10 months ago | (#46463129)

I agree with this. In addition, you can also backup to local folders, and have different backup sets so the really big stuff will be backed up online, but the smaller, more important things can be backed up both to a folder and online. That, and they let you control frequency of backups, and never delete anything unless you set it to remove deleted files after whatever period of time you say. Lord knows how many TB I have backed up there that is just deleted files and their daily versions.

Re:Crashplan (1)

tippe (1136385) | about 10 months ago | (#46463135)

Interesting. I just checked them out (http://www.code42.com/crashplan/) and the home service appears to be free. What's the catch? I noticed that the home plan uses weaker encryption (128-bit vs 448-bit), but is that all?

I agree but... (5, Informative)

Matteo De Felice (3574477) | about 10 months ago | (#46463155)

I agree, I've been using Crashplan for three years and the unlimited space it's really great BUT... ...I'm not sure about the bandwidth they provide: how long it will take to upload 20 TB? Anyway, I don't see what's the problem in using external drives for backup. Here in my lab I've realized that the best way to backup X Terabytes is to have another storage with X Terabytes...

Another RAID? (0)

Anonymous Coward | about 10 months ago | (#46462855)

Why buy one array when you can have two at twice the price?

In related news: rm -ra * should be used with caution. ;)

Re:Another RAID? (1)

devman (1163205) | about 10 months ago | (#46463055)

In my brief search I wasn't able to find a version of 'rm' that accepted a '-a' option.

ZFS pool (1)

Anonymous Coward | about 10 months ago | (#46462857)

Use a ZFS pool using a combination of a mirror, a raidz3 & spares. Add new disks as hot spares when money can be allocated. Easy, some what affordable & allows for failure.

Why you back up your porn? (1)

DrMcNasty (49579) | about 10 months ago | (#46462859)

You don't, at least not for cheap.
The only way you would be able to do something like this effectively would be to run another raid along side of your working raid and backup off to that
Still, holding onto 20 TB of data is overkill.

I would recommend bringing that down to a more manageable size for a home user and only backing up the items that are not easily replaceable, like personal photos, movies and documents. Backing up your movie collection or porn collection is just a waste.

Don't bother. (1)

Anonymous Coward | about 10 months ago | (#46462861)

I really doubt anyone actually uses 20TB of movies & music. It just sits there.

Re: Don't bother. (1, Insightful)

binarylarry (1338699) | about 10 months ago | (#46462903)

Exactly, do you really need to hoard all that content?

Hard drives + Robocopy (5, Informative)

DogDude (805747) | about 10 months ago | (#46462863)

I have a 16 TB media collection at home that I just back up on more hard drives.

External hard drives in USB cases + Robocopy works great for me.

Re:Hard drives + Robocopy (1)

Zocalo (252965) | about 10 months ago | (#46463021)

It's really either this or tape. Just be sure to verify your backups, make sure that you can actually restore, and keep a copy off the data off site at a suitably remote family member/friend's place. Personally, I use external USB3 disks as they are cheap and can be left copying data overnight, especially so if you structure the data so that it's easy to segment data on the RAID across multiple external drives, and replace them long before any MTBF kicks in. Also unlike some tape systems, don't require particular software to backup/restore - any directory copy/sync tool of choice will do, and for restoring specific files you can even use a file manager or command line copy.

Re:Hard drives + Robocopy (1)

ckedge (192996) | about 10 months ago | (#46463117)

Yup, same here. It's annoying, having twice as many hard drives as one needs including one entire set on the shelf, but it's the way to go.

I don't actually have a raid array for the live data, I have just a collection of disks mounted individually and so the files are already forced into "appropriate sized sets" suitable for a simple full disk robocopy.

I'm not sure what I'd do if I had a massive raid array of that size. Probably just grin and bear it and have a single 1-3 TB "new/incoming" that can be regularly backed up, and when it was full then make a final backup for the shelf and move it's contents into the long term raid array storage area, and I'd (try) and never make changes to the main long term raid files.

Title correct? (0)

Anonymous Coward | about 10 months ago | (#46462867)

Shouldn't this be titled 'Ask Slashdot: How Do You Backup 20TB of Data?'?

If it's that important, pay for tapes (0)

Anonymous Coward | about 10 months ago | (#46462871)

Not really a hard question to answer.

Re:If it's that important, pay for tapes (1)

DickBreath (207180) | about 10 months ago | (#46462953)

But punched paper tape is slow and makes a lot of noise.

You can just plug in an external drive, (1)

CoolCash (528004) | about 10 months ago | (#46462873)

but you need real backup software. As you fill up drives you replace it and continue the backup until you have a full backup. This way you can take them off site. Like any other backup solution, make sure you test the drives every few months to make sure your data is not corrupt and have a failed drive.

Old School (0)

Anonymous Coward | about 10 months ago | (#46462875)


If you want to hoard bits... (3, Insightful)

polymeris (902231) | about 10 months ago | (#46462881)

> It's not like you could just plug in an external drive [...]
Why not? Maybe not one, but 10 or 20 of them.

Re:If you want to hoard bits... (1)

Shortguy881 (2883333) | about 10 months ago | (#46463047)

Thats what I dont get. If he has 20TB of hard drive space as it is, why not double it and use that as a back up?

Re:If you want to hoard bits... (1)

minstrelmike (1602771) | about 10 months ago | (#46463145)

Yes. The _only_ way to have a usable backup of that data is to have a second RAID array.
If you just want a backup in order to check a box on a list (like most companies), then tape might work.

Two (0)

Anonymous Coward | about 10 months ago | (#46462883)

Most businesses would have two. Then just sync them. If its not worth it to you, the data must have been worthless.

tape (0)

Anonymous Coward | about 10 months ago | (#46462887)

Use tape.

No Need for Backup (0)

Anonymous Coward | about 10 months ago | (#46462891)

No need to back it up because he owned all the original CDs.

Oh . . . wait.

Backblaze (0)

Anonymous Coward | about 10 months ago | (#46462893)

Unlimited backups, $5 a month...
you need a BIG connection though...

Go on the internet and find a DLT drive (0)

Anonymous Coward | about 10 months ago | (#46462897)

some tapes and done..... should not even be that expensive..... everything else will cost more!
What will sadden me is that you could not thought of this yourself......

use /dev/null (0)

Anonymous Coward | about 10 months ago | (#46462899)

redirect all the backups to /dev/null :P

Similar Situation (1)

sanosuke001 (640243) | about 10 months ago | (#46462911)

I have a similar situation; 18.6 TB RAID-Z at home (8 3TB drives) using FreeNAS and with the new update it shows it was initially set up using a non-native block size (I was a bit naive regarding the settings when I first set it up) and I'd like to rebuild it but I have no way to backup 14+ TB. Also, I would like to have a backup in case more than one drive dies (1 parity works well but I could still suffer a catastrophic failure). I've looked into tape backup but anything that seems like it'd have enough storage to be practical (1+ TB per tape) seems excessively expensive and the 100GB tapes seems like it'd be unmanageable.

Backblaze (1)

rjshirts (567179) | about 10 months ago | (#46462915)

If your ISP doesn't have data caps, look at Backblaze ( http://www.backblaze.com/ [backblaze.com] ). $5 / month for unlimited storage for one computer. Only available for Mac and Windows, but I'm sure a virtual instance of Windows if you're using a Linux box would work... These are the folks that opensourced their hardware design for their storage "pods." http://blog.backblaze.com/2011... [backblaze.com]

Raid != backup (0)

Anonymous Coward | about 10 months ago | (#46462917)

I ran into this problem with software raid back when i was younger. My fix was mirroring to multiple drives and of course backing up off-site (parents house).

I delete it (0)

Anonymous Coward | about 10 months ago | (#46462923)

And just download new porn.

github (1)

beowulfcluster (603942) | about 10 months ago | (#46462933)

Why not store it all in 20000 github repositories?

Surely... (0)

Anonymous Coward | about 10 months ago | (#46462941)

If his data is legitimate, legally aquired media, he has hard copies anyway, and only uses the digital copies for his home media? As to your question; a second server seems the only feasable option to me with that amount of data, although it all depends on the monetary value you place on your data, my motto being if it's freely aquired and easy to replace, why bother, regard it as temporary, whereas if it's important or work related, back it up.

BackBlaze (2)

connor4312 (2608277) | about 10 months ago | (#46462947)

BackBlaze offers unlimited backup storage for home users for around $5/mo - encrypted with asymmetric keys. I've got about 750 GB on there myself, works great. Although they may not *like* you backing up 20 TB of stuff, they should accept it. And, if they don't, you're about back five bucks. Probably worth a try.

I second that! (0)

Anonymous Coward | about 10 months ago | (#46463167)

I'd like to plug BackBlaze. I've been using it for a while now and it's fantastic. It saved me from going down the whole RAID NAS / DAS route which isn't really backup because of fire / theft.

Here's my brief blog post on why I chose it...


Do something about your hoarding problem (4, Insightful)

Anonymous Coward | about 10 months ago | (#46462949)

"My friend (read I) lost 20TB of pirated content! What should my friend have done different?"

How about, ask yourself, how much of that content were you intending to ever consume again. Yeah, you can most likely delete 95% of it, that's 1TB of content that you might use again.

Hoarders! *lol*

Re:Do something about your hoarding problem (3, Insightful)

ustolemyname (1301665) | about 10 months ago | (#46463077)

Not all of us have access to the time machine required to know *which* 1TB that is.

Are you willing to share yours?

tape (0)

Anonymous Coward | about 10 months ago | (#46462951)

Tape, still cheapest per byte when random access is not needed, including backups. Much of the speed disadvantaged can be handed by putting a VTS in front.

old fashioned way (1)

Ingcuervo (1349561) | about 10 months ago | (#46462959)

first of all, home user with 20 Tb nowadays is still.... not common so i guess a "standard home user" solution is not gonna be easy to find. I would do the old fashion way with incremental tapes or bluerays, and dividing the information in several clusters in order to handle a different archive for always changing info and old archived data (im sure he doestn access every byte in day to day basis), so the daily backup/sync or whatever is done only in a smaller portion, for instance 2 Tb in a NAS?

Re-rip (0)

Anonymous Coward | about 10 months ago | (#46462963)

Re-rip from the original media.

Not 20TB, but.... (1)

Anonymous Coward | about 10 months ago | (#46462965)

I have about 7TB. I built 2 RAID devices, and back one up to the other.

Too much data (0)

Anonymous Coward | about 10 months ago | (#46462969)

It really depends on how often you plan on backing up, whether automation is required, and what your budget is.

The most expensive (but most automated and up-to-date) is a second RAID array that's made of cheaper disks and mirrored. Doesn't have to be fast, just made up of cheat 2TB/3TB disks.

Tape backup is also going to be an expensive solution, but also one that is much more automated.

The cost of Blu-Ray disks can't really be much compared to the other two options - if it's a media/file server, just do monthly incremental backups and save to Blu-Ray, the majority of the backups won't be substantial in size.

The best solution might be to tone down the digital packrattery - 20TB is a LOT of space for media that will probably never be played again.

ZFS? (1)

Anonymous Coward | about 10 months ago | (#46462971)

Totally not a "backup" solution but raidz2 to protect the data from many types of failures, and hourly snapshots to protect the data from the operator....
Now if your box catches fire, floods, etc you are in trouble but i agree the problem is not easy to fix.

You either spend a ton of time (and money) writing blurays, expensive tape soloutions, etc.

At the end of the day you might find it is cheaper to just have two boxes with seperate raidz2 pools and sync them.

Heck, you can even use the snapshots to support offline replication where you power up the second box and dump the snapshots across and power it down again.

Re:ZFS? (0)

Anonymous Coward | about 10 months ago | (#46463059)

raidz2 does not protect against the idiot at the keyboard deleting the array.

Crash Plan (0)

Anonymous Coward | about 10 months ago | (#46462975)

I've been using Crash Plan (http://www.code42.com/crashplan/) and it's pretty good and relatively cheap ($4-$5/month depending on contract length).

For one price you get "unlimited" storage. I only have 60GB or so of data that I back up, though. I wonder if they would have an issue with 20TB.

The big problem would be the initial upload. If you have a bandwidth cap issue, you can rate-limit your upload. You can also send them a seed drive, but that may be pretty tricky with 20TB of data.

Just a thought.

How Do You Backup 20TB of Data? (-1)

Anonymous Coward | about 10 months ago | (#46462983)

5 DVDs @ 30 cents ea = $1.50 and you've got it for as long as DVDs are around!

Re:How Do You Backup 20TB of Data? (1)

Icarium (1109647) | about 10 months ago | (#46463151)

AC, please point us mere mortals in the direction in which me may find these DVDs with a storage capacity of 4TB...

Re:How Do You Backup 20TB of Data? (0)

Anonymous Coward | about 10 months ago | (#46463161)

That would be more like 5000 DVDs.

Good luck. (3, Informative)

TheCarp (96830) | about 10 months ago | (#46462985)

A quick check at one service which lists such large amounts, you would be looking at almost $20k/year to keep a single offsite copy of that. That is the posted price however, I imagine that is enough that you could shop around and find a deal, but, a deal is still going to be prohibitive for most people.

At 20 TB I would start thinking about one of two things: Tape, and/or git-annex.

Unless prices have changed since I last looked and the scales tipped, tape has the advantage of being cheap. Of course, you will need to test your tapes occasionally and likely want 2 copies just in case, but, at that point you are invested in tape, may as well.

The other possibility is git-annex and lots of drives, but you can mix types. That way you can keep a catalog of your library and information on where it all is, and how many copies of each thing you have.

Of course, any way you slice it, each physical piece of media is something that can fail so you have to occasionally test to ensure redundancy.

Re:Good luck. (1)

damn_registrars (1103043) | about 10 months ago | (#46463079)

A quick check at one service which lists such large amounts, you would be looking at almost $20k/year to keep a single offsite copy of that.

Hopefully that will cause the poster to re-evaluate how much of what he has really is data, and how much really needs to be backed up. Does he really need to back up the entie series of Friends when he has it sitting on DVD already? What about the Rolling Stones box set, which is also sitting on the shelf? Sure, he spent a lot of time ripping all of those discs but does he have $20k worth of stuff to back up every year? You can buy a lot of movies and music for that much money.

I am willing to wager that on that 20TB array there was not more than 5GB worth of actual data. That can be backed up for almost nothing in comparison.

cannot make this stuff up? (-1)

Anonymous Coward | about 10 months ago | (#46462993)

honestly.... overkill 'weather' forecast remains at hang on to our hemispheres status http://www.globalresearch.ca/weather-warfare-beware-the-us-military-s-experiments-with-climatic-warfare/7561 ,,aka swing low sweet chariots of fire & ice.... kids marching http://img.rt.com/files/news/23/08/00/00/1380713_keystone_web_480p.mp4?event=download

Glacier at $20/mn expensive? (1)

kervin (64171) | about 10 months ago | (#46462997)

Glacier at $20 per month for 20TB is rediculously cheap by today's standards. And at those sizes, you'd want to ship those drives to Amazon instead of uploading. We do this all the time and it's not that hard.

The price of TBs of storage of course will come down without question. But by today's standards $20/month for a medium that won't "bit rot" on you is an amazing deal.

How much is really data? (0)

damn_registrars (1103043) | about 10 months ago | (#46463011)

It sounds like your friend had 20TB of movies and music that he might - or might not - have had legitimate copies of elsewhere. I'm not defending the RIAA or anything here but it sounds to me that all your friend is out is time. If he had any legitimate data - of his own creation - he should have already been backing it up somewhere else.

Replacate to a NAS (0)

Anonymous Coward | about 10 months ago | (#46463017)

Any good 8 bay NAS with 4TB drives
Raid 6 on a separate GIGABIT sub-net in a separate location in the house with battery backup.
Qnap, Synology or Thecus all make models that should do.
I personally would go with a Qnap ts-870-pro and HGST drives.

Don't hoard (4, Insightful)

rainer_d (115765) | about 10 months ago | (#46463019)

Were those 20T of original movies and music or just stuff he downloaded via bittorent?

He could have always bought a sufficiently large tape-library from ebay - but I guess the data wasn't worth that much.
That's always the first pair of questions to ask: how much is it worth and how much would it cost to recreate?
If the answer is somewhere between "I don't know" and "Well, it's not that much", then he just should stop hoarding that much stuff.

He could have built a filer with ZFS and sent daily snapshots to a 2nd filer - but that wouldn't have helped him if the house burnt down...

I would say get a life (0)

Anonymous Coward | about 10 months ago | (#46463035)

Who the hell even listens or watches to that much freely downloaded content anyways? Seriously, you're nothing more than a digital hoarder who gets emotionally attached to data.

Build another server (2, Interesting)

EmagGeek (574360) | about 10 months ago | (#46463041)

If you want to back up 20TB of data, you have to pay for it.

Build another server and rsync hourly.

Backup = More Disks (0)

Anonymous Coward | about 10 months ago | (#46463045)

If the data cost more than $1200-1800 to replace it, it's worth paying to have a backup.

Amazon Glacier is $0.01 per GB, or $205/month for 20TB. Clearly that becomes uneconomical fast.

A 20TB backup can be had in six 4TB drives via RAID 5 (don't want a backup drive failing, do we?).
A Drobo B800FS* is small enough (14x12x5) to be easily stored offsite and is a self-contained network appliance.
Since it has 8 bays total, there's also room for expansion to 28TB.

Total cost: 6*150 + 850 = $1750.

*You can shave off about $500 by using an off-brand RAID enclosure, but I think the software and support for the Drobo is worth it.

My solution (5, Funny)

StripedCow (776465) | about 10 months ago | (#46463049)

Figure out the theory of everything.
Then you can always recompute your data from scratch.

2nd Array or Tape (2)

Grave (8234) | about 10 months ago | (#46463053)

With a second array, or tape backup. The second array is going to be the easiest solution, but tape backup provides you the option of storing the tapes off-site, which is important for any real backup plan. After all, your friend could just as easily wipe out the 2nd array by mistake, or a disaster could wipe out the physical location. LTO-6 tapes are cheap and can hold 2.5-6.5TB of data depending on compression. Tape drives are perfect for backup, so why even ask if it's right?

20? (0)

Anonymous Coward | about 10 months ago | (#46463063)

That's not very much data I have at least 75TB worth of hard drive space and it just keeps getting cheaper and cheaper. To be fair though I run a repair shop lol so I get a lot of extras people don't want or want to trade ect.


See what I mean.

Rsync and Bluray and maybe dedup (2)

Supp0rtLinux (594509) | about 10 months ago | (#46463067)

As you noted, Bluray holds a lot of data, but would take some time. Since its audio/video media, odds are most of it is pretty stagnant. I'd do an initial rsync job to write out to Bluray... then once a month or so repeat the job but now rsync will only get what's changed. Depending on the media type and age, you could also look at dedup'ing it and if the dedup'd copy is significantly smaller than the source you might be able to put that onto say one or two 3-4Tb drives.

Only back up important stuff. (0)

Anonymous Coward | about 10 months ago | (#46463073)

Music is ephemeral. Use streamtuner. There is no need to save copies of muzak.

Unlimited cheap (0)

Anonymous Coward | about 10 months ago | (#46463083)


NAS4Free (1)

Anonymous Coward | about 10 months ago | (#46463085)

I use ZFS on NAS4Free at home and have two 48TB arrays, the second array is at a neighbors house, I am using mikrotik SXT PTP links in trade for him keeping my secondary server at his house, he gets internet and access to the movie storage/backup array. With ZFS I am not worried about a RAID failure as I just had a controller card fail and kill two drives on each of my pool. I didn't have any problems rebuilding the array and had I, I would have just pulled from the backup server. Also, with ZFS you get RaidZ-2 along with snapshots, which has been very handy at client locations to be able to save deleted documents(more than once from a disgruntled employee) also all of our machines backup to a backup area the kids have more than once gotten malware and restoring from a snapshot is easy!


LaCie 5Big for the Thunderbolt (0)

Anonymous Coward | about 10 months ago | (#46463101)

I have a LaCie 5Big for my Mac. Using RAID0, it gives me a full 20TB of storage. I'm using it with two drives in RAID1 configuration, and three drives in RAID0, giving me a total of 16TB mounted as two volumes. Cost was just under $2k US.

Simple (0)

Anonymous Coward | about 10 months ago | (#46463107)

Delete the porn you don't actually watch.

Here's an idea for preventing his accident (0)

Anonymous Coward | about 10 months ago | (#46463109)

Don't RAID the storage. Use (and connect) drives individually and keep a sane index in order to quickly search and access the proper drive. Yes, it's a bit more hassle, but so is losing 20TB in a RAID accident. I personally don't even see why one wouldn't consider the problems and dangers with RAID of this scale instead of just being a bit more careful, but then again I'm the pragmatic type, not the over-engineering nerd type.

failsafe**2 (1)

MissNoItAll (1103281) | about 10 months ago | (#46463111)

Ironic since from your description it would appear the RAID architecture served sufficiently well here (as it should have). It would appear you are seeking a solution to operator error, not equipment failure or other acts of God. Good luck.

Why back it up at all... ask the NSA for a restore (4, Funny)

Supp0rtLinux (594509) | about 10 months ago | (#46463115)

You could always just call up the NSA and ask them to restore the data. Odds are good they have a copy of it...

one bit at a time (2)

Cmdr-Absurd (780125) | about 10 months ago | (#46463119)

Same as always.

Just like you'd eat a whale... (1)

kyldere (723002) | about 10 months ago | (#46463121)

One byte at a time.

Plan for backup before you buy (5, Insightful)

Ktistec Machine (159201) | about 10 months ago | (#46463125)

Whenever you buy storage, you should buy the necessary backup capacity at the same time. You should never buy storage without buying backup capacity. Budget for it right from the start. If you can't afford the backup, you can't afford the storage. This may mean getting half as much storage as you'd like, but that's just the way it has to be. You probably wouldn't buy a car without an engine. It wouldn't do its job. So don't buy storage without backup. If you do, you have a storage system that can't do its job.

Raspberrypi as transport to another array? (1)

AidanApWord (691712) | about 10 months ago | (#46463153)

I would consider: http://www.makeuseof.com/tag/b... [makeuseof.com] ... and then plug a big array into the pi. Then host that in someone else's home (someone I trust of course!).

what he lost was bandwidth (0)

Anonymous Coward | about 10 months ago | (#46463163)

ok, but it's not like he lost anything he owned. I think what he's worried about is the 40TB of bandwidth (assuming 1 up 1 down sharing) required to replenish that.

Load More Comments
Slashdot Login

Need an Account?

Forgot your password?