What's Your Backup Strategy?

January 28, 2008

Jamie Zawinski's public service backup announcement starts off with a bang:

Option 1: Learn not to care about your data. Don't save any old email, use a film camera, and only listen to physical CDs and not MP3s. If you have no possessions, you have nothing to lose.

This is obviously meant as satire, but it's disturbingly close to reality for me. I suppose everything in my life that's worth capturing... well, let me put it this way: you're reading it. When I said make it public, I really meant it. Still, I'm fairly sure Jamie was kidding, and while Google may be a great service, it's only a so-so backup mechanism. Let's proceed to option 2, which goes something like this:

1) You have a computer. It came with a hard drive in it. Go buy two more drives of the same size or larger. If the drive in your computer is SATA2, get SATA2. If it's a 2.5" laptop drive, get two of those. Brand doesn't matter, but physical measurements and connectors should match.

2) Get external enclosures for both of them. The enclosures are under $30.

3) Put one of these drives in its enclosure on your desk. Name it something clever like "Backup". If you are using a Mac, the command you use to back up is this:

sudo rsync -vaxE --delete --ignore-errors / /Volumes/Backup/

If you're using Linux, it's something a lot like that. If you're using Windows, go f*ck yourself.

Yeah! Take that, Windows users! Hey, wait a second. I use Windows. Did I mention that Jamie is a funny guy? Moving on.

I've long been a fan of inexpensive hard drive enclosures. Jamie's advice confirms my long held opinion that multiple hard drives are the most effective and easy backup process you'll ever find. The rsync command is more than a simple copy; it actually does a block-by-block comparison, only copying the differences. So instead of backing up the entire contents of your hard drive (again), you only back up the parts that changed since your last backup. This is commonly known as incremental backup.

Incremental backups only have value if you're doing them regularly, so it's only natural to schedule this as a recurring task.

4) If you have a desktop computer, have this happen every morning at 5AM by creating a temporary text file containing this line:

0 5 * * * rsync -vaxE --delete --ignore-errors / /Volumes/Backup/

and then doing sudo crontab -u root that-file

If you have a laptop, do that before you go to bed. Really. Every night when you plug your laptop in to charge.

5) If you're on a Mac, that backup drive will be bootable. That means that when (WHEN) your internal drive scorches itself, you can just take your backup drive and put it in your computer and go. This is nice.

6) When (WHEN) your backup drive goes bad, which you will notice because your last backup failed, replace it immediately. This is your number one priority. Don't wait until the weekend when you have time, do it now, before you so much as touch your computer again. Do it before goddamned breakfast. The universe tends toward maximum irony. Don't push it.

7) That third drive? Do a backup onto it the same way, then take that to your office and lock it in a desk. Every few months, bring it home, do a backup, and immediately take it away again. This is your "my house burned down" backup.

What I like about Jamie's approach is that it's totally KISS, yet it touches all the cornerstones of a solid backup strategy:

  1. Pick a simple backup strategy you can live with.
  2. Make incremental backups a part of your daily routine.
  3. Include an off-site backup in your strategy.

And for the dissenters, although I can't imagine too many with the minimalist backup process Jamie outlined, there's this bon mot:

"OMG, three drives is so expensive! That sounds like a hassle!" Shut up. I know things. You will listen to me. Do it anyway.

I'm not sure Windows users have a direct equivalent of rsync. There is, of course, RoboCopy, and it looks like someone has ported rsync to Windows. But let's face it. I'm a Windows user. When I have a problem, I buy software. That's why, after hearing so many great things about it, I recently purchased a copy of Acronis True Image.

Acronis True Image 11 Home screen

Acronis does a lot of things, but most of all it's drive imaging software, a fancy GUI over the rsync command. With Jamie's recommended two external hard drives in tow, I can use Acronis to create a bootable mirror image of my hard drive. If anything at all goes wrong, I simply swap hard drives, and I'm back in business. I can even create those backup images incrementally and on a schedule. You don't even technically need a second or third hard drive; if you have a large enough primary drive, Acronis will allow you to create a new, hidden partition to store a complete backup image. You can restore these disk images from within Windows proper, during pre-boot, or from bootable USB or optical media. It is very cool, a logical evolution of the more primitive drive imaging products I've used for years.

Of course, as much as I am enamored of it, you don't have to spend thirty bucks on Acronis and even more for two external hard drives to have a decent backup strategy. Lots of people use completely internet based backup services, like Mozy, Carbonite, or JungleDisk, with varying degrees of success. One thing's for sure: until you have a backup strategy of some kind, you're screwed, you just don't know it yet. If backing up your data sounds like a hassle, that's because it is. Shut up. I know things. You will listen to me. Do it anyway.

Posted by Jeff Atwood
201 Comments

Encryption: TrueCrypt (www.truecrypt.org). Unfortunately, you don't have to throw money at it, nevertheless works like a charm.

Steven on January 30, 2008 6:04 AM

Cylindric said: "for example, someone cataloging all their images in Picasa/Lightroom/etc and then deleting all the jpegs off their PC"

This is why I have to deinstall Picasa for my mother-in-law; the idea that those things only add, display and sort metadata is probably something most users can't get their minds around yet.

Rob Janssen on January 30, 2008 6:09 AM

I use SyncBack from 2BrightSparks on my Windows machines. The free version I use at my various clients to backup code to a USB flashdrive. The paid for version I use at home to backup to an external USB HD.

Mark on January 30, 2008 6:09 AM

I use this rsync method already on my file servers. Mirroring doesn't help prevent filesystem corruption or accidentally deleted files. Then for windows computers(win32 not x64) the powertoy from MS synctool works great and is able to be automated.

Darrell Wright on January 30, 2008 6:39 AM

Time Machine. It's a beautiful thing.

Karim on January 30, 2008 6:46 AM

I use to use tar with my Mac. I had it set with cron to do a backup three times per week with rotating sets of data. I could have used rsync, but this way, I could compress my data as it is tarred, so it didn't take up so much room on the drive.

However, I've switched to Time Machine which can't be beat. It's completely automatic, and it is extremely easy to restore a file after you delete it. I can even restore individual emails and address book entries. How cool is that? I have a 160 Gigabyte FireWire drive on my desk backing up a 80 Gigabyte hard drive. I am thinking of getting two more and see if I can rotate between them. That would allow me to take one drive "off site" in case of a meteor attack.

(A meteor attack is a term to explain what happens if the physical location where the computer is located is destroyed by a meteor crashing through the roof, fire, or flood. Off site backups allow you to recover in such an incident. Yes, of the three disasters, a meteor is probably the least likely, but it's the most colorful. Thus, helps people remember and think about it.)

For PCs, I recommend Mozy. I find that it doesn't work well with Macs, but it's great for PCs. And, the backup is off site, so you don't have to worry about a meteor attack.

David on January 30, 2008 6:48 AM

Worth mentioning these freeware solutions for Windows.

Drive Image XML
http://www.runtime.org/dixml.htm

XXClone
http://www.pixelab.com/

anonymous on January 30, 2008 6:49 AM

But let's face it. I'm a Windows user. When I have a problem, I buy software.


English translation: "I'm an idiot."

For instance, about 5 minutes of surfing brought me an easy to install Free Software version of rsync for Windows at http://www.itefix.no/phpws/index.php?module=pagemasterPAGE_user_op=view_pagePAGE_id=6MMN_position=23:23

Being Free Software, I do not have to worry about:
o purposely hidden security or privacy holes (malware, callhomes, etc) that no one knows about.
o *accidentally* hidden security or privacy holes that only highly-motivated sociopaths with hex editors and kernel debug tools can find.
o digging into the kid's college fund to purchase it.
o having to do so *again* every time Microsoft releases a new OS or Intel comes up with a new hard drive communcations standard.

T.E.D. on January 30, 2008 6:54 AM

Backup:
1.) Use Vista's native backup to image entire drive to a second HD periodically
2.) Use Vista's native backup to image entire drive to an external USB drive less frequency and store it offsite
3.) Use Vista's "media" backup solution for data files like mp3, docs, and pics (saves a version history like Time Machine or source control)
4.) Periodically store all media files offsite


Matt on January 30, 2008 6:59 AM

I'll have to second foldershare. It's free and it just works. I have it installed on all of my home computers and one of my computers at work and it keeps copies of my photos and other personal files up to date and in sync with minimal fuss.

It has the added benefit that I can pull pics off my camera on any of my computers and they'll be available soon on the other ones.

Rick on January 30, 2008 7:01 AM

For the technically inclined, a great, free utility that will make mirror copies of a drive (minus Registry/system files/meta files: you can use NTBackup for that) is XXCopy at www.XXCopy.com -- I've been using this one for the past year now and it's great. the /CLONE option uses incremental backup strategies.

Pete on January 30, 2008 7:05 AM

As some one said a mile up higher, once you are burned you learn. I lost both my HDD's with in 6 hours, my wife lost her laptop HD 2 days later. Maximum irony, oh yeah. So I went out and bought 2 500G sata drives, as well as an external 500G drive. Raid 1 for the box and a weekly full back up. I may have to start doing a daily incremental as I am now using it for more than music and video storage. Thanks for all the info on other programs...

C

Craig on January 30, 2008 7:13 AM

Three words Jeff: Windows Home Server.

Works like a dream and its hassle free.

Roberto on January 30, 2008 7:14 AM

I'm a Windows user. When I have a problem, I search like heck for freeware. If and only if I can't find any freeware that does what I want, I reluctantly, reluctantly pry open my pocketbook for software. This seldom happens.

One time that it did though, was when I paid for MirrorFolder (http://www.techsoftpl.com/backup/index.php). I have Acronis TI I like it, but I think it's a bit bloated for an app I run every day. MirrorFolder is lean and mean, and a real Swiss-Army knife for backups. All my documents are RAID-style mirrored to an external drive, and also periodically backed up to a network drive, all without any intervention. I set it up, then just forgot about it, and it has yet to let me down. Well worth the $40.

Jim Doria on January 30, 2008 7:15 AM

So, uh, I might be late to the party but I just wanted to ask you why you changed your font to the completely unreadable mess it is today. Thanks :)

Cecil on January 30, 2008 7:29 AM

For an open source solution that is very worth looking at you might have a look at Restore http://restore-backup.com. Currently the # rated enterprise backup solution on Sourceforge.

Garret on January 30, 2008 7:54 AM

You have a computer. It came with a hard drive in it. Go buy two
more drives of the same size or larger. If the drive in your
computer is SATA2, get SATA2. If it's a 2.5" laptop drive, get
two of those. Brand doesn't matter, but physical measurements
and connectors should match.

Brand *does* matter. Get two completely different brands so that when the first one dies due to a design or manufacturing problem, the second one doesn't die of exactly the same thing at about the same time (IBM Deathstars anyone?). Increasing survivability through diversity costs very little, but can save your data in the long run.

Dave on January 30, 2008 8:19 AM

Or you could try Norton Save Restore/Norton Ghost/Backup Exec System Recovery (Desktop Edition). P2V and restore anywhere in the Backup Exec edition are great for a moving to a new computer without losing your old system.

ang on January 30, 2008 8:38 AM

Do you know of a software than can sync files, pictures etc on multiple hard drives.

So if I add or modify a file in one hard drive, it automatically updates it on other harddrives.

Hassan on January 30, 2008 8:38 AM

I'm giggling at all the "Buy WHS, problem solved" responses. It seems like half of the "I'm posting to say I'm protected" posts are quite comfortable with their data security despite the fact that they have no off-site backups. Unless WHS is fireproof, waterproof, and anything-else-extreme-proof, your data is gone when the house burns, floods, collapses, or anything else unspeakable happens.

That said, I don't do offsite backups either, but at least I know I'm unprepared.

Sitten Spynne on January 30, 2008 9:05 AM

As a Windows user, I don't spend a dime. I create a batch file like so:

xcopy [my directories] f:\backup /v /e /c /y

and use the windows task scheduler to make it happen at the decidedly non-peak hour of 3:00 am every morning.

Simple. Easy. Works.

If you want to get fancy, I suppose you could use vbscript or jscript. I never do.

ThatGuyInTheBack on January 30, 2008 9:16 AM

"You don't even technically need a second or third hard drive; if you have a large enough primary drive, Acronis will allow you to create a new, hidden partition to store a complete backup image."

I would disagree with this since I had an old hard drive stop spinning last year.

DiegoAndresJAY on January 30, 2008 9:18 AM

I've spent my fair share of time dealing with "backup software" and
the like and the that bothered me with a lot of them was that if my
system crashed, I had to first get Windows up and running, and THEN
use the restore client to bring back all my data.

If you are running Vista, that won't help. As soon as you change out the hard drive, you have to buy a new copy of the OS anyway.

T.E.D. on January 30, 2008 9:24 AM

First off, if I'm reading a nice article that half way through says windows users should go f--- themselves I will close the window and delete the link. Sorry, arrogance will only get you so far.

That being said, I've never lost my HD... yet. I do a full backup once a month via Robocopy which has a nice mirror feature. The backup is on an external HD which I keep in my desk and take with me when I travel, though I think I will add a second drive for an 'at work' backup.

One other thing you can do. Anything that is so important you can't risk even the time for a backup, keep it on a pendrive and keep it with you at all times. Get in the habit of checking your pocket for it every time you get your wallet, don't keep it on your key chain. You'll have to replace it once a year and you really have to be sure you have it, but you'll never lose your truly important stuff.

Tyler on January 30, 2008 9:49 AM

---If you are running Vista, that won't help. As soon as you change out the hard drive, you have to buy a new copy of the OS anyway.

Waaa?

You have to *reactivate it*, if you've had changed enough of the hardware at once. Just changing the hard drive alone, however, won't cause this : you have to change both the hard drive and your memory, or your motherboard, or otherwise make some pretty significant changes. Even if you make significant changes beyond this, you can legally reactivate the machine. With a normal license, you can do the first five activations over the internet, and I've yet to hear of anyone hitting the limit on phone activations even with OEM licenses.

Microsoft has an FAQ on this specifically because of the amount of misinformation out there.

Vista's antipiracy crap is a pain in the backside, irritating, and frustrating, but it's not going to require you to purchase a spare license *that* fast.

gattsuru on January 30, 2008 9:55 AM

One major things almost everyone forgots.
If you cannot restore you have NO backup!

Do you know how to restore a single file or your whole system?
Do you have the needed bootable disks around to get the system in a state where you can use the backup?
Have you ever tested the backup and done periodic tests?

Answer no to any of those and you just slightly above those not doing backups of any kind.

BTW RAID is not backup it is a method to keep the system running.

will dieterich on January 30, 2008 10:13 AM


I partition out a drive for data.

all my programs save to directories on the partition.
I move all of the silly windows directories over to the partition.
(my documents, desktop...) using tweakui

I have a maintenance account which is an administrator, and i sign into that, and copy the entire partition to a DVD once a month.

then I restore it on a scratch drive on another computer, so I'm sure i can later.

EvilTeach on January 30, 2008 10:28 AM

Just a reminder - if you live in New Orleans, don't put your off-site backup in your safety deposit box. They aren't waterproof.

Jim on January 30, 2008 10:29 AM

Vista's Complete PC Backup and Restore works nicely for me. If you're going to go holier than thou on Windows (like Jamie Zawinski), you should probably know what you're talking about first.

james on January 30, 2008 10:44 AM

I backup my data to compact discs every once in a while. I have spare computers so I'm not out of business if my primary PC dies. I keep some data on a thumb drive. My backup procedures are sporadic and inefficient. My main hard drive is a removable drive so I can swap it out easily but that is mostly for running different operating systems.

Robert S. Robbins on January 30, 2008 11:11 AM

For windows users, google 'unison' for an rsync FLOSS alternative. It has a GUI, but the CLI is nicer.

si on January 30, 2008 11:11 AM

Acronis is indeed nice; too bad I can't schedule it to run an incremental backup at logoff...

So now Acronis backs up my system at logon...

And SyncBackSE (http://www.2brightsparks.com/syncback/syncback-hub.html) backs up all my music, email and documents at logoff, which of course is better because at log off you stopped using the computer, so the backup is out of your way.

But all in all it's worth it :)

Leo on January 30, 2008 11:12 AM

You have to *reactivate it*, if you've had changed enough of the
hardware at once. Just changing the hard drive alone, however, won't
cause this : you have to change both the hard drive and your memory,
...
legally reactivate the machine. With a normal license, you can do
the first five activations over the internet, and I've yet to hear
of anyone hitting the limit on phone activations even with OEM
licenses.

OK. I went and reread the Microsoft FAQ on this, and you are almost entirely correct. The thing is there is a lot of uncertianty in there (purposely). For instance, if you activate and then upgrade your video card, then your hard drive dies, is that enough to invalidate your activation? Microsoft won't say, so you'd have to try it.

Secondly, I kept my last OS (Win2K) for about 7 years. During that time it went through at least 4 or 5 motherboards (more if you count the faulty ones). In fact, its still in use on a secondary machine in my house. So will I burn through 5 Vista reactivations at some point? Almost certianly.

Thirdly, I, like most system upgraders and retail PC purchasers (read: "almost all Vista users"), got my copy as an OEM copy. Will I get the same extra free activations as a retail box purchaser is said to get? I suspect no. The FAQ isn't clear. I'm not real anxious to find out the answer first hand. (It gets even more complicated here, depending on whether your OEM preactivated for you or not).

Really the best option would be to hide my hard drive from Vista entirely by using a RAID.

T.E.D. on January 30, 2008 11:15 AM

Mozy rocks. Internet backup is the best backup solution in my opinion. Sure, you can backup to that special drive on the top of your desk. However, what are you going to do when your house burns down or floods? Can you say: "100 gig of family photos and ditigal music GONE". This would be a HUGE disaster for me. We all need to learn that "backing up" is not enough, we need to prepare ourselves for disaster by backing up to an offsite location.

Brent on January 30, 2008 11:19 AM

There's this thing called RAID 1? Yeah. For a reasonable amount of money you can even get a Real RAID Card that does it in hardware instead of the junk that comes on motherboards these days, and it's even faster reading than a single drive.

Noah Yetter on January 30, 2008 11:37 AM

I used to back stuff up on removable hard drives. Partly because I used to live in South Florida and between the heat and humidity, CD-Rs would basically anneal themselves and self erase over time (one music CD from a touring band ended up getting erased although a surfer band from AL isn't the most popular thing, they're gone, a replacement is unavailable at any cost, and my disc is a coaster). And partly because I used to also just take the HD out of retired computers.

Sadly, my house was broken into just over a year ago, and all of my removable hard drives were stolen (along with a PDA, all my DVDs {no CDs tho} and a fireproof box with birth certs and old photos). That collection of removable hard drives getting stolen represents the loss of the last decade of stuff I was working on at home as well as stuff that was downloaded and is no longer available anywhere. I know because more than one academic project that I was interested in has been sold to a commercial company and all "open" or "free" copies of the early works are now gone (and even from archive.org). One such example is LEDA.

Peter on January 30, 2008 11:46 AM

I don't see Disk ARchive or DAR (http://dar.linux.free.fr/) on anyone's lists. Am I the only person that uses it for incremental backups?

Is there something wrong with it? You guys have got me worried!

That said I did manage to restore my configuration from it when I farked my Linux install, it can't be that bad...

Neil on January 30, 2008 11:59 AM

I have several computers, my primary work computer is a Windows box; each weekend a script is executed, it uses a program called nnBackup (see nncron.ru):
- it retrieves files from certain directories (email, IM, etc)
- compresses them
- uploads them to another computer
- keeping a queue of last N backups (in my case N=3)

This tool is also able to do one-way and two-way synchronization, but in my case it doesn't really work, and I am not sure whether it is my not RTFM'ing or a known issue (if I added a single file to a dir with many files, instead of uploading just the new file, it uploads all of them).

The program has a tonn of command line parameters and is extremely flexible.


It is free for ex-USSR residents, otherwise you have to pay. It's one of the rare cases in which I can say I was born there :-)

Alex Railean on January 30, 2008 12:01 PM

rsync is easy enough to install as part of cygwin. I can't do without cygwin on a windows box anyway.

rsync is also very handy for syncing files between work and home - or to some ssh accessible storage location in the "cloud". yeah there are tools for that too but I haven't found any that I'm happy with and that are as simple as rsync.
I like acronis too but I find it more useful for things like taking images of a system drive in case you need to revert because some crappy app broke the registry or something like that.

Ian on January 30, 2008 12:02 PM

Hi Jeff,

We constantly get customers contacting our tech support because they've just lost everything. And I personally many people who have absolutely no backup plans. With years of pictures on a hard drive that can't have much life left...

In regards to plans, let me offer a few more suggestions.

- Have an external HD that you don't keep at home/office, for quick off-site restoring. Just in case you get robbed, etc.

- I recommend an online backup service so that you can store your files remotely. As a last precaution.

- Always always use mirrored raid drive systems. The risks are just too high. It's worth the money. All it takes is one time.

Great article Jeff. Hopefully it will save some people from the pain of losing their data.

Stephane Grenier on January 30, 2008 12:12 PM

Syncing data to a second hard disk (or partition) may be a good idea if you need to reconfigure or upgrade on your system and want to be able to restore your system fast. But it won't help much if your equipment is damaged in a fire or stolen, or if you need to restore a (several versions) older file. Burning disks and storing them off-site is one solution, but unless you accumulate gigabytes of data every day, an online backup service such as Mozy is the most convenient solution.

Eric Jain on January 30, 2008 12:16 PM

Will I get the same extra free activations as a retail box purchaser is
said to get? I suspect no. The FAQ isn't clear. I'm not real anxious to
find out the answer first hand. (It gets even more complicated here,
depending on whether your OEM preactivated for you or not).

Both activation by internet and telephone within the United States involve no special tolls, simply the cost of your existing telephone or internet access plan. There's actually no 'tolled' Activation hotline for the United States at this time.

You can't reactivate an already activated OEM license over the internet, but you can do so over the phone. You are limited to the OEM license agreement, which licenses Windows Vista (and, for that matter, XP) to the existing motherboard/CPU. I personally don't like said agreement, but it's been in place since 95 at least. Microsoft's actually nicer than that, though, as they'll let pretty close to infinite number of phone revamps for damaged motherboards or hard drives -- I've personally phone reactivated one OEM license more than ten times, if not more than fifteen, due to a workstation with particularly high use and problematic users.

If you [i]want[/i] to violate the EULA, but don't like telling nice Microsoft Indian college graduate that you lost your motherboard, it's a problem, but for the applications involved in this thread involving a dead motherboard or hard drive, the only issue with Vista reactivation is ten minutes of your time and a bit of frustration.

gattsuru on January 30, 2008 12:21 PM

+1 robocopy

It should have said:
"If your on windows, type "robocopy /MIR C:\ F:\Backup" into a file called backup.bat and and put this in your schedule tasks"

Works great and it's free.

Ben on January 30, 2008 12:26 PM

plenty of piratebay searches on Acronis after an article like this.

bink on January 30, 2008 12:50 PM

Jungle Disk w/ Jungle Disk Plus does it for me, nightly rsync-like backups to Amazon S3 from all of my computers (Windows XP desktop, OS X laptop Linux servers).

No need to purchase the "Busness package" when my storage goes over some arbitrary limit, and I'm not paying for space I'm not using.

In addition I do nightly backups to an external firewire drive with SyncToy

Shrike on January 31, 2008 1:34 AM

I have a Maxtor USB external unit with two 750GB disks mirrored in it. I use Genie Backup Manager to perform an incremental backup every night and a full one every week or so. The beauty of it being that I can turn off the external HDD's when I'm not doing a backup making it less likely they'll be infected with a virus.

I didn't mind spending the money on GBM as the 30ish it cost would far out strip any catastrophic loss of data that might happen.

Paul on January 31, 2008 2:38 AM

I'm in the Strategy 1 camp. Of the stuff on my hard disk, I value my porn collection the most, but even that I rarely look at.

I've been running with no backups for almost 20 years now, and have always managed to move to newer PCs before the old disks gave up the ghost. However, when I migrate stuff I usually find myself throwing out the "Contents of old Drive C" a little while after the migration.

It may seem ironic, but it often turns out that what you amassed or created on your PC loses value about as quickly as the PC itself. A few years and you find yourself wondering, "what was THAT all about?"

Carl Smotricz on January 31, 2008 2:42 AM

Don't worry about backup!

Backup is easy and a complete waste of time.

The important thing is RESTORING or RECOVERY.

Think about what information you could not live without, imagine how that information could be lost to you and practice regularly testing the recovery of that data under potentially disastrous conditions.

Mike F on January 31, 2008 6:43 AM

Don't recommend backup on internet, specially if you don't have fast wide bandwidth in your area. Besides, what the heck is doing my data on the internet.

I'll rather get a second drive.

mramirez on January 31, 2008 8:05 AM

Sometimes a nice drive failure is just the thing to cleanup years worth of junk that you just can't bring yourself to delete/organize. =)

Craig on January 31, 2008 8:13 AM

Don't recommend backup on internet, specially if you don't have fast wide bandwidth in your area. Besides, what the heck is doing my data on the internet.

The first upload is a bit daunting, it took me two weeks to upload my data onto S3. The amount of data that changes daily is pretty minimal for most people, a few digital images now and then, some new music and a few documents, not more than a few hundred megabytes per day on average.

I'll trust Amazon to keep my data more than I trust myself to swap external drives regularly. And as for security, all my data is encrypted with AES256 by JungleDisk.

I'll rather get a second drive.

You need three drives, one offsite, to protect your data from being stolen (someone physically breaks in to your house) or destroyed in a fire/flood/hurricane.

Shrike on January 31, 2008 8:59 AM

Last time I tested it Acronis True Image 11 wouldn't backup/image a drive that has BitLocker drive encryption enabled. The full Vista 'Backup your computer' worked fine for the OS volume. And I use Robocopy for my data volumes - very handy for re-syncing after traveling.

Anthony Bouch on January 31, 2008 9:39 AM

My method works for me:

I have my C: drive, just 40GB, which contains exclusively the OS and any other software which must be installed on it. After installing Windows and its endless updates, I take an image of it (with Ghost). I then install the software that must be put on the C: drive. I take another image of it.

I then have my "software" hard drive, where I install the applications I want to use (Word, iTunes, Visual Studio, etc.) on the computer. I take an image of it. I then take an image once or twice a month. I've never really done the incremental thing; I just do one big image every time. Seems to work for me.

Then I have my data server on my LAN, which contains all my music, movies, documents, backups (including images), on two 500GB hard drives in a mirror configuration. So far I've never had to "use" any of it, but I know it's there and that's always comforting.

I've had several friends complain to me that their "computer crashed" and they can't get their stuff. I always ask, "Did you back it up?" and 99% of the time I get the response, "........no." I just shrug and say, "That's what you get."

Brent on January 31, 2008 10:13 AM

I've been a fan of Acronis TrueImage. I used that on my desktop with nightly backups to a network drive for a long time. I'd also take semi-regular backups of my laptop, primarily before traveling. Recently, I've actually moved to using WHS for doing my backups. I recently used it for performing a restore on my laptop and it worked pretty good (though a little slow).

On my Mac, I primarily use Time Machine now, though am thinking about SuperDuper to keep a nice copy of my drive, since I'm not sure about the full system restore process with Time Machine.

Overall, drives are cheap when compared with the value of your data and downtime.

Ken Robertson on January 31, 2008 10:24 AM

I'm surprised nobody has said it.

Gmail.

Greg on January 31, 2008 10:59 AM

I just back up stuff on CDRs (or DVDs). It's cheap and easy.

Amazon S3 sounds good though... but I imagine uploading my data would take far longer than simply burning it.

KG on January 31, 2008 11:44 AM

- Slap in a recent knoppix distro cd and watch it boot
into the shell and use the "ntfsclone" command to copy your whole partition sector wise onto an external usb2.0 mounted harddrive - which can't be ntfs though
- There are rsync binaries on win32 but they are mostly flacky. running rsync with cygwin isn't fun, either.
- On windows you are fine using robocopy from microsoft. stuff like this (ignoring vstudio temp files).. Note /PURGE clears additional files on the dest side, take care

---------dumpscript.bat-------
SET DST=Z:\BACKUP
SET IGN=*.obj *.pch *.pdb *.ilk *.exp *.res *.trg *.idb *.tmp *.plg *.ncb *.aps *.bsc *.sbr
robocopy /E /FFT C:\work\ %DST%\work\ /XF %IGN% /PURGE
robocopy /E /FFT C:\devlibs\ %DST%\devlibs\ /XF %IGN% /PURGE
------------------------------

- Also the software syncback (freeware, adv version also shareware ) is very fast.

MY RAPTORS WILL ARRIVE TOMORROW :)

Out of Control on January 31, 2008 12:17 PM

oops you mentioned robocopy already. think before posting.. :(

Out of Control on January 31, 2008 12:19 PM

Amazon S3 sounds good though... but I imagine uploading my data would take far longer than simply burning it.

Again, burning disks is something you need to remember to do every day/week/month.

Automated network uploads work in the background without any intervention on your part.

Shrike on January 31, 2008 12:27 PM

Briefly, the -E flag in the post is redundent to the -a flag. Rsync will likely fail to get crucial operating system files backed up and restored, especially while the OS is live.
Jeff, you intuitively went for a much wiser strategy. There are linux equivalents, but the method given is not one of them.

ian k on February 1, 2008 1:10 AM

I use a combination of encrypted volumes (thank you very much TrueCrypt), and online storage. Unfortunately most online storage providers (like Mozy, Carbonite, and JungleDisk) suffer from the same issues, namely:

1) the delay in access to your data (my restores should be immediate and always available);
2) I don’t really know where the data lives, so who knows where and how long my data will be available (JungleDisk is the exception – it’s on S3);
3) I don’t always own my decryption keys (which I, and only I, want);
4) the initial upload can be horrifically painful 80GB (big B) of data divided by 768kbps (little b) makes me shudder (1 day per 8GB +/- a bit).

Ultimately after using everything I could get my hands on, I still end up using ElephantDrive for everything.

1) Immediate access to my data via a backup client, the website, or WebDAV.;
2) My data all lives on S3 (yay!);
3) I pick and own my decryption keys;
4) The initial upload is reduced as they do global file de-duplication (which gives me much faster upload times after I got my first set of data uploaded).

I used their free service for awhile, which gave me plenty of storage for free (1GB) for everything that wasn’t video, audio, or pix. After I got used to it, I started using it for everything. Sometimes their tech support can be a bit slow to respond, but they do respond so I’m not going to piss and moan too much – after all they have all my data.

I’m surprised you missed them in your review Jeff. Mozy, Carbonite, and JungleDisk are so 2007. :-p

http://www.elephantdrive.com

cj little on February 1, 2008 6:46 AM

I think (based on some horrendous recent experience) that it's important to consider different aspects of backup - especially for Windows users.

Is your objective to:

1. Back up data only
2. Back up the entire disk so that you can restore your *existing* hardware if a disk goes down
3. Back up the entire system so you can restore to new, replacement hardware when something besides the disk goes down (or the building goes up in flames, etc...)


If all you care about is data, then almost any of the options described here will work (as long as the 'data' isn't in files that are opened in exclusive mode by applications - i.e. MS SQL Server, Exchange, etc...).

If option 2 is what you are going for, then a combo of option 1 and RAID is a workable solution.

But here's the kicker: Option 3 is really what most folks want. If my computer goes out the window, I want to be able to grab new hardware (or heck, even take the drive out of existing hardware and put in a blank drive), and know that I can get my entire system up and running with minimal fuss.

Minimal fuss means not having to install and configure an operating system, apply a million updates, etc... This means not having to re-install and re-configure all of the applications that I use (this implies being able to successfully back up AND restore the registry - more on this in a second).

In my case, the system I care the most about is a server, so bringing the active directory back up is also absolutely critical.

So how do you do such a backup? As mentioned in several posts, the built in ntbackup will back up all of the above (usually - there are still problems with VSS, but that's a different story).

So we go about using ntbackup to get all these great backups - but it turns out that actually *restoring* from these backups is a total crapshoot. And it's not because ntbackup is doing anything wrong, in particular - it is b/c it is almost impossible to reliably get Windows running on hardware X when it was originally installed on hardware Y. And the great news? There is almost *no* way that hardware X will even be available when you need to actually do your restore.

I have probably attempted about 25 system restores using ntbackup, restoring onto alternate hardware. Of those, I was able to bring Windows up about 5 times. It turns out that there are a number of (undocumented) areas in the registry that really, really care about what hardware you are running on. When ntbackup restores those areas of the registry, you are basically dead. Sometimes doing a 'repair' install from the Windows CD will fix these problem areas - but most times it just results in an endless sequence of reboots.

So, my word of caution here is: If you care about full system backups, you had absolutely better make sure you test restoring onto a different hardware setup than you actually run on. Performing test restores to the same hardware is almost useless, because that is not going to be what you are doing in a disaster scenario.

These comments refer specifically to ntbackup - but they go for *any* backup app that is capturing system state.

This is the number one issue that I have with disk image based systems for Windows. Unless they have some serious magic going on under the hood at restore time to make sure that the restored image will actually work on alternate hardware, all you'll get is a data backup (and a lot of wasted hours trying to get a machine to boot).

kday on February 1, 2008 8:50 AM

burning disks is no backup. they can fail after 1-5 years.

offler on February 1, 2008 10:06 AM

"burning disks is no backup. they can fail after 1-5 years."

All the documents I want to keep (and can't replace) easily fits onto a single DVD, so when I do a backup, I re-backup everything. I typically do this every few months, but I also have a flash drive to temporarily backup whatever documents I create between that time.

KG on February 1, 2008 10:35 AM

EMC has a product called Retrospect that revolves around the concept of "point in time" backups.

You run a backup whenever you like, and you can then restore your system (or the files you backed up) to a list of points in time and it will restore (entirely, or selectively) what you backed up as it was at that point. It also takes a snapshot of the system at each point-in-time, so you can inspect the state of other files, even if you didn't back them up...

It sounds like incremental backup, but it also takes into account files that have been deleted between the first backup and the point-in-time you select.

It's a little bit more complicated than some other backup tools, but once you learn how to use it, it's pretty powerful.

mattbg on February 2, 2008 10:29 AM

I have so little data I really care about I just send it to my gmail account and tag it (yeah, even complete bazaar repos), after all, I can get anything from the internets again but the things I make.

Phrodo_00 on February 3, 2008 7:44 AM

Acronis came free with my Fujitsu T4210 - double win for me =) It's simple, it's fast, does what it says on the box and I've never needed anything else. Other than cdrecord.exe crashing on me (easy fix: Task Manager - kill process), it is problem-free.

I have a partition for portable applications (zero installation), one for files, these get duplicated onto an enclosured hard drive at home every week. C gets backed up (full backup every time) every week, and once home I put it on another enclosured disk. I keep about 2 weeks' worth of the most recent backups, in addition to the original. The usual C drive image is about 5GB and is created in about 5 minutes or less, while I shower.

Of course, the main reason this works is because of partition separation - I keep Desktop and other important folders in the same partition used for portable applications. So far nothing's happened that this set up can't fix yet.

I really agree with having a backup plan you can live with, and that you are familiar with.

kureshii on February 4, 2008 10:50 AM

One extra vote for Windows Complete PC or Windows Home server. They both rely on delta info being already available (and stored in the "previous version" data of a Vista PC). That makes the backup faster.

Paperino on February 5, 2008 10:57 AM

"I post my important data in base64-encoded little chunks in the comments on the blogs of people who actually take the necessary steps to backup their data."
sounds time consuming. i put my data in godallahs hands.

official gop email archivist on February 6, 2008 11:21 AM

After this article was posted, I ordered a hard drive and enclosure on which to back up my Mac. They arrived last week, and I made my backups on Saturday. Today (Monday), my main hard drive failed.

That's the thing about backups. You only need to make them the day before your main hard disk craps out. Too bad you can never know when that is. I got lucky this time.

David on February 11, 2008 12:34 PM

(Windows Freeware solution)

SyncBack
http://www.softpedia.com/get/System/Back-Up-and-Recovery/SyncBack.shtml

XXClone
http://www.xxclone.com/

DriveImage XML
http://www.runtime.org/dixml.htm

UBCD for Windows
http://www.ubcd4win.com/

anonymous on February 12, 2008 9:37 AM

Windows Complete PC Backup and Restore is HORRIBLY crippled. It can ONLY backup to another physically attached disk, or to CD/DVD.

I can not backup to a network share!!! This is pathetic and unacceptable.

Jay R. Wren on February 20, 2008 4:42 AM

You really should update this post and add Microsoft's free SyncToy software to the list for Windows.

It has some decent functionality such as one-way, two-way sync, echo, etc. Also, used in conjunction with Scheduled Tasks (Start-accessories-System tools) makes regular backups/syncs a snap!

As a simple backup tool for non-techies, SyncToy comes very close to "just right"

Vinit on February 23, 2008 10:13 AM

Hey, the software you mentioned Acronis, would this be viable in a server situation? I'd like it to back up every hour, during back up, is data unusable? For instance, I have 22 people in the office, all using the server, I'd like the server to be backed up every hour incase if failure, if the server is mid backup, will users still be able to interact with the server?

Thanks in advance to anyone who can help.

Menekali on March 20, 2008 11:05 AM

My solution (and yes I've gotten burned twice before doing the right things below):

1) Internal SATA RAID backplane. Get one at Fry's for $100 and make sure it's SATA 3.0 compatible then assuming you have a case for it to fit, slide it in and hook up to your ASUS or whatever custom motherboard you have hopefully installed.

2) Setup RAID 1 or 5 depending on your budget of course

3) Use Elephant Drive as your off-site strategy. It's only $10 a month, almost unlimited GB storage and they have great client web tools to do these backups with

4) Norton Ghost 12 to create images often of your PC. Create an initial base windows image (no updates), then one with updates or whatever else to start (VS, SQL Server, etc.), then keep creating a new image each month or week for your 3rd image that's updated often

4) Never drop your external hard drive accidently if you are clumsy. Treat them like a baby ;)

Dave Schinkel on May 1, 2008 5:22 AM

Have you looked at Symantec System Exec Recovery?

http://www.symantec.com/business/products/overview.jsp?pcid=2244pvid=1601_1

Ben on May 27, 2008 3:29 AM

Ooops, I meant Symantec Backup Exec System Recovery, it's getting late, and I've spent far too much time on Rock Band!!

Ben on May 27, 2008 3:30 AM

There are only a few aspects of my computer that I really need to backup.

I don't worry about the software, because I have the disks. Plus, it never hurts to do a completely clean install. And if you've crashed a hard drive, it's probably time to do that.

Here is what I do.

I have a drive that is partitioned into two segments, one for XP and one for Vista. (Velociraptor Drive FTW)

I have another internal drive that holds my Development Projects. (Raptor drive FTW)

I have another internal drive that holds a backup of those Development Projects on the Raptor, my Documents, and my other media.

And, finally, I have an external hard drive that I back up Pictures, Documents, and all of my Development Projects on.

So far this has worked for me pretty well.

David McGraw on July 11, 2008 5:12 AM

My backup strategy is kinda complicated. I use Mozy for my window computer. (That part is easy) However for my linux box I copy all my linux files to my windows computer, and let Mozy back them up too. The hard part is keeping all of the permissions. I had to write it all down to keep track of how to do it:

http://www.squidoo.com/linux_backup

Hope it helps someone else with a linux box and a windows box like me.

John on July 21, 2008 4:15 AM

I just got acronis true image yesterday (I read about it here 6 months ago). It's hot. I'm going to get another copy for my wife's machine so she can enjoy data protection too.

There's nothing like a good backup to make you sleep just that much better.

Shaun on July 29, 2008 8:39 AM

In my experience MirrorFolder works very well. Set it up and forget it... until you need the data ;-)

http://www.thebigmind.org

Android on September 30, 2008 3:55 AM

Some time ago I didn’t even think about backup at all, until awful things had happened with my computer. After that I began to look for a good backup program. My friend told me about backing up online with Novosoft remote backup service. I tried it. It’s cheap and reliable!

Jane on October 9, 2008 3:36 AM

From their website, it doesn't look like Acronis True Image does what you've said. For example, it doesn't say that you could just swap hard disks and keep running as normal, it says you can boot from the backup in order to recover your system. Also, it doesn't say anything about these complete images being differential like rsync. I'm going to try it anyway though, but I don't think it's going to work like you've said. I'll report back.

Rob on November 28, 2008 8:30 AM

Hmm. a href=http://www.fssdev.com/products/casper/default.aspxCasper/a seems much more promising, particularly the description of its Smart Clone feature. I am going to try that instead of True Image, which doesn't even mention the features jwz was talking about.


Rob on November 28, 2008 8:47 AM

Yep, Casper works well.

Rob on November 30, 2008 10:06 AM

Just tried using this Acronis True Image...
you forgot this is application is not very much rsync like. it's more like any other run of the mill backup application.
Specifically, it saves the backup in its own propriety format. this for me is a deal breaker.

Shy on December 27, 2008 10:34 AM

Just use mozy, carbonite or newer players like vaulten
http://vaulten.com/download

rob on February 23, 2009 5:17 AM

I got rsync & cron setup in windows w/ cygwin. =) Not the easiest thing I've ever done but it works pretty decent. I still need to get an off site solution and take a full image snapshot monthly. But I have a latest snapshot taken every 2 hours, an additional one every monday (incase I blow something up), and monthly archives.

install cygwin, make sure to add the rsync & cron packages.

then create a user to run the cron service. replace with a secure one.

net user cron_server /add /yes
net localgroup Administrators cron_server /add
editrights -a SeAssignPrimaryTokenPrivilege -u cron_server
editrights -a SeCreateTokenPrivilege -u cron_server
editrights -a SeIncreaseQuotaPrivilege -u cron_server
editrights -a SeServiceLogonRight -u cron_server
mkpasswd -l -u cron_server >> /etc/passwd
editrights -a SeDenyInteractiveLogonRight -u cron_server
editrights -a SeDenyNetworkLogonRight -u cron_server
editrights -a SeDenyRemoteInteractiveLogonRight -u cron_server
cygrunsrv -I CronService -p /usr/sbin/cron -a -D -u cron_server -w

(thanks to someone else for that)

then check services.msc and the CronService should be running. run cron_diagnose.sh to make sure permissions are set.


here's my cron tab, have fun with the expressions :P
# latest backup every 2 hours, 30 minutes past hour
30 0,2,4,6,8,10,12,14,16,18,22 * * * /z/backup.sh latest

# weekly backup every monday at 8 30 pm
30 20 * * 1 /z/backup.sh weekly

# monthly backup 20th of every month at 10pm
0 22 20 * * /z/backup.sh monthly

save that in a file and run crontab to load it in

and here's my wrapper script around rsync
#!/bin/bash

drives="c d"
backupRoot="/z/rsync"
logRoot="/z/rsync/logs"
rsyncArgs="-vaxE --delete --ignore-errors"

case "$1" in
"latest")
backupDir="latest"
logFile="latest-`date +%Y-%m-%d-%H-%M`.log"
;;


"weekly")
backupDir="monday"
logFile="monday-`date +%Y-%m-%d-%H-%M`.log"
;;


"monthly")
backupDir="monthly/`date +%Y-%m-%d`"
logFile="monthly-`date +%Y-%m-%d-%H-%M`.log"
;;

*)
echo "USAGE backup.sh {latest | weekly | monthly}"
echo "add -d for dry run"
exit
;;
esac


mkdir -p "${backupRoot}/${backupDir}"
mkdir -p "${logRoot}"


for drive in ${drives} ; do
cmd="rsync ${rsyncArgs} /cygdrive/${drive} ${backupRoot}/${backupDir}"
echo
echo
echo ${cmd}
if [ "$2" != "-d" ] ; then
${cmd} >> ${logRoot}/${logFile} 2>&1
fi
done

John on July 17, 2009 3:03 AM

I haven't found an rsync port for Windows Vista that works reliably. All of them that I tried follow Junction Points and then rsync goes around and around and around in circles.

And the rsync ports that are out there are all re-packagings of the cygwin port that seem unhappy about every little thing. A native Win32 rsync would be welcome.

Clinton Pierce on February 6, 2010 10:20 PM

I thought it was:

"I am a Windows user, I get a cracked CD from a mate"
"I am a Mac user, I'd buy software if I could afford it after buying the dongle"
"I am a Linux user, I fork my own software from sourceforge"

As George Kostanza once said, "Flame on!"

John Ferguson on February 6, 2010 10:20 PM

If you combine rsync with copying to hard links, you can get the appearance of full backups for the storage price of incremental. Currently I have 6 months of daily backups online, and I can go back to any day using only about 3X the storage of the original data. Both the original data and the backups are full mirror RAID arrays. I can also adjust it to do it more than daily if I want, but that seems to be enough.

My favorite backup setup for off site was a system where we had fully mirrored drives with 3 drives instead of 2 in the mirror. Since they were hot swappable, we just yanked a drive, and stuck in a new one, then backups took place transparently.

Grant Johnson on February 6, 2010 10:20 PM

I've spent my fair share of time dealing with "backup software" and the like and the that bothered me with a lot of them was that if my system crashed, I had to first get Windows up and running, and THEN use the restore client to bring back all my data. Then there was the whole hassle of registry key fudgery and the like.

That's why I fell in love with Acronis. It is a fast and powerful full image of the computer that can be restored in a disaster using a recovery CD. On top of that, I can always mount the image as a drive letter if I accidentally wipe out my music files and need to restore just that.

I peeked at that link to DriveImage XML and it seems to have a lot of the same benefits. I might have to try that out since my wife's laptop is now on Vista and our license is only for XP.

Sean Patterson on February 6, 2010 10:20 PM

1. build a custom storage server for like less than 800$
2. install Windows Home Server on it
3. be happy :)

Ion Todirel on February 6, 2010 10:20 PM

I've been a MOZY user for about 6 months and I'm very happy with it.

It lacks the 'complete image' capability (though a simple RAID configuration can solve that for you), but for backing up raw data like pictures, music, etc, it's perfect.

$5 a month, unlimited. Can't beat that!

Aston on February 6, 2010 10:20 PM

I wasn't up to date on the Windows Backup And Restore, looks like that would more than handle things. I've used Robocopy to clone a disk, which worked great:
ROBOCOPY E:\ C:\ /e /efsraw /copyall /dcopy:t /r:0

I did that prior to upgrading from XP to Vista, so I ran ran Robocopy from the boot console on the Vista DVD. Craig Andera's Hobocopy looks interesting, though, as it'd copy files that are in use.

And like others said, I thought the progression was:
Mac user: buy shiny stuff and tell everyone how it's revolutionary
Windows user: root around for freeware, then try to find a cracked copy
Linux user: recompile the kernel to include whatever feature you're looking for

Jon Galloway on February 6, 2010 10:20 PM

You don't even technically need a second or third hard drive; if you have a large enough primary drive, Acronis will allow you to create a new, hidden partition to store a complete backup image.

You know that's a really stupid comment in an otherwise sensible article, right?

Shut up. I know things. You will listen to me. Do it anyway.

Maybe not as much as you think. Knowing what you don't know is the path to enlightenment. This kind of arrogance always comes a croppper one day.

Anon on February 6, 2010 10:20 PM

"Shut up. I know things. You will listen to me. Do it anyway."

http://www.codinghorror.com/blog/2008/01/whats-your-backup-strategy.html

Simon Brown on February 14, 2010 1:38 PM

My backup strategy is :
- Having a good software to backup
- Searching all my files that needs to backup
- Make the backup
- Store it online on the software company servers
- Format the hdd
- Restore the backup
:D is simple ! :D
By the way for people who want for their backup to be this simple , i want to let you know that i am using a free software called http://www.dmailer.com/dmailer-backup.html .

Wineasycom on June 26, 2010 4:52 AM

A thorough information back-up system is important for your information security. Many folks delay until disaster strikes when they think of any back-up. A great backup is an excellent strategy to defend against malware, failing hard drives, unfortunate occurrences and also human blunders. I could recommend a three stage strategay that can be quite invaluable. Here it is. 1. Plan for data backup 2. Commence a every day back-up routine 3. Customize your back up technique to your own preferences. Although greatest of the plans will not eliminate the situations of data loss. When these kinds of situations do appear, you ought to be prepared to obtain the very best data recovery services gurus one's wallet could manage.

Sam Marchant on July 24, 2010 7:53 PM

«Back | More comments»

The comments to this entry are closed.