Introduction

We all store more and more of our lives in digital form; spreadsheets, résumés, wedding speeches, novels, tax information, schedules, and of course digital photographs and video. All of this data is easy to store, transmit, copy, and share, but how easy is it to get back?

All of this data can be a harsh reminder that computers are not without fault. For years, storage costs have been dropping while at the same time the amount of storage in any one computer has been increasing almost exponentially. We are at a point where a single hard drive can contain multiple terabytes of information, and with a single mishap, lose it all forever. Everyone knows someone who has had the misfortune of having a computer stop working and wanting their information back.

It’s always been possible to safeguard your data, but now it’s not only necessary thanks to the explosion of personal data, it’s also more affordable than ever. When you think of the costs of backing up your data, just remember what it would cost you if you were to ever lose it all. This guide will walk you through saving your data in multiple ways, with the end goal being to have a backup system that is simple, effective, and affordable. In this day and age, you really can have it all.

It’s prudent at this point to define what a backup is, because there are a lot of misconceptions out there which can cause much consternation when the unthinkable happens, and people who thought they were protected find out they were not.

Backups are simply duplicates of data which are archived, and which can be restored to a previous point in time. The key is the data must be duplicated, and you have to be able to go back to an earlier time. Anything that doesn’t meet both of those requirements is not a backup.

As an example, many people trust their data to network storage devices with RAID (Redundant Array of Independent Disks). Without going into the intricacies of various forms of RAID, none of these Network Attached Storage (NAS) devices are any sort of a backup on their own. RAID is designed to protect a system from a hard disk failure and nothing more. Depending on the RAID level, it either duplicates disks, or uses a calculation to create a parity of the data which can be used to calculate the original value of the data if any part of the data is missing from a failed disk. While RAID is an excellent mechanism to keep a system operational in the event of a disk failure, it is not a backup because if a file is changed or deleted, it is instantly updated or removed on all disks, and therefore there is no way to roll back that change. RAID is excellent for use as a file share, and can even be effectively utilized as the target for backups, but it still requires a file backup system if important data is kept on the array.

Another similar example is cloud storage. Properly configured, cloud storage can be a backup target, and different services can even properly perform backups, but the average person with the average Google Drive or OneDrive account can’t copy their files there and hope they are protected. As with RAID, it is a more robust file storage than any single hard drive, but if you delete a file, or copy over another, it can be difficult or impossible to go back to a previous version.

Both RAID and cloud storage suffer from the same problem – you can’t go back to an earlier time, and therefore are not a true backup. True backups will allow you to recover from practically any scenario – fire, flood, theft, equipment failure, or the inevitable user error. This guide will walk you through several methods of performing backups starting at simple and moving up to elaborate systems that will truly protect your data. These methods work for home and business alike, just the type of equipment will likely differ.

There is some common terminology used in backups that should be defined before we start discussing the intricacies of backups:

  • Archive Flag: A bit setting on all files which states whether or not the file has been modified since the last time the flag was cleared.
  • Full Backup: A backup of all files which resets the archive flag.
  • Differential Backup: A backup of all files with the archive flag set, but it does not clear the archive flag.
  • Incremental Backup: A backup of all files with the archive flag set which resets the archive flag.
  • Image or System Based Backup: A complete disk level backup which would allow you to image a machine back to a previous state.
  • Deduplication: A software algorithm which removes all duplicate file parts to reduce the amount of storage required.
  • Source Deduplication: removing duplicate file information from files on the client end. This requires more CPU and memory usage on the client, but allows for a much smaller file size to be transferred to the backup target.
  • Target Deduplication: removing duplicate file information from files on the target end. This saves client CPU and memory usage, and is used to reduce the amount of storage space required on the backup target.
  • Block Level: A backup or system process which accesses a sequence of bytes of data directly on the disk.
  • File Level: A backup or system process which accesses files by querying the Operating System for the entire file.
  • Versioning: A list of previous versions of a file or folder.
  • Recovery Point Objective (RPO): The amount of time since the last backup deemed safe to lose in a disaster scenario. For example, if you perform backups nightly, your RPO would be the previous night’s backups. Anything created in between backups is assumed to be recoverable through other methods, or an acceptable loss.
  • Recovery Time Objective (RTO): The amount of time deemed acceptable between the loss of data and the recovery of data. For home use, there’s really no RTO but many commercial companies will have this defined either with in-house IT or with a Service Level Agreement (SLA) to a support company.
 
Plan Your Backups
Comments Locked

133 Comments

View All Comments

  • tribunal88 - Wednesday, May 21, 2014 - link

    Any reason that CrashPlan wasn't considered?
  • DanNeely - Wednesday, May 21, 2014 - link

    1) "Of course this list is certainly not exhaustive, with many companies now offering online backup solutions. A quick search in your favorite search engine will provide dozens of options. Be sure to choose the one that works best for you."

    2) Look at the 5th item on the bulleted list above the paragraph I just quoted...
  • antef - Wednesday, May 21, 2014 - link

    CrashPlan is fantastic. I used to use JungleDisk with S3, but the software was forgotten and became problematic and buggy. I gave it up and switched to CrashPlan. The client is easy to use and backups seem to happen fast and reliably.
  • Kenazo - Tuesday, May 27, 2014 - link

    Crashplan's friend to friend option is amazing. I have 3 or 4 people backing up to my home NAS, and my personal pictures and important documents all back up to my PC at work.
  • Haravikk - Wednesday, May 21, 2014 - link

    For most regular consumers, CrashPlan is something I'd definitely recommend; it's pretty easy to use and has unlimited storage, plus if you like you can specify the encryption key that is used (though of course you then have to find a way to keep that safe instead). Given the pricing of cloud storage it's also pretty well priced. I'm sure there are other cloud backup services, but CrashPlan is what I'm using.

    Personally though I've gone for the total overkill approach; I have my Mac's main system volume which I'm about to switch over to RAID-5, a Time Machine backup volume on RAID-5, a Synology NAS (no RAID since it's only two-disk), and the NAS is also configured to heedlessly run CrashPlan to backup my files. So I have a total of three redundant copies of my data, albeit one in the cloud that is usually a day or two behind, and would take weeks to re-download, but in the event of a fire burning down everything else I'd rather have that off-site protection.

    Still, I'd personally recommend local back-up drive + NAS for most serious computer users, especially if working with that computer is your job, as a single backup isn't enough IMO, as the last thing you want is to be in the middle of restoring your system, only for the backup to fail as well.
  • NonSequitor - Wednesday, May 21, 2014 - link

    Be really careful about RAID-5. It protects very well against a complete drive failure, but drive corruption or a drive that starts returning garbage will trash everything on the disk. You need a RAID level that does double parity or checksums, such as RAID-6 and RAID-Z, to actually protect against almost all hardware failures. Of course it still is not then a backup.
  • pdf - Wednesday, May 21, 2014 - link

    The bigger problem is that with large modern disks, a drive failure in RAID5 means that you're extremely likely to encounter unreadable sectors trying to resilver a replacement disk. A drive that starts returning garbage during regular operation should cause no problem with any competent RAID implementation though.

    Also, RAIDZ is single-parity - RAIDZ2, RAIDZ3, etc are the multi-parity versions. The other bonus with ZFS-based RAID implementations is full checksumming of all data and metadata on-disk, plus COW snapshots, and the latter means it can actually serve the role of a self-contained backup solution, using something like zfs-auto-snapshot to provide granular, aged snapshots of changed data.
  • Morawka - Wednesday, May 21, 2014 - link

    i havent heard RAIDZ recommended for 10 years
  • piroroadkill - Wednesday, May 21, 2014 - link

    What are you even on about?

    ZFS was only widely available in November 2005.
  • Mr Perfect - Friday, May 23, 2014 - link

    Guess that's only eight and a half years then.

Log in

Don't have an account? Sign up now