Category: Storage

Battle of the Online Backups – part 1 – Humyo

Posted by – March 11, 2010

Humyo is a UK based online and colloborative/sharing service. Datacentres based in Manchester. Generally provides a very clean and smooth service – the web user interface is particularly impressive and relies on Java technology to provide functionality such as uploading/downloading multiple files.

Pros

  • Supports Windows and Macs
  • Good, clean, intuitive web interface
  • Very good collaborative functionality
  • Priced in £ sterling
  • Generally excellent Windows client (has improved since I last tried Humyo a few months back)

Cons

  • Web interface’s Java components do not work properly with OS X and Firefox – requires Safari to work
  • Backup client fiddly and does not accurate reflect the progress of transfer
  • Additional cost for historical backups/file versioning
  • Mac backup client still needs a lot of work

I did find that I had a lot of trouble forcing the backup client to restrict the amount of bandwidth it should use and ultimately this is what put me off using Humyo as a sync service.

The Ultimate Battle of the Online Backups!

Posted by – March 9, 2010

Over the next week or so, I’m intending to post my findings of a variety of online backup services. I’ve tested:

SquirrelSave (note: I work for the company that runs it and am it’s primary support)
Jungledisk
Mozy Home
Mozy Pro
SugarSync
Humyo
Backblaze
Dropbox

I run both Windows 7 and Mac OS X (Snow Leopard), and have attempted try both platform where offered. My findings may surprise you, and I still advocate that you beg, borrow or buy a portable USB hard drive at the very least to store a copy of your data locally or invest in a Blu-Ray writable drive (they’re becoming cheaper slowly but surely) and doing the same.

Protecting your data with SquirrelSave..

Posted by – December 8, 2009

Making Cedric the Squirrel work harder, faster, stronger for you!

Disclaimer/Caveat: This is a personal blog, and all opinions within are my own and are not necessarily shared by my employers, Memset.  I provide support for the SquirrelSave service and therefore everything you read here is merely a personal view rather than official Memset opinion or documentation.

Online backups versus traditional backup methodology

Over the past few years, I’ve found online backup systems to be absolutely invaluable alongside backing up to DVD and Blu-Ray, as well as using external hard drives.  An online backup account allows you to instantly retrieve a deleted file from the Internet much faster than it takes to find the right discs, put them into the drive (or hook up the right external drive) and then copy the files across.

Additionally, with historical online backups, you can delete a file – forget about it for 30 days or more, and then suddenly realise that you need it again.  Big problem if you’re simply dumping/overwriting the contents of a backup on a hard drive.  Your physical backup may also die when you least expect it.  DVDs and Blu-Rays have a limited shelf life, and hard drives are quite prone to failing at any time for any reason.  Online backup services could be seen, in my eyes at least, to be like an extra insurance policy against both your computer and your physical media backups from failing.

Where SquirrelSave steps in

The service that I provide support for, SquirrelSave, has been successfully running for the past few years.  The datacentres in which data is stored are based in Reading, UK.  All data to and from the datacentres is encrypted between your computer and the backup server, and the filesystem in which your backups are stored is also encrypted.  But the real beauty and major advantage of SquirrelSave, for me, over all the other online backup providers (Jungle Disk, Mozy, Humyo, Carbonite, Backblaze, etc.) is that it’s based around existing open source software.  SquirrelSave essentially provides a GUI wrapper around SSH, rsync and SCP.

With SquirrelSave you define your Include and Exclude lists within the GUI (SquirrelSave ships with a set of sensible defaults – generally your C:\Users\<username> directory is set for backup, and many temporary/system directories are set for exclusion[1]) and then hit Start Full Backup.  This kicks off the long backup process which can take several days to several weeks depending on how fast your broadband provider’s upload speed allows[2].  You can specify a limit to the amount of bandwidth SquirrelSave uses if you find that Cedric the Squirrel is feasting a bit too much on your uploads.

Examining backed up data or restoring is simplicity in itself.  While SquirrelSave does not provide a web based interface for this, it does include the WinSCP client that makes it easy to navigate through the backup server directories to recover your files.  It is then simply a case of dragging and dropping directories and/or files over to your hard drive to restore them.  SquirrelSave also has multiple historical backups, so that if you do delete a file from your machine, you can restore a file from 2,4,6,12,14, etc. days ago (the historical data doubles each time).

I’ve used SquirrelSave myself both at work and at home to recover files that I’ve been stupid enough not to back up manually first.  The most recent case was when I had to reinstall the Macbook due to serious rainbow beach ball issues upon start-up.  I recovered all of my documents, SSH keys, etc. within a matter of minutes of installing the SquirrelSave client.  Note: the Mac SquirrelSave client is still in development/testing at this time.

SquirrelSave Tip #1

If you see “Some files not completely transferred (23)” when performing a SquirrelSave backup, don’t worry.  This indicates that somewhere within your Include list, you’re backing up temporary files which existed when SquirrelSave (or rather, rsync) was compiling it’s list of files to back up.  By the time the backup started, those files were deleted or moved.

Restoring files to a new PC

There’s no right or wrong way of restoring files to your new/replacement PC.  But there are several ways of doing so.  My suggestion would be to ensure that you keep a backup of your local SquirrelSave config directory.  This is located (on Vista and 7 machines) under C:\Users\<yourusername>\AppData\Roaming\SquirrelSave.  I’d make sure that you’re using something like WinZip, PowerArchiver or any ZIP utility to back up the contents of this directory and keep it safe.  Not a problem if you forget to do this, as you can restore without this data – but any customisations made to your Include and Exclude tabs will be lost.

On the new PC,  if you’ve kept the config files, then restore them to the same path as was on your old PC.  Install SquirrelSave.  If you don’t have the config files, you’ll be prompted to login and run the configuration file from your SquirrelSave online web account.  If this is the case it is VITAL that you pause/select backup later when prompted.  You do NOT want SquirrelSave to start backing up your new PC just yet.

Once SquirrelSave is installed and configured, you can then use the View Backup button to connect to your files and then copy them over to your new PC. 

IMPORTANT NOTE: If you do not want SquirrelSave to back up these files again, or delete the contents of the current directory hierarchy on the backup server – make sure you copy these files back to the same paths on your new PC as before.  If you put files into different directories, SquirrelSave will think these are new and back them up.  Eventually the files in the old folders on the backup server will be deleted.  So files and folders must be like-for-like on the new PC if you wish to avoid these issues.

Once the files have been restored, you can unpause SquirrelSave and it’ll start to back up your new PC.

SquirrelSave Tip #2

The more advanced SquirrelSave user can use any SCP client to connect to their backup store.  Your private key is stored as ssh_key in the config directory (see above), and you can use this to connect to the backup store (the host that you need to connect to is formed from your SquirrelSave username, followed by .backup.squirrelsave.com).

There you have it.  SquirrelSave is a safe, easy-to-use, online backup service which costs just £4.95 + VAT per month (with 30 day money back guarantee) for unlimited storage.  While it is offered and supported on the Windows platform (XP, Vista or 7) at the moment, it WILL be expanded to the Mac and Linux platforms in due course.

If you need assistance with SquirrelSave, please do NOT contact me directly here – please use the official support email of support@squirrelsave.com.  We aim to reply within 2 hours of receiving your email (Monday-Friday in office hours).

Footnotes

[1] Users of Microsoft Outlook will need to explicitly declare the path to their PST files as SquirrelSave exlcludes the AppData path by default (this is because it can contain a LOT of unnecessary data).  To backup Outlook data on a Windows Vista/7 machine, you’d need to include C:\Users\<yourusername>\AppData\Local\Microsoft\Outlook within your SquirrelSave Include tab.

That said, I HIGHLY recommend Outlook users consider buying a copy of AJ Systems OutBack Plus 97 which can bundle Outlook configuration and PST files into a single file, as well as other Windows application preferences.  The resulting file can then be backed up by SquirrelSave quickly and easily.

[2] I’ve found that Virgin Media customers are seriously disadvantaged due to the peak usage caps that they place on customers.  I would advise that Virgin customers seek another broadband provider if you’re wanting SquirrelSave or other online backup provider – regardless of whoever you choose, you will see major delays in uploading your data versus other providers who do not impose such limits.

How does one plan for long term archival of photos, video, etc?

Posted by – July 17, 2009

Reading Robert Llewellyn's tweets about his shiny new Drobo desktop RAID hard drive cluster, I was wondering just what people are doing about long-term archiving their photos, videos and other important valuable data? 

Back when I was working in the film industry, we were using near-line storage and tape backups to archive assets.  For the most part, this worked okay, but required a heck of a lot of room, was very complex (one full time person dedicated to the job) and during my time there, the kit evolved at least three times.  When I was working at previous web hosting companies/ISPs we used tape backups.  The type of tapes we used are now redundant and about as much use as a betamax video.

When I've been shooting video, I had been using Mini-DV for both SD and HD material.  Unfortunately I no longer have access to a Mini-DV system because my own camcorder has died (so I would need to repair or buy a new one) and the HD stuff used a specific encoding system.  If I back up what material I've transferred to DVD or Blu-Ray, I'd have a limited shelf life of around 100 years before the surfaces started to deteriorate and a new medium found.  These days I shoot on SDHC cards, but even these are evolving and new formats coming out all the time.

I like Blu-Ray as an archiving medium at the moment, but (a) it's too slow to write 50Gb of data, and (b) something's going to take over sooner rather than later as a superior format with a greater amount of capacity.  But at least it's a format that allows me to put all of my iTunes collection and photos onto a single disc.  And that's good enough for me.  At the moment.

The trouble is that storage is constantly evolving.  I no longer have access to a vinyl record player or even normal cassette tapes that we used to buy in bulk to record music from the radio (or if you were like me (probably not), record your own "radio shows" and give them to your friends to listen to – who would then do the same.  Hey, we were cheaper than Jonathan Ross back then).

The trick is to find a medium which is going to last, can be passed down the generations, and not cause our future relations to have to resort to building a tape, DVD or HD player from scratch to play their ancestor's video of a day trip to Canvey Island.

A prime case of rapidly evolving technology being a right pain in the arse.

The joys of Windows and RAID 0..

Posted by – May 15, 2009

Dell are sending out a replacement hard drive for the laptop. 

This necessitates I break the RAID 0 mirror and re-install Windows and everything else again.  At least I have a Blu-Ray writer to back everything up to it (providing the BD-RE discs arrive in time).  Need to do some video editing this week for Kate, so will have to install the trial version of Premiere Pro.  Should be interesting to see how fast it renders and re-renders video.

Speaking of Blu-Ray, I'm going to be backing up ALL of my old Mini-DV tapes to Blu-Ray disc in the (hopefully) not too distance future.  Does anybody have a MiniDV video camera/playback unit with firewire (or USB at a pinch) they could lend me to do this?  I'm a bit nervous having to use the PCE-1000 unit after the issues last year..

  • Martyn’s Wishlists

  • Martyn's Blu-Ray Wishlist
  • Martyn Interviews..

  • Susanna Clarke (JS&MN)
  • Jane Goldman (Stardust)
  • Martyn’s Tutorials..

  • Unofficial Memset hosting FAQs
  • Running Wordpress with IIS 7.5
  • Using Lighttpd on Ubuntu 10.04LTS
  • Blog hosted by

  • Memset Ltd. on a Memset miniserver
  • Email serviced by

  • Google Apps Premier Edition and
  • MDaemon 11.x
  • Recent Comments

  • Archives

  • Site protected by..

  • Meta