Original URL: http://www.theregister.co.uk/2006/08/03/plusnet_loses_deleted_emails/
PlusNet has today admitted that it will not be able to restore 700GB of lost customer emails. Never. Ever.
A PlusNet engineer accidentally deleted the emails on Sunday 9 July and the company has been struggling to restore them ever since.
That struggle is now over.
The PlusNet site explains why it has taken so long to (not) sort things out. The screw-up involved a Sun NAS device which runs on StorageTek's proprietary operating system which meant data recovery experts had to alter the tools they usually use.
Other than the weird operating system it said the biggest problem was caused by the unfortunate engineer's first attempt to fix the original mistake.
The engineer tried to recover the data by creating a volume of the same size, and in the same place, as the first volume - "an old sysadmin trick", PlusNet tells us. But the system uses the first volume to create a master inode - essentially a map of where all the other data is kept. Because this was deleted, finding the rest of the data in the second and third volumes is very difficult.
They did get some information back from these other volumes but without the master inode it is all but impossible to tell which emails belong to who.
Within three hours the Sun NAS was on its way to data recovery specialists.
A statement on the PlusNet website claims that half of the email was spam and that 48 per cent of it had already been read - leaving just one or two per cent of actual deleted unread email.
PlusNet is now getting its Sun kit back so it get on with setting up a new email storage system.
Here is the explanation (http://usertools.plus.net/status/archive/1154603560.htm) from PlusNet. There is a more technical description of what went wrong on ADSLguide here. (http://bbs.adslguide.org.uk/showthreaded.php?Cat=&Board=plusnet&Number=2600008) ®
PlusNet blasts email into blackhole (again) (23 August 2007)
http://www.theregister.co.uk/2007/08/23/plusnet_deletes_again/
PlusNet shuts down webmail indefinitely (16 May 2007)
http://www.theregister.co.uk/2007/05/16/plusnet_webmail_shut/
Spammers stuff PlusNet email accounts (again) (15 May 2007)
http://www.theregister.co.uk/2007/05/15/plusnet_spam_attack_may/
PlusNet just wants to be loved - again (13 April 2007)
http://www.theregister.co.uk/2007/04/13/plusnet_comeback_packages/
Plusnet servers stuffed by spam (3 April 2007)
http://www.theregister.co.uk/2007/04/03/plusnet_email_spam_downtime/
PlusNet goofs on passwords (7 February 2007)
http://www.theregister.co.uk/2007/02/07/plusnet_passwords/
PlusNet email goes adrift (8 January 2007)
http://www.theregister.co.uk/2007/01/08/plusnet_email_problems/
BT bids for PlusNet (16 November 2006)
http://www.theregister.co.uk/2006/11/16/bt_bids_plusnet/
BT sniffs at PlusNet (12 October 2006)
http://www.theregister.co.uk/2006/10/12/bt_plusnet/
PlusNet goes offline (17 August 2006)
http://www.theregister.co.uk/2006/08/17/plusnet_down_again/
PlusNet deletes more customer info (16 August 2006)
http://www.theregister.co.uk/2006/08/16/plusnet_deletes_cgi/
PlusNet shares bounce on results (2 August 2006)
http://www.theregister.co.uk/2006/08/02/plusnet_good_results/
Oops! PlusNet's Force 9 blows email gale (26 July 2006)
http://www.theregister.co.uk/2006/07/26/plusnet_emails_customer_details/
PlusNet hit by storm in a forum (20 July 2006)
http://www.theregister.co.uk/2006/07/20/plusnet_complains/
PlusNet obliterates customer emails (11 July 2006)
http://www.theregister.co.uk/2006/07/11/plusnet_email_fiasco/
PlusNet slips out 'basic' broadband (31 May 2006)
http://www.theregister.co.uk/2006/05/31/plusnet_broadband/
© Copyright 2008