Feeds

Amazon web services customers vent spleen

Cloud giant says sorry for outage and resulting issues

Choosing a cloud hosting partner with confidence

Vulnerabilities in Amazon's web services that were exposed after lightning hit power supplies at the weekend have led to stinging criticism from some customers.

The bolt knocked out the utility and back-up generators in Dublin, causing a blackout which took down the Elastic Cloud Compute (EC2) and Relational Database Services (RDS).

Efforts to bring EC2 back online were delayed as the Elastic Block Storage (EBS) servers required manual operations before they could restore customer volumes, while making extra copies of data sucked up capacity, meaning it needed to find extra juice elsewhere.

Amazon said on Monday it would resolve the process in 48 hours but wrote to customers yesterday informing them it had discovered an error in EBS software which "incorrectly deleted" one or more blocks when cleaning snapshots.

"The root cause was a software error that caused the snapshot references to a subset of blocks to be missed during the reference counting process," the company said.

Snapshots containing the missing blocks were disabled and copies of affected snapshots have replaced the empty blocks.

"We apologise for any potential impact this might have on your applications," Amazon said.

On its services health board today, the US firm described its EC2 services as still having connectivity issues.

One customer said his data contained significant numbers of "trashed blocks". Fortunately he had migrated to a virtual server at another hosting firm, so he deleted the snapshots and breathed "a sigh of relief", but warned it could have been worse if he had relied on EBS snapshot for backups.

"This just goes to confirm my own assessment, which is that AWS is not suitable for small-scale deployments. The economies of scale and price/performance just don't work at the low end.

"They are much more suitable for large scale deployments where service provision and backups can be split across multiple availability zones. It also serves as a reminder not to put all one's eggs into one basket," he said.

Another agreed, "There is clearly a massive defect in the multi-availability zone products."

The master database instances hosted in areas unaffected by the Dublin incident were "taken down by their slaves being hosted inside the affected zone", said another source.

One customer summarised the situation as "if you stored your backup in the cloud too, [Amazon] hosed it".

Security for virtualized datacentres

More from The Register

next story
It's Big, it's Blue... it's simply FABLESS! IBM's chip-free future
Or why the reversal of globalisation ain't gonna 'appen
'Hmm, why CAN'T I run a water pipe through that rack of media servers?'
Leaving Las Vegas for Armenia kludging and Dubai dune bashing
Bitcasa bins $10-a-month Infinite storage offer
Firm cites 'low demand' plus 'abusers'
Facebook slurps 'paste sites' for STOLEN passwords, sprinkles on hash and salt
Zuck's ad empire DOESN'T see details in plain text. Phew!
CAGE MATCH: Microsoft, Dell open co-located bit barns in Oz
Whole new species of XaaS spawning in the antipodes
Microsoft and Dell’s cloud in a box: Instant Azure for the data centre
A less painful way to run Microsoft’s private cloud
AWS pulls desktop-as-a-service from the PC
Support for PCoIP protocol means zero clients can run cloudy desktops
prev story

Whitepapers

Why cloud backup?
Combining the latest advancements in disk-based backup with secure, integrated, cloud technologies offer organizations fast and assured recovery of their critical enterprise data.
A strategic approach to identity relationship management
ForgeRock commissioned Forrester to evaluate companies’ IAM practices and requirements when it comes to customer-facing scenarios versus employee-facing ones.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.
New hybrid storage solutions
Tackling data challenges through emerging hybrid storage solutions that enable optimum database performance whilst managing costs and increasingly large data stores.