Feeds

Demon ends porn-less Internet Archive block

Be, Virgin - collateral damage

Beginner's guide to SSL certificates

British ISP Demon Internet is no longer blocking access to the Internet Archive's Wayback Machine, after working in tandem with the IA to correct a "technical issue" with its child-pornography filter.

Earlier this week, multiple Demon customers complained they were unable to access the Wayback Machine, an 85-billion-page web history dating back to 1996. Attempts to retrieve archived webpages were met with error pages whose urls pointed to Demon's child porn filter, based on a blacklist compiled by the not-for-profit Internet Watch Foundation.

The IWF soon confirmed that its blacklist contains at least one image hosted by the Wayback Machine. But although IWF filters are typically designed to block individual pages, Demon's filter seemed to be blocking the entire archive.

In a statement tossed our way, Thus Cable & Wireless - the owners of Demon Internet - now say they have resolved the problem. "We will continue to work closely with the IWF and others to ensure the safety and security of all web users and address any technical issues, should they arise, in order to deliver the best service to our customers," the statement reads. "In this instance, the technical issue, an obscure software bug brought to light by the interaction of our filtering technology and the Internet Archive's servers, has been identified and resolved."

The company did not elaborate, but a senior engineer with the company has provided an explanation on a newsgroup where users have discussed the blocking. According to this post, Demon customers were unable to access large parts of the Wayback Machine because of the way Demon's IWF filter interacted with the web cache used by the IA to speed access.

Because at least one Internet Archive page is blacklisted by the IWF, Demon uses a proxy server each time a user requests info from the IA's servers. If a user requested a page that had not been cached by the IA, Demon's proxy had a way of mucking with the caching process. When creating a url for the cached page, IA servers were inserting the proxy's name: iwfwebfilter.thus.net.

This created cache urls that did not point to webpages. And so, more often than not, Demon customers received error pages when attempting to access the Wayback Machine. And because the bogus urls remained in the IA cache, it meant that error pages appeared when surfers on other ISPs attempted to access the same content.

Which explains why some Be Unlimited and Virgin Media customers were having problems with the Wayback Machine.

"A page with the iwfwebfilter.thus.net URLs could be cached and then served up to non-Demon customers, which explains...other reports of people who'd not been anywhere near the Demon caches seeing 'iwfwebfilter.thus.net' where they'd been expecting 'web.archive.org,'" reads the post from that Demon engineer.

Be and Virgin have both told The Reg that their IWF filters have not causing problems with Wayback access. The Internet Archive has not responded to requests for comment.

Last month, IWF-based filters created a similar problem with Wikipedia, a free encyclopedia/online cult. But this issue was resolved when the IWF decided to remove a controversial Wikipedia url from its blacklist. ®

Intelligent flash storage arrays

More from The Register

next story
TEEN RAMPAGE: Kids in iPhone 6 'Will it bend' YouTube 'prank'
iPhones bent in Norwich? As if the place wasn't weird enough
Consumers agree to give up first-born child for free Wi-Fi – survey
This Herod network's ace – but crap reception in bullrushes
Crouching tiger, FAST ASLEEP dragon: Smugglers can't shift iPhone 6s
China's grey market reports 'sluggish' sales of Apple mobe
Sea-Me-We 5 construction starts
New sub cable to go live 2016
New EU digi-commish struggles with concepts of net neutrality
Oettinger all about the infrastructure – but not big on substance
EE coughs to BROKEN data usage metrics BLUNDER that short-changes customers
Carrier apologises for 'inflated' measurements cockup
Comcast: Help, help, FCC. Netflix and pals are EXTORTIONISTS
The others guys are being mean so therefore ... monopoly all good, yeah?
Surprise: if you work from home you need the Internet
Buffer-rage sends Aussies out to experience road rage
prev story

Whitepapers

A strategic approach to identity relationship management
ForgeRock commissioned Forrester to evaluate companies’ IAM practices and requirements when it comes to customer-facing scenarios versus employee-facing ones.
Storage capacity and performance optimization at Mizuno USA
Mizuno USA turn to Tegile storage technology to solve both their SAN and backup issues.
High Performance for All
While HPC is not new, it has traditionally been seen as a specialist area – is it now geared up to meet more mainstream requirements?
Beginner's guide to SSL certificates
De-mystify the technology involved and give you the information you need to make the best decision when considering your online security options.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.