Feeds

Scroogle busted again after Google tweak

Private Google scraper on fourth life

Security for virtualized datacentres

Update Scroogle is once again offline after Google made yet another change to the auxiliary web interface the not-for-profit uses to serve up a privacy-friendly version of Mountain View's search engine.

"Here we go again," Scroogle founder Daniel Brandt says in a post to the site. "We regret to announce that Google changed their output format once again." As he looks for a solution, Brandt tells users to "check back in a day or two." He did not immediately respond to a request for comment.

Brandt and Scroogle (www.scroogle.org) have been scraping Google search results since 2002, letting privacy-conscious netizens search Google without being tracked by the web giant. But this past May, after Google removed an interface page where Brandt was scraping results, the service went offline. It returned the next day, when Brandt tapped a different interface, but this interface soon disappeared as well.

Brandt recovered again. But now Scroogle is down for a third time. "The last time this happened was in July, and we were down for five days," he says. "During that time we looked for the simplest remaining Google format we could find, reprogrammed our parser, and ended up with something that worked. However, the file we fetched from Google was three times more bloated for the same information, as compared to the previous format we used, and we are still not happy about this.

"Now it looks like even more bloat. We have to take a closer look at the new format and see if we can program around it."

According to Brandt, his service requires a Google interface that serves up Google results in a relatively simple format. Scroogle is run entirely on donations. There are no ads.

Scroogle originally scraped results from an interface at google.com/ie, which Google built for use inside the sidebar offered by Internet Explorer 6. But as Google killed its support for IE6, it snuffed this interface. Brandt replicated the setup through another page — google.com/search — by adding an IE parameter ("&output=ie") to the url. But then this option vanished as well. And so on.

Google has never attempted to shutdown Scroogle directly. But historically, it seems, there have been conflicting options within the company over how to treat Brandt and Scroogle. Nowadays, the site itself does turn up in Google's search results. ®

Update

Scroogle is now back online. "I have to tolerate more bloat, and there are occasional screw-ups in the parsing...But it is usable," Brandt tells us. "Google's coding gets more complex as the files get more bloated. I'm not sure it's worth trying to clean up what I'm showing now, because I have little faith that Scroogle can last much longer."

Reducing the cost and complexity of web vulnerability management

More from The Register

next story
Phones 4u slips into administration after EE cuts ties with Brit mobe retailer
More than 5,500 jobs could be axed if rescue mission fails
JINGS! Microsoft Bing called Scots indyref RIGHT!
Redmond sporran metrics get one in the ten ring
Driving with an Apple Watch could land you with a £100 FINE
Bad news for tech-addicted fanbois behind the wheel
Murdoch to Europe: Inflict MORE PAIN on Google, please
'Platform for piracy' must be punished, or it'll kill us in FIVE YEARS
Phones 4u website DIES as wounded mobe retailer struggles to stay above water
Founder blames 'ruthless network partners' for implosion
Found inside ISIS terror chap's laptop: CELINE DION tunes
REPORT: Stash of terrorist material found in Syria Dell box
Sony says year's losses will be FOUR TIMES DEEPER than thought
Losses of more than $2 BILLION loom over troubled Japanese corp
prev story

Whitepapers

Providing a secure and efficient Helpdesk
A single remote control platform for user support is be key to providing an efficient helpdesk. Retain full control over the way in which screen and keystroke data is transmitted.
WIN a very cool portable ZX Spectrum
Win a one-off portable Spectrum built by legendary hardware hacker Ben Heck
Saudi Petroleum chooses Tegile storage solution
A storage solution that addresses company growth and performance for business-critical applications of caseware archive and search along with other key operational systems.
Protecting users from Firesheep and other Sidejacking attacks with SSL
Discussing the vulnerabilities inherent in Wi-Fi networks, and how using TLS/SSL for your entire site will assure security.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.