Feeds

Scroogle resurrected once again

Private Google scraper in SCO-like refusal to die

Build a business case: developing custom apps

Scroogle has once again returned from the dead, continuing to serve up its privacy-friendly Google search results after another programming tweak from founder Daniel Brandt.

Brandt and the not-for-profit Scroogle have been scraping Google search results since 2002, allowing netizens to use Mountain View's search engine without being tracked by the company. But in May, after Google removed an interface page where Brandt was scraping results, the service went offline. It returned a day later, as Brandt tapped a slightly different interface, only for this interface to vanish as well.

Originally, Brandt said he was unlikely to find another means of simply and reliably scraping Google, but he has now settled on a fix — though it's a bit more bloated than the old setup. "It's back up, and it looks like the old Scroogle to everyone. But I'm not a happy camper," he tells The Reg. "I finally spent two days reprogramming my parser in Scroogle...I do not like the extra bloat because the six dedicated servers I lease have monthly quotas for bandwidth."

Scroogle is run entirely with donations. You can support the cause here.

The service originally scraped results from an interface at google.com/ie, which Google built for use inside the sidebar offered by Internet Explorer 6. If you installed the Google Toolbar with IE6 and chose Google as the default search engine, google.com/ie would provide search results in the window that popped up on the side of the browser. These results had to be simple because the sidebar was small.

But as Google phased out all sorts of support for IE6, it did away with this interface. After google.com/ie went offline in May, Brandt was able to replicate his setup via another page — google.com/search — by adding an IE parameter ("&output=ie") to the url. But last week, this disappeared as well.

At Google's annual developer conference in May, über-Googler Matt Cutts indicated that Google was not specifically targeting Scroogle when it removed the google.com/ie interface. And it would appear that the same applies to the "&output=ie" interface.

In any event, Brandt has now switched to another method that still provides 100 results per page, does not include Google's "Universal" search results, and sidesteps Google's ads. "A Scroogle user discovered how to get generic results, without ads, and 100 at a time. It was a completely different format than the &output=ie interface, but at least it was merely three times more bloated," Brandt says. ®

Build a business case: developing custom apps

More from The Register

next story
Assange™: Hey world, I'M STILL HERE, ignore that Snowden guy
Press conference: ME ME ME ME ME ME ME (cont'd pg 94)
Premier League wants to PURGE ALL FOOTIE GIFs from social media
Not paying Murdoch? You're gonna get a right LEGALLING - thanks to automated software
Online tat bazaar eBay coughs to YET ANOTHER outage
Web-based flea market struck dumb by size and scale of fail
Amazon takes swipe at PayPal, Square with card reader for mobes
Etailer plans to undercut rivals with low transaction fee offer
US regulators OK sale of IBM's x86 server biz to Lenovo
Now all that remains is for gov't offices to ban the boxes
XBOX One will learn to play media from USB and DLNA sources
Hang on? Aren't those file formats you hardly ever see outside torrents?
Class war! Wikipedia's workers revolt again
Bourgeois paper-shufflers have 'suspended democracy', sniff unpaid proles
prev story

Whitepapers

Endpoint data privacy in the cloud is easier than you think
Innovations in encryption and storage resolve issues of data privacy and key requirements for companies to look for in a solution.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Solving today's distributed Big Data backup challenges
Enable IT efficiency and allow a firm to access and reuse corporate information for competitive advantage, ultimately changing business outcomes.
Reg Reader Research: SaaS based Email and Office Productivity Tools
Read this Reg reader report which provides advice and guidance for SMBs towards the use of SaaS based email and Office productivity tools.