Peter Gabriel cranks his f*ck machine
Meet the website promising to defy the tyranny of choice
Updated The Filter wants to be your internet friend. And unlike Facebook, it wants to help you ignore all the morons, self-broadcasters and general noisy bombardment that characterises the modern web experience.
The pitch is simple. Web users are presented with limitless entertainment choices, and the majority of them are rubbish. To most of us, at least 90 per cent of the sound and video available online is utter tosh, although which 90 per cent naturally varies according to taste. The Filter promises to intelligently sift through all those songs, movies and TV shows to generate a more palatable daily media diet.
The Filter's hipster-friendly start page
The site's been in private beta for a while, and in April got some early loving  in the US media. On Tuesday it opened to the hoi polloi and staged a launch for mainstream and web-fancying UK press in London.
Amid the throng of crappy web start-ups, long overdue a cull (we're polishing our "titsup 2.0" headlines daily in preparation), The Filter has star power thanks to the involvement of former Genesis frontman-turned-web-entrepeneur Peter Gabriel.
The Filter's auto-critic is based on Bayesian mathematics, a branch of probability that has come to be used widely in attempts at artificial intelligence such as anti-spam tools and genetic sequence processing.
Bayesian inference can combine background data with a few points of evidence to work out the probability of an unknown. The Filter's background data for music recommendation is 50 million sales and playlists imported from the Nokia store and MSN music. Its evidence is the preferences you give it when you sign up, which it uses to estimate whether you'll like, say, Peter Gabriel if you like Genesis (probably).
Gabriel is mostly acting as the public figurehead of the operation, while also providing financial and evangelical backing, like a wealthy musical Buddha. He told El Reg: "If you look at the major religions, freedom from choice is something people often choose voluntarily. It allows people to look in themselves." Blimey.
The Bayesian algorithm generates a raw list of recommendations, which is then passed through a series of user-adjustable filters (geddit?) designed to allow for mood.
It's a subtly different approach those used by fellow music recommendation engine Last.fm, owned by US conglomerate CBS. The Filter claims testing has shown its mathematical approach produces superior recommendations to Last.fm's community-based "wisdom of crowds" (ahem) kung fu. Unlike CBS, The Filter doesn't have full song licensing deals with record labels, however, so for now acts less as a personal radio station and more as jump-off point.
The Filter's ambitions go beyond music though. At launch there's movie and web video (think cats playing piano on YouTube, not Doctor Who on iPlayer) recommendations. We're promised TV will be added soon, thought the firm's technical chiefs accept they need more background data to improve recommendations outside the music market.
'Yes, I hate Phil Collins too'
CEO David Maher-Roberts said: "For the Bayesian maths to work we're probably talking about 100-200 pieces of usage data we need to get from one song or film to another and for that recommendation to be of value. You can do it with less but it gets more susceptible to people [in the background data] with strange taste." The eventual plan is cross-media recommendations; like Scorsese movies? You'll probably want to listen to Exile on Main St..
The future-gazing Gabriel wants to see the system extended to cover areas such as events and literature. "We're seeing man and machine merging here, and I think its only just beginning," he said, pitching the potential for a personal "life jockey".
Recommendation engines are nothing new, of course. Since days of dotcom yore Amazon has spammed customers with offers based on their previous purchases. Those who of us have ever bothered to read Amazon's marketing emails might worry that their choices create a kind of feedback loop, reinforcing everyday tastes at the expense of things we've never seen or heard the like of before. The Filter has adopted parallel strategies to nix such onanistic concerns.
One of the user-adjustable filters tweaks how surprised you want to be by the site's recommendations. A second feature, still in development, is currently referred to as the "fuck machine". It allows more adventurous users to effectively mate their tastes to that of a friend, band, magazine or anyone else with an account. The resulting bastard offspring profile will then be pushed through the Bayesian algorithm to build a new probability network.
Development of the Filter's algorithm was initiated and is led by telecoms industry veteran Martin Hopkins, who founded Tertio and flogged it in 1999. The brains behind the algorithm are proud of how they catered for entertainment junkies' tendency to go through phases. They've made a series of tweaks to their algorithm over the last three years designed to help it to "forget".
The idea is that your pretentious Italian cinema phase, or momentary obsession with obscure Japanese noise rock won't end up poisoning the Filter's well of recommendations forever. Amazon remains convinced El Reg ought to be buying Java textbooks, despite the fact we ran away from code more than three years ago and have made plenty of other purchases since.
Not that Amazon cares while it's printing money by selling actual things. Plans to make actual money from The Filter will sound depressingly familiar to anyone who's watched the $1bn+ venture capital that web 2.0 marketing has attracted to the current generation of online start-ups. There'll be targeted advertising and efforts to white-label the algorithm.
Gabriel said: "The technology is something that I want in my life. And I like to gamble." ®
Shortly after this article was published, The Filter  went for a little lie down. At 1.33pm it's promising to be back soon.