Feeds

Yahoo! open sources uber web server

'400-terabytes-a-day' Traffic Server lands at Apache

Secure remote control for conventional and virtual desktops

Yahoo! has open sourced the back-end software platform that underpins the company's webmail client and countless other applications offered up across its sweeping web portal.

Known as Traffic Server, the platform handles general edge caching, edge processing, and load balancing at Yahoo!, but it's also used to manage traffic on the company's internal storage and server-virtualization services.

"It's used at the edge, but it also gets used almost like an application server," Chuck Neerdaels, Yahoo! vp of content storage, delivery, and edge, tells The Reg. It serves up the latest version of Yahoo! Mail, for instance, which the company calls "Candy Gram."

Acquired with Yahoo!'s purchase of Inktomi, Traffic Server has been in active use at the two companies for the past eight years. According to Yahoo!, it now handles 30,000 requests per second, serving 30 billion Web objects and 400 terabytes of data a day.

"It is a very mature, very reliable piece of technology," says Shelton Shugar, Yahoo!'s senior vp of cloud computing. "In some form, it supports more than half of Yahoo!'s traffic."

The company donated a version of the platform to The Apache Software Foundation last week through the Apache Incubator program. "This is part of our overhaul strategy to open source cloud services that are mature and not laden with Yahoo!-specific stuff that wouldn't make sense for open source," says Shugar.

In June, the company open sourced its internal Hadoop distro, an internet-scale distributed data-crunching platform based the Apache project of the same name.

Neerdaels says Traffic Server was originally designed as a proxy cache. But it's Yahoo!'s go-to tool for http session management, and it includes an API for tweaking content all the way down at the protocol level. "You can poke around with various headers and inject content and direct client requests to different backends, all through a relatively clean API," he says.

Neerdaels and Shuger also describe Traffic Server as an "extensible framework" that lets you tweak the architecture according to the task at hand. And, according to the company, it suits web operations both large and small. "It's simple enough for a small operation to pick it up quickly," says Neerdaels. "But the big players can pick it up and it will scale to meet their needs pretty impressively."

Those 400 terabytes are served up from between 100 and 150 "commodity" machines. ®

Security for virtualized datacentres

More from The Register

next story
Microsoft WINDOWS 10: Seven ATE Nine. Or Eight did really
Windows NEIN skipped, tech preview due out on Wednesday
Business is back, baby! Hasta la VISTA, Win 8... Oh, yeah, Windows 9
Forget touchscreen millennials, Microsoft goes for mouse crowd
Apple: SO sorry for the iOS 8.0.1 UPDATE BUNGLE HORROR
Apple kills 'upgrade'. Hey, Microsoft. You sure you want to be like these guys?
ARM gives Internet of Things a piece of its mind – the Cortex-M7
32-bit core packs some DSP for VIP IoT CPU LOL
Microsoft on the Threshold of a new name for Windows next week
Rebranded OS reportedly set to be flung open by Redmond
Lotus Notes inventor Ozzie invents app to talk to people on your phone
Imagine that. Startup floats with voice collab app for Win iPhone
prev story

Whitepapers

Forging a new future with identity relationship management
Learn about ForgeRock's next generation IRM platform and how it is designed to empower CEOS's and enterprises to engage with consumers.
Storage capacity and performance optimization at Mizuno USA
Mizuno USA turn to Tegile storage technology to solve both their SAN and backup issues.
The next step in data security
With recent increased privacy concerns and computers becoming more powerful, the chance of hackers being able to crack smaller-sized RSA keys increases.
Security for virtualized datacentres
Legacy security solutions are inefficient due to the architectural differences between physical and virtual environments.
A strategic approach to identity relationship management
ForgeRock commissioned Forrester to evaluate companies’ IAM practices and requirements when it comes to customer-facing scenarios versus employee-facing ones.