Feeds

Grid computing from Sun

Open Source and proud of it

  • alert
  • submit to reddit

HP ProLiant Gen8: Integrated lifecycle automation

newsforge logo Sun's open source Grid Engine software currently runs over 7000 grids with an average of 47 CPUs per grid, and a steadily increasing percentage of the grids it powers run Linux, according to John Tollefsrud, Sun's Grid marketing manager.

This is not a Sun software product that gets as much press or visibility as Java, and the 21,000+ Grid Engine download total (as of November 29, 2002) hardly compares with the hundreds of thousands of downloads per month the Sun-sponsored OpenOffice project boasts. But in some ways, in the long run, Grid Engine may be as influential as these other, higher-profile projects.

There's also a commercial Grid Engine Enterprise Edition available for companies that want to spend money on the software (and on support contracts) instead using the free, open source version which, according to Tollefsrud, runs exactly the same code.

The product was originally proprietary, but Sun released it as open source two years ago. "Here's commercial grade software that used to be sold as a revenue product, now open source but still being developed by Sun," says Tollefsrud.

Sun's grid computing product is designed to be used primarily in a department-sized corporate environment. It runs a daemon on each (Unnix or Linux) computer in your network, and when you have a computationally intensive task to perform, it grabs unuused CPU cycles from the appropriate computers and uses them. You can set parameters for each task, like "Linux machines only" or "Only use this group of computers between 'X' and 'Y' hours," or whatever else suits your fancy.

The point is to make sharing computational resources across a grid not only efficient, but easy. Tollefsrud points with special pride to one user, Axyz Animation, Inc. because, he says, "They're not Disney or Lucas, just a small shop that needs to concentrate on animation, not worry about the computing behind it."

Increase Resource Utilization

Tollefsrud says Sun has about 6000 CPUs set aside for chip design, and "these CPUs run over 90% usage, while average CPU utilization is in single digits."

(The Linux computer on which this story is being written is currently averaging below 5% CPU usage.)

Obviously, the more "bang" you can get out of each CPU you own, the better. The savings from efficient CPU use are not obvious -- and may not even be measurable -- in most home or office environments, but when you get into large-scale technical computing or graphics rendering they add up quickly. According to Tollefsrud, the financial service industries are jumping all over grid computing; they have boxes that work hard at transaction-type tasks during office hours, but do little or nothing the rest of the time. Why not use that "down" time to work on portfolio analyis and other tasks that take large calculations, but don't need to be completed in real time but can wait for an overnight run?

Sorry, we don't do Windows

Grid Engine Enterprise Edition is available for Solaris and Linux. Since these are the two operating systems Sun sells, this should not come as a surprise. The open source version has been adapted by users for just about all known Unix variants, including Mac OS X. There has been some discussion about doing a Windows port -- not officially sanctioned by Sun -- but so far it is just at the "talk" stage. Right now, if you want to build a an "office network by day, supercomputer by night" computer array, you are going to have to use Linux or Unix or some combination of the two.

This is yet another argument for Linux on the desktop -- especially in financial and science-type companies.

Not quite "plug in" worldwide grid computing yet

That's a nice dream, and a lot of people have written interesting academic papers about how it's going to change the world when it finally happens, but there are a lot of steps that need to be taken between now and then. Security is one of the biggest problems, and is likely to remain one for more than a few years to come.

But this is today, and Sun's Grid Engine is here today, concentrating on department-level computational resource sharing, complete with algorithms to calculate which users are using the grid most and which ones are contributing the most resources to it, a feature needed by corporate and government bean counters who decide what percentage of which computing budget needs to come from which group or department.

Grid computing is getting easier all the time

Not long ago -- just a few years -- setting up computer clusters and grids was a rough job. Now, with software like Sun's Grid Engine and other packages available, it is not an overly intimidating process, at least for professional sysadmins.

"The people that have deployed most of these grids [using Sun Grid Engine]... they didn't have Sun come out and do it for them," says Tollefsrud. "They did it themselves. It's not that hard." © Newsforge.com.

Reducing security risks from open source software

More from The Register

next story
Sysadmin Day 2014: Quick, there's still time to get the beers in
He walked over the broken glass, killed the thugs... and er... reconnected the cables*
SHOCK and AWS: The fall of Amazon's deflationary cloud
Just as Jeff Bezos did to books and CDs, Amazon's rivals are now doing to it
Amazon Reveals One Weird Trick: A Loss On Almost $20bn In Sales
Investors really hate it: Share price plunge as growth SLOWS in key AWS division
US judge: YES, cops or feds so can slurp an ENTIRE Gmail account
Crooks don't have folders labelled 'drug records', opines NY beak
Auntie remains MYSTIFIED by that weekend BBC iPlayer and website outage
Still doing 'forensics' on the caching layer – Beeb digi wonk
BlackBerry: Toss the server, mate... BES is in the CLOUD now
BlackBerry Enterprise Services takes aim at SMEs - but there's a catch
The triumph of VVOL: Everyone's jumping into bed with VMware
'Bandwagon'? Yes, we're on it and so what, say big dogs
Carbon tax repeal won't see data centre operators cut prices
Rackspace says electricity isn't a major cost, Equinix promises 'no levy'
prev story

Whitepapers

Designing a Defense for Mobile Applications
Learn about the various considerations for defending mobile applications - from the application architecture itself to the myriad testing technologies.
Implementing global e-invoicing with guaranteed legal certainty
Explaining the role local tax compliance plays in successful supply chain management and e-business and how leading global brands are addressing this.
Top 8 considerations to enable and simplify mobility
In this whitepaper learn how to successfully add mobile capabilities simply and cost effectively.
Seven Steps to Software Security
Seven practical steps you can begin to take today to secure your applications and prevent the damages a successful cyber-attack can cause.
Boost IT visibility and business value
How building a great service catalog relieves pressure points and demonstrates the value of IT service management.