Crazy Texans dunk servers in DEEP FRYERS
Will 2012 be the year of immersive mineral oil cooling?
HPC blog | Vid I first met the Green Revolution guys back at SC09 in Portland, Oregon. As I roamed the exhibit hall, people kept telling me to check out “those guys with the deep fryers full of servers”. At last I found them out in the lobby, which is the kids’ table section of the show.
Above is a quick video of their demo that I shot while they told me about their plans, and why immersive cooling was the next wave (so to speak) in data center cooling. As I walked away I thought, “This is a science project. They’ll either run out of money or get discouraged, and I’ll probably never see them again.” While I do think that liquid cooling in some form is going to make a big comeback, I figured that immersive cooling was probably a step too far, and if it did happen, it would come from a larger and more established company.
The next time I saw them was at SC11 in Seattle – not as a demonstration, but as a key sponsor of the University of Texas Student Cluster Competition team. According to the team, using Green Revolution’s cooling allowed them to put more gear to work and definitely helped them finish near the top of the pack in the competition.
The Texas team gave me a walk-through of their equipment in this video: You can also see them changing out a node in the video attached to this article.
I ran into them again just last week at GTC 2012 (see video interview below): They’ve come a long way since that demo system at SC09. They now have 10U, 42U, and 60U designs that can accept almost any standard 19” rack mount server. Green Revolution technicians only need to strip the fans off of the servers, put a liquid-proof capsule over the hard drives, and replace the thermal grease with a substitute that doesn’t mix with mineral oil.
More importantly for Green Revolution, they now have a reasonably long list of customers and report that they’re fielding new requests for information right and left. A quick look at their website shows that they have culled enough data from these customers to figure out some real-world cost numbers.
For a new data centre (or an extensive retrofit), they figure that going with their immersive solution will result in building costs that are 30 to 40 per cent less than traditional data centres of comparable capacity. These saving arise from the elimination of CRAC units and chillers, plus the ability to use smaller generators, UPS units, and much smaller air conditioning units. When it comes to operating expenses, they calculate that a 20KW (42U) installation will save more than $100,000 in energy and infrastructure costs over a 10-year period.
It’s particularly appropriate that they were at NVIDIA’s GTC 2012 show. Tesla GPUs are incredibly speedy when it comes to processing code, but like everything fast, they generate quite a bit of heat. Users looking to maximise facility and operating efficiency would be well advised to check out immersive cooling. Once you get past your initial “What the hell?” reaction, you’ll see how it could make a lot of sense for particular situations. If you already see its potential dividends, then maybe you’re ahead of the wave. ®
Synthetic 'silicone' oils are not flammable and are well established for use in heat baths. In fact, you could put a fire out by throwing silicone oil over it. They may be more expensive than 'chip fat' but this is ok since the oil is not used up or degraded by this cooling application.
Re: Not new and not green
Agreed this idea has been around for many decades, military and industrial use of oils, flouronert etc are common and old.
You miss the power calculations though, they didn't just remove the fans on the PC, they can also remove or severely downsize the HVAC/CRAC cooling units for the Data Center room, and the result of that is the ability to reduce the sizing on the UPS units. Both of these factors result in a large amount of savings, there are much better ways than the proposed to solve this....but I can't give away all my good ideas for free... :-)
They have several problems with their demo:
Mineral oil doesn't remove heat, it absorbs it (to a point) and then releases it into the room its housed in. This works great for home PC's that you heat up all evening playing games, and then cool down overnight, but would be terrible for a non-stop international supporting data center. They are glossing over that their demo is in a giant super AC cooled exhibit room.
Mineral oils also tend to work the stickers off of the MB, cards etc. Easy enough to remove these by hand for 20 servers for a demo, but not a realistic practice for 20,000 servers in a data center.
Also their Data Center would have to be a like a clean room, the open top would attract dust, hair etc and would become murky and dirty, and that could clog any pumps fans etc that are used to circulate the mineral oil over the hotter parts of the PC (PSU and CPU)
Liquids are like 3000 times more effective at cooling than air though.
I've seen working models, and proposals for liquid metals for cooling (not direct contact of course) alcohol (yikes) and many other industrial chemicals including and similar to flouronert.
Still good on them for trying and making people think
... how many people, when presented with a working device, come on a comments board to point out how it will never work.
Oil cooling has been around for many years. The downsides are well known. There may be savings to made for the right kind of installation. Get over it.