Feeds

HPC > More stories

Hadoop Elephant

Avert your eyes! Hortonworks mates Hadoop beast with SAS

Hadoop company Hortonworks is teaming up with SAS on a strategic partnership to integrate its analytics platform with SAS's suite of data technologies. The alliance was announced on Friday and will give enterprises a "SAS/ACCESS" interface into the Hortonworks Data Platform, which will let them run tools such as Visual Analytics …
Jack Clark, 19 Oct 2013
Elephant

Hadoop 2 stampedes onto world's mega compute clusters

The Apache Software Foundation has branded the data analytics Hadoop platform with version 2 and sent the Elephant-logoed system stampeding out into the wild. The second version of the open-source technology comes with a refreshed compute engine via the YARN data processing and service engine, and the addition of high- …
Jack Clark, 16 Oct 2013
Predator drone, credit Wikipedia

How were your hols, cluster kids? Oh, partied, studied... did we mention WE BUILT DRONES

HPC blog Among the five teams who will be defending America’s Big Iron honour at the upcoming Student Cluster Competition (SCC) are a few students who skipped the keg parties to, er, build, fly, program and optimise the performance of unmanned aerial vehicles. These students will do battle, beginning on 18 November at the SC13 conference …

Students schlep from afar to join the quest for international HPC glory

SCC'13 Three teams of students will be jetting in from overseas to enter this year's Student Cluster Competition, due to kick off on November 18 at the annual SC13 Supercomputing Conference.</p? The teams will be competing in the Big Iron division where undergraduate students design, build, and tune their very own HPC clusters. They’ll …
Team Tsinghua, Overall Winners at the ISC 2012 Student Cluster Competition

Students prep for battle of wits, MIPs and watts: It's student cluster-wrestling time

SCC'13 The countdown is on. Twelve university teams are preparing for another epic battle at the student cluster-wrestling match, the SC13 Student Cluster Competition (SCC). The gig will take place during the 2013 Supercomputing Conference in Denver, Colorado, beginning 18 November. The teams will compete on the SC13 exhibition hall …
A boffin

'Computer GEEKS' snatch NOBEL Prize for chemistry - without using chemicals

Three chemists have been awarded the Nobel Prize in their field, not for arcane experiments with bubbling beakers but for writing software to make computers do all the hard work. "In the 1970s, Martin Karplus, Michael Levitt and Arieh Warshel laid the foundation for the powerful programs that are used to understand and predict …
Iain Thomson, 9 Oct 2013

Cray turns cluster crank with ScaleMP

Does your performance in the datacenter suffer because you don’t have enough memory to really get the job done? Do you have apps that don’t perform well on clusters, or don’t parallelize at all? If this describes you or a loved one, read on, because Cray thinks it has the solution for you. Cray, with partner ScaleMP, recently …
Artist impression of Bristol's quantum chip

Quantum computing gets recursive

When a quantum computer can produce results that would take thousands of years to produce out of a classical computer, an obvious question arises: if you've given the wrong answer, how would you know? That's a question to which University of Vienna boffins have turned their attention to. A computation involving a handful of …

EMC snaps up ex Symantec veep to rule new HPC skunkworks

EMC has recruited an ex-Symantec exec to lord it over its Emerging Technology Products division. His product brief includes "hybrid Cloud Gateways and High Performance Computing storage" which is fine ... except EMC hasn't got any such products. Chirantan “CJ” Desai will be the president of the newly-formed Emerging Technology …
Chris Mellor, 27 Sep 2013

StorNext gets revamp, Quantum claims 5x data throughput boost

Quantum has taken its StorNext file management system and updated it from top to bottom, making it multi-core processor aware and more scalable so it can handle five times more data than StorNext 4. The company says workflows in the digital media and entertainment business are becoming more complex, involving bigger files, …
Chris Mellor, 23 Sep 2013
Hadoop elephant

Apache Foundation embraces real time big data cruncher 'Storm'

The Apache Foundation has voted to accept the “Storm” real time data processing tool into its incubator program, the first step towards making it an official part of the Foundation's open source offerings. Storm aims to do for real time data processing what Hadoop did for batch processing: queue jobs and send them off to a …
Simon Sharwood, 19 Sep 2013

Memory muddle muddies Intel's Exascale ambitions

IDF13 Intel's lofty attempt to make a supercomputer capable of an exaflop by 2020 while consuming a mere 20 megawatts of power is running into major problems due to the pesky laws of physics. When Intel announced its exaflop goal back in 2011, the chipmaking giant talked up a variety of technologies it was bringing to bear on the …
Jack Clark, 14 Sep 2013

The future of PCIe: Get small, speed up, think outside the box

IDF13 The near-ubiquitous PCI Express interconnect – aka PCIe – is finding its way into mobile devices, working its way into cabling, and is on schedule to double its throughput in 2015 to a jaw-dropping 64 gigabytes per second in 16-lane configurations. So said Ramin Neshati, the Marketing Workgroup Chair of the PCI-SIG, when The Reg …
Rik Myslewski, 13 Sep 2013
IBM logo

IBM forges NextScale servers for HPC and hyperscale cheapskates

IDF13 Concurrent with Intel's launch of the "Ivy Bridge-EP" Xeon E5-2600 v2 processors in San Francisco today, Big Blue trotted out its most vanity-free machines to date, the NextScale line. The new systems are designed specifically to compete with low-cost, stripped down alternatives from Hewlett-Packard, Dell, Silicon Graphics, and …
AMD Llano vs Intel Sandy Bridge notebook chips

Wanna boost app speed? Think of the server, and tune 'er to NUMA

HPC on Wall Street The HPC on Wall Street conference was hosted in the Big Apple on Monday, and while there was a lot–and we mean a lot–of talk about big data, one presentation stood out as being potentially much more useful in the long run than all of the big data bloviations. The talk was given by one of the founders of a financial services …
ARM versus Atom

Intel's Avoton Atoms give microservers muscle – and Xeon-class features

With the launch of the "Avoton" Atom C2000 server chips, Intel is putting its second-generation of 64-bit, server-class Atom processors into the field - and what is arguably the first such Atom that is truly designed for modern server workloads. The C2000 has enough computing oomph, enough memory capacity, and integrated memory …

Fujitsu to push 28 nanometer limits with Sparc64 X+

Hot Chips Fujitsu wants to squeeze more performance out of its homegrown Sparc64 X processor for commercial and supercomputing workloads, and it can't wait until Taiwan Semiconductor Manufacturing Corp, its foundry partner, gets 20 nanometer processes into the field and ramped. So the engineers at Fujitsu have gone back over the design …

Intel bakes super-snooper to stop industrial espionage

Intel has created a Hadoop-based rig that analyses just about every network event in the company – four to six billion of them on business days - in close to real time so it can spot threats including industrial espionage. Intel officials declined to name the tool, saying it would not be "productive" to disclose its name, but …
Simon Sharwood, 21 Aug 2013
Hadoop Elephant

Intel adds Lustre support to Hadoop

World+dog agrees that Hadoop is a very fine tool with which to tackle map reduce chores, but the software has a couple of constraints, especially its reliance on the Hadoop Distributed File System (HDFS). There's nothing wrong with HDFS, but its integration with Hadoop means the software needs a dedicated cluster of computers on …
Simon Sharwood, 21 Aug 2013

VLSCI fires up 20 teraflop Barcoo

The Victorian Life Sciences Computation Initiative – VLSCI – has gone live with its latest big iron, Barcoo, an x86 architecture machine with double the capacity of the facility's Merri x86 system. The 70-node Barcoo runs 1,120 Sandy Bridge cores (16 cores per node), with 20 Xeon Phi 5110P cards distributed across ten nodes. …

Cray posts modest loss, awaits Q4 revenue wave

Supercomputer maker Cray turned in a slightly better than expected second quarter, with a modest bump in revenues and a slight loss. This is a win in the ever-choppy supercomputer racket – and particularly for Cray in a second quarter. For the past three years, Cray has been cramming a large portion of its sales in the final …

Nvidia buys Portland Group for compiler smarts

Graphics chip maker Nvidia has big aspirations to get into computing proper with ARM processors and GPU coprocessors, and its odds in its battle against archrival Intel may have just gotten a lot better now that it has snapped up The Portland Group. The financial terms of the acquisition, which has been completed, were not …
What the Tianhe-2 super should look like in its final home

Bugs in beta weather model used to trash climate science

Development work on a not-yet-prime-time weather forecasting model has been seized on as proof that climate models can't be trusted. The reason? Folks who aren't keen on climate change discovered this paper in the journal of the American Meteorological Society, in which Song-You Hong of South Korea's Yonsei University Department …
The XC30 supercomputer, formerly known as Cascade

Cray bags $30m to upgrade Edinburgh super to petaflops-class

It is not much of a surprise, seeing as how the UK's national supercomputing service at the University of Edinburgh is a long-time Cray customer, that they would return to Cray to replace its existing XE6 system and replace it with a petaflops-class machine based on the latest Cray interconnect and Intel processor technology. …
a 42-node cluster of Parallella-16 boards from Adapteva

Adapteva ships Kickstarted baby supercomputer boards

Upstart RISC processor and coprocessor designer Adapteva is shipping the first of its Parallella system boards, which its Epiphany multicore processors with ARM processors to create a spunky and reasonably peppy hybrid compute engine that doesn't cost much and is very energy efficient for certain kinds of processing. It is not …
SKA artists impression

Square kilometre array data heading for AWS cloud

Whether it's weather or Earth or whether an object exists in extra-galactic space, cloud computing disciplines are changing the face of research at facilities such as the National Computing Infrastructure (NCI) and the International Centre for Radio Astronomy Research (ICAR). The National Computing Infrastructure, which during …
lotus F1 team, car front view

How do you drive a supercomputer round a Formula 1 track?

When you arrive at the Lotus F1 Team HQ you’re politely asked not to take pictures without asking first. It soon becomes clear that most of the site is off bounds photographically, so we agree that it’ll be easier all round if our guide, senior account manager Luca Mazzocco, simply tells us when we can take photos. It’s not so …
Joe Fay, 22 Jul 2013

German students get hot 'n' heavy on Coffee Table of Doom

HPC blog My first look at the Chemnitz University of Technology's “Coffee Table of Doom” entry into the recently concluded ISC’13 student cluster-building challenge really gave me pause for thought. Four very large workstations crammed to the brim with 16 accelerators (eight Intel Phi plus eight NVIDIA K20) was something to behold. Two …

Will Jocks strap on beefy ARMs to grapple rival racks next year?

Video When the University of Edinburgh decided to enter the gruelling cluster-building competition for students at this year's International Supercomputing Conference, they didn’t have to look far for hardware suppliers eager to feed their need for speed. The server-wrangling undergraduates turned to UK-based businesses Viglen and …
What the Tianhe-2 super should look like in its final home

Explicit shots: China's gorgeous flop-tastic Tianhe-2 supercomputer

Pics Some of the feeds and speeds of the Chinese government's Tianhe-2 massively parallel ceepie-phibie supercomputer leaked out in May and then even more came out a week later ahead of the planned big splash at the International Super Computing shindig in Leipzig, Germany. But El Reg has some juicy pics of some of the key components …

ISC Student Cluster Competition: The kids are alright

HPC Blog Yet another exciting ISC Student Cluster Competition has moved from the ISC'13 exhibit hall battlefield into the annals of history. Now that we've analyzed the results, let's take a look at the victors and their accomplishments. Highest LINPACK ISC Student Cluster Competition LINPACK test results ISC Student Cluster Competition …

Kluster Kamph results sliced, diced, pulverized

HPC Blog With the dust settling on the ISC'13 Student Cluster Challenge, it's a good time to look back, take stock, and see what we've learned. While traveling recently, I found myself unable to type on my laptop keyboard (after the idiot in front of me reclined into my lap), but I found I could still use the handy track point "nub". So …

South African kids win global cluster glory at HPC fest

HPC blog Our last day's talk with Team South Africa did nothing to tip us off that they were going to be the eventual winner of the entire ISC’13 Student Cluster Challenge. But I wasn’t the only one in the dark – I don’t think they had any idea they had a chance to win it all. Team South Africa displayed their normal good-spirited, fun …
China HPC

Chinese students put feet up after intensive rack-thrashing session

HPC blog The last day of the ISC’13 Student Cluster Challenge found both of the Chinese teams feeling confident. We checked in with Team Huazhong and Team Tsinghua just a few hours before the awards ceremony to see how they felt about the competition and their prospects for victory. Team Tsinghua, winner of the Overall Champion trophy …

American kids leave HPC smackdown hungry for Phi

HPC blog Colorado and Purdue, the two American teams at the ISC’13 Student Cluster Challenge, had more in common than geography and a fondness for lots of ice in their drinks. (Or at least some ice, damn it. What’s wrong with Europe, anyway? Why can’t we have ice if we want it?) For one thing, each team has more cluster competition …
The Eurora supercomputer built by Eurotech and Nvidia

Supercomputer efficiency jumps, but nowhere near exascale needs

It is not precisely the kind of leap that the supercomputer industry needs to reach exascale performance by the end of the decade, but more powerful GPU and x86 coprocessors are enabling more energy-efficient machines, at least according to the latest Green500 rankings. The Green500 list comes out two or three times a year, …

Sweaty European youngsters get to grips with ‘coffee table of doom’

HPC blog It was a hot week in Leipzig - "sweating through your shirt five minutes after you walk out of your hotel" hot. However, extreme heat and even the resulting prickly heat won’t keep us from checking in with all of the teams during the last day of the ISC’13 Student Cluster Challenge. First up are the teams from Europe:Team …

2 Chinese teams. 1 unbeaten. Cluster wrestlers, be warned

HPC blog China has sent two teams to the eight-university 2013 International Supercomputing Conference Student Cluster battle, but they had to earn their trip. As student cluster competition aficionados know, the Asia Student Supercomputer Challenge held their first regional cluster competition last April. In addition to the possibility …
Eagle

Rainforest Eagles 2.0 and African cluster boffins head to Europe for app WAR

HPC blog The cluster kids on eight international university teams have now deployed their clusters at the 2013 International Supercomputing Conference in Leipzig, Germany. The 2013 ISC Student Cluster Challenge entrants are now fighting each other to win a series of HPC benchmarks and scientific apps. The two teams below - Costa Rica's …

US cluster kids bring noisy gear, 'fun' toys to World War HPC

HPC blog Eight universities have travelled to the 2013 International Supercomputing Conference in Leipzig, Germany, to participate in the 2013 ISC Student Cluster Challenge. They’ve hastily pulled together their data-nomming HPC beasts and are now busily working to to hit the jackpot on a series of HPC benchmarks and scientific …

Edinburgh students' heaving racks: UK's only hope for cluster-wrestling glory

HPC blog Eight universities have travelled to the 2013 International Supercomputing Conference in Leipzig, Germany, to participate in the 2013 ISC Student Cluster Challenge. They’ve deployed their clusters and are busily working to turn in the best results on a series of HPC benchmarks and scientific apps. This year, the competition …

Euro students cluster fest: Configurations LAID BARE

HPC blog The configurations of the systems to be used by the young HPC warriors in the 2013 International Supercomputing Conference's Student Cluster Challenge were released last week, but they have now been verified to make sure that last-minute changes are accurately represented. Here’s the "big table" showing some of the details for …