Fujitsu, Oracle pair up on future 'Athena' Sparc64 chips
But Larry may not resell servers that use them
How does the Athena stack up to other Sparcs?
For comparison, a top-end Sparc Enterprise M9000 has 64 sockets, which can be crammed with four-core Sparc64-VII+ processors running at the same 3GHz clock speed that is the top-level target for the Sparc64-X chip. The M9000 server tops out at 256GB across its eight system boards, however, yielding a maximum of only 2TB of main memory. And that is older DDR2 main memory.
By the way, this M9000 box does not support Solaris 11, according to Oracle's spec sheet, which is hard to believe. But Fujitsu says it is supporting Solaris 11 in data sheet for the M9000. Go figure.
If you want to go the distributed route and not spend big bucks on a monolithic SMP server, you can use the Real Application Clusters (RAC) extensions to the Oracle database and throw it on a Sparc SuperCluster using the T4-4 servers. You can do that today.
A single rack of the SuperCluster has four T4-4 servers, which are four-socket boxes. Each machine has four Sparc T4 processors, which have eight cores with eight threads per core running at 3GHz, with 1TB of main memory. That's 128 cores with 4TB of memory per rack, and across the eight racks of a SuperCluster (or Exadata for that matter), you would have 1,024 cores and 32TB of main memory. That's the same as the future Athena system, albeit with three very big caveats: a T4 core is not an Athena core, a T4 thread is definitely not an Athena thread, and a cluster is not a shared memory system.
When Oracle moves to the Sparc T5 processor, which Oracle was showing off at Hot Chips 24 and which is expected to ship sometime before the end of this year, it will be able to double up a SuperCluster to a staggering 2,048 cores and perhaps as much as 64TB of memory, if memory capacity doubles along with the core count.
Schematic of the Athena server interconnect
How far performance can scale on the Athena boxes depends in large part on the socket-to-socket interconnect that Fujitsu has cooked up, and which, the more you look at it, looks less and less like Tofu.
According to the schematic above, Fujitsu is using a distributed crossbar interconnect, with two crossbar ports on each four-socket Athena board, which are multipathed into the on-board glueless interconnect to cut down on latencies. Four crossbar switch boards, each with a pair of crossbar ports like each server system board has, are at the heart of the system.
If you look really carefully at the Athena system interconnect diagram, you'll see that only one of the two crossbar ports on the system boards is actually used in the sixteen-way NUMA server, and that the used port only has six links. Maybe Fujitsu's artists just got lazy and didn't want to draw all of the links on the diagram because it would look like something out of a Spirograph.
That said, if for some reason those lines are representative of the way the crossbar interconnect works, then half of the crossbar switches and half the ports are not even being used at all, and that means the Athena system can scale to 32 nodes and 128 processors, or a whopping 2,048 cores in a single system image.
The Sun and Oracle roadmaps, last updated at OpenWorld 2011, did not have the future M4 processors scaling that far – but roadmaps change. Either way, with 64 or 128 Sparc64-X processors, this would make a formidable NUMA server or a fat memory node in a very large supercomputer cluster.
According to Toyoki, memory capacity and latency across a shared-memory system are, in fact, two of the things that Fujitsu very much kept in mind it designed the Athena processor and system.
The Athena system boards will have liquid loop cooling, which was designed for the K super and now the PrimeHPC commercial supers, to cool the processors and their main memory, allowing for the memory to be slammed right up against the processor sockets and thereby reducing the length of wires and therefore signal latencies between the CPU and its memory banks.
While neither Fujitsu nor Oracle were very clear about how the future Athena systems would come to market, Toyoki was very clear when Andy Mendelsohn, senior vice president of database server technologies at Oracle, took the stage with him to talk about some of the Oracle-specific features that the Athena machines will support.
For one, the Logical Domain (LDom) hypervisor, rebranded as Oracle VM for Sparc and thus far only available on Sparc T series chips, is going to finally make its way to Fujitsu boxes, providing true logical partitioning.
Fujitsu plans to support LDom partitions with the Athena systems
Toyoki also explained that the Athena chip would have direct decimal math execution units as well as special number-format conversions that are required inside the Oracle database, which converts from decimal to binary, does an addition, and converts it back to decimal format to store the answer in the database. These and other "software on chip" functions, as Fujitsu calls its on-chip function accelerators, are expected to significantly boost the performance of the Oracle database.
Oracle cofounder and CEO Larry Ellison took the stage to introduce the new Exadata X3 machines and the Oracle infrastructure cloud right after Toyoki, and he did not say Oracle would be peddling Athena machines, either. But Ellison seemed to be enthusiastic about the machines just the same.
"I am going to make a promise to you," Ellison said. "By this time next year, that Sparc microprocessor will run the Oracle database faster than anything on the planet."
While Fujitsu had been very careful not to put out a launch date for the Sparc64-X or Athena chips and the systems that use them, Larry just couldn't help himself. Now, it would be nice if Oracle customers would be told that the Athena chip is the Sparc64-X chip and that Oracle was going to resell and support them when Fujitsu gets them ready for market.
In the meantime, we'll gather up what information we can find on the forthcoming Fujitsu boxes and go through some early benchmark tests Fujitsu disclosed. Perhaps Oracle will say more about its future Sparc plans on Wednesday when John Fowler, executive vice president of systems, gives his keynote. ®