Intel Xe-HP Graphics: Early Samples Offer 42+ TFLOPs of FP32 Performanceby Dr. Ian Cutress on August 21, 2020 11:00 AM EST
- Posted in
- Intel Arch Day 2020
One of the promises that Intel has made with its new Xe GPU family is that in its various forms it will cater to uses ranging from integrated graphics all the way up to the high performance compute models needed for super-dense supercomputers. This means support for the types of calculations involved in simple graphics, complex graphics, ray tracing, AI inference, AI training, and the compute that goes into molecular modelling, oil-and-gas, nuclear reactors, rockets, nuclear rockets, and all the other big questions where more compute offers more capabilities. Sitting near the top of Intel’s offerings is the Xe-HP architecture, designed to offer high performance GPUs for standard server and enterprise deployments.
Over the past couple of weeks Intel has offered some of the first technical details of Xe-HP, following Raja Koduri showing it off across his social media profiles. We know that it is designed to be a modular architecture, with different chiplets connected together using Intel’s Embedded Multi-Die Interconnect Bridge technology. We also know, due to disclosures made at Intel’s Architecture Day, that it is set to be built on Intel’s 10nm Enhanced SuperFin (10ESF, formerly 10++, formerly 10+++) manufacturing process, which we believe to be a late 2021 process. Raja Koduri promised during the Architecture Day presentation that Xe-HP (and Xe-HPG) will be available in 2021.
Intel explained that the modular Xe-HP design will scale from one to four tiles, and the concept of Xe-HP was to ‘scale everything’, such as execution units, frequency, bandwidth, IPC, and math capabilities. We assume that each tile will have direct access to some on-chip memory as well – truly scaling up every aspect of a chip – although how the chip's HBM2E is allocated hasn't been confirmed. The point of the product is that it is designed for the data-center, so there needs to be a mix of media compute as well as raw compute, covering all sorts of uses cases.
As part of the demonstration during Architecture Day, Intel also showcased that they’ve been running some benchmarks on the early silicon in the labs. By early silicon, we mean that these aren’t running at the final frequencies, this isn’t final firmware, and the software stack still has a way to go, so undoubtedly there are optimizations at every level.
First, Intel showed that a single tile of Xe-HP can not only transcode one 4K60 video in real time, but ten. In the demonstration they had the FFmpeg output, showing that the demo was converting each video from 5332 kb/s overall down to 3000 kb/s average (6000 kb/s max).
For compute, Intel offered the following performance numbers, given as peak GFLOPs of FP32 math using the OpenCL-based CLPeak benchmark.
- One Tile: 10588 GFLOPs (10.6 TF) of FP32
- Two Tile: 21161 GFLOPs (21.2 TF) of FP32 (1.999x)
- Four Tile: 42277 GFLOPs (42.3 TF) of FP32 (3.993x)
We also get some additional information from the video of Xe-HP. The tests were done on Linux, and actually all done on a version of the quad-tile chip, but made to run in 1T/2T/4T modes. This is why when looking at the video we can see all three versions are running at 1300 MHz. The string used for the chip is ‘XeHP HD Graphics NEO’ as well.
The video also shows that a single tile has 512 ‘compute units’, while the dual tile has 1024 compute units and the quad-tile has 2048 compute units. And while Intel hasn't officially claried what "compute units" mean in this context, the performance figures all but confirm that it's counting Intel's Execution Units. Based on the given GFLOPs, the stated clock speed, and the Xe architecture's 8 pipes per Execution unit with dual FMAs, Intel's performance figures map to 512/1024/2048 EUs respectively. That would mean that each one would have:
- One Tile: 512 EUs = 4096 ALUs (+ 1024 Extended Math ALUs)
- Two Tile: 1024 EUs = 8196 ALUs (+ 2048 Extended Math ALUs)
- Four Tiles: 2048 EUs = 16384 ALUs (+ 4096 Extended Math ALUs)
This is assuming that the Execution Unit structure of 8+2 from Xe-LP remains. We know that HP will support new XMX instructions for matrix math, as well as AI-related quantization levels and FP64 too. Which Intel's Hot Chips presentation has confirmed will be implemented within the EUs as additional physical blocks.
There was also a shot of the rear of an Xe-HP die, which Raja has shown off during his Hot Chips keynote as well. We can play a game of count the pins.
Intel believes it is achieving near linear scaling in compute performance across its multi-tile strategy – at least up to 4T using CLPeak, a benchmark designed to measure a GPU's maximum compute throughput. There’s nothing here to say about tile-to-tile bandwidth scaling, or if this multi-tiling strategy and NUMA arrangement of tiles has knock-on effects for memory-limited or sparse math – Intel’s goal was simply to show that the hardware is running and what kind of peak compute performance it can offer. There’s also no word on power consumption either, or cost, however in the presentation Intel says that the goal here is to offer the equivalent of a rack-scale transcoding system in a single chip with best-in-class TCO, winning on performance-per-watt-per-dollar.
Xe-HP is set to be available in 2021 for the Enterprise market.
- The Intel Xe-LP GPU Architecture Deep Dive: Building Up The Next Generation
- Intel’s Xe-HPG GPU Unveiled: Built for Enthusiast Gamers, Built at a Third-Party Fab
- Intel Xe-HPC GPU Status Update: 4 Process Nodes Make 1 Accelerator
- Spotted At Hot Chips: Quad Tile Intel Xe-HP GPU
- Hot Chips 2020 Live Blog: Intel's Xe GPU Architecture (5:30pm PT)
Post Your CommentPlease log in or sign up to comment.
View All Comments
TopHatProductions115 - Friday, August 21, 2020 - linkBut can it run Crysis?!
I'll see myself out now :P
Ian Cutress - Friday, August 21, 2020 - linkWe have CPUs that can run Crysis through software rendering now. Not well, but they do run :)
The_Stopher - Friday, August 21, 2020 - linkCan it run Crysis remastered? ;)
kaspar737 - Saturday, August 22, 2020 - linkThe better question now is "Can it run Microsoft Flight Simulator?"
Machinus - Friday, August 21, 2020 - linkWhat is the ISA for the basic execution units? How are they getting sufficient bandwitdh and latency with 2000 units? Knights Mill only had 128 x86 cores. Is this a reduced instruction set?
extide - Friday, August 21, 2020 - linkIt's more like a GPU than a CPU -- but I'm sure it uses some sort of proprietary ISA, of which I don't think a name has ever been mentioned publicly, at least not to my knowledge. Probably "The Xe ISA"
Spunjji - Monday, August 24, 2020 - linkIt's almost certainly reduced when compared with x86, as the EUs don't need to do nearly as many different kinds of work.
KimGitz - Friday, August 21, 2020 - linkWhen you consider NVidia`s latest earnings show they made more money due to rapid growth in this segment as opposed to previously having the gaming segment being more profitable. Intel are onto something.
Spunjji - Monday, August 24, 2020 - linkWorth noting that Nvidia's growth in that area was largely down to the purchase of Mellanox, otherwise they'd still be earning significantly more from gaming graphics.
Definitely a smart move from Intel, but they'll need to be compelling in an area that Nvidia aren't.
nico_mach - Wednesday, August 26, 2020 - linkEven if Intel is successful, it will take time to unseat NVIDIA's CUDA frameworks and in the meantime, NVIDIA will be releasing new gear. I'm no fan of Intel (the last few years of shenanigans has been godawful) but it's great to see more competition here.
The secondary question is how much this market is really going to grow. I get the sense that personal assistants and internet startups have plateau'd and the global economy is now a big question mark, with the American market a double question mark.