5.1 Special Day on "Embedded Meets Hyperscale and HPC" Session: Heterogeneous Computing in the Datacenter and in HPC

Printer-friendly version PDF version

Date: Wednesday, March 27, 2019
Time: 08:30 - 10:00
Location / Room: Room 1

Chair:
Christian Plessl, Paderborn University, DE, Contact Christian Plessl

Co-Chair:
Christoph Hagleitner, IBM Research, CH, Contact Christoph Hagleitner

Heterogeneous computing systems with accelerators are claiming the top ranks in the TOP500 list of the largest HPC computing systems and find increasing adoption in hyperscale cloud datacenters. Accelerators offer performance and efficiency gains despite the diminishing returns from traditional technology scaling. The talks in this session will set the stage for the this special day and analyze the value proposition of accelerators for traditional and emerging workloads. An overview of this vibrant environment will be followed by more detailed presentations on systems using GPUs and FPGAs

TimeLabelPresentation Title
Authors
08:305.1.1PARALLEL WORLDS: LESSONS FROM EXTREME SCALE DATACENTERS
Author:
Nicole Hemsoth, The Next Platform, US
Abstract
While there might seem to be little connection between the power efficiency, performance, and price worlds of embedded computing and HPC or hyperscale datacenters, there are more parallels than meet the eye. We will look at how some of the largest datacenter operators in supercomputing and hyperscale are designing next-generation systems from an architectural standpoint and examine the pressures that are driving these choices. In the coming post-Moore's Law era, these forces will drive particular designs to the top—and those could have implications for how computing evolves from the top down.
09:005.1.2GPU ACCELERATED COMPUTING IN HPC AND IN THE DATA CENTER
Author:
Peter Messmer, NVidia, US
Abstract
Since the introduction of CUDA a bit over a decade ago, heterogeneous computing with GPUs has become increasingly popular in HPC. While the initial applications were mostly exploratory in nature, the processing power, the relatively intuitive programming model and a rapidly growing software ecosystem comprised of tools, libraries and training material helped a broad user community to adopt heterogeneous computing. Today, most of the top HPC applications are therefore GPU accelerated, covering all areas of computational science and engineering, including quantum chemistry, structural mechanics or weather simulation. This trend got an extra boost with the increasing computing demand of machine learning, specifically for training deep neural networks, where the processing power of GPUs was suddenly in demand from non-traditional HPC applications in the datacenter. Today, we therefore find GPUs not only in the fastest supercomputers in the world, but also in the largest datacenters. In this presentation, I will discuss the current impact of GPU in HPC and the data center, look at the challenges still faced by developers and how we are working on mitigating them.
09:305.1.3HETEROGENEOUS COMPUTE ARCHITECTURES FOR DEEP LEARNING IN THE CLOUD
Authors:
Michaela Blot and Ken O'Brien, Xilinx Research, IE
Abstract
Accuracy of deep learning algorithms continues to outpace many traditional algorithms, while requiring little domain expertise and no explicit programming. However, they are typically associated with astronomical computational and memory requirements which push the limits of projected performance scalability with future technology nodes. This has led to a surge in innovative computer architectures and chips. Within this talk, we'll take a deeper look at compute and memory requirements for a range of popular neural networks and discuss how emerging architectures, fuelled by cloud dynamics, are trying to overcome this through architectural innovation.
10:00End of session
Coffee Break in Exhibition Area



Coffee Breaks in the Exhibition Area

On all conference days (Tuesday to Thursday), coffee and tea will be served during the coffee breaks at the below-mentioned times in the exhibition area.

Lunch Breaks (Lunch Area)

On all conference days (Tuesday to Thursday), a seated lunch (lunch buffet) will be offered in the ""Lunch Area"" to fully registered conference delegates only. There will be badge control at the entrance to the lunch break area.

Tuesday, March 26, 2019

  • Coffee Break 10:30 - 11:30
  • Lunch Break 13:00 - 14:30
  • Awards Presentation and Keynote Lecture in ""TBD"" 13:50 - 14:20
  • Coffee Break 16:00 - 17:00

Wednesday, March 27, 2019

  • Coffee Break 10:00 - 11:00
  • Lunch Break 12:30 - 14:30
  • Awards Presentation and Keynote Lecture in ""TBD"" 13:30 - 14:20
  • Coffee Break 16:00 - 17:00

Thursday, March 28, 2019

  • Coffee Break 10:00 - 11:00
  • Lunch Break 12:30 - 14:00
  • Keynote Lecture in ""TBD"" 13:20 - 13:50
  • Coffee Break 15:30 - 16:00