eprintid: 30640
rev_number: 11
eprint_status: archive
userid: 6218
dir: disk0/00/03/06/40
datestamp: 2021-10-26 08:49:38
lastmod: 2021-10-28 06:03:48
status_changed: 2021-10-26 08:49:38
type: doctoralThesis
metadata_visibility: show
creators_name: Frey, Dirk
title: Design and Implementation of a Network-Attached Accelerator to Improve Data Movement in HPC Environments
divisions: i-110300
adv_faculty: af-11
abstract: In this work, the concept of a network-attached accelerator was developed. This
novel node type connects accelerator and network interface card directly via an artificial
PCIe interface. By exploiting the additional functions of the EXTOLL network
card, this remote PCIe hierarchy can be integrated into any system with an EXTOLL
network interface card via the network without requiring any modifications
to the accelerator driver. A Intel R
 Xeon PhiTMwas used which can be successfully
booted by the remote PCIe hierarchy over the network and is then available as a
standalone node. In addition, the Intel R
 Xeon PhiTMitself can actively communicate
with other Intel R
 Xeon PhiTMwithout the need for a CPU. The accelerator and
network card form a single unit that can communicate directly with others via the
highly specialized EXTOLL network, forming an cluster of accelerators. Various experiments
demonstrate, that this combination has a higher bandwidth and a lower
latency than common systems.
Several prototype systems have been developed to evaluate the concept and reduce
the packing density by a factor of four. This is the most densely packed HPC system
to date. The enormous cooling demand could only be met by using a novel cooling
medium NovecTM 649 . An developed 2-phase cooling system can cool the 12 kW
power dissipation of the 32 network-attached accelerators with a total of 32 TFLOP
of computing power only by the power consumption of a single circulating pump. As
a result, the GreenICE system achieves an unprecedented power usage effectiveness
of 1.01.
date: 2021
id_scheme: DOI
id_number: 10.11588/heidok.00030640
ppn_swb: 1775318443
own_urn: urn:nbn:de:bsz:16-heidok-306403
date_accepted: 2021-10-19
advisor: HASH(0x561a6288fa50)
language: eng
bibsort: FREYDIRKDESIGNANDI2021
full_text_status: public
place_of_pub: Heidelberg
citation:   Frey, Dirk  (2021) Design and Implementation of a Network-Attached Accelerator to Improve Data Movement in HPC Environments.  [Dissertation]     
document_url: https://archiv.ub.uni-heidelberg.de/volltextserver/30640/1/20210317_dissertation-dirk-frey-print-version.pdf