Description
H100/H200 Systems
The NVIDIA DGX™ H100/H200 Systems are the universal systems purpose-built for all AI infrastructure and workloads from analytics to training to inference. The DGX H100/H200 systems are built on eight NVIDIA H100 Tensor Core GPUs or eight NVIDIA H200 Tensor Core GPUs.
| Component | Description |
|---|---|
| GPU |
For H100: 8 x NVIDIA H100 GPUs that provide 640 GB total GPU memory
For H200: 8 x NVIDIA H200 GPUs that provide 1,128 GB total GPU memory
|
| CPU | 2 x Intel Xeon 8480C PCIe Gen5 CPUs with 56 cores each 2.0/2.9/3.8 GHz (base/all core turbo/Max turbo) |
| NVSwitch | 4 x 4th generation NVLinks that provide 900 GB/s GPU-to-GPU bandwidth |
| Storage (OS) | 2 x 1.92 TB NVMe M.2 SSD (ea) in RAID 1 array |
| Storage (Data Cache) | 8 x 3.84 TB NVMe U.2 SED (ea) in RAID 0 array |
| Network (Cluster) card | 4 x OSFP ports for 8 x NVIDIA® ConnectX®-7 Single Port InfiniBand Cards
Each card provides the following speeds:
|
| Network (storage and in-band management) card | 2 x NVIDIA® ConnectX®-7 Dual Port Ethernet Cards
Each card provides the following speeds:
|
| System memory (DIMM) | 2 TB using 32 x DIMMs |
| BMC (out-of-band system management) | 1 GbE RJ45 interface
Supports Redfish, IPMI, SNMP, KVM, and Web user interface |
| System management interfaces | Dual port 100GbE in slot 3 and 10 GbE RJ45 interface |
| Power supply | 6 x 3.3 kW |
