HGX B300 | HGX B200 | |
| Form Factor | 8x NVIDIA Blackwell Ultra SXM | 8x NVIDIA Blackwell SXM |
| FP4 Tensor Core** | 144 PFLOPS | 105 PFLOPS | 144 PFLOPS | 72 PFLOPS |
| P8/FP6 Tensor Core* | 72 PFLOPS | 72 PFLOPS |
| INT8 Tensor Core* | 2 POPS | 72 POPS |
| FP16/BF16 Tensor Core* | 36 PFLOPS | 36 PFLOPS |
| TF32 Tensor Core* | 18 PFLOPS | 18 PFLOPS |
| FP32 | 600 TFLOPS | 600 TFLOPS |
| FP64/FP64 Tensor Core | 10 TFLOPS | 296 TFLOPS |
| Total Memory | Up to 2.3 TB | 1.4 TB |
| NVLink | Fifth generation | Fifth generation |
| NVIDIA NVSwitch™ | NVLink 5 Switch | NVLink 5 Switch |
| NVSwitch GPU-to-GPU Bandwidth | 1.8 TB/s | 1.8 TB/s |
| Total NVLink Bandwidth | 14.4 TB/s | 14.4 TB/s |
| Networking Bandwidth | 1.6 TB/s | 0.8 TB/s |
| Attention Performance | 2X | 1X |
** With sparsity | without sparsity
HGX H200 | HGX H100 | |
| Form Factor | 8x NVIDIA H200 SXM | 8x NVIDIA H100 SXM |
| FP8/FP6 Tensor Core* | 32 PFLOPS | 32 PFLOPS |
| INT8 Tensor Core* | 32 POPS | 32 POPS |
| FP16/BF16 Tensor Core* | 16 PFLOPS | 16 PFLOPS |
| TF32 Tensor Core* | 8 PFLOPS | 8 PFLOPS |
| FP32 | 540 TFLOPS | 540 TFLOPS |
| FP64 | 270 TFLOPS | 270 TFLOPS |
| FP64 Tensor Core | 540 TFLOPS | 540 TFLOPS |
| Total Memory | 1.1 TB HBM3e | 640 GB HBM3 |
| GPU Aggregate Bandwidth | 38 GB/s | 27 GB/s |
| NVLink | Fourth generation | Fourth generation |
| NVIDIA NVSwitch™ | NVLink 4 Switch | NVLink 4 Switch |
| NVSwitch GPU-to-GPU Bandwidth | 900 GB/s | 900 GB/s |
| Total NVLink Bandwidth | 7.2 TB/s | 7.2 TB/s |
| Networking Bandwidth | 0.8 TB/s | 0.8 TB/s |
| Unit | Configuration | Quantity |
| GPU | NVIDIA Umbriel GPU Baseboard, HGX B200 8-GPU 180GB HBMЗe | 1 |
| CPU | 6960P 2P(72C/2.7G/500W,72C/2.3G/400W)(66C/2.6G/450W,48C/3.1G/450W) | 2 |
| Memory | 96GB DDR5-6400 2Rx4 (24Gb) LP ECC RDIMM | 24 |
| Hard Disk | 3.8TB NVMe PCle4.0 3D TLC U.3 15mm,1DWPD | 4 |
| Hard Disk | 960GB NVMe PCle4x4 M.2 22x110mm 1DWPD SED 5YR | 2 |
| InfiniBand | 900-9X766-003N-S00 1XNDR400G IB/EN OSFP Gen5x16 NoCrypto CX7 | 8 |
| Network | 900-9X7AH-0078-DTZstd 2x200G EN/IB QSPF112Gen5x16NoCryptCX7 | 2 |
| Unit | Configuration | Quantity |
| GPU | GPU-NVHGX-H200-8-GPU 141GB SXM5 | 1 |
| CPU | Intel 8558 48C 2.1-4.0G 260MB 330W | 2 |
| Memory | 64GB DDR5-5600 2Rx4 (16Gb) LP ECC RDIMM | 32 |
| Hard Disk | 3.8TB NVMe PCle4.0 3D TLC U.3 15mm,1DWPD | 4 |
| Hard Disk | 960GB NVMe PCle4x4 M.2 22x110mm 1DWPD SED 5YR | 2 |
| InfiniBand | 900-9X766-003N-S00 1XNDR400G IB/EN OSFP Gen5x16 NoCrypto CX7 | 8 |
| Network | 900-9X7AH-0078-DTZstd 2x200G EN/IB QSPF112Gen5x16NoCryptCX7 | 2 |