H100 NVL 94 GB

General
ManufacturerNVIDIA
SeriesServer Hopper(Hxx)
GPU NameGH100
ArchitectureHopper
GenerationServer Hopper(Hxx)
Release DateMar 2023
Bus InterfacePCIe 5.0 x16
Process & Die
FoundryTSMC
Process Size5 nm
Transistors80,000 M
Transistor Density98,300 K/mm²
Die Size814 mm²
Clock Speeds
Base Clock1,080 MHz
Boost Clock1,785 MHz
Memory
VRAM94 GB
Memory TypeHBM3
Memory Clock1,310 MHz
Memory Bus6016-bit
Bandwidth3,940 GB/s
Processing Units
Shading Units16,896
TMUs528
ROPs24
SMs132
Tensor Cores528
RT Cores0
Cache
L1 Cache250 KB
L2 Cache50 MB
Power & Thermals
TDP400 W
Suggested PSU800 W
Power Connectors8-pin EPS
Dimensions
Board Length267 mm
Board Width111 mm
Outputs
API Support
OpenCL3.0
CUDA9.0
Theoretical Performance
Pixel Rate42.84 GP/s
Texture Rate942.5 GT/s
FP16 (Half)241,300 GFLOPS
FP32 (Single)60,320 GFLOPS
FP64 (Double)30,160 GFLOPS
External
TechPowerUpView →