Unprecedented Performance, Scalability, and Security for Every Data Center
The NVIDIA® H100 Tensor Core GPU enables an order-of-magnitude leap for large-scale AI and HPC with unprecedented performance, scalability, and security for every data center and includes the NVIDIA AI Enterprise software suite to streamline AI development and deployment. H100 accelerates exascale scale workloads with a dedicated Transformer Engine for large language models. For small jobs, H100 can be partitioned down to right-sized Multi-Instance GPU (MIG) partitions.
NVIDIA Hopper Architecture Addresses LMM Needs at Scale
With Hopper Confidential Computing, this scalable compute power can secure sensitive applications on shared data center infrastructure. The inclusion of NVIDIA AI Enterprise with H100 PCIe purchases reduces time to development and simplifies deployment of AI workloads, and makes H100 the most powerful end-to-end AI and HPC data center platform.
NVIDIA H100 PCIe Delivers Dramatic TCO Advantage for AI with NVIDIA AI Enterprise
The NVIDIA Hopper architecture delivers unprecedented performance, scalability and security to every data center. Hopper builds upon prior generations from new compute core capabilities, such as the Transformer Engine, to faster networking to power the data center with an order of magnitude speedup over the prior generation.
NVIDIA H100 Training Performance – 4X Higher Than A100
NVIDIA NVLink supports ultra-high bandwidth and extremely low latency between two H100 boards, and supports memory pooling and performance scaling (application support required). Second-generation MIG securely partitions the GPU into isolated right-size instances to maximize QoS (quality of service) up to 7 secured tenants. The bundling of NVIDIA AI Enterprise (exclusive to the H100 PCIe), a software suite that optimizes the development and deployment of accelerated AI workflows, maximizes performance through these new H100 architectural innovations. These technology breakthroughs fuel the H100 Tensor Core GPU - the world’s most advanced GPU ever built.
For additional information on the NVIDIA H100 contact PNY at gopny@pny.com or visit our website at www.pny.com.
