Introducing NVIDIA H100, the Next Generation of Accelerated Computing

Posted by PNY Pro on Fri, Nov 11, 2022 @ 03:30 PM


Unprecedented Performance, Scalability, and Security for Every Data Center

The NVIDIA® H100 Tensor Core GPU enables an order-of-magnitude leap for large-scale AI and HPC with unprecedented performance, scalability, and security for every data center and includes the NVIDIA AI Enterprise software suite to streamline AI development and deployment. H100 accelerates exascale scale workloads with a dedicated Transformer Engine for large language models. For small jobs, H100 can be partitioned down to right-sized Multi-Instance GPU (MIG) partitions.

nvidia hopper

NVIDIA Hopper Architecture Addresses LMM Needs at Scale

With Hopper Confidential Computing, this scalable compute power can secure sensitive applications on shared data center infrastructure. The inclusion of NVIDIA AI Enterprise with H100 PCIe purchases reduces time to development and simplifies deployment of AI workloads, and makes H100 the most powerful end-to-end AI and HPC data center platform.

nvidia h100 pcle

NVIDIA H100 PCIe Delivers Dramatic TCO Advantage for AI with NVIDIA AI Enterprise

The NVIDIA Hopper architecture delivers unprecedented performance, scalability and security to every data center. Hopper builds upon prior generations from new compute core capabilities, such as the Transformer Engine, to faster networking to power the data center with an order of magnitude speedup over the prior generation.

training performance

NVIDIA H100 Training Performance – 4X Higher Than A100

NVIDIA NVLink supports ultra-high bandwidth and extremely low latency between two H100 boards, and supports memory pooling and performance scaling (application support required). Second-generation MIG securely partitions the GPU into isolated right-size instances to maximize QoS (quality of service) up to 7 secured tenants. The bundling of NVIDIA AI Enterprise (exclusive to the H100 PCIe), a software suite that optimizes the development and deployment of accelerated AI workflows, maximizes performance through these new H100 architectural innovations. These technology breakthroughs fuel the H100 Tensor Core GPU - the world’s most advanced GPU ever built.

For additional information on the NVIDIA H100 contact PNY at or visit our website at

Topics: PNY, PNYPRO, NVIDIA Professional GPUs, Tensor Core GPU, NVIDIA Data Center GPUs, NVIDIA H100, NVIDIA NVLink, H100 Tensor Core GPU

Subscribe to Email Updates

Connect With Us


Posts by Tag

see all

Most Popular Posts

Terms & Conditions

Blog Terms & Conditions