The NVIDIA Ada Lovelace architecture has been making waves with professional graphics users since its introduction, offering an unprecedented combination of performance, upgraded ray-tracing capabilities, enhanced AI features, and dramatic FP32 compute power. At GTC last month, NVIDIA unveiled a new addition to the lineup: the RTX 4000 SFF Ada Generation GPU. This compact yet powerful GPU is designed specifically for SFF workstations, and brings an outstanding level of performance, features, and capabilities to an even broader range of systems, since this board is also compatible with standard (ATX) enclosures. Here is what you need to know about this exciting and innovative new product:
NVIDIA L4 GPU: Powering the Next Generation of Energy-Efficient Data Centers
As data centers continue to grow in size and complexity, the demand for energy-efficient, high-performance solutions has never been higher. NVIDIA has stepped up to the challenge with the introduction of the L4 Tensor CoreGPU. Designed specifically for data center applications, the NVIDIA L4 GPU brings a new level of power efficiency and performance to meet the ever-evolving needs of modern data centers. Here, we’ll explore the key features and benefits of the NVIDIA L4 GPU unveiled at GTC.
Other GTC 2023 Announcements
NVIDIA unveiled its latest flagship GPU, the H100 NVL, which brings two NVIDIA H100 PCIe boards together using NVIDIA NVLink interconnect technology. The new NVL version has 94GB of HBM3 memory per GPU for a total of 188GB of GPU memory. According to NVIDIA, H100 NVL is ideal for deploying massive LLMs like ChatGPT at scale and can deliver up to 12x faster inference performance at GPT-3 compared to the prior generation A100 at data center scale. This H100 system is expected to be released in the second half of the year.
NVIDIA announced significant updates to Omniverse, a platform for building and operating metaverse applications. Some of the key takeaways include Omniverse’s ability to unify and streamline infrastructure-as-a-service (IaaS) and platform-as-a-service (PaaS) functions. Plus, NVIDIA Omniverse Cloud will be hosted on Microsoft Azure. Omniverse Cloud is NVIDIA’s full-stack cloud environment for developing, deploying and managing industrial metaverse applications. By hosting it on Azure, NVIDIA is increasing access to its service catalog, including tools like Isaac Sim, Replicator and Drive Sim.
While CAD software has been used for product design and engineering for decades now, this represents only part of the overall resources and time investment that go into product development. With Omniverse, NVIDIA is offering a full-stack IaaS to businesses, removing many barriers and unifying full product workflows, including not only design and engineering but also programming, validation, manufacturing and servicing of the product. Since NVIDIA Omniverse is based on RTX technology, these (and other) software enhancements will provide a powerful impetus for workstation graphics upgrades, since NVIDIA RTX GPUs are required in the workstation(s) being utilized. You can learn more about the latest NVIDIA Omniverse enhancements here.
The NVIDIA Grace Hopper Superchip is a breakthrough accelerated CPU architecture designed from the ground up for giant-scale AI and high-performance computing applications. The superchip will deliver up to 10x higher performance for applications running terabytes of data, enabling scientists and researchers to reach unprecedented solutions for the world’s most complex problems.
NVIDIA also showcased several advancements in edge AI and robotics during GTC, including Omniverse Cloud hosted on Microsoft Azure, which increases access to NVIDIA Isaac Sim, a platform for developing and managing AI-based robots. Also among the highlights were the new NVIDIA Jetson Orin Nano Developer Kit and availability of the full lineup of Jetson Orin modules offering a giant performance leap for edge AI and robotics applications. Additionally, the NVIDIA Clara Holoscan platform brings advanced AI capabilities to medical imaging and diagnostics, potentially revolutionizing healthcare with faster, more accurate diagnoses, and better patient outcomes.
NVIDIA GTC demonstrated that breakthrough technologies — from new GPUs to robotics platforms — are impacting essentially every industry and enterprise, as AI adoption becomes a prerequisite to remaining competitive. Looking forward, PNY expects even more exciting developments from NVIDIA as it continues to define, implement, and shape the future of AI, graphics, and computing.