From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
AI Infra Summit: NVIDIA Vera Rubin and DSX Platform Advancements Showcase Energy Efficiencies of Optimizing Tokens Per Watt for AI Factories
NVIDIA showcases energy efficiency gains through tokens-per-watt optimization for AI infrastructure
NVIDIA announced full-stack AI factory platform advancements including Vera Rubin NVL72 systems, Dynamo inference software, and DSX MaxLPS power management.
The company reported that DSX MaxLPS can deliver up to 1.4x more tokens per megawatt through factory-wide power optimization, and that for next-generation Vera Rubin NVL72 AI factories it can enable up to 40% more GPU capacity within the same megawatt budget.
Lambda validated DSX MaxLPS on Blackwell servers, achieving 23% improvement in performance per watt and 24% increase in token throughput.
From the source
NVIDIA addresses that challenge with a full-stack AI factory platform spanning Vera Rubin systems, Dynamo inference software, NeMo libraries and NVIDIA networking — including NVIDIA NVLink for scale-up computing, Spectrum-X Ethernet and ConnectX SuperNICs for connecting thousands of nodes, BlueField-powered context-memory storage and BlueField DPUs for infrastructure security.
blogs.nvidia.com
Other stories
Amazon · 2 OctSweep thousands of leases for compliance using Amazon Quick and the Adjudicated Query pattern