Nvidia says Groq racks will be online this year following $20 billion purchase

The Nvidia Groq 3 LPU chip during the Nvidia GTC conference in San Jose, California, March 18, 2026.David Paul Morris | Bloomberg | Getty ImagesNvidia announced on Monday that its Groq 3 LPX rack is in full production, marking the commercialization of technology from the company's largest acquisition on record. The Groq rack will be deployed alongside Vera central processors and Rubin graphics processors at neocloud Nebius, and will be online later this year, Nvidia senior director Dion Harris told reporters.Nvidia's race to manufacture Groq's chip and make it available to customers highlights the growing importance of low-latency inference that's needed to make AI agents feel responsive without long lags for users, especially for coding. Cloud companies can charge more for these kind of tokens, Nvidia says."For folks who are serving tokens, it unlocks the ability to offer premium tiers of service for those users and those customers who actually demand the most latency-sensitive" service agreements, Harris said on the call. In December, Nvidia bought assets from chip startup Groq for $20 billion, the company's largest purchase.. The Groq architecture includes 500 megabytes of speed...