Nvidia says Groq racks will be online this year after $20 billion deal

Key Points:

• Nvidia has begun full production of its Groq 3 LPX rack, commercializing technology from its largest acquisition to date, the $20 billion purchase of chip startup Groq in December.
• The Groq 3 LPX racks, which package 256 Groq 3 chips, will be deployed alongside Nvidia's Vera central processors and Rubin graphics processors at neocloud Nebius, expected to be online later this year.
• Groq chips focus on low-latency inference, particularly the "decode" phase of AI model serving, enabling faster and more responsive AI agents, which is valuable for premium, latency-sensitive cloud services.
• Nvidia emphasizes that Groq chips complement rather than replace GPUs, using the right processor for specific workloads, with Vera Rubin systems handling the bulk of data center tasks.
• Nvidia CEO Jensen Huang projects $1 trillion in cumulative sales from Blackwell and Vera Rubin chips through 2027, dedicating a quarter of data center space for coding applications to Groq chips.