NVIDIA made the biggest deal in its history — acquiring the startup Groq for $20B, reports CNBC.
Quick clarification: this is not Grok, Elon Musk's chatbot, but a hardware unicorn that makes LPU chips. If you've seen videos where a model generates text at Eminem-level speed — those were Groq chips.
What Happened
NVIDIA isn't buying the company outright (antitrust regulators wouldn't allow it) — instead, it's licensing the technology and bringing the entire team on board, led by founder Jonathan Ross, the person who originally created the TPU at Google.
💡 Why It Matters
LPU (Language Processing Unit) chips are built exclusively for language models. Their key innovation is ditching scarce HBM memory in favor of ultra-fast SRAM. In regular GPUs, data takes time to reach the core — here, memory is built right into the processor.
💡 What This Changes
1. Local AI on steroids. If LPU technology makes it into consumer GPUs, we'll get assistants that work locally, instantly, and without the internet.
2. Security for business. Companies will be able to deploy blazing-fast models inside their own infrastructure without sending data to the cloud.
🏁 Who Else Is in the Race
The only competitor on the same playing field is Cerebras with their plate-sized chips (Wafer Scale Engine).