Groq raises $350M to fund its pivot from AI chips to Nvidia-powered neocloud

Groq, the AI startup once known for its custom language processing units (LPUs), has raised $350 million to accelerate its transformation into a "neocloud" provider that rents out Nvidia-powered compute clusters. The round was led by investment firm Disruptive, with planned participation from Nvidia, and values the company at $3.5 billion — a significant drop from the $6.9 billion valuation it commanded last September, just before Nvidia hired away founder and CEO Jonathan Ross and other top talent in a $20 billion licensing deal.

Groq's spokesperson downplayed the valuation gap, framing it not as a down round but as a "new valuation for the post-Nvidia-licensing-deal version of Groq." The company's pivot is stark: after losing its founding team, it has moved from competing with Nvidia on inference chips to becoming a customer of Nvidia, operating data centers filled with Nvidia GPUs. This is a strategic shift that places Groq squarely inside Nvidia's ecosystem, much like CoreWeave, Lambda, and Nebius.

The new capital builds on a $650 million round from June and aims to scale Groq's infrastructure from 54 megawatts to over 200 megawatts by 2027. Groq already operates 13 data centers across North America, Europe, the Middle East, and Asia Pacific, serving over 6 million developers and enterprises. The fresh funding will support customers who need "medium and larger sized clusters of Nvidia accelerated computing for training and inference."

Inference — the real-time computation that powers AI applications — is the company's new focus. Alex Davis, chairman of Groq and CEO of Disruptive, said, "We are building Groq into the world's leading AI inference cloud. Inference will without a doubt become the largest and most critical layer of AI infrastructure." This bet on inference is a deliberate response to the growing demand for running AI workloads at scale, but it's not without risks.

The neocloud business model is under heavy scrutiny. CoreWeave, a leading example, has reported strong revenue growth and landed major contracts with Meta and Anthropic, yet investors remain wary of its high capital expenditures, debt load, and exposure to rapidly depreciating hardware. Groq's financials are private, but the company's pivot raises the same questions: can neoclouds turn their massive investments into sustainable profits?

For developers, Groq's shift means a new player in the crowded neocloud market, offering access to Nvidia GPUs for training and inference. But in a market where differentiation is hard, Groq's success will hinge on its ability to execute on its infrastructure buildout and compete on price and performance. The company's relationship with Nvidia — both as a customer and an investor — could be a double-edged sword, providing access to scarce GPUs but also tying its fortunes to the very company it once sought to upend.