Jonathan Ross, Founder of Groq

What It Covers

Groq founder Jonathan Ross discusses the $20B NVIDIA partnership, how LPU and GPU architectures complement each other to accelerate AI inference, and lessons from a decade building Groq — covering leadership philosophy, hiring frameworks, near-bankruptcy survival, and why fast inference was contrarian before becoming consensus.

Key Questions Answered

• •GPU + LPU Architecture: Groq's NVIDIA deal emerged from discovering that LPUs handle memory-throughput-constrained matrix operations while GPUs handle compute-constrained ones within LLM decoder layers. Combining both eliminates bottlenecks across all matrix multiplications, similar to using both 18-wheelers and delivery vans in a logistics network. This insight went from concept to wired funds in three weeks after Ross presented to Jensen Huang.
• •Minimal Constraints Leadership: Ross distilled Groq's entire company direction onto a challenge coin: 25 million tokens per second. The fewer constraints given to highly autonomous people, the more freedom they have to surprise you with solutions. Over-constraining kills innovation; under-constraining without a crisp objective causes paralysis. The goal must be simple enough to engrave on a coin yet open enough to allow creative problem-solving.
• •Intentional Leadership Phrasing: Replacing "should we do this?" with "I intend to do this" eliminates unnecessary pessimistic pushback while preserving genuine safety-critical objections. Drawn from David Marquet's *Turn the Ship Around*, this shift helped Ross stop being talked out of three consecutive LLM deployment opportunities. People volunteer objections only when something is genuinely wrong, not reflexively negative.
• •Hiring for Loss Bias: Groq's people spec screened for "book the win early" personalities — people who, upon hearing something is achievable, immediately treat not doing it as a loss. Ross observed that in architecture meetings, the same information produced opposite reactions: some heard "chip could be twice as fast next version," while loss-biased thinkers heard "chip is half as fast if we skip this now." Hire the latter for innovation-driven organizations.
• •Groq Bonds Survival Mechanism: Three weeks from insolvency, Ross rejected a layoff plan that would have eliminated critical compiler engineers needed to reach product viability. Instead, he offered salary-for-equity exchanges called Groq Bonds. Roughly 80% of employees participated, with approximately half reducing salaries to statutory minimums around $50,000–$60,000. Attrition dropped below 10%, possibly to 5%, extending runway by nearly two months.
• •Reality Quotient Over IQ: Ross hired explicitly for reality quotient — the ability to identify the dominant game being played rather than optimizing a subordinate metric. Myspace maximized account signups; Facebook maximized monthly active users and won by playing the superior game. Founders must connect every team member's daily work to the dominant metric, then practice full-time change management by making necessary pivots feel like continuations, not disruptions.