Mistral: Voxtral TTS, Forge, Leanstral, & what's next for Mistral 4 — w/ Pavan Kumar Reddy & Guillaume Lample

What It Covers

Mistral releases Voxtral TTS, a 3B-parameter text-to-speech model supporting nine languages, built on a novel autoregressive flow matching architecture with an in-house neural audio codec. Guillaume Lample and Pavan Kumar Reddy also cover Mistral Small, the Forge deployment platform, and the LeanStral formal math reasoning project.

Key Questions Answered

• •Autoregressive Flow Matching for TTS: Voxtral TTS uses a flow matching head attached to a 3B Ministral backbone, processing audio at 12.5 Hz latent tokens. Flow matching outperforms depth transformers for audio generation because it models the distribution of possible inflections rather than predicting a blurred mean, and reduces inference to 12–16 steps versus k autoregressive steps per frame.
• •Neural Audio Codec Design: The in-house codec converts audio into 12.5 Hz latent tokens, each containing one semantic token plus multiple acoustic tokens. Embeddings are summed at each frame on the input side. This continuous-discrete hybrid design enables streaming-first voice agent deployment, targeting sub-100ms latency for real-time applications rather than batch audio file processing.
• •Fine-Tuning on Proprietary Data Yields Outsized Gains: Enterprises using closed-source models via API leave decades of domain-specific data unused. Fine-tuning on proprietary data via Mistral Forge — using the same training infrastructure Mistral's science team uses internally — can produce models 10x cheaper to serve and significantly stronger on domain-specific tasks than any general-purpose model accessed through a shared endpoint.
• •LeanStral Uses Lean Formal Proofs as Verifiable RL Reward Signal: Formal proof verification in the Lean language provides a binary, unambiguous reward signal — code either compiles or it does not — solving the reward hacking problem that plagues open-ended mathematical reasoning. This enables reinforcement learning on complex multi-step proofs and transfers reasoning gains to coding and general problem-solving domains.
• •Sparse Mixture-of-Experts Architecture for Mistral Small: Mistral Small activates roughly 6B parameters out of a larger sparse MoE architecture, supports a 256k context window, and merges previously separate specialist models — coding, reasoning, vision — into one artifact. The approach keeps per-query compute low while consolidating capabilities, making it practical to deploy on-premise for latency-sensitive or data-privacy-constrained enterprise workloads.