Tool mentioned on podcasts
vLLM
Mentioned on 5 episodes by 2 guests across our covered podcasts.
SignalCast may earn commission on purchases via these links.
Who mentioned it
“Simon Mo, cofounder and CEO of InfraAct and lead maintainer of VLLM, joins a16z to explain how open-source inference became critical infrastructure...VLLM gives operators up to 10 configurable speed tiers...VLLM supports over 1,000 model architectures and serves as the benchmark hardware vendors use to validate new chip performance before public release.”
Mentioned on: a16z Podcast- Woosuk KwonAuthor
“Simon Moe and Woosuk Kwon, cofounders of Infraact and creators of VLLM, explain how AI inference has evolved from a simple side project in 2022 to one of computing's most complex challenges”
Mentioned on: a16z Podcast