Tools mentioned by Simon Moe
Software and services Simon Moe has mentioned across podcast appearances.
SignalCast may earn a small commission on purchases through these links — at no extra cost to you.
vLLM
RecommendedAuthor“Simon Mo, cofounder and CEO of InfraAct and lead maintainer of VLLM, joins a16z to explain how open-source inference became critical infrastructure...VLLM gives operators up to 10 configurable speed tiers...VLLM supports over 1,000 model architectures and serves as the benchmark hardware vendors use to validate new chip performance before public release.”