Gear mentioned by Matt Garman
Hardware and equipment Matt Garman has mentioned across podcast appearances.
SignalCast may earn a small commission on purchases through these links — at no extra cost to you. As an Amazon Associate we earn from qualifying purchases.
Trainium 3
Recommendedby AWS
“Trainium 3 currently delivers AWS's strongest cost-performance ratio for inference workloads, not just training. The majority of Bedrock inference traffic runs on Trainium. Startups evaluating GPU costs should assess Trainium as a primary inference option.”
Firecracker
Recommendedby AWS
“Key gaps include lightweight compute sandboxes via Firecracker micro-VMs, time-boxed fine-grained permissions distinct from user IAM roles, and sub-three-second database spin-up times.”