SAM 3: The Eyes for AI — Nikhila & Pengchuan (Meta Superintelligence), ft. Joseph Nelson (Roboflow)

What It Covers

Meta releases SAM 3, introducing text-based concept prompting for image and video segmentation, enabling detection of 200,000+ visual concepts through natural language descriptions.

Key Questions Answered

• •Automated Data Engine: SAM 3's training pipeline reduced human annotation time from 2 minutes per image to 25 seconds using AI-powered verification and model-in-the-loop approaches.
• •Concept Segmentation Scale: New SACO benchmark contains 200,000+ unique visual concepts versus previous benchmarks with only 1,200 concepts, enabling real-world vocabulary diversity for segmentation tasks.
• •Video Processing Architecture: Decoupled detector and tracker components allow identity-agnostic detection while preserving individual object tracking, with parallel inference scaling across multiple H200 GPUs for real-time performance.
• •Fine-tuning Efficiency: Domain adaptation requires only 10 data points with 3-5 negative examples proving highly effective for customizing SAM 3 to specific use cases.