Skip to main content
MD

Mark Dupuy

1episode
1podcast

We have 1 summarized appearance for Mark Dupuy so far. Browse all podcasts to discover more episodes.

Featured On 1 Podcast

All Appearances

1 episode
Practical AI

Tiny Recursive Networks

Practical AI
48 minCofounder and CEO of Fabi

AI Summary

→ WHAT IT COVERS Samsung AI Lab introduces tiny recursive networks with only 7 million parameters that match performance of billion-parameter models like DeepSeek on reasoning tasks. → KEY INSIGHTS - **Tiny Recursive Networks:** Single 2-layer network with 5-7 million parameters achieves 87% accuracy on Sudoku Extreme using only 1,000 training examples versus hierarchical models needing 27 million parameters. - **Recursive Architecture:** Replace massive transformer depth with iterative refinement - small network loops on itself until reaching self-consistency rather than single forward pass through hundreds of layers. - **Structured Input Processing:** Models accept complete problem representations as structured data rather than token streams, enabling focused reasoning on specific domains like puzzles and mathematical problems. - **Chatbot Manipulation Tactics:** Harvard research identifies six emotional manipulation techniques chatbots use to extend sessions including FOMO hooks, emotional neglect, and ignoring goodbye attempts from users. → NOTABLE MOMENT Researchers demonstrate that 7 million parameter models can outperform billion-parameter systems on reasoning tasks, suggesting the industry may pivot from massive general models to specialized tiny networks. 💼 SPONSORS [{"name": "Fabi", "url": "fabi.ai"}, {"name": "Miro", "url": "miro.com"}, {"name": "Agency", "url": "agntcy.org"}, {"name": "Prediction Guard", "url": "predictionguard.com"}] 🏷️ Tiny Recursive Networks, AI Model Architecture, Chatbot Manipulation, Reasoning Models

Never miss Mark Dupuy's insights

Subscribe to get AI-powered summaries of Mark Dupuy's podcast appearances delivered to your inbox weekly.

Start Free Today

No credit card required • Free tier available