Training AI Models Without a Billion-Dollar Data Center | Steffen Cruz of Macrocosmos
Episode
47 min
Read time
2 min
Topics
Remote Work, Personal Finance, Startups
AI-Generated Summary
Key Takeaways
- ✓Distributed Pretraining Economics: Centralized data centers lock training costs into upfront capital expenditure, but distributed training enables real-time energy cost arbitrage. Macrocosmos targets surplus energy pockets — such as off-peak Icelandic power — to reduce pretraining costs to roughly 10–20% of conventional data center rates, making 70-billion-parameter model training accessible to cash-constrained startups and academic institutions.
- ✓Model Parallelism at Scale: Rather than running full model copies on each node, Macrocosmos deploys small model "slivers" across distributed machines using pipeline parallelism. This allows frontier-scale models to be trained from consumer-grade hardware like Mac minis and prosumer GPUs, with an orchestration layer resembling Kubernetes routing data between nodes to simulate a unified supercomputer.
- ✓Blockchain as Coordination Layer, Not Compute Layer: The blockchain in BitTensor serves three specific functions — identity registry, synchronization clock, and transparent payout trigger — while all actual compute and training data remain entirely off-chain. Understanding this separation helps evaluate any blockchain-AI project: the chain handles trust and compensation, not processing or storage.
- ✓Consumer Hardware as Passive Income Infrastructure: Macrocosmos's Train at Home program lets owners of idle Mac minis, MacBooks, or consumer GPUs contribute compute during unused hours and earn IOTA token payouts proportional to hours contributed. With 2,500 macOS app downloads in the first two weeks, the supply-side network can scale without capital expenditure by monetizing already-purchased personal devices.
- ✓Two-Sided Market for Underutilized GPU Inventory: NeoCloud and hyperscaler providers typically rent out 90–95% of GPU inventory, leaving gaps of two or more hours between bookings. Macrocosmos targets these interruptible idle windows, offering providers better margins than spot inference pricing while giving demand-side users — researchers, startups, enterprises — a PyTorch-compatible interface requiring no additional workflow changes.
What It Covers
Steffen Cruz, CTO of Macrocosmos, explains how his company uses BitTensor's blockchain infrastructure to train large language models through distributed compute nodes worldwide, targeting 5,000 nodes by mid-2025 and 70-billion-parameter models as a commercial milestone for cost-arbitrage AI training.
Key Questions Answered
- •Distributed Pretraining Economics: Centralized data centers lock training costs into upfront capital expenditure, but distributed training enables real-time energy cost arbitrage. Macrocosmos targets surplus energy pockets — such as off-peak Icelandic power — to reduce pretraining costs to roughly 10–20% of conventional data center rates, making 70-billion-parameter model training accessible to cash-constrained startups and academic institutions.
- •Model Parallelism at Scale: Rather than running full model copies on each node, Macrocosmos deploys small model "slivers" across distributed machines using pipeline parallelism. This allows frontier-scale models to be trained from consumer-grade hardware like Mac minis and prosumer GPUs, with an orchestration layer resembling Kubernetes routing data between nodes to simulate a unified supercomputer.
- •Blockchain as Coordination Layer, Not Compute Layer: The blockchain in BitTensor serves three specific functions — identity registry, synchronization clock, and transparent payout trigger — while all actual compute and training data remain entirely off-chain. Understanding this separation helps evaluate any blockchain-AI project: the chain handles trust and compensation, not processing or storage.
- •Consumer Hardware as Passive Income Infrastructure: Macrocosmos's Train at Home program lets owners of idle Mac minis, MacBooks, or consumer GPUs contribute compute during unused hours and earn IOTA token payouts proportional to hours contributed. With 2,500 macOS app downloads in the first two weeks, the supply-side network can scale without capital expenditure by monetizing already-purchased personal devices.
- •Two-Sided Market for Underutilized GPU Inventory: NeoCloud and hyperscaler providers typically rent out 90–95% of GPU inventory, leaving gaps of two or more hours between bookings. Macrocosmos targets these interruptible idle windows, offering providers better margins than spot inference pricing while giving demand-side users — researchers, startups, enterprises — a PyTorch-compatible interface requiring no additional workflow changes.
Notable Moment
Cruz describes a near-future scenario where a personal AI agent, after completing its assigned tasks by mid-morning, autonomously decides to contribute the machine's idle compute to a training network and earns passive income — returning a tangible financial result to the user by end of day.
Episode Transcript
The blockchain, in effect, is a registry of addresses, and it points toward the actual assets that are being registered. There's no training data on the chain. There's no compute on the chain. Today, we are training models. We're training multiple models all at once using pockets of cheap energy, which translates into cheap compute. By the middle of this year, I would like us to reach 5,000 compute nodes. I think this is respectable sized cluster that you can train a a model that will get people's attention and make them understand that there's a lot of utility in this technology. I think that's an important milestone for us. So my name is Stefan Crews. I am, I'm the cofounder and the CTO of Microcosmos. I hold a PhD in subatomic physics in University of British Columbia. So I was a I was a physics researcher for the beginning of my career, and then I pivoted to AI when it became apparent to me that there's a lot of opportunity for scientists that are just about to graduate from their, from their postgraduate studies. And and there's just there's there's an entirely new science sort of being born and developed in real time for us, and I think my decision is one that a lot of other people have made as well where they want to go from, being in what can feel like the sort of the old school machinery of of traditional science in academia where things move slow and your contributions can be very narrow and sparse to becoming a pioneer of this entirely new exciting thing, which is not only abstract and theoretical, but it's being applied in new and interesting ways constantly. So when I saw that, I I I concluded my PhD, and I decided to leap, leap leaped out of academia and into sort of the application of, AI and also physics in in various private sector domains such as manufacturing and systems optimization. Following that, I I discovered BitTensor, which is a very interesting AI, blockchain project. And, ostensibly, the purpose of BitTensor is to allow AI to be developed in a way that is fully democratized and is sort of done in a global a global way with incentives. And I thought that was such a fascinating, proposal that I decided to join the network. I've been within the BitTensor ecosystem for around three years now, and I have been relentlessly experimenting and building within BitTensor, the kind of things that I think would make a lot of sense and would bring a lot of value to the world using a blockchain as a prerequisite tool to enable AI research to be done in various ways and scales that will be very difficult otherwise. Yeah. And specifically well, first, let's talk about BitTensor. But before you began, we were talking about, how there are a few of these blockchain ecosystems, for either training or, or marketing, AI models or AI …
Get the full transcript (8,144 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 44-minute episode.
Get Eye on AI summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Eye on AI
From Zero to 150 Robots in Just 20 Months | Mike LeBlanc, Foundation Future Industries
Aug 19 · 66 min
Practical AI
AIUC-1: Building trust in AI agents
Jun 25
More from Eye on AI
Why People Are Paying 10x More for AI - and What That Means for the Chip Market | Sid Sheth, d-Matrix
Aug 17 · 50 min
Beyond Biotech
How Epic Bio is leveraging CRISPR without cutting DNA
Apr 30
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.
Tools
“Steffen Cruz, CTO of Macrocosmos, explains how his company uses BitTensor's blockchain infrastructure to train large language models through distributed compute nodes worldwide”
“with an orchestration layer resembling Kubernetes routing data between nodes to simulate a unified supercomputer”
“NeoCloud and hyperscaler providers typically rent out 90–95% of GPU inventory, leaving gaps of two or more hours between bookings”
“offering providers better margins than spot inference pricing while giving demand-side users — researchers, startups, enterprises — a PyTorch-compatible interface requiring no additional workflow changes”
Products
- Train at HomeBy guest
by Macrocosmos
“Macrocosmos's Train at Home program lets owners of idle Mac minis, MacBooks, or consumer GPUs contribute compute during unused hours and earn IOTA token payouts”
More from Eye on AI
We summarize every new episode. Want them in your inbox?
From Zero to 150 Robots in Just 20 Months | Mike LeBlanc, Foundation Future Industries
Why People Are Paying 10x More for AI - and What That Means for the Chip Market | Sid Sheth, d-Matrix
American Companies Have 36 Months to Go AI-Native or Get Left Behind | Drew Cukor, TWG AI
Why People Are Paying 10x More for AI | Sid Sheth, d-Matrix
AI Agents Fixing Your IT Before You Even Know Something Broke | Erhan Giral & Ryan Manning, BMC Helix
Similar Episodes
Related episodes from other podcasts
Practical AI
Jun 25
AIUC-1: Building trust in AI agents
Beyond Biotech
Apr 30
How Epic Bio is leveraging CRISPR without cutting DNA
a16z Podcast
Apr 2
Alex Blania on Proof of Human and Building World's Identity Network
Latent Space
Feb 25
🔬Searching the Space of All Possible Materials — Prof. Max Welling, CuspAI
The Bio Report
Feb 4
Reprogramming T Cells to Cross the Brain’s Border
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Startups & Product Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Eye on AI.
Every Monday, we deliver AI summaries of the latest episodes from Eye on AI and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime