Skip to main content
Eye on AI

Training AI Models Without a Billion-Dollar Data Center | Steffen Cruz of Macrocosmos

47 min episode · 2 min read
·
Steffen Cruz

Episode

47 min

Read time

2 min

Topics

Remote Work, Personal Finance, Startups

AI-Generated Summary

Key Takeaways

  • Distributed Pretraining Economics: Centralized data centers lock training costs into upfront capital expenditure, but distributed training enables real-time energy cost arbitrage. Macrocosmos targets surplus energy pockets — such as off-peak Icelandic power — to reduce pretraining costs to roughly 10–20% of conventional data center rates, making 70-billion-parameter model training accessible to cash-constrained startups and academic institutions.
  • Model Parallelism at Scale: Rather than running full model copies on each node, Macrocosmos deploys small model "slivers" across distributed machines using pipeline parallelism. This allows frontier-scale models to be trained from consumer-grade hardware like Mac minis and prosumer GPUs, with an orchestration layer resembling Kubernetes routing data between nodes to simulate a unified supercomputer.
  • Blockchain as Coordination Layer, Not Compute Layer: The blockchain in BitTensor serves three specific functions — identity registry, synchronization clock, and transparent payout trigger — while all actual compute and training data remain entirely off-chain. Understanding this separation helps evaluate any blockchain-AI project: the chain handles trust and compensation, not processing or storage.
  • Consumer Hardware as Passive Income Infrastructure: Macrocosmos's Train at Home program lets owners of idle Mac minis, MacBooks, or consumer GPUs contribute compute during unused hours and earn IOTA token payouts proportional to hours contributed. With 2,500 macOS app downloads in the first two weeks, the supply-side network can scale without capital expenditure by monetizing already-purchased personal devices.
  • Two-Sided Market for Underutilized GPU Inventory: NeoCloud and hyperscaler providers typically rent out 90–95% of GPU inventory, leaving gaps of two or more hours between bookings. Macrocosmos targets these interruptible idle windows, offering providers better margins than spot inference pricing while giving demand-side users — researchers, startups, enterprises — a PyTorch-compatible interface requiring no additional workflow changes.

What It Covers

Steffen Cruz, CTO of Macrocosmos, explains how his company uses BitTensor's blockchain infrastructure to train large language models through distributed compute nodes worldwide, targeting 5,000 nodes by mid-2025 and 70-billion-parameter models as a commercial milestone for cost-arbitrage AI training.

Key Questions Answered

  • Distributed Pretraining Economics: Centralized data centers lock training costs into upfront capital expenditure, but distributed training enables real-time energy cost arbitrage. Macrocosmos targets surplus energy pockets — such as off-peak Icelandic power — to reduce pretraining costs to roughly 10–20% of conventional data center rates, making 70-billion-parameter model training accessible to cash-constrained startups and academic institutions.
  • Model Parallelism at Scale: Rather than running full model copies on each node, Macrocosmos deploys small model "slivers" across distributed machines using pipeline parallelism. This allows frontier-scale models to be trained from consumer-grade hardware like Mac minis and prosumer GPUs, with an orchestration layer resembling Kubernetes routing data between nodes to simulate a unified supercomputer.
  • Blockchain as Coordination Layer, Not Compute Layer: The blockchain in BitTensor serves three specific functions — identity registry, synchronization clock, and transparent payout trigger — while all actual compute and training data remain entirely off-chain. Understanding this separation helps evaluate any blockchain-AI project: the chain handles trust and compensation, not processing or storage.
  • Consumer Hardware as Passive Income Infrastructure: Macrocosmos's Train at Home program lets owners of idle Mac minis, MacBooks, or consumer GPUs contribute compute during unused hours and earn IOTA token payouts proportional to hours contributed. With 2,500 macOS app downloads in the first two weeks, the supply-side network can scale without capital expenditure by monetizing already-purchased personal devices.
  • Two-Sided Market for Underutilized GPU Inventory: NeoCloud and hyperscaler providers typically rent out 90–95% of GPU inventory, leaving gaps of two or more hours between bookings. Macrocosmos targets these interruptible idle windows, offering providers better margins than spot inference pricing while giving demand-side users — researchers, startups, enterprises — a PyTorch-compatible interface requiring no additional workflow changes.

Notable Moment

Cruz describes a near-future scenario where a personal AI agent, after completing its assigned tasks by mid-morning, autonomously decides to contribute the machine's idle compute to a training network and earns passive income — returning a tangible financial result to the user by end of day.

Know someone who'd find this useful?

Episode Transcript

The blockchain, in effect, is a registry of addresses, and it points toward the actual assets that are being registered. There's no training data on the chain. There's no compute on the chain. Today, we are training models. We're training multiple models all at once using pockets of cheap energy, which translates into cheap compute. By the middle of this year, I would like us to reach 5,000 compute nodes. I think this is respectable sized cluster that you can train a a model that will get people's attention and make them understand that there's a lot of utility in this technology. I think that's an important milestone for us. So my name is Stefan Crews. I am, I'm the cofounder and the CTO of Microcosmos. I hold a PhD in subatomic physics in University of British Columbia. So I was a I was a physics researcher for the beginning of my career, and then I pivoted to AI when it became apparent to me that there's a lot of opportunity for scientists that are just about to graduate from their, from their postgraduate studies. And and there's just there's there's an entirely new science sort of being born and developed in real time for us, and I think my decision is one that a lot of other people have made as well where they want to go from, being in what can feel like the sort of the old school machinery of of traditional science in academia where things move slow and your contributions can be very narrow and sparse to becoming a pioneer of this entirely new exciting thing, which is not only abstract and theoretical, but it's being applied in new and interesting ways constantly. So when I saw that, I I I concluded my PhD, and I decided to leap, leap leaped out of academia and into sort of the application of, AI and also physics in in various private sector domains such as manufacturing and systems optimization. Following that, I I discovered BitTensor, which is a very interesting AI, blockchain project. And, ostensibly, the purpose of BitTensor is to allow AI to be developed in a way that is fully democratized and is sort of done in a global a global way with incentives. And I thought that was such a fascinating, proposal that I decided to join the network. I've been within the BitTensor ecosystem for around three years now, and I have been relentlessly experimenting and building within BitTensor, the kind of things that I think would make a lot of sense and would bring a lot of value to the world using a blockchain as a prerequisite tool to enable AI research to be done in various ways and scales that will be very difficult otherwise. Yeah. And specifically well, first, let's talk about BitTensor. But before you began, we were talking about, how there are a few of these blockchain ecosystems, for either training or, or marketing, AI models or AI …

Get the full transcript (8,144 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Eye on AI transcripts →

You just read a 3-minute summary of a 44-minute episode.

Get Eye on AI summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.

Tools

  • Steffen Cruz, CTO of Macrocosmos, explains how his company uses BitTensor's blockchain infrastructure to train large language models through distributed compute nodes worldwide
  • with an orchestration layer resembling Kubernetes routing data between nodes to simulate a unified supercomputer
  • NeoCloud and hyperscaler providers typically rent out 90–95% of GPU inventory, leaving gaps of two or more hours between bookings
  • offering providers better margins than spot inference pricing while giving demand-side users — researchers, startups, enterprises — a PyTorch-compatible interface requiring no additional workflow changes

Products

  • contribute compute during unused hours and earn IOTA token payouts proportional to hours contributed
  • by Macrocosmos

    Macrocosmos's Train at Home program lets owners of idle Mac minis, MacBooks, or consumer GPUs contribute compute during unused hours and earn IOTA token payouts

More from Eye on AI

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's Startups & Product Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into Eye on AI.

Every Monday, we deliver AI summaries of the latest episodes from Eye on AI and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime