Skip to main content
NVIDIA AI Podcast

How Anyone Can Build Meaningful AI Without Code - Ep. 283

40 min episode · 2 min read
·
Shania Levin

Episode

40 min

Read time

2 min

Topics

Investing, Fundraising & VC, Leadership

AI-Generated Summary

Key Takeaways

  • Optimization Engine: Impromptu's system optimizes entire AI stacks—models, data, prompts, and evaluations—toward user-defined task success metrics, achieving 98% accuracy through either manual tuning (30+ runs) or automatic optimization mode for non-technical builders without requiring machine learning expertise.
  • Mixed-Code Architecture: The platform bridges legacy codebases with AI capabilities by ingesting existing GitHub repositories and adding generative features directly, eliminating the need to rebuild from scratch while maintaining production-ready infrastructure including governance, multi-tenancy, and infinite memory systems.
  • CUDA Performance Advantage: Using NVIDIA CUDA libraries for embedding and classification operations enables instant feedback loops for creators by running vector computations natively on GPUs rather than CPUs, allowing rapid iteration and serving high workloads with minimal GPU footprint across cloud or customer VPCs.
  • Provable AI Framework: Building trust requires transparency through dashboards showing accuracy metrics, decision-making processes, optimization run histories, and data lineage for custom models—allowing users to see, control, and roll back AI decisions rather than treating systems as black boxes.

What It Covers

Shania Levin, CEO of Impromptu AI, explains how her platform enables non-technical users to build production-ready AI applications achieving 98% accuracy through automated optimization, custom data models, and mixed-code infrastructure powered by NVIDIA CUDA.

Key Questions Answered

  • Optimization Engine: Impromptu's system optimizes entire AI stacks—models, data, prompts, and evaluations—toward user-defined task success metrics, achieving 98% accuracy through either manual tuning (30+ runs) or automatic optimization mode for non-technical builders without requiring machine learning expertise.
  • Mixed-Code Architecture: The platform bridges legacy codebases with AI capabilities by ingesting existing GitHub repositories and adding generative features directly, eliminating the need to rebuild from scratch while maintaining production-ready infrastructure including governance, multi-tenancy, and infinite memory systems.
  • CUDA Performance Advantage: Using NVIDIA CUDA libraries for embedding and classification operations enables instant feedback loops for creators by running vector computations natively on GPUs rather than CPUs, allowing rapid iteration and serving high workloads with minimal GPU footprint across cloud or customer VPCs.
  • Provable AI Framework: Building trust requires transparency through dashboards showing accuracy metrics, decision-making processes, optimization run histories, and data lineage for custom models—allowing users to see, control, and roll back AI decisions rather than treating systems as black boxes.

Notable Moment

When Levin asked her cofounder, computational physicist Sean Robinson, about building AI that generates AI applications, he initially said impossible—then reconsidered twenty minutes later, leading to their platform that now automagically constructs production-ready generative systems from user conversations.

Know someone who'd find this useful?

Episode Transcript

Hello. Welcome to the NVIDIA AI podcast. I'm your host, Noah Kravitz. Before we begin, a quick reminder, if you're enjoying the podcast, take a second to follow us wherever you get your podcasts. It helps us out, and it helps you out by making sure you never miss an episode that just show up in your feed. My guest today is Shania Levin. Shania is the cofounder and CEO of Impromptu AI. They're focused on helping nontechnical folks create AI products, which is, as Shania and I were just saying before we hit record, it's where a lot of focus is these days. So this is gonna be a great conversation, and let's get into it. Shania, thank you for joining the podcast. So happy to have you. Thank you so much for having me. It's been such an honor. So let's start with a little bit about your background, if you don't mind, and then getting into, you know, what inspired you to to cofound and build Impromptu and tell us what it's all about. Absolutely. So, background is I I studied business and computer science, and then I spent, some time at Google working on developer tools, for Google Home and Android, helping, you know, build Android applications for millions of developers all over the world. And then I spent some time at eBay working on both ads and more traditional machine learning, which was super fun. And then I got tired of of just, you know, working at big companies, so I was like, I'm gonna try this startup thing. And, I then went on to Cloudflare, and then I was a direct senior director product at Docker, and then I was head of product at a series c company, startup company, and then, I decided to go out on my own. I built a company called, CodeC, which was, helping developers to master the understanding of their code bases, which back in 2019 was revolutionary. It's like the, the BT before transformer era or something. I don't know if we can call it. Exactly. I've been doing this a really long time helping people to understand their code. And, we built something called CodeCAI, which basically allowed you to chat with your code base. So I was in the, you know, GPT two beta, like, way early in the process. And so we were building, this generative system back then, and then Coatsy got acquired. And I decided to take some time off and travel around the world. Fantastic. I ended up really starting off, building, just a very simple app with Lovable. Tried to do that. And, of course, being the technical person that I am, I really broke it. I just full full on broke it. And then I put a pause on that. I ended up taking a role for, a short amount of time at a subsidiary of Fox Sports to help them with their AI. And right around the same …

Get the full transcript (7,059 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all NVIDIA AI Podcast transcripts →

You just read a 3-minute summary of a 37-minute episode.

Get NVIDIA AI Podcast summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links.

Tools

  • Impromptu AIBy guest

    by Impromptu AI

    Shania Levin, CEO of Impromptu AI, explains how her platform enables non-technical users to build production-ready AI applications achieving 98% accuracy through automated optimization, custom data models, and mixed-code infrastructure powered by NVIDIA CUDA.

More from NVIDIA AI Podcast

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into NVIDIA AI Podcast.

Every Monday, we deliver AI summaries of the latest episodes from NVIDIA AI Podcast and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime