Skip to main content
The Journal

Her Client Was Deepfaked. She Says xAI Is to Blame.

20 min episode · 2 min read
·
Carrie Goldberg

Episode

20 min

Read time

2 min

Topics

Design & UX, Artificial Intelligence, Product & Tech Trends

AI-Generated Summary

Key Takeaways

  • Product Liability Strategy: Goldberg bypasses Section 230 immunity by arguing Grok is a defectively designed product that foreseeably causes harm, similar to unsafe car airbags or baby beds. This approach holds companies liable for releasing products without adequate safeguards against known dangers like deepfake abuse, rather than treating them as passive content publishers protected by traditional internet law.
  • AI Content Generation Distinction: The lawsuit argues chatbots like Grok generate original content rather than merely hosting user posts, making them liable as content creators. When users type prompts like "take her clothes off," Grok produces the actual image, making it materially different from platforms that simply publish third-party content. This distinction could reshape how courts interpret Section 230 for AI tools.
  • Public Nuisance Legal Theory: Goldberg adds a public nuisance claim because Grok operates on X, a self-described public square, where deepfakes immediately become public. Grok allegedly produced thousands of undressed images per hour affecting hundreds of thousands of women worldwide. This mass-scale public harm in a shared digital space creates grounds for public nuisance liability beyond individual harm claims.
  • Court Precedent Over Legislation: Goldberg prioritizes lawsuits over waiting for new laws because courts provide immediate action and create binding precedent faster than legislative processes. She filed St. Clair's lawsuit within nine days of the harm occurring, while regulations typically respond to problems that have existed for years. One successful case can establish precedent affecting entire industries without congressional action.
  • Discovery Strategy for Accountability: The lawsuit aims to expose internal company communications showing how long xAI continued allowing harmful image generation after learning about the abuse. Goldberg wants to reveal boardroom discussions, quantify total victims harmed, and document the scale of images created. This discovery process could establish corporate knowledge standards for AI companies releasing potentially dangerous products.

What It Covers

Lawyer Carrie Goldberg sues Elon Musk's xAI over Grok chatbot generating nonconsensual deepfake nude images of conservative influencer Ashley St. Clair and thousands of other women. The case challenges Section 230 protections using product liability theory, arguing AI companies should be held accountable when their products create harmful content, not just host it.

Key Questions Answered

  • Product Liability Strategy: Goldberg bypasses Section 230 immunity by arguing Grok is a defectively designed product that foreseeably causes harm, similar to unsafe car airbags or baby beds. This approach holds companies liable for releasing products without adequate safeguards against known dangers like deepfake abuse, rather than treating them as passive content publishers protected by traditional internet law.
  • AI Content Generation Distinction: The lawsuit argues chatbots like Grok generate original content rather than merely hosting user posts, making them liable as content creators. When users type prompts like "take her clothes off," Grok produces the actual image, making it materially different from platforms that simply publish third-party content. This distinction could reshape how courts interpret Section 230 for AI tools.
  • Public Nuisance Legal Theory: Goldberg adds a public nuisance claim because Grok operates on X, a self-described public square, where deepfakes immediately become public. Grok allegedly produced thousands of undressed images per hour affecting hundreds of thousands of women worldwide. This mass-scale public harm in a shared digital space creates grounds for public nuisance liability beyond individual harm claims.
  • Court Precedent Over Legislation: Goldberg prioritizes lawsuits over waiting for new laws because courts provide immediate action and create binding precedent faster than legislative processes. She filed St. Clair's lawsuit within nine days of the harm occurring, while regulations typically respond to problems that have existed for years. One successful case can establish precedent affecting entire industries without congressional action.
  • Discovery Strategy for Accountability: The lawsuit aims to expose internal company communications showing how long xAI continued allowing harmful image generation after learning about the abuse. Goldberg wants to reveal boardroom discussions, quantify total victims harmed, and document the scale of images created. This discovery process could establish corporate knowledge standards for AI companies releasing potentially dangerous products.

Notable Moment

St. Clair describes seeing AI-generated images of herself undressed and in explicit poses with her toddler's backpack visible in the background, then having to put that same backpack on her son the next day. This visceral example demonstrates how deepfake technology violates victims in their own homes, merging digital abuse with physical daily life in ways traditional image-based abuse never could.

Know someone who'd find this useful?

Episode Transcript

Elon Musk's AI chatbot Grok is facing intense criticism accused of allowing ex users to generate fake sexually explicit images. Late last month, the popular AI chatbot, Grok, came under fire for a new feature. An influx of explicit content coming after Grok recently enhanced its image generation abilities with a new model. Grok, which is integrated on the platform x, began allowing users to edit images with text prompts. X users quickly discovered they could use the feature to have Grok execute instructions like take her clothes off or put her in a bikini. Within days, X was flooded with nonconsensual AI generated images. It's impacting It's impacting hundreds of thousands of women worldwide. Grok is producing thousands of undressed images per hour on x, allegedly. And experts are saying that the scale is nothing like anything they have ever seen before. Elon Musk, who owns x, has called criticisms of Grok an effort to suppress free speech. X later said that the platform has restricted users' ability to use Grok to edit images of real people in revealing clothing. The company also said it had blocked the ability to generate images of real people in bikinis and other revealing attire in places where it's illegal. But at least one user says the damage has been done. Ashley Saint Claire is a 27 year old conservative influencer who's known in part for having a child with Musk. Saint Claire said Grock undressed images of her and depicted her in sexually explicit poses in response to user prompts. Here she is on CBS. The worst for me was seeing myself undressed, bent over, and then my toddler's backpack in the background because I had to then see that and see myself violated in that way and such horrific images and then put that same backpack on my son the next day. Saint Clair decided to sue xAI, the company behind Grok. AI should not be allowed to generate and undress children and women. That's what needs to happen. St. Clair's lawsuit gets at the heart of the thorny legal issues surrounding new AI tools, and it confronts the question, who is responsible for the content that users prompt chat chatbots to create? Last week, I sat down with St. Clair's lawyer, a woman named Carrie Goldberg. She's known for litigating online sexual harm cases and has a particular strategy for holding companies liable for online content. Carrie told me her goal is to help create new guardrails for an era of artificial intelligence. I want this to set precedence so that this company and its competitors don't go back into the business of peddling in people's nude images. Welcome to The Journal, our show about money, business, and power. I'm Jessica Mendoza. It's Tuesday, January 27. Coming up on the show, a conversation with the lawyer taking on Grok and XAI. This episode is brought to you by Indeed. Hiring isn't just about finding someone willing to take the job. …

Get the full transcript (3,106 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all The Journal transcripts →

You just read a 3-minute summary of a 17-minute episode.

Get The Journal summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

More from The Journal

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best News Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's AI & Machine Learning Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into The Journal.

Every Monday, we deliver AI summaries of the latest episodes from The Journal and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime