Kasia Chmielinski

AI Summary

→ WHAT IT COVERS Kasia Chmielinski, former White House technologist and UN adviser, explains how product management practices inherently create bias in AI systems and provides four concrete strategies for building more responsible technology that serves marginalized users. → KEY INSIGHTS - **Product Management Trade-offs:** Standard PM practices prioritize speed and ideal users, creating DNA-level exclusions. Early design decisions become permanent architecture, making marginalized users perpetually secondary. Building accessible-first or for edge cases produces better products for everyone long-term. - **AI as Process Not Product:** Treat AI development as multi-stage process including use case selection, training data, deployment, monitoring, and decommissioning. Build componentized systems to isolate and test each piece separately. Implement evaluations and red teaming at every stage rather than only at launch. - **Vendor Procurement Questions:** Before contracting AI vendors, demand answers on training data sources, accuracy measurement methods, ground truth comparisons, update frequency, and decommissioning criteria. Build accountability into contracts since customer complaints target you, not third parties, regardless of who built the system. - **Data Nutrition Labels:** Standardized dataset labels surface qualitative information like data cleaning methods, funding sources, intended uses, known issues, and ethical assessments. Organizations using labels report improved dataset quality because documentation requirements force better curation decisions upfront before model training begins. → NOTABLE MOMENT Chmielinski reveals building COVID vaccine equity systems that misclassified their own identity, demonstrating how technologists creating AI systems often fall into the gaps of their own products, becoming victims of the binary classifications and assumptions they programmed into algorithms. 💼 SPONSORS [{"name": "MTPCon London", "url": "mindaproduct.com"}] 🏷️ AI Ethics, Responsible AI, Data Governance, Product Management