The Technical Interview Is Broken
Episode
53 min
Read time
2 min
Topics
Career Growth, Relationships, Investing
AI-Generated Summary
Key Takeaways
- ✓Interview Evolution: Algorithm questions like reversing linked lists and inverting binary trees became standard because Google popularized them, not because they reflect daily engineering work. HackerRank is now running a literal billboard apology campaign in San Francisco, acknowledging this mismatch and actively shifting toward real-world repository-based assessments that mirror actual job tasks.
- ✓Chakra's Three-Dimension Evaluation Framework: HackerRank's AI interviewer scores candidates across three axes: task completion, AI fluency measured by framing-judging-steering quality, and conceptual understanding via 15-minute follow-up probing. The platform has processed over 500,000 AI interviews and achieves a 4.6–4.7 out of 5 Developer Love Index rating, higher than static take-home assessments.
- ✓AI Fluency as the New Core Skill: Hiring managers should evaluate candidates on how they frame prompts, judge AI output quality, and steer models toward correct solutions — not just whether final code works. Candidates who cannot critically assess AI-generated output represent a production risk, as unchecked AI-generated pull requests with hundreds of file changes are already creating review bottlenecks at engineering teams.
- ✓Hiring Is a Regulated Industry: Companies deploying AI in interviews must comply with EEOC regulations, NYC Local Law 144, and the EU AI Act. HackerRank addresses this by building proprietary evaluation models, converting all voice responses to text before scoring to eliminate accent and appearance bias, and conducting pre-launch adverse impact testing across gender and demographic groups.
- ✓Software Engineering Expanding Into Every Role: The narrative has shifted from "software engineering is dead" to "software engineering is everywhere." Product managers, designers, customer support, sales, marketing, and legal teams are now building agents and tools. Roles like Forward Deployed Engineer, Go-to-Market Engineer, and Talent Engineer are emerging, making AI fluency evaluation relevant far beyond traditional developer hiring pipelines.
What It Covers
HackerRank CEO Vivek Ravisankar joins host Josh Goldberg to examine why algorithm-based technical interviews lost validity, how AI rendered classic coding questions obsolete, and how HackerRank's new Chakra platform reimagines hiring by evaluating real-world task completion, AI fluency, and critical thinking across agentic development environments.
Key Questions Answered
- •Interview Evolution: Algorithm questions like reversing linked lists and inverting binary trees became standard because Google popularized them, not because they reflect daily engineering work. HackerRank is now running a literal billboard apology campaign in San Francisco, acknowledging this mismatch and actively shifting toward real-world repository-based assessments that mirror actual job tasks.
- •Chakra's Three-Dimension Evaluation Framework: HackerRank's AI interviewer scores candidates across three axes: task completion, AI fluency measured by framing-judging-steering quality, and conceptual understanding via 15-minute follow-up probing. The platform has processed over 500,000 AI interviews and achieves a 4.6–4.7 out of 5 Developer Love Index rating, higher than static take-home assessments.
- •AI Fluency as the New Core Skill: Hiring managers should evaluate candidates on how they frame prompts, judge AI output quality, and steer models toward correct solutions — not just whether final code works. Candidates who cannot critically assess AI-generated output represent a production risk, as unchecked AI-generated pull requests with hundreds of file changes are already creating review bottlenecks at engineering teams.
- •Hiring Is a Regulated Industry: Companies deploying AI in interviews must comply with EEOC regulations, NYC Local Law 144, and the EU AI Act. HackerRank addresses this by building proprietary evaluation models, converting all voice responses to text before scoring to eliminate accent and appearance bias, and conducting pre-launch adverse impact testing across gender and demographic groups.
- •Software Engineering Expanding Into Every Role: The narrative has shifted from "software engineering is dead" to "software engineering is everywhere." Product managers, designers, customer support, sales, marketing, and legal teams are now building agents and tools. Roles like Forward Deployed Engineer, Go-to-Market Engineer, and Talent Engineer are emerging, making AI fluency evaluation relevant far beyond traditional developer hiring pipelines.
Notable Moment
Ravisankar revealed that HackerRank is building an RL gym and model evaluation infrastructure using real-world coding canvases, positioning the company to sell benchmark and eval services directly to frontier AI labs and enterprise model builders like Salesforce, Amazon, and Nvidia — a pivot beyond hiring entirely.
Episode Transcript
The technical interview has long been used as a proxy for actual job performance. Brain teasers, data structure puzzles, or reversing a linked list became the price of admission to employment as a developer in many organizations, even though few engineers do that work day to day. It would seem AI has now broken that model entirely, since an LLM can one shot any classic algorithm question. This is forcing tech companies to rethink what an interview should measure. Vivek Ravishankar is the co founder and CEO of HackerRank, which is one of the most well known platforms for tech interview practice problems. In this episode, Vivek joins Josh Goldberg to discuss why old style interviews stopped working, the company's apology tour for years of algorithm puzzles, how to keep AI evaluation fair and trustworthy, and where both models and the shape of hiring may be headed as software engineering becomes something every role does. This episode is hosted by Josh Goldberg, front end developer at Sentry and open source maintainer. Josh works on projects in the TypeScript ecosystem, most notably TypeScript ESLint, a powerful static analysis tool set for JavaScript and TypeScript. Josh is also the author of the O'Reilly Learning TypeScript book, a Microsoft MVP for developer technologies, and a cofounder of SquiggleConf, a conference for excellent web developer tooling. Find Josh on Blue Sky, fostadon,and.com as Joshua k Goldberg. With me today is Vivek Ravasankar, CEO of HackerRank. Vivek, welcome to Software Engineering Daily. Thank you for the invite. Super good to be here. How's it going? Things are good. I'm always excited to talk about tech interviews and AI and how it's all shaping together. But before we dive into all that, tell us, how did you get started with HackerRank? Yeah. I started this company over a decade ago. I used to work at Amazon as a developer where I interviewed a lot of people, and I realized that resumes didn't have a great correlation to their skills. I'd interviewed people who looked great on paper, completely bombed the interview and vice versa. And that led to the idea of maybe skills matter more than pedigree. Of course, we hadn't codified it that way, but that was the founding inspiration to get going. And we started the company with that ethos. It's still our ethos. Lovely. And over the years, you've seen quite a few different styles of interview questions. What was the original premise for what kinds of things you were seeing companies ask and have folks answer? Yeah. I think if you were to just zoom out and think about all the evolution of questions, it always used to be one of those things of whichever was the most prominent software engineering company. And whatever their interview process was, it became the standard de facto across the board. So Microsoft was technically the first software company, and the questions that they used to ask early on were things like how many golf balls …
Get the full transcript (10,910 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 50-minute episode.
Get Software Engineering Daily summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Software Engineering Daily
Fraud Prevention in the Age of AI Agents
Nov 12 · 42 min
Stuff You Should Know
Selects: Gobble Gobble: Turkeys!
Nov 14
More from Software Engineering Daily
GitLab and the Evolution of DevSecOps
Nov 10 · 56 min
WorkLife with Adam Grant
How to figure out what you want with Simone Stolzoff
Nov 3
More from Software Engineering Daily
We summarize every new episode. Want them in your inbox?
Fraud Prevention in the Age of AI Agents
GitLab and the Evolution of DevSecOps
SED News: PHP’s Megabug, a Hidden Mic at OpenAI, and Dead AI Products
Demis Hassabis and the Race to Build AI with Sebastian Mallaby
AI Regulation and What Every Tech Company Should Know
Similar Episodes
Related episodes from other podcasts
Stuff You Should Know
Nov 14
Selects: Gobble Gobble: Turkeys!
WorkLife with Adam Grant
Nov 3
How to figure out what you want with Simone Stolzoff
WorkLife with Adam Grant
Sep 22
How to survive a life quake with Chip Conley
WorkLife with Adam Grant
Sep 15
Bryce Dallas Howard on the realities of being handed a head start
Stuff You Should Know
Sep 12
Selects: Wasps: Not as cute as bees
Explore Related Topics
This podcast is featured in Best Cybersecurity Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Investing & Markets Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Software Engineering Daily.
Every Monday, we deliver AI summaries of the latest episodes from Software Engineering Daily and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime