AI Summary
→ WHAT IT COVERS Host Claire demonstrates how to build an AI-powered pull request review bot using Vercel's Eve agent framework in under 30 minutes. The bot automatically scores PRs as low, medium, or high risk using a 100-point system, auto-approves low-risk changes, and escalates others to humans via Slack. → KEY INSIGHTS - **PR Auto-Approval at Scale:** Intercom's AI PR review system delivers 5x faster approvals than human reviewers while simultaneously reducing production revert rates. Their approach proves AI-reviewed code can exceed human-reviewed code in quality and safety, making auto-approval a net positive rather than a risk tradeoff for engineering teams managing high PR volume. - **Risk Scoring Framework:** Structure PR risk scoring across six dimensions: change size and blast radius, reversibility, data and security impact, operational changes, and verification gap (test coverage plus CI completion). Assign numeric weights to each dimension; scores below 24 are low risk, 25–64 medium, and 65-plus high risk requiring mandatory human review. - **Vercel Eve Agent Architecture:** An Eve agent requires only four components to function as a PR reviewer: a GitHub channel connector, a markdown instruction file (roughly one page), a skill to read PR diffs, and two tools for risk assessment and decision output. Vercel handles OAuth, refresh tokens, and Slack/GitHub configuration through built-in wizard-based connectors. - **SOC 2 Compliance Compatibility:** Auto-approving PRs does not violate SOC 2 or HIPAA frameworks provided the policy is documented in risk and code review policies, and every decision is logged, auditable, and queryable. Teams should confirm specifics with their security team, but compliance is achievable without requiring human sign-off on every individual PR. - **Eval Loop for Internal Bots:** Treat internal AI agents like customer-facing products by logging every PR review decision into an evaluation platform. Engineers periodically audit whether the bot scored correctly, enabling continuous improvement of risk thresholds and scoring logic — the same eval methodology used to improve external AI products applies directly to internal automation tools. → NOTABLE MOMENT Counterintuitively, the most time-consuming part of building the bot was not writing code — it was configuring third-party dashboards for Slack and GitHub app permissions. The host resolved this by using an AI browser agent to navigate and complete those configuration screens autonomously, cutting setup time dramatically. 💼 SPONSORS [{"name": "WorkOS", "url": "https://workos.com"}] 🏷️ AI Code Review, Pull Request Automation, Vercel Eve, Developer Productivity, AI Agents