Agents That Think Together: Cisco's Vijoy Pandey on Semantic Alignment, Scope, Accord & Concord
Episode
91 min
Read time
3 min
Topics
Relationships, Design & UX, Software Development
AI-Generated Summary
Key Takeaways
- ✓Silent Failure Rate: Multi-agent systems appear operational while producing zero outcomes. In one travel-booking test with five agents, system dashboards showed 66% uptime — all green — yet task completion was 0%. Cognitive misalignment, not infrastructure failure, caused the breakdown. Operators should not trust uptime metrics alone as a proxy for outcome delivery; semantic observability requires a separate dedicated layer.
- ✓Cognitive Failure Compounding: Semantic misalignments compound exponentially across agent chains. In a five-agent deployment, one cognitive failure dropped accuracy from 99% to 98%. Two failures dropped it to 81%. Three failures collapsed accuracy to 16% — near random output. Cisco's analysis of public ChatDev traces found 100% of multi-agent sessions contained at least one semantic failure, making this a universal, not edge-case, problem.
- ✓Scope Protocol — Cognitive Observability: Scope is an open-source observability platform that builds knowledge graphs on top of standard OpenTelemetry traces to detect semantic and cognitive drift between agents. It functions like lane-departure warning software, flagging when agents diverge from shared goals without disrupting existing infrastructure. Teams using any OpenTelemetry-compatible stack can deploy Scope without replacing current monitoring tooling.
- ✓Accord Protocol — Pre-Work Intent Alignment: Accord is an open-source protocol that forces agents to align on goals, scope, and terminology before execution begins. A concrete failure mode it addresses: one agent interprets "100,000 users" as total users while another assumes concurrent users — a grounding mismatch that cascades through legal, finance, and engineering outputs. Accord rides above A2A and MCP protocols via the open-source Agent Bridge project.
- ✓Concord Protocol — Mid-Work Negotiation: Concord handles coordination and compromise during active task execution, where conditions shift and agent assumptions diverge. In the restaurant-booking example, two agents representing different people with conflicting food preferences, location requirements, and availability windows cannot autonomously reach a reservation without Concord-style negotiation. The protocol enables agents to update shared understanding dynamically rather than locking in initial assumptions.
What It Covers
Vijoy Pandey, SVP at Cisco's Outshift division, details how multi-agent systems fail silently in production deployments with partners including Swisscom, ServiceNow, and Webex. He introduces three open-source tools — Scope, Accord, and Concord — designed to detect semantic drift, align agent intent before work begins, and enable negotiation during execution.
Key Questions Answered
- •Silent Failure Rate: Multi-agent systems appear operational while producing zero outcomes. In one travel-booking test with five agents, system dashboards showed 66% uptime — all green — yet task completion was 0%. Cognitive misalignment, not infrastructure failure, caused the breakdown. Operators should not trust uptime metrics alone as a proxy for outcome delivery; semantic observability requires a separate dedicated layer.
- •Cognitive Failure Compounding: Semantic misalignments compound exponentially across agent chains. In a five-agent deployment, one cognitive failure dropped accuracy from 99% to 98%. Two failures dropped it to 81%. Three failures collapsed accuracy to 16% — near random output. Cisco's analysis of public ChatDev traces found 100% of multi-agent sessions contained at least one semantic failure, making this a universal, not edge-case, problem.
- •Scope Protocol — Cognitive Observability: Scope is an open-source observability platform that builds knowledge graphs on top of standard OpenTelemetry traces to detect semantic and cognitive drift between agents. It functions like lane-departure warning software, flagging when agents diverge from shared goals without disrupting existing infrastructure. Teams using any OpenTelemetry-compatible stack can deploy Scope without replacing current monitoring tooling.
- •Accord Protocol — Pre-Work Intent Alignment: Accord is an open-source protocol that forces agents to align on goals, scope, and terminology before execution begins. A concrete failure mode it addresses: one agent interprets "100,000 users" as total users while another assumes concurrent users — a grounding mismatch that cascades through legal, finance, and engineering outputs. Accord rides above A2A and MCP protocols via the open-source Agent Bridge project.
- •Concord Protocol — Mid-Work Negotiation: Concord handles coordination and compromise during active task execution, where conditions shift and agent assumptions diverge. In the restaurant-booking example, two agents representing different people with conflicting food preferences, location requirements, and availability windows cannot autonomously reach a reservation without Concord-style negotiation. The protocol enables agents to update shared understanding dynamically rather than locking in initial assumptions.
- •Identity-Model Decoupling Strategy: Pandey separates agent identity, persona, and memory from both the underlying model and the harness. His personal agent "Arnold Lane" runs simultaneously on Hermes, Muse, DOTS, and Grok — switching models without losing continuity. This architecture prevents vendor lock-in and survives model deprecations. The practical implementation: store persona and memory in a layer that is explicitly independent of whichever frontier model or harness sits beneath it.
- •Latent Space Communication — Inevitable for Hard Science: Agent-to-agent communication in high-dimensional latent space, bypassing natural language entirely, is positioned as necessary for problems like drug discovery, materials science, and weather modeling where token-based communication introduces lossy compression. Pandey frames this as analogous to pharmaceutical drug introduction — the capability should be developed and deployed incrementally with staged rollouts, not blocked, but not rushed into human-facing systems without structured guardrails.
Notable Moment
Pandey describes his personal test case: his agent and his wife's agent cannot autonomously book a dinner reservation. Despite both agents being deployed on production-grade global infrastructure, they fail to negotiate food preferences, location, and availability without human intervention. He frames this two-person, single-task failure as the baseline threshold the entire field must clear before enterprise-scale agentic outcomes become credible.
Episode Transcript
Hello, and welcome back to the Cognitive Revolution. My guest today is Vjoy Pandey, SVP and GM of Outshift by Cisco. When Vjoy was last here in March, he described the Internet of Cognition, The higher order protocols that AI agents need to share context, align on intent, and solve problems together. And he offered a prescient description of what the field collectively is building. Systems where agents come together and do net new things that really make a difference. Today, with the open face incident and Navier Stokes both in the rearview mirror, that's clearly now the reality. For better and at least in some cases for worse. And Cisco's efforts have accelerated alongside everything else. The agency project now belongs to the Linux Foundation, and Cisco has deployed multi agent systems with partners including Swisscom, ServiceNow, SoftServe, and Webex. Naturally, they've seen how agents often miscommunicate and misunderstand one another, and how these semantic and cognitive misalignments between agents can quickly compound into major performance degradations. To help others avoid similar issues, they've recently open sourced a new suite of protocols designed to help agents think and work productively together. This includes projects called Scope, which builds knowledge graphs on top of agent traces and attempts to identify cognitive failures. Accord, which helps agents align on intent, scope, and key terms before work gets underway. And Concord, which helps agents negotiate an outcome that all of them can accept even when they initially disagree. A highlight of this conversation for me was the opportunity to compare notes on our personal AI setups. Mine, as regular listeners will know, combines high access, low autonomy agents that I think of as extensions of myself and that run on my personal computer with lower access, higher autonomy agents that run on their own computer. VJoy on the other hand has a single agent for himself, which he calls Arnold Lane after a Pink Floyd song, and another for his wife. But he reports the two agents still often struggle to act effectively together on their human's behalf. Meanwhile, in an effort to avoid lock in to a single model provider and maintain choice and flexibility going forward, we both aim to separate our agents' identities, personas, and memory systems from both the model and the proprietary harnesses they run-in. Toward the end, we get VJoy's latest takes on such hot button issues as latent space communication between agents, which he believes is inevitable and perhaps required for certain use cases like drug discovery and weather modeling. And also on the argument that Yuval Noah Harari recently made that we humans will soon be governed by AI systems beyond our comprehension, much as cows today are already ruled by markets and other structures they know nothing about. As you'll hear, VJoy's perspective is that this is already the reality in many domains. And that with proper record keeping, monitoring, and other guardrails, the benefits should far exceed the costs. With that, I …
Get the full transcript (13,413 words) + summary by email — free
One-time email with the complete transcript and AI summary of this episode. No account needed.
One email, no spam. We’ll also show you what SignalCast does.
You just read a 3-minute summary of a 88-minute episode.
Get Cognitive Revolution summarized like this every Monday — plus up to 2 more podcasts, free.
Pick Your Podcasts — FreeKeep Reading
More from Cognitive Revolution
The Neuron Basis: Goodfire's Curt Tigges on Agentic Interp, Monosemanticity & Reverse Engineering
Nov 10 · 116 min
Lex Fridman Podcast
#501 – DHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux
Aug 26
More from Cognitive Revolution
AI:AM: Is THIS the AI We Want? Alarming Acceleration, AI Election Bets, GPU Trading & AI-Native VC
Nov 7 · 87 min
a16z Podcast
AI for America's Small Businesses | Lassie
Jul 30
Books, tools, and gear mentioned in this episode
SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.
Tools
by Cisco
“Scope is an open-source observability platform that builds knowledge graphs on top of standard OpenTelemetry traces to detect semantic and cognitive drift between agents. It functions like lane-departure warning software, flagging when agents diverge from shared goals without disrupting existing infrastructure.”
by Cisco
“Accord is an open-source protocol that forces agents to align on goals, scope, and terminology before execution begins. Accord rides above A2A and MCP protocols via the open-source Agent Bridge project.”
by Cisco
“Concord Protocol — Mid-Work Negotiation: Concord handles coordination and compromise during active task execution, where conditions shift and agent assumptions diverge. The protocol enables agents to update shared understanding dynamically rather than locking in initial assumptions.”
“Accord rides above A2A and MCP protocols via the open-source Agent Bridge project.”
“Scope is an open-source observability platform that builds knowledge graphs on top of standard OpenTelemetry traces to detect semantic and cognitive drift between agents.”
Products
company
“Vijoy Pandey, SVP at Cisco's Outshift division, details how multi-agent systems fail silently in production deployments with partners including Swisscom, ServiceNow, and Webex.”
“Vijoy Pandey, SVP at Cisco's Outshift division, details how multi-agent systems fail silently in production deployments with partners including Swisscom, ServiceNow, and Webex.”
“Vijoy Pandey, SVP at Cisco's Outshift division, details how multi-agent systems fail silently in production deployments with partners including Swisscom, ServiceNow, and Webex.”
“Cisco's analysis of public ChatDev traces found 100% of multi-agent sessions contained at least one semantic failure, making this a universal, not edge-case, problem.”
More from Cognitive Revolution
We summarize every new episode. Want them in your inbox?
The Neuron Basis: Goodfire's Curt Tigges on Agentic Interp, Monosemanticity & Reverse Engineering
AI:AM: Is THIS the AI We Want? Alarming Acceleration, AI Election Bets, GPU Trading & AI-Native VC
KYC Becomes KYA: Sentinel Bio's Joshua Monrad on DNA Screening, Uplift Studies & Agent Monitoring
AI:AM: Carbon in the Arena, Mistral's Le Chonk, the Agent-Run Economy, Ferroelectric RAM + New Hacks
Freedom of Action: America's ASI Strategy, w/ RAND's Joel Predd, Ben Boudreaux & Matt Chessen
Similar Episodes
Related episodes from other podcasts
Lex Fridman Podcast
Aug 26
#501 – DHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux
a16z Podcast
Jul 30
AI for America's Small Businesses | Lassie
Lenny's Podcast
Mar 29
From skeptic to true believer: How OpenClaw changed my life | Claire Vo
Venture Stories
Mar 5
Parth Patil on Coding Agents, Building Reid AI, and What It Takes to Operate at the Frontier
Latent Space
Jan 17
Brex’s AI Hail Mary — With CTO James Reggio
Explore Related Topics
This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.
Read this week's Software Engineering Podcast Insights — cross-podcast analysis updated weekly.
You're clearly into Cognitive Revolution.
Every Monday, we deliver AI summaries of the latest episodes from Cognitive Revolution and 192+ other podcasts. Free for one show.
Start My Monday DigestNo credit card · Unsubscribe anytime