Skip to main content
Cognitive Revolution

Agents That Think Together: Cisco's Vijoy Pandey on Semantic Alignment, Scope, Accord & Concord

91 min episode · 3 min read
·
Vijay Pandey

Episode

91 min

Read time

3 min

Topics

Relationships, Design & UX, Software Development

AI-Generated Summary

Key Takeaways

  • ✓Silent Failure Rate: Multi-agent systems appear operational while producing zero outcomes. In one travel-booking test with five agents, system dashboards showed 66% uptime — all green — yet task completion was 0%. Cognitive misalignment, not infrastructure failure, caused the breakdown. Operators should not trust uptime metrics alone as a proxy for outcome delivery; semantic observability requires a separate dedicated layer.
  • ✓Cognitive Failure Compounding: Semantic misalignments compound exponentially across agent chains. In a five-agent deployment, one cognitive failure dropped accuracy from 99% to 98%. Two failures dropped it to 81%. Three failures collapsed accuracy to 16% — near random output. Cisco's analysis of public ChatDev traces found 100% of multi-agent sessions contained at least one semantic failure, making this a universal, not edge-case, problem.
  • ✓Scope Protocol — Cognitive Observability: Scope is an open-source observability platform that builds knowledge graphs on top of standard OpenTelemetry traces to detect semantic and cognitive drift between agents. It functions like lane-departure warning software, flagging when agents diverge from shared goals without disrupting existing infrastructure. Teams using any OpenTelemetry-compatible stack can deploy Scope without replacing current monitoring tooling.
  • ✓Accord Protocol — Pre-Work Intent Alignment: Accord is an open-source protocol that forces agents to align on goals, scope, and terminology before execution begins. A concrete failure mode it addresses: one agent interprets "100,000 users" as total users while another assumes concurrent users — a grounding mismatch that cascades through legal, finance, and engineering outputs. Accord rides above A2A and MCP protocols via the open-source Agent Bridge project.
  • ✓Concord Protocol — Mid-Work Negotiation: Concord handles coordination and compromise during active task execution, where conditions shift and agent assumptions diverge. In the restaurant-booking example, two agents representing different people with conflicting food preferences, location requirements, and availability windows cannot autonomously reach a reservation without Concord-style negotiation. The protocol enables agents to update shared understanding dynamically rather than locking in initial assumptions.

What It Covers

Vijoy Pandey, SVP at Cisco's Outshift division, details how multi-agent systems fail silently in production deployments with partners including Swisscom, ServiceNow, and Webex. He introduces three open-source tools — Scope, Accord, and Concord — designed to detect semantic drift, align agent intent before work begins, and enable negotiation during execution.

Key Questions Answered

  • •Silent Failure Rate: Multi-agent systems appear operational while producing zero outcomes. In one travel-booking test with five agents, system dashboards showed 66% uptime — all green — yet task completion was 0%. Cognitive misalignment, not infrastructure failure, caused the breakdown. Operators should not trust uptime metrics alone as a proxy for outcome delivery; semantic observability requires a separate dedicated layer.
  • •Cognitive Failure Compounding: Semantic misalignments compound exponentially across agent chains. In a five-agent deployment, one cognitive failure dropped accuracy from 99% to 98%. Two failures dropped it to 81%. Three failures collapsed accuracy to 16% — near random output. Cisco's analysis of public ChatDev traces found 100% of multi-agent sessions contained at least one semantic failure, making this a universal, not edge-case, problem.
  • •Scope Protocol — Cognitive Observability: Scope is an open-source observability platform that builds knowledge graphs on top of standard OpenTelemetry traces to detect semantic and cognitive drift between agents. It functions like lane-departure warning software, flagging when agents diverge from shared goals without disrupting existing infrastructure. Teams using any OpenTelemetry-compatible stack can deploy Scope without replacing current monitoring tooling.
  • •Accord Protocol — Pre-Work Intent Alignment: Accord is an open-source protocol that forces agents to align on goals, scope, and terminology before execution begins. A concrete failure mode it addresses: one agent interprets "100,000 users" as total users while another assumes concurrent users — a grounding mismatch that cascades through legal, finance, and engineering outputs. Accord rides above A2A and MCP protocols via the open-source Agent Bridge project.
  • •Concord Protocol — Mid-Work Negotiation: Concord handles coordination and compromise during active task execution, where conditions shift and agent assumptions diverge. In the restaurant-booking example, two agents representing different people with conflicting food preferences, location requirements, and availability windows cannot autonomously reach a reservation without Concord-style negotiation. The protocol enables agents to update shared understanding dynamically rather than locking in initial assumptions.
  • •Identity-Model Decoupling Strategy: Pandey separates agent identity, persona, and memory from both the underlying model and the harness. His personal agent "Arnold Lane" runs simultaneously on Hermes, Muse, DOTS, and Grok — switching models without losing continuity. This architecture prevents vendor lock-in and survives model deprecations. The practical implementation: store persona and memory in a layer that is explicitly independent of whichever frontier model or harness sits beneath it.
  • •Latent Space Communication — Inevitable for Hard Science: Agent-to-agent communication in high-dimensional latent space, bypassing natural language entirely, is positioned as necessary for problems like drug discovery, materials science, and weather modeling where token-based communication introduces lossy compression. Pandey frames this as analogous to pharmaceutical drug introduction — the capability should be developed and deployed incrementally with staged rollouts, not blocked, but not rushed into human-facing systems without structured guardrails.

Notable Moment

Pandey describes his personal test case: his agent and his wife's agent cannot autonomously book a dinner reservation. Despite both agents being deployed on production-grade global infrastructure, they fail to negotiate food preferences, location, and availability without human intervention. He frames this two-person, single-task failure as the baseline threshold the entire field must clear before enterprise-scale agentic outcomes become credible.

Know someone who'd find this useful?

Episode Transcript

Hello, and welcome back to the Cognitive Revolution. My guest today is Vjoy Pandey, SVP and GM of Outshift by Cisco. When Vjoy was last here in March, he described the Internet of Cognition, The higher order protocols that AI agents need to share context, align on intent, and solve problems together. And he offered a prescient description of what the field collectively is building. Systems where agents come together and do net new things that really make a difference. Today, with the open face incident and Navier Stokes both in the rearview mirror, that's clearly now the reality. For better and at least in some cases for worse. And Cisco's efforts have accelerated alongside everything else. The agency project now belongs to the Linux Foundation, and Cisco has deployed multi agent systems with partners including Swisscom, ServiceNow, SoftServe, and Webex. Naturally, they've seen how agents often miscommunicate and misunderstand one another, and how these semantic and cognitive misalignments between agents can quickly compound into major performance degradations. To help others avoid similar issues, they've recently open sourced a new suite of protocols designed to help agents think and work productively together. This includes projects called Scope, which builds knowledge graphs on top of agent traces and attempts to identify cognitive failures. Accord, which helps agents align on intent, scope, and key terms before work gets underway. And Concord, which helps agents negotiate an outcome that all of them can accept even when they initially disagree. A highlight of this conversation for me was the opportunity to compare notes on our personal AI setups. Mine, as regular listeners will know, combines high access, low autonomy agents that I think of as extensions of myself and that run on my personal computer with lower access, higher autonomy agents that run on their own computer. VJoy on the other hand has a single agent for himself, which he calls Arnold Lane after a Pink Floyd song, and another for his wife. But he reports the two agents still often struggle to act effectively together on their human's behalf. Meanwhile, in an effort to avoid lock in to a single model provider and maintain choice and flexibility going forward, we both aim to separate our agents' identities, personas, and memory systems from both the model and the proprietary harnesses they run-in. Toward the end, we get VJoy's latest takes on such hot button issues as latent space communication between agents, which he believes is inevitable and perhaps required for certain use cases like drug discovery and weather modeling. And also on the argument that Yuval Noah Harari recently made that we humans will soon be governed by AI systems beyond our comprehension, much as cows today are already ruled by markets and other structures they know nothing about. As you'll hear, VJoy's perspective is that this is already the reality in many domains. And that with proper record keeping, monitoring, and other guardrails, the benefits should far exceed the costs. With that, I …

Get the full transcript (13,413 words) + summary by email — free

One-time email with the complete transcript and AI summary of this episode. No account needed.

One email, no spam. We’ll also show you what SignalCast does.

Browse all Cognitive Revolution transcripts →

You just read a 3-minute summary of a 88-minute episode.

Get Cognitive Revolution summarized like this every Monday — plus up to 2 more podcasts, free.

Pick Your Podcasts — Free

Keep Reading

Books, tools, and gear mentioned in this episode

SignalCast may earn commission on purchases via these links. As an Amazon Associate, SignalCast earns from qualifying purchases.

Tools

  • by Cisco

    “Scope is an open-source observability platform that builds knowledge graphs on top of standard OpenTelemetry traces to detect semantic and cognitive drift between agents. It functions like lane-departure warning software, flagging when agents diverge from shared goals without disrupting existing infrastructure.”
  • by Cisco

    “Accord is an open-source protocol that forces agents to align on goals, scope, and terminology before execution begins. Accord rides above A2A and MCP protocols via the open-source Agent Bridge project.”
  • by Cisco

    “Concord Protocol — Mid-Work Negotiation: Concord handles coordination and compromise during active task execution, where conditions shift and agent assumptions diverge. The protocol enables agents to update shared understanding dynamically rather than locking in initial assumptions.”
  • “Accord rides above A2A and MCP protocols via the open-source Agent Bridge project.”
  • “Scope is an open-source observability platform that builds knowledge graphs on top of standard OpenTelemetry traces to detect semantic and cognitive drift between agents.”

Products

  • “His personal agent 'Arnold Lane' runs simultaneously on Hermes, Muse, DOTS, and Grok — switching models without losing continuity.”
  • “His personal agent 'Arnold Lane' runs simultaneously on Hermes, Muse, DOTS, and Grok — switching models without losing continuity.”
  • “His personal agent 'Arnold Lane' runs simultaneously on Hermes, Muse, DOTS, and Grok — switching models without losing continuity.”
  • “His personal agent 'Arnold Lane' runs simultaneously on Hermes, Muse, DOTS, and Grok — switching models without losing continuity.”

company

  • “Vijoy Pandey, SVP at Cisco's Outshift division, details how multi-agent systems fail silently in production deployments with partners including Swisscom, ServiceNow, and Webex.”
  • “Vijoy Pandey, SVP at Cisco's Outshift division, details how multi-agent systems fail silently in production deployments with partners including Swisscom, ServiceNow, and Webex.”
  • “Vijoy Pandey, SVP at Cisco's Outshift division, details how multi-agent systems fail silently in production deployments with partners including Swisscom, ServiceNow, and Webex.”
  • “Cisco's analysis of public ChatDev traces found 100% of multi-agent sessions contained at least one semantic failure, making this a universal, not edge-case, problem.”

More from Cognitive Revolution

We summarize every new episode. Want them in your inbox?

Similar Episodes

Related episodes from other podcasts

Explore Related Topics

This podcast is featured in Best AI Podcasts (2026) — ranked and reviewed with AI summaries.

Read this week's Software Engineering Podcast Insights — cross-podcast analysis updated weekly.

You're clearly into Cognitive Revolution.

Every Monday, we deliver AI summaries of the latest episodes from Cognitive Revolution and 192+ other podcasts. Free for one show.

Start My Monday Digest

No credit card · Unsubscribe anytime