Source Document
Yizhen Jiang, Haowei Guo, Tianyi Bai, Zengjie Hu, Lu Ma, Zhengyang Zhao, Haoze Sun, Peng Pei, Wentao Zhang, "MCPHallu: Benchmarking Reasoning, Execution, and Memory Hallucinations in MCP Agents", arXiv:2611.07689 [cs.AI], submitted 2026-11-05, DOI 10.48550/arXiv.2611.07689. Affiliation: Peking University Zhongguancun Academy, Meituan, Hong Kong University of Science and Technology. Code and benchmark released (github.com/J1zz/mcp_hallu), CC BY-NC-SA 4.0.
This is a preprint without peer review. Most authors are affiliated with Peking University Zhongguancun Academy and Meituan, and two did internships at Meituan. The paper states it was supported by Meituan along with several Chinese government and academic grants. None of the 14 evaluated models is Meituan's own, so this is not a direct case of a company showcasing its own product. Task generation uses Claude Sonnet 4.6 and the primary judge is GPT-4o — both commercial models — but the authors state that deterministic components (live-server reference checks, post-execution state assertions) make up 70-80% of each subtype score, with the LLM judge contributing only 20-30%, and they report that swapping the judge for Claude Sonnet 4.5 leaves rankings nearly unchanged (correlation 0.914).
Study Overview
The question is simple: when an agent that reaches across multiple servers via the Model Context Protocol (MCP) fails, which stage — reasoning, execution, or memory — is responsible, and why? Existing MCP benchmarks mostly measure task completion, or diagnose failures only after the fact. MCPHallu does the opposite: it plants a structural trap into each task so that one specific hallucination type becomes the dominant cause of failure.
The benchmark spans 5 capability domains (search, analytics, productivity, finance, coding), runs on 36 production MCP servers (GitHub, Notion, Slack, and others, each in an isolated Docker container), and contains 358 tasks split across 4 hallucination subtypes (Branch Collapse, Unreachable Goal, Tool Misuse, Context Forgetting) and 3 difficulty levels. Ground truth is checked via live-server reference scripts and post-execution state assertions. The authors ran 14 frontier models from 8 vendors for a total of 5,012 trajectories.
Key Results
The overall average score is 0.642 (on a 0-1 scale), with Claude Opus 4.6 the best at 0.728 (this review independently re-averaged all 14 models' scores to confirm). Of the four subtypes, Unreachable Goal is the hardest, averaging 0.458 with a pass rate of only 23.2% — meaning agents often keep calling tools or claim completion on goals that are structurally impossible to achieve with the tools available.
Breaking this down by tool-call count makes the pattern sharp. Runs that make zero calls (recognizing infeasibility immediately) pass 65.0% of the time, but once an agent makes four or more calls, the pass rate drops to 0%. The more it keeps acting, the more false claims of completion pile up.
Source: original Table 6
View as table
| Item | Pass rate |
|---|---|
| 0 | 65.0% |
| 1-3 | 27.9% |
| 4-7 | 0.0% |
| 8-15 | 0.0% |
| 16+ | 0.0% |
On Tool Misuse, the bottleneck is not finding the right tool but resisting the wrong one. Calling only the correct tool yields an 84.7% pass rate, but calling it alongside a semantically overlapping "confusion" tool drops that to 32.3% — even though the required tool is still present in the trajectory.
| Tool-call archetype | Runs | Pass rate | Mean steps |
|---|---|---|---|
| Correct tool only | 825 | 84.7% | 3.54 |
| Correct + confusion tool | 260 | 32.3% | 10.70 |
| Confusion tool only | 16 | 0.0% | 3.38 |
| Neither called | 75 | 8.0% | 0.37 |
One more point: the overall leader, Claude Opus 4.6, ranks only 7th of 14 models on the Branch Collapse subtype (this review recomputed the ranking directly from the original Table 5). Model rankings shift by an average of 6.9 of 13 positions across subtypes, and Branch Collapse is nearly uncorrelated with Unreachable Goal across models (r = -0.12) — a single aggregate score hides this gap entirely.
Credibility Assessment
Three things earn trust. First, grading leans on live-server state checks and post-hoc state assertions, with the LLM judge's share explicitly capped at 20-30%. Second, the authors themselves verified and disclosed that swapping the judge for a different vendor's model leaves rankings almost unchanged (correlation 0.914). Third, the 36 servers are version-pinned real production packages rather than mocks, and the code and tasks are public, leaving a route to external replication.
The caveats are equally clear. This is a preprint without peer review, funded in part by Meituan along with other grants, and two authors interned at Meituan. The authors themselves disclose that the three axes (reasoning, execution, memory) are a design heuristic rather than statistically independent factors, that the 36 servers skew toward English-language, Western SaaS products so results may not generalize to non-English or regional services, and that the tool inventory is fixed per task, so hallucinations from servers being installed or removed mid-trajectory are not measured. There is no directly contradicting result, but there is a point of comparison: a prior MCP benchmark the authors cite, MCP-Atlas, reports top-model pass rates of 50% or higher (up to 82.2% in some reported configurations) — but that measures general task completion without a structural trap, so it is not directly comparable to MCPHallu's 0.642 average. Completion rate and hallucination-mechanism diagnosis are different questions.
Related Research
- Zhang et al. (2024). ToolBeHonest — A prior benchmark (EMNLP 2024) measuring solvability-judgment errors in single-server, stateless tool use. GPT-4o scored only 37.0 of 100, showing tool hallucination is a long-standing problem, but it does not cover multi-server, stateful, long-horizon settings — the gap MCPHallu fills.
- Xu et al. (2025). Reducing Tool Hallucination via Reliability Alignment (RelyToolBench) — A prior work introducing "indecisive actions" that let an agent defer tool use or seek clarification instead of forcing a call. Its direction matches MCPHallu's finding that early recognition (65% pass at zero calls) beats persistence (0% pass at four-plus calls) — independent, converging evidence that stopping early is the key lever.
- Bandi et al. (2026). MCP-Atlas — A prior MCP benchmark measuring tool-use competency across 36 real MCP servers and 1,000 tasks, with a post-hoc 11-category failure taxonomy. MCPHallu extends this completion-rate design toward pre-planted structural traps that isolate a specific failure type per task — the two benchmarks ask complementary questions (completion vs. mechanism diagnosis) rather than conflicting ones.
Reviewer's Judgement
First, the 0.642 average score obscures the benchmark's most operationally important number. The signal that actually matters is the cliff: pass rate hits exactly 0% once an agent has made four or more tool calls on an infeasible goal. I judge that a dashboard built around averages or a single leaderboard score is likely to miss this cliff entirely — an MCP agent deployed without an early-stop policy may keep reporting "still working" while tasks that are already unrecoverable pile up underneath it.
Second, I judge the scoring design here — deterministic components at 70-80%, LLM judgment capped at 20-30%, with a disclosed cross-judge correlation of 0.914 — to be a genuine answer to the "LLM-judge dependence" critique this series raises often. Anyone building their own agent benchmark should take this split-and-disclose pattern as a template.
Third, the fact that the overall top model drops to 7th place on one specific subtype should unsettle the common procurement habit of "just pick the top model." I judge that a team whose MCP deployment is dominated by branch-collapse-style failures (combining multiple tool outputs under a condition) should look at that subtype's leaderboard, not the aggregate one.
Putting It to Work
- Early-stop budget — Force an "infeasible" judgment within 3 tool calls on tasks where goal achievability is uncertain. The cliff from 65.0% (zero calls) to 0% (four-plus calls) is the evidence.
- Clean up overlapping tools — Exposing a semantically overlapping tool alongside the correct one drops pass rate from 84.7% to 32.3%. Namespace or merge near-duplicate tools when wiring an MCP server.
- Track subtype-level leaderboards — Don't pick a model on aggregate score alone. Rankings shift by an average of 6.9 of 13 positions across subtypes, so first identify which failure mode dominates your own workload.
- Favor deterministic grading — If you build your own evaluation pipeline, consider capping the LLM judge's weight at 20-30% and filling the rest with post-execution state verification, as this benchmark does.
Conclusion
MCPHallu's contribution is not measuring how often MCP agents fail, but structurally exposing why and at which stage. More valuable in practice than the 0.642 average score are its two mechanisms: pass rate collapses to 0% when an agent fails to recognize an unreachable goal early, and Tool Misuse pass rate is roughly halved once a confusion tool enters the trajectory. Given its preprint status and its Western-SaaS-leaning server set, the first step is to reproduce these same four failure modes against your own MCP deployment before drawing conclusions. For an operational example of cutting tool count to reduce this kind of confusion, see the AutoRAG MCP tool-consolidation guide.
References
- MCPHallu: Benchmarking Reasoning, Execution, and Memory Hallucinations in MCP Agents — arXiv abstract (source)
- Full HTML text of the same paper — used to verify tables and figures
- MCPHallu code and benchmark repository
- 2,594 Tools Down to 2: The AutoRAG MCP Server Migration — sunny34.com blog
Ask AI about this review
The assistant has read this review and the numbers it verified. Ask anything — it answers from the text and says so when something isn't in it.
Loading the chat…