Source Document
Ruiheng Yu, Oteo Mamo (Florida State University), Siyu Gan (Johns Hopkins University), Weikuan Yu, Mulong Luo (Florida State University), "OverServe: Resource Amplification Attacks on SaaS Agents via Tool–Prompt Co-Design", arXiv:2611.14808 [cs.CR], submitted 2026-11-10, DOI 10.48550/arXiv.2611.14808.
This is an arXiv preprint that has not been through peer review (cs.CR, posted directly on submission; no conference or journal acceptance was found in the text). All authors are university-affiliated (Florida State University, Johns Hopkins University), and the evaluation targets simulated environments on nine public benchmarks (AppWorld, EnterpriseOps-Gym, and others), not a named commercial service. The Acknowledgment states the project is "sponsored by the FSU-ReliaQuest Innovation Challenge" — ReliaQuest is a security company, but the paper neither evaluates nor promotes its product. The authors' Ethical Considerations section recommends controlled environments and execution limits for reproduction, and the actual attack-generation code is not released. The session's egress was fully blocked (curl diagnostics confirmed CONNECT-tunnel rejections to arxiv.org, example.com, and sunny34.com alike), so WebFetch could not open the source directly; the full text was instead checked against a primary-source HTML copy in docs/research-authoring/snapshots/2026-11-14 (collected 2026-11-13T22:07:59Z).
Study Overview
The question: in a subscription-billed SaaS AI agent, can a tool and a prompt that each independently pass the provider's review combine to amplify resource use (tokens, API calls) undetected? The threat model: SaaS providers bill customers by task success, but LLM API cost is incurred regardless of success, so manipulating the agent's stopping decision shifts cost onto the provider without shifting it onto the customer. The authors' OverServe, a multi-agent framework, pairs an MCP tool that truthfully reports service status with an ordinary-looking prompt asking the agent to confirm completion. Each tool call terminates normally and never lies, but if the backend keeps receiving updates (churn), the agent keeps re-checking. A generated tool-prompt pair only counts as "admitted" if it passes static code review, a runtime completion check, and prompt review. Four victim models — Qwen3.8-27B, Nemotron-3-Super, DeepSeek-v4-Flash, and Sonnet-5 — were evaluated on selected tasks from nine benchmarks including MCPMark, AppWorld, and EnterpriseOps-Gym.
Key Results
Per-model geometric-mean amplification across five enterprise workflow benchmarks (EnterpriseOps-Gym, Enterprise-Worlds, STATE-Bench, WorkBench, Toolathlon-GYM):
| Model | Geometric-mean amplification |
|---|---|
| Qwen3.8-27B | 19.30× |
| DeepSeek-v4-Flash | 17.75× |
| Nemotron-3-Super | 8.07× |
| Sonnet-5 | 4.07× |
Source: §5.2 in the paper (the overall geometric mean across 20 model-benchmark pairs is 10.30×). AppWorld (measured in API requests) and Terminal-Bench (measured in elapsed time) use different units and are reported separately, excluded from this geometric mean.
On AppWorld, Sonnet-5 raised API requests from 29 to 2,722.5 — 93.88×, the highest figure in the paper — while Qwen reached only 9.26× on the same benchmark, showing how widely amplification swings by model-benchmark pair. On EnterpriseOps-Gym, which caps at 200 calls, Qwen and Nemotron both rose from 5 to 200 calls (40.00×), hitting the cap. Terminal-Bench is reported as an elapsed-time ratio rather than a call count, ranging 12.12×–53.48×. Every attacked run still passed the original task's checks (channel creation, message posting, etc.) — the extra calls under churn were entirely unrelated re-checking. Relative to matched clean runs, cumulative input/output tokens rose by a median of 8.70× under churn.
Compared directly against prior attacks, only OverServe passed all three review stages while also achieving the largest amplification:
| Attack | Quiet amp. | Churn amp. | Code/runtime/prompt review passed |
|---|---|---|---|
| A2M | 1.17–1.50× | 1.17–1.50× | 0/2, 0/2, unmodified prompt |
| LoopTrap | 2.00–4.17× | 4.00–10.00× | 0/2, 0/2, unmodified prompt |
| STA (4 rounds) | 1.00–1.83× | 1.00–1.83× | N/A, N/A, 4/4 |
| OverServe | 1.25–1.50× | 7.00–10.00× | 2/2, 2/2, 2/2 |
Source: Table 2 in the paper (Qwen3.8-27B and Sonnet-5, MCPMark TxtMerge and EnterpriseOps-Gym, 40-turn budget). Quiet/Churn hold the same tool and prompt fixed and vary only backend update activity; review-passed counts are how many times the pre-registered attack tool/prompt cleared each of the three checks (N/A means that attack has no component of that type).
Detection evasion was measured separately. Running 22 archived attack tools through five industrial scanners (Cisco YARA, Lasso regex, MCPInspect, MCPShield, LLM tool review) produced zero alerts across all of them; among research detectors, DCI (description-code inconsistency) caught 3/22 and Connor (malicious-MCP-server detection) caught 1/22. A controlled ablation (Table 3 in the paper) directly shows the two components are both necessary: with the original prompt alone, the crafted tool is never invoked; with the crafted prompt and tool together under ongoing backend updates, calls rise from 5 to 40 (the budget cap). When updates stop after ten writes, the run ends normally at 37 calls; removing the crafted tool entirely drops calls back to 7.
Credibility Assessment
Grounds for trust: a controlled comparison applying the same protocol (quiet/churn conditions, matched budgets) across four models and nine benchmarks, with the ablation in Tables 2 and 3 directly supporting the causal claim that the tool and prompt must act together. The detection evaluation used five real, deployed industrial scanners rather than detectors the authors built themselves.
Caveats: a single pre-peer-review preprint with no independent replication confirmed. Backend churn is simulated — the authors themselves state "incomplete synchronization is simulated" — so whether the attack reproduces against a live production SaaS backend is unverified. The threat model assumes the provider already allows third-party MCP tool registration; many real services add a human review step beyond automated scanners, and that layer's effectiveness is outside this paper's scope. The 22 tools used in the detection evaluation were generated and selected by OverServe itself, which carries a selection-bias risk, and the scanning was not independently re-run by a third party. No prior work was found that supports the opposite claim (that component-level review alone suffices) — if anything, the cited prior attacks (A2M, LoopTrap) being easily detected as single vectors points the same direction as this paper's conclusion.
Related Research
- Xu et al. (2026). LoopTrap: Termination Poisoning Attacks on LLM Agents — a prior attack directly compared in the paper's own Table 2. It manipulates termination through a single vector (tool or prompt) and reaches up to 10× under churn, but in OverServe's comparison it was caught 0/2 by both code and runtime review. Prior-work relation, and a contrast point: OverServe's central claim is that detection is hard to avoid without the combined design.
- Li & Wang (2026). Sponge Tool Attack: Stealthy Denial-of-Efficiency against Tool-Augmented Agentic Reasoning — a prior attack using query-only access to induce inefficiency through prompt rewriting alone. In OverServe's comparison (Table 2), four-round STA stays at 1.00–1.83×, showing amplification is limited without a paired tool. Prior-work relation.
- Liu et al. (2026). ReasoningBomb: A Stealthy Denial-of-Service Attack by Inducing Pathologically Long Reasoning in Large Reasoning Models — cited by OverServe as an adjacent threat. It targets a reasoning model's own token generation through the input prompt, not a SaaS agent's tool-calling loop, so the attack surface differs. Independently identified and confirmed via WebSearch (direct WebFetch access to the full text stayed blocked by the session egress fault), so the reported figures (e.g., an average input-to-output token amplification ratio) are used only to describe the relationship, not folded into the Key Results above. Prior-work (adjacent-mechanism) relation.
Reviewer's Judgement
First, I'd judge that even when a provider already has all three gates — tool review, a runtime completion check, and prompt review — passing them doesn't guarantee safety. The paper's core point is that each component can be individually "honest" (never reporting a false status) while the combination is still malicious, and that looks like a structural blind spot for scanners such as Cisco's or Lasso's, which are designed to check one component at a time.
Second, I'd read the authors' finding that "every OverServe run passes the original task's checks" as a clue for defense as much as a demonstration of stealth. The fact that a new "completion requirement" appears outside the original task's verification criteria is itself a plausible detection signal, but the paper doesn't test defenses along that line.
Third, I'd be cautious about reading Sonnet-5's noticeably lower geometric-mean amplification (4.07×) relative to the other three models (8–19×) as a straightforward safety difference. A footnote to Table 1 shows, for instance, that Qwen's BrowseComp-Plus baseline itself failed to complete the task and was dropped from that entry — the set of tasks each model could be scored on differs, so part of the gap between models may be a selection effect rather than a capability or safety difference.
Putting It to Work
- Outlier-based cost monitoring — track per-task call counts against their historical average independent of task success, and flag a successful task whose call count spikes several times above normal as a billing anomaly.
- Added-completion-condition gate — add a review step that checks whether a user prompt introduces a new "confirm completion" requirement absent from the original task's own verification criteria.
- Treat static scanners as a first filter, not a verdict — a third-party MCP tool clearing a YARA/regex-based scanner should be treated as passing a first filter, with a hard cap at runtime on how often the agent may re-query the same status.
- Resource transparency for subscription billing — expose actual per-customer resource usage independent of task success, so anomalous patterns can be caught early by the customer side as well as the provider.
- Add combined test cases to the review pipeline — include tool-plus-prompt test cases alongside component-level tests, verifying combined safety separately from each component's individual safety.
Conclusion
OverServe's contribution is an empirical demonstration, across four models and nine benchmarks, that an "honest tool plus an ordinary prompt" can each clear review individually while the combination amplifies a SaaS agent's resource use by tens of times. The ceiling was 93.88× on Sonnet-5 and AppWorld, and the five-benchmark per-model average ranged 4.07–19.30×. Prior single-vector attacks were caught by code and runtime review, while OverServe passed all three. That said, backend churn is simulated and independent replication doesn't yet exist, so the numbers are best read as directional, and adding combined-case tests to a real MCP tool approval pipeline looks like the more realistic near-term response. Designing a trust-and-version gate for MCP registry servers before they're adopted is covered further in our piece on the MCP registry server trust and version gate.
References
- OverServe: Resource Amplification Attacks on SaaS Agents via Tool–Prompt Co-Design — arXiv abstract (source)
- Full HTML text of the same paper — used for table/figure verification
- The MCP Registry Server Trust and Version Gate — sunny34.com blog
Ask AI about this review
The assistant has read this review and the numbers it verified. Ask anything — it answers from the text and says so when something isn't in it.
Loading the chat…