25%, 50%, 60% — Baselines Undisclosed: Reviewing ANASSA, a Supply-Chain Spatial Agent

Source Document

Constantinos Papantoniou (Anassa.ai, corresponding author) and Brian Hilton (Research Scientist), "Agentic AI Orchestration Framework for Spatial Intelligence: Supply Chain Deployment", arXiv:2610.34569 [cs.AI], submitted 2026-10-25, DOI 10.48550/arXiv.2610.34569.

This is an unreviewed preprint. The corresponding author, Constantinos Papantoniou, is listed as affiliated with Anassa.ai — the company that commercializes the ANASSA architecture this paper describes — which is a structural conflict of interest: the deployment results being reported are a self-evaluation of the company's own product. Co-author Brian Hilton's affiliation is listed only as "Research Scientist," so an independent institutional affiliation cannot be confirmed. No funding source is disclosed separately. The authors state they used Claude (Anthropic) and Microsoft Copilot to assist with text and figure ideation during manuscript preparation.

Study Overview

The paper poses four research questions: (1) RQ1 Coordination — do typed contracts at agent boundaries reduce the manual-reconciliation burden on analysts; (2) RQ2 Grounding — does validating spatial claims against certified authoritative data reduce unsupported claims; (3) RQ3 Fusion and reproducibility — does versioned fusion of asynchronously updating telemetry, network state, and hazard data enable auditable decisions; (4) RQ4 Governance — can blocking human-approval gates preserve accountability without eliminating the latency advantage of orchestration.

The test bed is multi-hazard risk assessment on an ocean-and-inland freight lane, including cold-chain excursion detection over container telemetry, run as a three-month proof of concept (POC) across three implementation iterations. ANASSA itself is specified as eleven components (C1–C11) across four architectural layers, a six-step "Geospatial AI Cognitive Loop" (S1 Sensing through S6 Learning), eight typed data contracts (K1–K8) that declare a precondition at every agent boundary, and two blocking human-in-the-loop approval gates (plan approval and decision approval).

Key Results

The authors define relative change against the manual baseline as ΔM=(M_manual−M_POC)/M_manual×100% and report three outcomes. Absolute baseline values and sample sizes are withheld as confidential.

D1 (data quality) is the rate of published claims lacking supporting references, assessed by human review. D2 (runtime) spans from the initiation of the multi-hazard workflow to a validated output. D3 (decision latency) spans from objective to approved decision — meaning the two blocking approvals are themselves inside the measured interval. The three figures use different measurement bases, so they cannot be averaged or summed, and the paper itself describes them as "normalized relative changes," not inferential statistics.

Credibility Assessment

This is a pre-peer-review preprint with a clear conflict of interest as noted above. To its credit, the authors spell out limitations in unusual detail: they state up front that these are "uncontrolled deployment observations," not controlled experiments; the comparison is against a single manual workflow with no randomization; and typed contracts, authoritative grounding, and governance gates were introduced simultaneously, so the improvement cannot be attributed to any one mechanism. Instrumentation was also incomplete — intervention rate and gate dwell time, the key evidence for RQ4, were not captured. Importantly, the baseline is the organization's own prior manual workflow, not a competing agentic-GIS system — the paper does not claim ANASSA outperforms published systems such as GeoAgentic-RAG or GeoAgent. We found no directly contradicting external evidence, but that is partly because no comparable external figures exist for this deployment in the first place.

Related Research

Of the prior systems the authors compare against in their own Table 1, we independently confirmed three:

• Bao et al. (2026), Spatial-Agent: Agentic Geo-spatial Reasoning with Scientific Core Concepts — prior work. It structures spatial concepts as a graph and reports beating ReAct and Reflexion baselines, but has neither typed contracts nor governance gates (classified Contracts=N, Gov.=N in the paper's own Table 1).
• Yu et al. (2026), GeoAgentBench: A Dynamic Execution Benchmark for Tool-Augmented Agents in Spatial Analysis — benchmark origin. The ANASSA authors themselves list evaluation against this benchmark as future work, which is itself an admission that the deployment numbers reported here have not yet been translated into a standard-benchmark score.
• Mansourian and Oucheikh (2026), Bridging natural language and GIS — prior work. A multi-agent framework that turns natural-language queries into QGIS workflows, sharing ANASSA's goal of reducing analyst-reconciliation burden but without authoritative-data validation or a governance layer.

All three share a common gap — agent decomposition and spatial reasoning work, but grounding and governance remain weak — which is exactly the gap ANASSA's design targets. None of the three reports industrial deployment figures, however, so there is no comparison point for whether ANASSA's 25/50/60% figures represent "better performance" than prior work.

Reviewer's Take

First, the most trustworthy part of this paper is, paradoxically, not the numbers but the limitations section. It is unusual for a vendor-authored white paper to describe its own commercial product's results as "uncontrolled observations" rather than overstating them. But that transparency does not make the 25%, 50%, and 60% figures themselves verifiable — with absolute baselines and sample sizes entirely withheld, a reader has no way to recompute or falsify them, and under those conditions it is hard to separate "observation" from "claim."

Second, we judge the evidence for RQ4 (governance cost) to be the weakest link. The paper's headline appeal is that decision latency fell 60% even with two human-approval gates in place — yet the authors themselves state that gate dwell time and intervention rate were not measured (Discussion, Table 8). In other words, the paper's most attention-grabbing claim — that governance does not erode the latency advantage — rests on a measurement that never isolated governance's own cost.

Practical Applications

• Treat vendor self-reported PoC figures as relative only — if the vendor won't share an absolute baseline and sample size you can recompute, don't use the percentage in a procurement decision.
• Borrow the typed-contract principle, not the vendor architecture — declaring a schema with preconditions at every agent boundary is a vendor-neutral design choice you can adopt in your own harness.
• Instrument governance-gate cost separately — when adding HITL approval gates to a supply-chain workflow, capture intervention rate and gate dwell time from day one so you can tell whether verification is adding latency.
• Ask for standard-benchmark numbers too — "improvement over our own manual process" and "score on a public benchmark like GeoAgentBench" are different questions; request both before procurement.
• Run a single-factor grounding ablation — before adopting, disable only the authoritative-data check on your own data once to confirm whether the improvement is really coming from grounding.

Conclusion

ANASSA targets a real industrial problem — coordinating spatial data across systems that share neither a reference frame nor an owner — with a concrete design: typed contracts, authoritative grounding, and blocking governance. The 25%, 50%, and 60% relative improvements reported from a three-month deployment are worth noting as directional signals, but with absolute values undisclosed and multiple mechanisms changed at once in an uncontrolled observation, it is premature to treat them as "verified results." Until the instrumentation and ablation plan the authors themselves propose is actually carried out and the numbers are decomposed, it is safer to evaluate the design principles — typed boundaries, authoritative-data validation — ahead of the headline figures. The idea of validating claims against authoritative data runs along the same axis as the grounding problem covered in our guide to layering ontologies onto RAG.

References

• Agentic AI Orchestration Framework for Spatial Intelligence: Supply Chain Deployment — arXiv abstract (primary source)
• Full HTML text of the same paper — used for table cross-checking (via a GitHub Actions primary-source snapshot; this session's egress was blocked, see Source Document above)
• Spatial-Agent (Bao et al., 2026) — related research
• GeoAgentBench (Yu et al., 2026) — related research
• Guide to layering ontologies onto RAG — sunny34.com blog