Cut Tokens 87%, Double Accuracy: A Review of CORAL's Working-Memory Reset for Long-Horizon Agents

Source

Zheng Zhu, Xiaozhuan Liang, Xi Chen, Bei Yu, Jiaya Jia, "Don't Lose the Thread: Empowering Long-Horizon LLM Agents with Cognitive Resource Self-Allocation", arXiv:2610.40350 [cs.CL], submitted 2026-10-29, DOI 10.48550/arXiv.2610.40350. Affiliations: The Chinese University of Hong Kong (CUHK), Tencent, The Hong Kong University of Science and Technology (HKUST). Funding: Hong Kong Research Grants Council, Areas of Excellence scheme (AoE/E-601/22-R).

This is an unreviewed arXiv preprint. Several authors list a Tencent affiliation alongside their university one, which is a disclosed industry tie; the funding itself, however, comes from a Hong Kong government academic grant unrelated to that company. One of the two main backbones evaluated (Qwen3-8B) is an open-weight model unaffiliated with the authors' employer, and training data was synthesized using both Claude Sonnet 4 and the authors' own backbones, which limits single-vendor bias in the data pipeline. This session's network egress was blocked session-wide (a control fetch to example.com and to arxiv.org both returned a proxy-policy CONNECT 403), so we manually triggered the GitHub Actions snapshot workflow and cross-checked the figures below against the primary-source snapshot it collected at 2026-10-30T22:09:15Z.

Study Overview

Long-horizon LLM agents accumulate verbose environmental feedback and failed-attempt logs with every thought-action-observation cycle, which progressively degrades planning and reasoning — a "cognitive overload" the authors compare to human working-memory saturation. Their fix borrows the human remedy of cognitive offloading: writing intermediate state down so it no longer has to be held in mind.

COgnitive Resource Self-ALlocation (CORAL) gives the agent two callable tools. Memory Management (MM) checkpoints task progress and verified facts. Context Optimization (CO) clears the conversation history and starts a fresh episode once the agent itself judges the context too cluttered, carrying forward only the checkpoint. Critically, both tools are invoked by the agent's own judgment, not a fixed schedule or external controller. Training is two-stage: supervised fine-tuning (SFT) instills basic checkpointing, then Multi-episode Agentic Reinforced Policy Optimization (an extension of DAPO that propagates trajectory-level rewards across episode boundaries) refines the checkpointing policy itself. Evaluation covers GAIA's 103-question validation set, five multi-hop Knowledge QA benchmarks, and BrowseComp.

Key Results

On GAIA with Qwen3-8B, CORAL's stage-by-stage performance is as follows (paper's Table 1, Pass@1/Avg@8). We independently recomputed each average as a 39/52/12-question weighted mean and it matches the paper's reported figures.

By the headline average, CK-Pro-8B (43.7%) edges out CORAL (42.8%), but that edge sits entirely on Level 1 (56.4% vs. 46.2%). CORAL leads on Level 2 (45.7% vs. 42.3%) and more than doubles CK-Pro-8B on Level 3 (19.8% vs. 8.3%) — consistent with a design meant to pay off as horizons get longer. Applying CORAL via prompting alone to Claude Sonnet 4 reaches a 65.0% average, close to OpenAI Deep Research's 67.4% (vs. a 60.2% ReAct baseline).

Cost figures come from instrumenting all 824 GAIA evaluation trajectories (103 questions × 8 samples) on Qwen3-8B (paper's Table 2). Computing the token reduction directly, (1,078−136)/1,078 = 87.4%, matches the paper's own stated figure.

The more trained the model, the less often it invokes CO, the reset tool (4.3 calls per trajectory with prompting only, down to 0.21 after SFT+RL). Training teaches better checkpointing, not more resetting — an agent that records state well never accumulates enough clutter to justify a reset. In an untrained, prompting-only comparison on BrowseComp (150 questions, Claude Sonnet 4), CORAL reached 30.7% against ReAct's 22.7%, an 8.0-point gap the authors call the largest of any benchmark they measured. But in a cross-backbone check, Qwen2.5-7B-Instruct actually lost 3.9 points under prompting-only CORAL because it could not reliably emit JSON for four tools instead of two (SFT reversed this, lifting it from 17.5% to 34.4%) — a caution that bolting CORAL onto a weak backbone without training can backfire.

Credibility Assessment

Three things support trust here. First, the GAIA level-by-level breakdown checks out arithmetically against the reported averages. Second, CORAL beats its baseline across three qualitatively different evaluations — GAIA, five Knowledge QA sets, and BrowseComp. Third, the cost comparison holds the backbone (Qwen3-8B) and the trajectory set (the same 824 runs) fixed, so method and model effects aren't conflated.

Caveats are just as clear. The BrowseComp comparison covers only the first 150 questions — described as "computationally prohibitive" to run in full — on a single untrained backbone (Claude Sonnet 4). GAIA's Level 3 has only 12 questions, a small sample. The text cites a drop in run-to-run standard deviation from 3.5% to 1.9% under RL, but that figure is pulled from an appendix we did not independently verify in this pass. The Tencent co-authorship is a disclosed conflict of interest, though the benchmarks themselves (GAIA, HotpotQA, and others) are public and independent of the authors' employer. As a counterpoint, MEM1 (below) argues fixed-schedule compression alone can still deliver efficiency gains — this doesn't flatly contradict CORAL's claim that agent judgment is necessary, but it does mean the case against rule-based compression is less airtight than CORAL alone suggests.

Related Work

• Zhou et al. (2025). MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents — prior work, contrasted directly. An end-to-end RL framework that compresses on a fixed schedule after every function call; CORAL's own §5 argues this rigid schedule "can discard useful information and disrupt high-level planning." CORAL differs by letting the agent itself decide when to compress.
• Yu et al. (2025). MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agent — prior work. Reads a fixed long document in segments while overwriting a fixed-size memory; CORAL's paper notes this targets a static input, whereas CORAL addresses context that grows dynamically through interaction.
• Wei et al. (2025). BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents — benchmark origin. The source benchmark CORAL uses for its generalization test; its many-hop web-exploration questions are designed to expose exactly the kind of context-management failure CORAL targets.

All three prior works target the same underlying problem — unbounded context growth — but diverge on the fix: MEM1 and MemAgent fix the timing and size of compression by rule or structure, while CORAL leaves that judgment to the agent. For this review we independently confirmed these papers' authors, dates, and central claims via web search rather than reading their original tables directly, so the relationships above are described at that level of confidence only.

Reviewer's Take

First, reading "CK-Pro-8B beats CORAL on average (43.7% vs. 42.8%)" as a loss for CORAL would be a misreading. The gap sits entirely on Level 1, and CORAL more than doubles CK-Pro-8B on Level 3. For any workload with a mix of difficulty, the level-by-level breakdown — not the single average — should drive the adoption call.

Second, the abstract's framing of the 8.0-point BrowseComp gain as the paper's largest should be treated cautiously. It rests on three stacked constraints at once — 150 of the full question set, one backbone, and zero training — so whether it holds at full scale, on other backbones, or after fine-tuning can't be answered from this paper alone. The most striking number here is also the least stress-tested one.

Third, the Qwen2.5-7B-Instruct regression (-3.9 points) is relegated to an appendix, but it may matter more in practice than the headline results. It marks a real boundary condition: letting an agent manage its own context through tool calls can backfire on a backbone that can't reliably call multiple tools in the first place.

Practical Takeaways

• Consider agent-initiated checkpointing tools — where the backbone is capable enough, prefer letting the agent decide when to checkpoint and reset over fixed-schedule compression.
• Instrument tokens and calls per trajectory — track input tokens, LLM call counts, and peak context length alongside accuracy when evaluating a harness change; here, token reduction was itself a signal of better attention management, not just a cost metric.
• Don't bolt tools onto a weak backbone without training — prompting-only, multi-tool setups can regress accuracy on models that struggle with reliable JSON tool calls.
• Evaluate by difficulty tier, not just the average — a single headline number can hide exactly where a method helps or hurts.
• Re-verify small-sample generalization claims at your own scale — results from a reduced subset on one backbone deserve a wider re-check before informing a production decision.

Conclusion

CORAL's contribution is handing context management to the agent's own judgment rather than a fixed rule, and getting both lower token cost and higher accuracy out of that choice. On GAIA, it cut input tokens 87.4% versus ReAct while more than doubling accuracy, with the gains concentrated on the hardest, longest-horizon questions. Its BrowseComp generalization evidence, however, rests on a small sample and a single backbone, and prompting-only deployment can backfire on weaker models without training. The Tencent co-authorship is a disclosed conflict of interest, though the evaluation itself runs on public benchmarks. Teams considering letting agents edit and manage their own context in production may also want our operational guide to adopting agent context editing.

References

• Don't Lose the Thread: Empowering Long-Horizon LLM Agents with Cognitive Resource Self-Allocation — arXiv abstract (source)
• Full HTML text of the same paper — used for table and figure cross-checks
• Our operational guide to adopting agent context editing — sunny34.com blog