28 October 2026
20 papers shortlisted this week — most discussed: Trajectory2Gym: Decision-Grounded Compositional Interaction Synthesis (349 upvotes).
Memory Tax: Dissecting the Net Value of Agent Memory
This empirical study evaluates whether building dedicated structured memory systems for long-horizon LLM agents delivers positive net value over simple retrieval. Across multiple benchmarks and model backbones, many complex agent memory architectures perform worse than naive RAG operating over raw interaction history. The authors dissect the trade-offs of memory frameworks to isolate where state tracking adds noise versus actual utility.
arXiv · 28 October 2026 · Read the original →
Eat Your Precision: Precision Objective Mitigates Reward Hacking in Rubric-based RL
Rubric-based rewards used during reinforcement learning on non-verifiable tasks primarily reward rubric coverage, turning RL into a recall-maximizing objective. Consequently, models suffer from reward hacking by producing overly verbose responses filled with unnecessary or incorrect facts. Incorporating an explicit precision objective alongside recall mitigates this failure mode.
arXiv · 28 October 2026 · Read the original →
Trajectory2Gym: Decision-Grounded Compositional Interaction Synthesis for Tool-Use Agents
Successful execution logs do not automatically translate into effective training trajectories for tool-use agents. Successful interactions frequently include actions unjustified by the agent's visible observation state or fail to capture multi-step dependencies. Trajectory2Gym formalizes requirements for trajectory supervision, emphasizing compositional coverage to ensure training data grounds decisions in visible information.
arXiv · 28 October 2026 · Read the original →
Rollback: Experience Backtracking in World Models for Policy Improvement
Action-conditioned world models are typically deployed as forward-only physical surrogates for robot policy learning. The Rollback framework introduces experience backtracking, enabling policies to rewind simulation state to historical decision points to sample counterfactual futures. This technique exploits a simulator-native capability that physical environments cannot offer.
arXiv · 28 October 2026 · Read the original →
Trial by Trace: Benchmarking AI Agent Harnesses for Reliability and Failure Attribution
Standard agent benchmarks focus primarily on underlying model capabilities, obscuring failures caused by the supporting orchestration software. TraceTrial-Bench evaluates agent execution harnesses specifically for system reliability and failure attribution across multi-step execution traces. This setup isolates runtime and framework bugs from core model reasoning errors.
arXiv · 28 October 2026 · Read the original →
ChronoReplay: One Answer Interface Is Not Enough for Streaming Spatial Intelligence
Post-training spatial vision-language models on single question-answer readouts causes capabilities to concentrate narrowly on that interface while degrading performance on others. For instance, optimizing a model to answer relative direction queries does not force it to retain metric distance information required for other spatial tasks. The paper demonstrates why spatial intelligence requires multi-interface supervision during post-training.
arXiv · 28 October 2026 · Read the original →
At least everyone else is having just as much trouble keeping their agents on the rails.
6 stories, every Wednesday
Published here every week. Follow by RSS to get it as it lands.