26 August 2026

20 papers shortlisted this week — most discussed: EnvHarness: Awakening Static Worlds for Agent Learning (263 upvotes).

One week of arXiv Picks, 6 stories, as published.

The Mask Is Not the Model: Auditing Prefix Invariance in Attention, State-Space, and Hybrid Sequence Models

This paper formalizes prefix invariance to ensure representations at a given position do not depend on future inputs, introducing a lightweight audit requiring only two forward passes without training or gradients. The authors demonstrate that traditional attention-mask inspection is insufficient, as causal leaks can still occur via operations like scans or normalization.

Why it matters — A zero-training, two-forward-pass audit can detect causal leaks in attention and state-space models that bypass standard attention-mask checks.

arXiv · 26 August 2026 · Read the original →

Training & Efficiency

Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts

This paper addresses the high computational cost of tuning hyperparameters, specifically learning rates, for large-scale Mixture-of-Experts (MoE) models. It proposes a compute-efficient, two-step hyperparameter transfer framework to optimize these parameters across extreme model sizes and token budgets.

Why it matters — A two-step hyperparameter transfer framework allows optimizing learning rates for large-scale MoE models without expensive sweeping at full scale.

arXiv · 26 August 2026 · Read the original →

Systems & Inference

RISE: Adaptive Imagination for World Action Models

RISE is a system-level adaptive imagination framework for World Action Models (WAMs) that replaces fixed imagination budgets with dynamic planning. It makes sequential Roll/Stop decisions based on the expected planning benefit of continuing a rollout in a given scene.

Why it matters — Replacing fixed rollout budgets with dynamic Roll/Stop decisions optimizes inference compute by only simulating future states when it benefits planning.

arXiv · 26 August 2026 · Read the original →

Agents & Tools

AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces

AutoSaddler is an automated framework designed to optimize agent harnesses, which traditionally require manual engineering of prompts, tool configurations, and control logic. It leverages durable updates extracted from agent execution traces to automatically improve agent robustness on long-horizon tasks.

Why it matters — Automating harness optimization directly from agent execution traces eliminates the manual trial-and-error of designing prompts and tool configurations.

arXiv · 26 August 2026 · Read the original →

Evaluation & Benchmarks

SWE-bench Science: Can Coding Agents Resolve Engineering Tasks in Science?

This paper introduces SWE-bench Science, a benchmark designed to evaluate how coding agents resolve engineering tasks in scientific software. Unlike benchmarks that only measure aggregate success, it focuses on analyzing the specific failure modes of agents when repairing scientific code.

Why it matters — Evaluating coding agents on scientific software requires analyzing specific failure modes rather than relying solely on aggregate task success.

arXiv · 26 August 2026 · Read the original →

Agents & Tools

EnvHarness: Awakening Static Worlds for Agent Learning

EnvHarness addresses the limitations of static, hand-built environments used for training LLM agents, which fail to adapt to an agent's evolving weaknesses. It provides a framework to dynamically generate and adapt environments, reducing the engineering overhead of domain-specific pipelines and unreliable verifiers.

Why it matters — Dynamically generating adaptive environments instead of static, hand-built ones prevents agents from outgrowing their training setups while reducing engineering overhead.

arXiv · 26 August 2026 · Read the original →

A lot of elaborate harnesses for agents we still don't quite trust.

6 stories, every Wednesday

Published here every week. Follow by RSS to get it as it lands.

Subscribe by RSS All issues

← Previous issue Next issue →