30 September 2026
20 papers shortlisted this week — most discussed: Raven: The Harness of Harnesses for Composable Agentic Intelligence (244 upvotes).
Groupwise Agentic Grading and Advantage Redistribution for Code Agent RL
The authors show that standard Group Relative Policy Optimization (GRPO) gives identical advantage to all test‑passing code trajectories, ignoring differences in implementation quality and task compliance. They propose Groupwise Agentic Grading and Advantage Redistribution, which grades each trajectory on cleanliness and adherence, then redistributes advantage accordingly, giving the policy a richer learning signal.
arXiv · 30 September 2026 · Read the original →
SAKI: Maximal-Coupling-Routed Teacher Supervision for On-Policy Distillation
On‑policy distillation suffers when a weak student diverges from the teacher, leading to misaligned supervision. SAKI introduces a KL‑constrained teacher‑guided rollout combined with maximal coupling and an accept/reject reuse scheme, keeping student trajectories close to the teacher while preserving on‑policy exploration.
arXiv · 30 September 2026 · Read the original →
What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling
The paper empirically compares explicit world‑action models that denoise video frames at inference with latent models that skip future generation. Despite the heavy cost of video denoising, latent WAMs achieve comparable performance, demonstrating that discarding explicit future synthesis can retain accuracy while cutting compute.
arXiv · 30 September 2026 · Read the original →
Selecting Diverse SFT Traces Improves Post-RL Generalization
Investigating supervised‑fine‑tuning (SFT) data for RL, the authors define "route diversity" as variation in reasoning step sequences and devise a lightweight fingerprint to select diverse traces. Experiments reveal that, given equal training budgets, picking the most diverse SFT samples improves post‑RL generalization.
arXiv · 30 September 2026 · Read the original →
Learning Beyond What You Sample: Off-Policy-Aware Cross-Model Trajectory Exchange for RLVR
RL with Verifiable Rewards (RLVR) often encounters rollout groups with no successful trajectories, limiting gradient signals. The authors propose an off‑policy‑aware cross‑model trajectory exchange that reuses successful rollouts discovered by other models, increasing the chance of reward‑based updates under a fixed budget.
arXiv · 30 September 2026 · Read the original →
OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?
The study systematically pairs image‑to‑image generation and image‑to‑text understanding models to ask when visual generation supervision benefits downstream perception tasks. Controlled experiments reveal specific conditions—such as geometry‑rich data and shared encoder architectures—under which generation pre‑training improves understanding.
arXiv · 30 September 2026 · Read the original →
The vocabulary is scaling faster than the models.
6 stories, every Wednesday
Published here every week. Follow by RSS to get it as it lands.