07 October 2026
20 papers shortlisted this week — most discussed: Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Cove (68 upvotes).
TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models
This paper addresses the substantial computation and memory overheads in reinforcement learning (RL) for post-training large language models (LLMs), particularly during rollout generation. It identifies a key limitation in existing FP4 RL methods, which optimize quantization accuracy on training and rollout paths independently. The proposed TRACE method aims to directly reduce these overheads through rollout-guided quantization-aware training.
arXiv · 07 October 2026 · Read the original →
Self-Generated Feedback Destabilizes Test-Time Training: A Causal Decomposition of Long-Horizon Adaptation
This paper investigates the destabilizing effect of self-generated feedback in test-time training (TTT), where a model learns from its own outputs during inference. It demonstrates that retaining generated-text updates worsens prediction on independent human-written text across long-horizon adaptation streams. The study provides a causal decomposition to explain how each update changes the model that generates subsequent training examples.
arXiv · 07 October 2026 · Read the original →
From Evidence to Action: How Tool-Using Agents Fail
This paper studies failure modes in tool-using agents, specifically examining breakdowns in the "evidence-to-action chain." It highlights that correct outcomes do not always guarantee that an agent's actions were supported by evidence established beforehand. The research analyzes these breaks across ten model-harness configurations, from single actions to dependent workflows.
arXiv · 07 October 2026 · Read the original →
LMBuild: Evaluating LLM Agents for Generating Buildable and Functional Structures
This paper introduces LMBuild, a new benchmark for evaluating LLM agents that generate 3D structures. It addresses the gap in existing evaluations, which primarily focus on geometric quality while overlooking the crucial aspects of physical realizability and intended function. LMBuild aims to assess whether generated objects can actually be built and perform their functions in the physical world.
arXiv · 07 October 2026 · Read the original →
PerturBot: Breaking Shortcut Priors in Vision-Language-Action Models with Perturbative Training
This paper addresses the problem of vision-language-action (VLA) policies completing complex tasks by relying on shortcut priors instead of relevant evidence. It provides examples where VLA models ignore instructed targets or execute actions based on familiar nouns despite changed verbs. The work proposes "perturbative training" as a method to break these shortcut priors and enhance model robustness.
arXiv · 07 October 2026 · Read the original →
Optimizing the Optimizer: Language Models Discover Faster Molecular Relaxation
This paper investigates the potential of language models to improve geometry optimization, a major and costly step in quantum-chemical workflows. It explores whether an LLM agent can discover faster molecular relaxation methods through "autoresearch" by rewriting existing optimizers. The goal is to reduce the wall time dominated by force evaluations at the density-functional level.
arXiv · 07 October 2026 · Read the original →
More complexity, more interesting failure modes.
6 stories, every Wednesday
Published here every week. Follow by RSS to get it as it lands.