05 August 2026

20 papers shortlisted this week — most discussed: SwanTale: Unified Multi-Speaker Speech and Audio Generation for Instru (142 upvotes).

One week of arXiv Picks, 6 stories, as published.

Agents & Tools

LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks

LongHorizon-Harness analyzes how standard LLM agent frameworks fail during extended multi-step workflows due to context bloat. Managing task execution, state, and evaluation inside a single expanding context window causes early assessment errors to compound and derail downstream actions.

Why it matters — Decoupling state tracking and completion verification from prompt execution history stops hallucinated self-evaluations from cascading across long-horizon agent tasks.

arXiv · 05 August 2026 · Read the original →

LLMs & Reasoning

DAPD: Dual-Anchored Policy Distillation

DAPD addresses the privilege illusion in on-policy self-distillation, where student models attempt to emulate privileged teacher behaviors without having access to privileged inputs during inference. The dual-anchored approach regularizes the student policy against both baseline context and privileged teacher distributions.

Why it matters — Anchoring student training against both baseline and privileged context prevents models from developing dependencies on context features absent at inference time.

arXiv · 05 August 2026 · Read the original →

Systems & Inference

DiffusionGemma Technical Report

DiffusionGemma introduces discrete diffusion to LLM decoding by iteratively refining blocks of 256 tokens in parallel. Converted directly from pre-trained Gemma weights rather than trained from scratch, the model bypasses sequential token-by-token autoregressive decoding bottlenecks while maintaining generation quality.

Why it matters — Adapting autoregressive model weights into block-parallel discrete diffusion bypasses sequential KV-cache bottlenecks without requiring full pre-training from scratch.

arXiv · 05 August 2026 · Read the original →

Training & Efficiency

SAF-OPD: Stable Advantage Fusion for On-Policy Distillation

SAF-OPD tackles the instability caused by combining scalar RL rewards with token-level teacher distillation. It identifies gradient conflicts between dense teacher advantage bounds and sparse outcome-based exploration, proposing a unified advantage fusion mechanism to balance teacher imitation with independent policy search.

Why it matters — Blending dense teacher advantages with sparse outcome rewards requires explicit advantage fusion to keep teacher supervision bounds from suffocating RL exploration.

arXiv · 05 August 2026 · Read the original →

Multimodal

Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMs

This work reveals trajectory anchoring bias in autonomous driving VLMs, where revealing ground-truth trajectory data to teacher models produces ungrounded CoT explanations. It introduces deferred trajectory exposure, withholding ground-truth future paths until after the teacher generates verifiable chain-of-thought spatial reasoning.

Why it matters — Withholding target ground-truth data during teacher CoT generation forces models to build verifiable reasoning from visual inputs instead of reverse-engineering answers.

arXiv · 05 August 2026 · Read the original →

Multimodal

JoyAI-Video-Edit: Real-Time Open-Ended Video Editing with Autoregressive Diffusion

JoyAI-Video-Edit introduces a 16B-parameter autoregressive diffusion framework designed for low-latency streaming video editing. The system processes video in causal chunks without requiring future frame lookahead or a fixed duration, balancing computational complexity with temporal consistency.

Why it matters — Chunk-wise causal autoregressive diffusion enables real-time unbounded video editing within fixed memory and latency budgets.

arXiv · 05 August 2026 · Read the original →

Lots of policy distillation this week, for when inference budgets finally hit reality.

6 stories, every Wednesday

Published here every week. Follow by RSS to get it as it lands.

Subscribe by RSS All issues

← Previous issue Next issue →