12 August 2026

20 papers shortlisted this week — most discussed: Macaron-V1: Towards Open Continual Learning with Self-Improvement and (282 upvotes).

One week of arXiv Picks, 6 stories, as published.

Evaluation & Benchmarks

SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring

This paper introduces SWE-Bench ProMax and reveals that nearly 60% of unsolved instances in the widely used SWE-bench Verified benchmark contain flawed tests, such as overly narrow or overly broad assertions. It addresses these evaluation quality issues to provide a more accurate benchmark for long-horizon software engineering agents.

Why it matters — Nearly 60% of unsolved SWE-bench Verified instances are flawed, meaning agent performance evaluations are heavily bottlenecked by benchmark test quality rather than actual agent capability.

arXiv · 12 August 2026 · Read the original →

Training & Efficiency

SFT Conflicts, RL Coexists: A Theoretical and Empirical Analysis of Multi-Task Learning for LLMs

This paper analyzes multi-task learning in LLMs, demonstrating that Supervised Fine-Tuning (SFT) suffers from severe task conflicts during multi-stage training, whereas Reinforcement Learning (RL) allows diverse tasks to stably coexist. The authors trace this difference down to the parameter level to explain the underlying mechanics.

Why it matters — SFT causes parameter-level task conflicts in multi-stage training, whereas RL avoids these conflicts and enables stable multi-task coexistence.

arXiv · 12 August 2026 · Read the original →

Systems & Inference

OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching

The paper presents OasisKV, an inference serving system designed to scale the key-value (KV) cache beyond High Bandwidth Memory (HBM) limits. It utilizes lookahead sparse prefetching during the token generation (decode) phase to mitigate the memory footprint and traffic bottlenecks of long-context workloads.

Why it matters — Prefetching KV cache with lookahead sparse techniques allows long-context LLM inference to scale beyond physical HBM capacity limits.

arXiv · 12 August 2026 · Read the original →

Agents & Tools

Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replay

This work introduces a deterministic, zero-model pipeline that compiles passively captured screen activity into structured agent memory. By segmenting local capture streams into typed activity frames, it allows computer-use agents to replay and recall user routines without paying the high inference costs of frontier models to re-derive them.

Why it matters — Using a deterministic, zero-model pipeline to compile screen activity into structured memory eliminates the need to run expensive frontier LLM inference to reconstruct user routines.

arXiv · 12 August 2026 · Read the original →

Multimodal

SimWAM: A Simple World Action Model for End-to-End Autonomous Driving

SimWAM is an end-to-end autonomous driving model that leverages video generation purely as a training signal rather than generating future frames at inference. It co-trains a pretrained video expert and a lightweight action expert using joint flow matching, isolating the video expert during deployment.

Why it matters — Co-training with video generation purely as a training signal (and isolating it at inference) captures video dynamics priors without the high computational cost of generating future frames during deployment.

arXiv · 12 August 2026 · Read the original →

Safety & Alignment

Stealing Reasoning Traces from Proprietary LLM APIs

This paper exposes an architectural vulnerability in proprietary LLM APIs that hide their chain-of-thought reasoning traces. Instead of storing these traces on the server, providers return them to the client as encrypted text blocks to be sent back with subsequent requests, allowing adversaries to steal the reasoning traces.

Why it matters — Returning encrypted reasoning traces to the client to avoid server-side storage creates an architectural vulnerability that allows adversaries to steal proprietary chain-of-thought data.

arXiv · 12 August 2026 · Read the original →

Hard to worry about stolen reasoning when we're still swapping KV caches to disk.

6 stories, every Wednesday

Published here every week. Follow by RSS to get it as it lands.

Subscribe by RSS All issues

← Previous issue Next issue →