Newsdesk
Engineering
Data & AI
Industries
Enterprise Systems
Go-to-Market
Longform
DesignIndiaAll stories

Engineering Reading

14 November 2026

25 new posts across 8 engineering blogs — 7 worth your time.

One week of Engineering Reading, 7 stories, as published.

Architecture

Choosing QuePaxa, an unusual consensus algorithm

Cloudflare details their choice to adopt QuePaxa, a relatively new consensus algorithm, for their global control plane service Meerkat. The post examines the architectural trade-offs of choosing QuePaxa over established alternatives like Raft, Multi-Paxos, or Viewstamped Replication.

Why it matters — Modern consensus protocols like QuePaxa can provide architectural advantages over Raft or Multi-Paxos for global control plane state management.

Cloudflare · 14 November 2026 · Read the original →

Performance

How We Built TLX: A Hardware-Native GPU Compiler for Production ML at Scale

Meta developed Triton Low-Level Extensions (TLX) to give engineers explicit warp-group and cluster-level orchestration capabilities directly within the Triton compiler. This extension preserves Triton's high-level programming velocity while enabling hardware-native optimizations that yield performance gains in production recommendation workloads.

Why it matters — Exposing explicit warp-group and cluster orchestration in higher-level GPU compilers unlocks modern hardware capabilities without abandoning developer velocity.

Meta · 14 November 2026 · Read the original →

Architecture

Skipper, Airbnb’s embedded workflow engine, is now open source

Airbnb open-sourced Skipper, an embedded workflow engine that runs directly inside service runtimes rather than relying on a standalone orchestration cluster. It allows developers to define durable multi-step processes as standard Java or Kotlin classes with built-in progress persistence and crash recovery.

Why it matters — Embedding durable state machines directly within service runtimes eliminates the operational complexity and network latency of external workflow orchestration clusters.

Airbnb · 14 November 2026 · Read the original →

Data & ML

How Pinterest Improved Analytics Agent Compliance with Loop Engineering

Pinterest engineered loop control constraints for their internal Analytics Agent to reliably diagnose query latency anomalies across data pipelines. The system forces the LLM agent to follow structured diagnostic steps sequentially rather than jumping to conclusions or missing compliance steps.

Why it matters — Enforcing explicit structural control loops around LLM tool execution prevents multi-step agents from deviating during complex technical diagnostics.

Pinterest · 14 November 2026 · Read the original →

Performance

Intelligent Delivery: Making Every Unit of Compute Serve Better Ads

Meta built Intelligent Delivery to dynamically allocate compute resources across serving stacks, request types, and hardware chips as ML ads ranking models outpace hardware growth. The system evaluates where an extra unit of compute delivers the highest marginal value across the entire request pipeline.

Why it matters — Dynamic compute allocation based on real-time marginal gain yields higher overall system efficiency than fixed resource budgets per inference request.

Meta · 14 November 2026 · Read the original →

Developer Experience

Extending LLDB to Debug Applications That Span CPUs and GPUs

Meta created a vendor-neutral accelerator plugin architecture inside lldb-server to handle debugging across modern hybrid workloads. The framework represents CPUs and GPUs as distinct sub-processes within a single unified debugging session, separating debugger infrastructure from device-specific execution controls.

Meta · 14 November 2026 · Read the original →

Infrastructure

How Zillow runs 100 million daily notifications on AWS Step Functions

Zillow processes over 100 million daily personalized alerts by representing every notification delivery as an independent, short-lived AWS Step Functions execution state machine. This design provides consistent execution behavior, isolated retry logic, and precise campaign tracking across massive daily notification spikes.

Why it matters — Instantiating short-lived state machine instances per item provides deterministic fault isolation and operational visibility for high-volume message delivery pipelines.

AWS Architecture · 14 November 2026 · Read the original →

So much custom infrastructure just to serve ads and send push notifications.

7 stories, every Saturday

Published here every week. Follow by RSS to get it as it lands.

← Previous issue Next issue →