Newsdesk
Engineering
Data & AI
Industries
Enterprise Systems
Go-to-Market
Longform
DesignIndiaAll stories

Databases & Data

17 November 2026

66 new posts across 10 database and data engineering sources — 10 worth your time.

One week of Databases & Data, 10 stories, as published.

Postgres

Mehmet Ince: Part 3/6 | How I Ended Up Turning a 22-Year-Old PostgreSQL Type-Confusion Primitive into RCE (CVE-2026-6460)

A detailed post-mortem documenting how a 22-year-old zero-day type-confusion primitive in PostgreSQL core (CVE-2026-6460) was analyzed and turned into a Remote Code Execution (RCE) vulnerability. It tracks the investigation from managed service behavior down to underlying C engine internals.

Why it matters — Demonstrates how legacy type-confusion primitives within database core C codebases can be chained to achieve remote code execution.

Planet PostgreSQL · 17 November 2026 · Read the original →

Performance

Dinesh Kumar: How to Reduce PostgreSQL Memory Usage and Cut Your Cloud Bill in Half

Covers practical techniques for reducing PostgreSQL RAM consumption in production environments. It details how optimizing connection pooler configurations dropped memory usage from 93% to 50% on a customer system while reducing cloud infrastructure spending from $630 to $320 per month.

Why it matters — Tuning connection pooler settings directly reduces idle backend process memory overhead without requiring database hardware upgrades.

Planet PostgreSQL · 17 November 2026 · Read the original →

Storage Internals

Radim Marek: B-tree pages, sorted and sparse

Examines PostgreSQL physical storage mechanisms, shifting focus from heap pages to B-tree index page structures. It outlines how index tuples, sparse page layouts, and heap ctid references interact during scan operations.

Why it matters — Understanding physical B-tree layout vs heap page layout helps engineers reason about index traversal costs and tuple pointer maintenance.

Planet PostgreSQL · 17 November 2026 · Read the original →

Data Engineering

How we migrate TBs from Heroku without logical replication

Details strategies for migrating multi-terabyte PostgreSQL databases away from Heroku Postgres where standard logical replication is disabled on default plans. It explains alternative extraction and backfill patterns used to move production databases safely.

Why it matters — Provides approach patterns for running large database cutovers when native change data capture or logical replication functionality is unavailable.

PlanetScale · 17 November 2026 · Read the original →

Analytics & OLAP

How Infinitas Learning uses ClickHouse Managed Postgres to process billions of events for 1.6M unique learners

Explores the architecture used by Infinitas Learning to process billions of events for 1.6 million learners by pairing ClickHouse Managed Postgres with ClickHouse Cloud. The integration uses a distributed cache layer to reduce analytical P99 query latency from 13 seconds down to 410 milliseconds.

Why it matters — Implementing a distributed caching layer over OLAP storage can reduce analytical P99 latency by over 95%.

ClickHouse · 17 November 2026 · Read the original →

Performance

Optimizing Document Lookup: Making Atlas Search and Vector Search Up to 5x Faster

Breaks down internal query processing optimizations made to MongoDB Atlas Search and Vector Search. By identifying and removing redundant query planning steps and execution wrapping around core operations, search workloads achieved up to 5x latency improvements.

Why it matters — Eliminating redundant query planning overhead and execution wrapper code can yield multi-fold speedups without altering core execution algorithms.

MongoDB · 17 November 2026 · Read the original →

Storage Internals

Ducks in a Column

Explains the columnar storage architecture behind DuckDB, detailing how isolating individual columns reduces disk I/O for selective queries and how processing data in 2,048-value vectors optimizes CPU execution.

Why it matters — Vectorized execution over contiguous column chunks maximizes CPU cache locality and minimizes I/O by fetching only referenced attributes.

DuckDB · 17 November 2026 · Read the original →

Reliability

PostgreSQL 14 Reaches End-of-Life

PostgreSQL 14 reached its end-of-life on November 12, 2026, meaning it will no longer receive security patches or bug fixes. Teams running this version must upgrade to a supported version like PostgreSQL 17 or 18 to maintain database security and stability.

Why it matters — Teams on PostgreSQL 14 must plan and execute a major version upgrade to maintain security and receive bug fixes, potentially impacting application compatibility and requiring significant testing.

Planet PostgreSQL · 17 November 2026 · Read the original →

Performance

Aurora Serverless Scales Faster for AI

Amazon Aurora Serverless now automatically adds 12 Aurora Capacity Units (ACUs) within a second, scaling up to 256 ACUs to support agentic AI and other spiky workloads. This improvement allows for faster response to sudden demand spikes compared to provisioned instances, as demonstrated by benchmark data.

Why it matters — Applications with spiky, unpredictable workloads like AI agents can now achieve higher throughput faster on Aurora Serverless, potentially reducing over-provisioning costs.

aws.amazon.com · 17 November 2026 · Read the original →

Performance

ClickHouse Leads JSONBench Benchmark

The JSONBench benchmark, comparing 27 database engines on a billion JSON documents, shows ClickHouse maintaining its lead in performance. This benchmark highlights ClickHouse's ability to combine flexible JSON storage with fast analytics and efficient storage at scale for logs, events, and machine learning pipelines.

Why it matters — Teams working with large JSON datasets for analytics can expect ClickHouse to offer leading performance, potentially influencing technology choices for new projects.

ClickHouse · 17 November 2026 · Read the original →

Another week spent either tuning PostgreSQL or planning to upgrade it.

10 stories, every Tuesday

Published here every week. Follow by RSS to get it as it lands.

← Previous issue