All Posts

• Apache Iceberg Internals Dive Deep On Performance

  In this blog I will explain the performance of Apache Iceberg in great details. Apache Iceberg is a high-performance table format designed for large-scale analytics workloads. While its consistency and schema evolution features are covered in previous blog, its impact on query performance is equally transformative. This document provides an in-depth analysis of Iceberg’s read optimizations, focusing on metadata efficiency, file pruning, predicate push down, vectorized reads, data layout strategies, caching mechanisms, and integration with compute engine like Apache Spark.
  By the end of this document, you will have a deep understanding of how Iceberg enhances performance, the trade-offs involved, and best practices for maximizing efficiency in read-heavy workloads.

• Apache Iceberg Architecture Dive Deep

  This is first part of iceberg series where I dive deep into Apache Iceberg internals. In this blog I will explain the architecture, specifications and protocols of Apache Iceberg in great details. I will go over the internal working, high level design, metadata evolution with examples for different write modes Apache Iceberg support Merge On Read, and Copy On Write. I will also go over the control flow / low level design of Apache Iceberg write path in both simplified and detailed version. I will also touch upon compaction and consistency handling of Apache Iceberg.

• Introduction To Distributed Systems

  This blog contains the introduction of distributed systems essentials, a starting point for someone starting up in the journey of distributed systems.