Apache Iceberg
A high-performance open table format for huge analytic datasets
Apache Iceberg is an open-source, high-performance table format designed for large-scale analytic workloads on data lakes. It enables multiple query engines such as Spark, Trino, Flink, Presto, Hive, and Impala to safely read and write the same tables concurrently. Key features include full schema evolution, hidden partitioning, time travel, rollback, and data compaction.
Iceberg defines a high-performance open table format with a metadata layer that tracks snapshots, partition specs, and schema history, allowing any compatible engine to read and write tables safely and efficiently.
data engineers and analysts working with large-scale analytics on data lakes
Background.
- Status
- launched
- Business model
- open-source
- Company
- The Apache Software Foundation
Similar projects.
Editorial take on the space this project sits in — momentum signals, adjacent moves, our call on whether the wedge is real. Get pinged when we publish a new read or when the landscape shifts.
Have a take on this space?
Tell us what you’d build differently, where you think the incumbents miss, or what we’ve gotten wrong about this project. Comments + reactions are coming soon.