Build Lakehouses with Delta Lake
Delta Lake is an open-source storage framework that enables building a
Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, Ruby, and Python.
Open
Community driven, rapidly expanding integration ecosystem
Simple
One format to unify your ETL, Data warehouse, ML in your lakehouse
Production Ready
Battle tested in over 10,000+ production environments
Platform Agnostic
Use with any query engine on any cloud, on-prem, or locally
Key Features
ACID Transactions
Protect your data with serializability, the strongest level of isolation
Scalable Metadata
Handle petabyte-scale tables with billions of partitions and files with ease
Time Travel
Access/revert to earlier versions of data for audits, rollbacks, or reproduce
Open Source
Community driven, open standards, open protocol, open discussions
Unified Batch/Streaming
Exactly once semantics ingestion to backfill to interactive queries
Schema Evolution / Enforcement
Prevent bad data from causing data corruption
Audit History
Delta Lake log all change details providing a fill audit trail
DML Operations
SQL, Scala/Java and Python APIs to merge, update and delete datasets
Read the Lakehouse Whitepaper
Together, the features of Delta Lake improve both the manageability and performance of working with data in cloud storage objects, and enable a “lakehouse” paradigm that combines the key features of data warehouses and data lakes: standard DBMS management functions usable against low-cost object stores.
Pipeline using separate storage systems
Using Delta Lake for both stream and table storage
Organizations that have contributed to Delta Lake
Together we have made Delta Lake the most widely used lakehouse format in the world!
Join the Delta Lake Community
Delta Lake is supported by more than 190 developers from over 70 organizations across multiple repositories.
Chat with fellow Delta Lake users and contributors, ask questions and share tips.
Project Governance
Delta Lake is an independent open-source project and not controlled by any single company. To emphasize this we joined the Delta Lake Project in 2019, which is a sub-project of the Linux Foundation Projects. Within the project, we make decisions based on these rules.