linux-foundation

Join the Delta Lake Community

Delta Lake is supported by more than 190 developers from over 70 organizations across multiple repositories.
Chat with fellow Delta Lake users and contributors, ask questions and share tips.

Scheduled and Latest Videos

R. Tyler Croy
Watch Delta Rust code development LIVE on Twitch.tv!
with R. Tyler Croy (agentdero), Delta Lake maintainer,
Director of Platform Engineering, Scribd
Twitch Logo
Because of the contributions from our amazing community, Delta Lake is now up to 20M monthly downloads! We’re proud of the progress this project is making and invite you to get involved. Get started today.
Delta lake monthly downloads chart

Contribute

Help us build the simplest, most complete, battle-tested open-source storage framework ever!
Below are a few great ways to get started to contribute.

Delta

192 contributors | 43 organizations

Delta Lake connectors for Apache Spark™, with Scala/Java and Python APIs, and for Java-based engines like Hive, Flink, PrestoDB, etc.
 

Report an issue
View Pull Requests

Delta Rust

50 contributors | 26 organizations

Delta Lake connector written natively in Rust, with Python bindings.
 

Report an issue
View Pull Requests

Delta Sharing

19 contributors | 2 organizations

An open protocol for simple and secure data sharing.
 

Report an issue
View Pull Requests

kafka-delta-ingest

6 contributors | 2 organizations

Delta Lake connector for streaming data from Kafka into Delta tables.
 

Report an issue
View Pull Requests

delta.io website

7 contributors | 3 organizations

Delta Lake website and documentation built on Gatsby.js framework.
 

Report an issue
View Pull Requests

Refer to the  Delta Lake contribution guide  for the latest on communication, coding style, and how to sign your work.

Refer to the  Delta Lake Protocol  for the specification for the Delta Transaction Protocol, which brings  ACID properties  to large collections of data, stored as files, in a distributed file system or object store.

Want to help or to help out?

Looking for ways to help or to get help? Refer to the  Getting Help Guide.

Governance

Delta Lake is an independent open-source project and not controlled by any single company. To emphasize this we joined the Delta Lake Project in 2019, which is a sub-project of the Linux Foundation Projects. Within the project, we make decisions based on these rules.

Delta Lake is supported by a wide set of developers from over 70 organizations across multiple repositories. Since 2019, more than 190 developers have contributed to Delta Lake! The Delta Lake community is growing by leaps and bounds with more than 6200 members in the Delta Users slack.

For more information, please refer to the founding technical charter.

Integrating a Data Warehouse and a Data Lake

FLORIAN VALEYE

STAFF DATA ENGINEER BACK MARKET

This conversation from the Open Source Summit in Spain provides valuable insights into the significance of Delta Lake, the role of Rust in data engineering, and the collaborative nature of open source communities.

The Delta Lake open source project integrates data lakes and data warehouses, a needed combination in this new age of scale-out data requiring reliability and controls.

A data lakehouse integrates the advanced data analytics and low-cost storage of a data lake with the performance and reliability of a data warehouse, said Florian Valeye, a data engineer with Back Market, in this episode of The New Stack Makers, recorded at the Open Source Summit in Bilbao, Spain, earlier this fall.

Project Maintainers

Want to dive deeper into Delta Lake, please chat with any of our maintainers!

For more information on how to contribute, please refer to the Delta Lake contribution guide.

NameOrganziationFocal Areas
Michael ArmbrustDatabricksdelta, connectors, delta-sharing
R. Tyler CroyScribddelta, delta-rs, kafka-delta-ingest
Tathagata DasDatabricksdelta, connectors
QP HouNeuralinkdelta, delta-rs
Will JonesVoltron Datadelta, delta-rs
Venki KorukantiDatabricksdelta, connectors
Denny LeeDatabricksdelta, connectors, delta-sharing, delta-rs, website
Mykhailo OsypovScribddelta-rs, kafka-delta-ingest
Robert PackBASFdelta, delta-rs
Allison PortisDatabricksdelta, connectors
Scott SandreDatabricksdelta, connectors
Florian ValeyeBackmarketdelta, delta-rs
Thomas VollmerMicrosoftdelta-rs
Christian WilliamsScribddelta, delta-rs, kafka-delta-ingest
Ryan ZhuDatabricksdelta, connectors, delta-sharing
Gerhard BruecklPaiqo GmbHdelta, connectors, delta-sharing
Ion KoutsourisASMLdelta, delta-rs

Organizations that have contributed to Delta Lake

Together we have made Delta Lake the most widely used lakehouse format in the world!

adobe
atlassian
apple
amazon
alibaba
backMarket
byteDance
canva
cockroachdb
comcast
databricks
disney
ebay
grafana
ibm
microsoft
safeGraph
sambaTv
scribd
starburst
td
talend
twilio
ucDavis
kubit
The Linux Foundation
Project Governance

Delta Lake is an independent open-source project and not controlled by any single company. To emphasize this we joined the Delta Lake Project in 2019, which is a sub-project of the Linux Foundation Projects. Within the project, we make decisions based on these rules.