Multi-Table Transactions with LakeFS and Delta Lake скачать в хорошем качестве

Multi-Table Transactions with LakeFS and Delta Lake

This is a recording of the live tech talk hosted on August 31, 2021. Join us for a tech talk about LakeFS and Delta Lake. Paul Singman from Treeverse and Denny Lee from Databricks discuss multi-table transactions with LakeFS and Delta Lake. LakeFS enables you to manage your data lake the way you manage your code, allowing for a collaborative development environment and CI/CD deployment of data. Delta Lake is an open-source project that enables building a Lakehouse architecture on top of existing storage systems such as S3, ADLS, GCS, and HDFS. In this session, Paul and Denny will discuss LakeFS and Delta Lake and the integration of LakeFS and Delta Lake simplifies your multi-table pipelines. Speakers: Paul leads DevRel for lakeFS, after several years as a ML engineer at Equinox Fitness. He enjoys contextualizing the latest data trends and technologies in blog posts and talks, instead of getting caught up in the hype surrounding specific tools. Denny Lee is a developer advocate at Databricks, where he works on Delta Lake, Apache Spark, Data Sciences, and Healthcare Life Sciences. He has previously built enterprise DW/BI and big data systems at Microsoft including Azure Cosmos DB, Project Isotope (HDInsight), and SQL Server as well as the Senior Director of Data Sciences Engineering at SAP Concur. Denny holds a Masters in Biomedical Informatics from Oregon Health Sciences University. Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-nam...