Batch to Streaming in One Easy Step (Premier Sponsor) (w/ Emily Hawkins & Arjun Narayan) скачать в хорошем качестве

Batch to Streaming in One Easy Step (Premier Sponsor) (w/ Emily Hawkins & Arjun Narayan)

In this talk, we will demonstrate how to get started with streaming analytics using the same analytics engineering skillset that keeps you productive in batch analytics. Traditionally, streaming analytics has required a separate knowledge base, tooling, and ecosystem from batch analytics, one that is comparatively poorer as an ecosystem with a lot less tooling. We believe that the future of streaming is the same as that of batch analytics - using dbt and SQL for modeling and working with your data. In this talk, we’ll walk through how Materialize helps you build a SQL-first streaming pipeline, as well as go through real-life examples of how Materialize users are building streaming pipelines in production with the very same dbt models they built for their batch data. We’ll have a special guest appearance from Emily Hawkins, Data Infrastructure Lead at Drizly. She'll share her experience using Materialize + dbt to help solve for cart abandonment. Catch all of Coalesce 2021, the analytics engineering conference, at https://getdbt.com/coalesce-2021. 00:00 Intro 02:43 Defining Batch Processing 03:28 Defining Stream Processing 05:08 Spectrum of Use Cases 08:35 Existing Streaming Systems Don't Support SQL 10:04 Streaming with Materialize 15:17 dbt + Materialize 17:09 Using Materialize in Drizly 24:18 Q&A