Stream Processing in SQL: One Approach by Noel Kwan, RisingWave at Bengaluru Streams May 2024 скачать в хорошем качестве

Stream Processing in SQL: One Approach by Noel Kwan, RisingWave at Bengaluru Streams May 2024

Recording of the session from the May 2024 Bengaluru Streams Meetup. Speaker: Noel Kwan, Software Engineer at RisingWave Labs About the talk: Join us for an exploration of real-time streaming data processing, where we’ll delve into RisingWave’s Stream Processing Model and interact with data streams using SQL. In this session, we will begin by demonstrating the difference between batch and streaming data processing. We will then cover the internals of RisingWave’s architecture, such as decoupled compute and storage, and discuss how each RisingWave service operates. We will further dive into stateful and stateless streaming computations, examining aspects like the internal state of stateful computations and how it can be observed from RisingWave. We will also explore RisingWave’s handling of batch queries and discuss the serving scenarios in which RisingWave excels. Next, we will cover data delivery and ingestion with external systems like Kafka, seamlessly integrating them to showcase how different systems can collaborate to provide various features. Finally, we will review a simple dashboard application for ride-hailing data and demonstrate these concepts. After this talk, developers should be more familiar with the batteries-included capabilities of RisingWave and understand how to simplify their stream processing workflows with RisingWave.