Reactive.Community: Jay Kreps, Stream Processing with Apache Kafka скачать в хорошем качестве

Reactive.Community: Jay Kreps, Stream Processing with Apache Kafka

ai.bythebay.io Nov 2025, Oakland, full-stack AI conference Scale By the Bay 2019 is held on November 13-15 in sunny Oakland, California, on the shores of Lake Merritt: https://scale.bythebay.io. Join us! ----- Most software systems continuously transform streams of inputs into streams of outputs. Yet the idea of directly modeling stream processing in infrastructure systems is just coming into it's own after a few decades on the periphery. This talk will cover the basic challenges of reliable, distributed, stateful stream processing. It will cover how Apache Kafka was designed to support capturing and processing distributed data streams by building up the basic primitives needed for a stream processing system. Finally it will explore how these kind of infrastructure maps to practical problems based on our experience building and scaling Kafka to handle streams that captured hundreds of billions of records per day. Jay Kreps is the original author of several of open source projects including Apache Kafka, Apache Samza, Voldemort, and Azkaban. Jay is the co-founder and CEO at Confluent, a company built around realtime data streams and the open source messaging system Apache Kafka.