Smart City Data Pipeline, an Edge to Core Data Story скачать в хорошем качестве

Smart City Data Pipeline, an Edge to Core Data Story

Smart Cities are complex and challenging environments. They generate an overwhelming amount of data that you have to ingest, transfer, prepare and store even before thinking of analyzing them or training a model. In this presentation based on a fictitious but concrete scenario, in the city of London, we will see how you can leverage different data engineering patterns to create a full edge-to-core data pipeline. All of these: Computer Vision, Kafka, Object Storage, Data aggregation, Real-time and Batch analysis, in a fully cloud-native containerized environment, are some of the technologies we will explore and see working live. After this session, you should get a better understanding on how to get your models in production, how to automate some data engineering workflows, and how to build a resilient production-grade data workflow infrastructure.