Scaling Argo Events for Enterprise Scheduling: A Case Study fr... Antonio Si & Prema devi Kuppuswamy скачать в хорошем качестве

Scaling Argo Events for Enterprise Scheduling: A Case Study fr... Antonio Si & Prema devi Kuppuswamy

Scaling Argo Events for Enterprise Scheduling: A Case Study from Intuit - Antonio Si & Prema devi Kuppuswamy, Intuit Intuit is currently developing a highly scalable scheduling and orchestration platform, leveraging Argo Events for scheduling. We found that as we aimed for a larger scale, existing Argo Events components required enhancements to effectively handle our rapidly expanding needs for horizontal sensor scalability. In this presentation, we will explore the challenges we encountered with Argo Events and outline the measures we've implemented to construct a robust, scalable enterprise scheduler. This includes our innovative contribution of a Kafka-based Eventbus to Argo Events, which provides at least once semantics, and horizontal scalability to sensors - key for enhancing the scalability and reliability of our platform. We will also delve into the internal tooling, performance planning strategies, and custom observability metrics we've developed to manage our platform effectively. we will also present performance data, which demonstrates a significant 90% reduction in resource usage.