Fast Observability on S3 with Parseable скачать в хорошем качестве

Fast Observability on S3 with Parseable

For memberships: join this channel as a member here:    / @thegeeknarrator   Summary In this conversation, Nitish Tiwari discusses Parseable, an observability platform designed to address the challenges of managing and analyzing large volumes of data. The discussion covers the evolution of observability systems, the design principles behind Parseable, and the importance of efficient data ingestion and storage in S3. Nitish explains how Parseable allows for flexible deployment, handles data organization, and supports querying through SQL. The conversation also touches on the correlation of logs and traces, failure modes, scaling strategies, and the optional nature of indexing for performance optimization. References: Parseable: https://www.parseable.com/ GitHub Repository: https://github.com/parseablehq/parseable Architecture: https://parseable.com/docs/architecture Chapters: 00:00 Introduction to Parseable and Observability Challenges 05:17 Key Features of Parseable 12:03 Deployment and Configuration of Parseable 18:59 Ingestion Process and Data Handling 32:52 S3 Integration and Data Organisation 35:26 Organising Data in Parseable 38:50 Metadata Management and Retention 39:52 Querying Data: User Experience and SQL 44:28 Caching and Performance Optimisation 46:55 User-Friendly Querying: SQL vs. UI 48:53 Correlating Logs and Traces 50:27 Handling Failures in Ingestion 53:31 Managing Spiky Workloads 54:58 Data Partitioning and Organisation 58:06 Creating Indexes for Faster Reads 01:00:08 Parseable's Architecture and Optimisation 01:03:09 AI for Enhanced Observability 01:05:41 Getting Involved with Parseable For memberships: join this channel as a member here:    / @thegeeknarrator   Don't forget to like, share, and subscribe for more insights! ============================================================================= Like building stuff? Try out CodeCrafters and build amazing real world systems like Redis, Kafka, Sqlite. Use the link below to signup and get 40% off on paid subscription. https://app.codecrafters.io/join?via=... ============================================================================= Database internals series:    • Write-ahead-logging   Popular playlists: Realtime streaming systems:    • Realtime Streaming Systems   Software Engineering:    • Software Engineering   Distributed systems and databases:    • Distributed Systems and Databases   Modern databases:    • Modern Databases   Stay Curios! Keep Learning! #database #s3 #objectstorage #opentelemetry #logs #metrics