Скачать с ютуб Scale it easy: YDB's high performance in a nutshell в хорошем качестве

Scale it easy: YDB's high performance in a nutshell

Evgenii Ivanov at HighLoad++ Serbia 2024 Implementing a distributed database with strong consistency isn’t difficult; the challenge lies in ensuring speed and scalability. YDB excels in these aspects. In this talk, we’ll discuss YDB’s architecture and its high performance, present rthe esults of benchmarks, and compare YDB to top competitors. Why are performance and scalability so important nowadays? We live in the era of big data, and performance is what makes big data practically useful. Imagine a petabyte database that can handle only 1K transactions per second or the same database requiring 1M servers to operate. In both cases, the database would not be very useful. In today’s world, big data is everywhere; databases must be fast enough to handle this data and affordable for many companies or even individuals. Performance provides both speed and low cost. A genuinely high-performance database allows you to process more data using less hardware. YDB is such a database: it is fast, affordable, and reliable. It combines high availability and scalability with strong consistency and ACID transactions. Time-tested, there are installations with thousands of servers and petabytes of data that have existed for years. In an increasingly data-driven world, YDB’s blend of performance, scalability, and reliability sets it apart as a top choice for organizations seeking to maximize the value of their data. In this talk, we’ll delve deeper into YDB’s architecture, starting with an overview of its key components and design principles. We’ll discuss its role in achieving high-performance and fault tolerance. Throughout the presentation, we’ll illustrate how the proper separation of key-value and query processing layers can improve performance on various request distributions. Additionally, we examine YDB’s actor system, detailing its evolution and the impact on throughput and latency. To better illustrate YDB’s performance, we’ll provide comprehensive examples of various benchmarks, including: Low-level component testing to showcase the efficiency of individual modules Key-value YCSB tests to demonstrate YDB’s ability to handle high-throughput workloads Distributed transactions to highlight the system’s capacity for managing complex, multi-node operations We’ll also share case studies of real-world optimization scenarios, enabling attendees to learn: How a simple yet effective configuration can increase throughput by up to 30% Strategies for addressing GRPC-layer bottlenecks and their impact on performance The crucial role of SDK implementations in shaping the end-user performance experience The tools and methods we employ in our performance optimization efforts, such as profiling and monitoring In conclusion, we’ll compare YDB against top competitors such as CockroachDB and Yugabyte, analyzing various aspects such as ease of deployment, performance, and scalability. By sharing these results, we’ll help the audience gain a better understanding of YDB’s capabilities and how it outperforms competing solutions in handling large-scale data processing tasks efficiently.