Running 100 Million Queries Reliably on In-Memory Distributed SQL Engine скачать в хорошем качестве

Running 100 Million Queries Reliably on In-Memory Distributed SQL Engine

Presto is an open source software which was initially released by Facebook and was widely adapted by enterprise use cases such as advertising and web. In this talk, filmed June 21 at the IMC Summit in Amsterdam, software engineer Kai Sasaki of Treasure Data Inc. introduces the technologies used in real-use cases about how to make reliable in-memory distributed cluster which can be tolerate to be provided as PaaS. He'll explain how Presto is an in-memory fast distributed SQL engine which fits to adhoc/interactive use cases. Our Treasure Data provides data management platform on cloud by using Presto. Since the library is now widely used in critical use cases in our customers, it is important to pursuit the high performance and stability on millions of queries. In addition the data size our Presto cluster is processing become increasing day by day. The key solutions which will be covered by this session are Multi-resource awareness of node scheduling Distributed RDBMS based job queue called 'PerfectQueue' Partition-based resource scheduler Resource isolation semantics to fit in-memory workload context.