Developing IO Prefetching for Postgres | Citus Con: An Event for Postgres 2022 скачать в хорошем качестве

Developing IO Prefetching for Postgres | Citus Con: An Event for Postgres 2022

In this video of Melanie Plageman’s talk at Citus Con: An Event for Postgres, learn more about developing and refining an algorithm for prefetching data blocks from the application layer. Data prefetching (often called "readahead") is a necessary component of PostgreSQL's proposed new IO paradigm: direct and asynchronous IO. As of PostgreSQL 14, prefetching is already in use in limited contexts, e.g. bitmap heap scan. But without kernel readahead, Postgres must implement additional prefetching of its own. Melanie’s talk from the Americas livestream at Citus Con will cover the basics of IO prefetching in PostgreSQL, the prefetching algorithm proposed with the direct and asynchronous IO patch set, and the process of refining a prefetching model. Melanie Plageman is a Postgres database hacker working on open source at Microsoft. She has worked on the Postgres executor, planner, storage, and statistics subsystems. Most recently she has been hacking on the proposed asynchronous and direct IO patch set. She is passionate about writing maintainable database code and about building developer tools. ► Video bookmarks: ⏩ 00:00 Introduction ⏩ 00:54 What is prefetching? ⏩ 05:11 Prefetching development issues & challenges ⏩ 06:24 Advantages of simulation ⏩ 14:05 Evaluating prefetching simulation output ⏩ 23:21 Algorithm work-in-progress ⏩ 24:05 Next steps ⏩ 25:24 Q&A with Melanie & Marco ✅ Learn more: Watch more Citus Con talks: https://aka.ms/cituscon-playlist 📕 Everything you need to know about Citus Con: An Event for Postgres can be found at: https://aka.ms/cituscon 📌 Let’s connect: Twitter – @CitusCon,   / cituscon   #CitusCon #PostgreSQL #Database