Taming Explosive Growth: Scaling Financial Databases скачать в хорошем качестве

Taming Explosive Growth: Scaling Financial Databases

Welcome to the third episode of Architecture Deep Dive with Oleksii Petrov! In today’s podcast, our guest — Dmytro Hnatiuk, Principal Software Engineer, Wise. In this episode, we dive deep into the challenges of scaling financial databases, handling explosive growth, and building resilient systems that can withstand massive transaction volumes. Dmytro shares insights from nearly a decade of experience working on high-load financial infrastructure, covering everything from indexing and query optimization to data partitioning, domain separation, and when (and when not) to consider distributed databases. Link to Dmytro’s presentation: "Taming Explosive Growth: Building Resilience in a Hyper-Scaled Financial Platform" 🔗 https://fwdays.com/en/event/highload-... What you should subscribe to: – More interesting content for developers: https://fwdays.com/en/events – Fwdays Twitter:   / fwdays   – Oleksii Petrov's Telegram channel: https://t.me/OleksiiTheArchitect – Oleksii Petrov's LinkedIn:   / alexhelkar   Timestamps: 00:00 - Intro 00:24 - About Wise and Dmytro's Background 01:56 – Dmytro’s journey to Chief of Financial Databases at Wise 05:11 - Importance of Data Integrity in Financial Systems 07:04 - Scaling challenges at Wise 09:23 – Exponential data growth at Wise (1B records/month) 12:27 – Database performance and key metrics 13:39 – How do you actually scale a relational database? 16:18 – When a database becomes your bottleneck? 17:57 - The Performance Optimization Pyramid Explained 21:55 - Starting with Basic Database Setup and Configuration 24:15 - Cloud instances vs managed databases (EC2 vs AWS RDS) 25:40 - Effective Indexing Strategies and Common Pitfalls 32:04 - Application-Level Fixes for Better Performance 36:43 - Query Optimization Techniques and Tools 46:48 - Segregating Workloads for Efficiency 52:33 - Data Modularization and Domain Separation 59:46 - Implementing Table Partitioning 01:04:08 - Data Archival Strategies 01:06:33 - Horizontal sharding: the “top league” of scaling 01:07:49 - Thoughts on Distributed and Serverless Databases 01:11:15 - Summary of Scaling Achievements and Key Lessons 01:12:44 - Final Advice on Scaling Databases 01:13:37 - Don’t forget to subscribe and like!