Postgres with many data (froscon2025)

Picking up the topic of previous talks about using PostgreSQL to store many data, very many data, and absurdly many data, this talk wants to talk about the problems and challenges that one might experience when trying to shove all the data into PostgreSQL. Many things that are simple with small amounts of data can become headache-inducing. As data grows even a simple 'select count(*)' can be unpleasantly slow. Taking a naive backup could easily take more than a day, and restoring such a backup is similarly time-consuming. We will explore the limits of where PostgreSQL can go, the limits imposed by physics, hardware, and software, and ideas how we can go beyond those limitations. We'll also look at some performance problems and the many strategies we have to mitigate them. Hopefully this talk will give you the confidence that PostgreSQL can grow with your data, and show you some of the options you have to improve performance when your data just keeps growing and growing. Licensed to the public under http://creativecommons.org/licenses/by/4.0 about this event: https://programm.froscon.org/2025/events/3326.html