Scaling Postgres

In this episode of Scaling Postgres, we discuss the shutdown of Ottertune, how schema changes cause locks and how to avoid them, the benefits of on conflic do nothing, and pgvectorscale. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/321-ottertune-is-dead/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss three organizations scaling their databases to 100 TB and beyond, collation speed, configuring memory and new AI extensions To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/320-100tb-and-beyond/ Want to learn more about Postgres performance? Join my FREE training called Postgres Performance Demystified here: https://www.scalingpostgres.com/courses/postgres-performance-demystified/

In this episode of Scaling Postgres, we discuss a time when Postgres development stopped, two new extensions pg_lakehouse & pg_compare and the upcoming event Posette. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/319-when-postgres-development-stoppped/

In this episode of Scaling Postgres, we discuss all the new features in Postgres 17 Beta 1, some features that did not make it, database collations & sorting and causes of slow commits. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/318-postgres-17-beta-1-released/

In this episode of Scaling Postgres, we discuss a new time-series open source extension called pg_timeseries, Postgres ignoring indexes, JSONB selectivity issues, and geographically distributed multi-tenant applications. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/317-time-series-open-source-extension/

In this episode of Scaling Postgres, we discuss new Postgres releases, optimizing a query to be 1,000 times faster, custom vs. generic plans and the pgtt extension. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/316-new-releases-1000-times-faster-query/

In this episode of Scaling Postgres, we discuss how hacking on Postgres is hard, a notifier pattern for using Listen/Notify, using histograms for metrics and saturated arithmetic. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/315-hacking-on-postgres-is-hard/

In this episode of Scaling Postgres, we discuss performance improvements for pgvector 0.7.0, a guide to vector embeddings, building a Retrieval Augmented Generation app and only allow logins to replicas. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/314-150-times-faster-pgvector/

In this episode of Scaling Postgres, we discuss whether the future of MySQL is Postgres, how to use recursive CTEs, work on OrioleDB, and PG17 performance improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/313-the-future-of-mysql-is-postgres/

In this episode of Scaling Postgres, we cover potential features in Postgres 17 such as explain serialize, verbose copy, pg_buffer_cache_evict, as well as many others. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/312-postgres-17-commit-orama/

In this episode of Scaling Postgres, we discuss a 1,400 times faster max and group by implementation, new quantization capabilities in pgvector, adaptive radix trees and splitting & merging partitions in PG17. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/311-max-group-by-performance/

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/310-andres-microsoft-postgres-save-linux/

In this episode of Scaling Postgres, we discuss whether Postgres will pull a Redis, remembering Simon Riggs, built-in collation provider and C.UTF-8 in PG 17 and health checks. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/309-will-postgres-pull-a-redis/

In this episode of Scaling Postgres, we discuss high availability's future, a custom sharding solution by Figma, sharding pg_vector queries, and PG17 logical replication failover. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/308-scale-through-sharding/

In this episode of Scaling Postgres, we discuss whether we should be using bytewise or linguistic ordering by default, how to transform data in Postgres, benefits of a transaction_timeout and how to enforce join order. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/307-collation-conundrum/

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/306-scalability-limits-from-slru-lock-manager/

In this episode of Scaling Postgres, we discuss one configuration change that resulted in an 11,000 times faster query, why Postgres is not using your index, backported PG improvements and parallelism with TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/305-11k-faster-configuration-change/

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/304-overhead-of-pg_stat_statements/

In this episode of Scaling Postgres, we discuss new Postgres releases, performance comparisons between PgBouncer, PgCat and Supavisor, a new extension pg_analytics, and new planner capabilities in PG16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/303-pgbouncer-pgcat-supavisor-fight/

In this episode of Scaling Postgres, we discuss when and how you should use UUIDs or not, how to optimize space with column order and arrays, whether it is better to tune parameters or queries and what devs should know about Postgres with Andrew Atkinson. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/302-uuid-vs-bigint-battle/

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/301-postgres-llm-os-30-times-faster-index-builds/

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/300-postgres-celebration/

In this episode of Scaling Postgres, we discuss how you can build a GPT in 500 lines of SQL code, how to optimize extension loading, the best way to set passwords and being able to change generated columns. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/299-build-a-gpt-in-sql/

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/298-10-100-times-higher-latency-with-distributed-postgres/

In this episode of Scaling Postgres, we discuss hopes for Postgres in 2024, whether you need foreign keys, incremental backups, and five ways of doing not exists. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/297-postgres-in-2024/

In this episode of Scaling Postgres, we discuss the State of Postgres 2023 survey, a repository of Postgres how-tos, ways foreign keys can break and a custom SQL playground. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/296-state-of-postgres-2023/

In this episode of Scaling Postgres, we discuss a 30K messages per second queue built on Postgres, a zero downtime logical replication upgrade, the release of the Supavisor 1.0 connection pooler and PostGIS day. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/295-30k-messages-per-second-queue/

In this episode of Scaling Postgres, we discuss how much observability is needed, avoiding locks during database migrations, a huge Postgres events blogging event and FIPS mode. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/294-how-much-observability-is-needed/

In this episode of Scaling Postgres, we discuss how create statistics can help you get better plans, issues with subtransactions, all about extensions and best practices when indexing timestamps. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/293-better-plans-with-statistics/

In this episode of Scaling Postgres, we discuss using companion databases, multi-tenancy database design, whether SQL is good, and different transaction isolation levels. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/292-companion-databases/

In this episode of Scaling Postgres, we discuss Timescale's performance improvements from adding a query vectorization pipeline, doing blue-green deployments for databases, using reserved_connections and two improvements to null handling. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/291-2-to-4-times-faster-with-vectorization/

In this episode of Scaling Postgres, we discuss my Postgres Performance Starter Kit, new releases of Postgres, removing JIT, and a lightweight message queue. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/290-postgres-releases-equals-reindexing/

In this episode of Scaling Postgres, we discuss new options for Postgres scheduling tools, proper ways to kill processes and explain usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/289-postgres-scheduling-opportunities/

In this episode of Scaling Postgres, we discuss index corruption from a ICU collation change, another caveat for PgBouncer prepared statements, ways to version data, and using Postgres as a cache. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/288-index-corruption-from-icu-collation-change/

In this episode of Scaling Postgres, we discuss how the new version of pgbouncer could get you 15% to 250% faster query throughput, the availability of using kubernetes snapshots for backup and restore with CloudNativePg and Ruby on Rails Postgres improvements. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/287-15-250-percent-faster-query-throughput/

In this episode of Scaling Postgres, we discuss a new extension that promises substantially faster text search and ranking, an AI content storm, how to work with money and the fastest way to stop Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/286-20-times-faster-text-search-ranking/

In this episode of Scaling Postgres, we cover a deep dive into indexes from a presentation that includes a decision tree of sorts, how to convert to partitioned tables once you have hundreds of millions of rows and detail about the new pg_stat_io view. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/285-indexing-deep-dive/

In this episode of Scaling Postgres, we discuss whether something is 23 times faster or 1.1 times faster. We also discuss the release of Timescale Vector and whether you can build a queue on Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/284-23-or-1-times-faster-performance/

In this episode of Scaling Postgres, we discuss how to get 222 times faster analytical queries with columnar storage, a Postgres 16 feature review, the birth of a feature and fuzzy search. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/283-222-times-faster-analytical-queries-with-columnar-storage/

In this episode of Scaling Postgres, we discuss the release of Postgres 16, a Postgres meme, storing files or base64 strings and sharding intelligently. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/282-postgres-16-released-postgres-meme-file-vs-base64-strings-intelligent-sharding/

In this episode of Scaling Postgres, we discuss the benefits and disadvantages of HNSW indexes for working with vector data, configuring vacuum to reduce bloat and optimize performance, the new options available for \watch and all about connections. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/281-hnsw-indexes-vacuuming-bloat-watch-me-now-connections/

In this episode of Scaling Postgres, we discuss the release of Postgres 16 RC1, implementing bi-directional replication, different ways you can set up Postgres parameters and how to handle polymorphism and foreign keys. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/280-postgres-16-rc1-bi-directional-replication-all-about-parameters-foreign-keys-polymorphism/

In this episode of Scaling Postgres, we discuss how pgbouncer can impact a TPS benchmark, partition-wise join & aggregate performance, partitioning a table with billions of rows and cool Postgres 16 features. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/279-tps-benchmark-partition-wise-join-partitioning-billions-postgres-16-features/

In this episode of Scaling Postgres, we discuss how to squeeze the most out of your database, achieving one million connections to Postgres, how to use indexes with LIKE and pgvector HNSW index performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/278-squeeze-your-system-one-million-connections-indexing-like-pgvector-hnsw/

In this episode of Scaling Postgres, we discuss new Postgres releases, taking the 2023 State of PostgreSQL survey, partitioning vs. sharding and the fastest way to do bulk loads. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/277-postgres-releases-postgresql-survey-partitioning-sharding-bulk-loading/

In this episode of Scaling Postgres, we discuss the importance of correlation with BRIN indexes, how partitioning can kill performance, 10 tips for beginners and how to track table and index usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/276-brin-correlation-poor-partitioning-10-beginner-tips-table-index-usage/

In this episode of Scaling Postgres, we discuss getting rid of vacuum, how to do zero-downtime cut-overs, analyzing the impact of slow networks and seeing a not in optimization. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/275-no-more-vacuum-zero-downtime-cut-over-network-impact-not-in-optimization/

In this episode of Scaling Postgres, we discuss subquery performance, how to avoid excessive locking when doing updates, how to change a columns datatype without excessive locking and lessons from an upgrade outage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/274-subquery-performance-avoid-update-locking-column-changes-outage-workshop/

In this episode of Scaling Postgres, we discuss how Debian & Ubuntu package Postgres, how ifflat indexes work, in vs any performance and how to log view usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/273-debian-ubuntu-packages-ivfflat-indexes-in-vs-any-view-logging/

In this episode of Scaling Postgres, we discuss the release of Postgres 16 Beta 2, the rise of vectors and storing them, Foreign Data Wrapper performance and how to identify unused indexes. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/272-postgres-16-beta-2-rise-of-vectors-fdw-performance-unused-indexes/