Scaling Postgres

In this episode of Scaling Postgres, we discuss a new extension that promises substantially faster text search and ranking, an AI content storm, how to work with money and the fastest way to stop Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/286-20-times-faster-text-search-ranking/

In this episode of Scaling Postgres, we cover a deep dive into indexes from a presentation that includes a decision tree of sorts, how to convert to partitioned tables once you have hundreds of millions of rows and detail about the new pg_stat_io view. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/285-indexing-deep-dive/

In this episode of Scaling Postgres, we discuss whether something is 23 times faster or 1.1 times faster. We also discuss the release of Timescale Vector and whether you can build a queue on Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/284-23-or-1-times-faster-performance/

In this episode of Scaling Postgres, we discuss how to get 222 times faster analytical queries with columnar storage, a Postgres 16 feature review, the birth of a feature and fuzzy search. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/283-222-times-faster-analytical-queries-with-columnar-storage/

In this episode of Scaling Postgres, we discuss the release of Postgres 16, a Postgres meme, storing files or base64 strings and sharding intelligently. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/282-postgres-16-released-postgres-meme-file-vs-base64-strings-intelligent-sharding/

In this episode of Scaling Postgres, we discuss the benefits and disadvantages of HNSW indexes for working with vector data, configuring vacuum to reduce bloat and optimize performance, the new options available for \watch and all about connections. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/281-hnsw-indexes-vacuuming-bloat-watch-me-now-connections/

In this episode of Scaling Postgres, we discuss the release of Postgres 16 RC1, implementing bi-directional replication, different ways you can set up Postgres parameters and how to handle polymorphism and foreign keys. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/280-postgres-16-rc1-bi-directional-replication-all-about-parameters-foreign-keys-polymorphism/

In this episode of Scaling Postgres, we discuss how pgbouncer can impact a TPS benchmark, partition-wise join & aggregate performance, partitioning a table with billions of rows and cool Postgres 16 features. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/279-tps-benchmark-partition-wise-join-partitioning-billions-postgres-16-features/

In this episode of Scaling Postgres, we discuss how to squeeze the most out of your database, achieving one million connections to Postgres, how to use indexes with LIKE and pgvector HNSW index performance. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/278-squeeze-your-system-one-million-connections-indexing-like-pgvector-hnsw/

In this episode of Scaling Postgres, we discuss new Postgres releases, taking the 2023 State of PostgreSQL survey, partitioning vs. sharding and the fastest way to do bulk loads. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/277-postgres-releases-postgresql-survey-partitioning-sharding-bulk-loading/

In this episode of Scaling Postgres, we discuss the importance of correlation with BRIN indexes, how partitioning can kill performance, 10 tips for beginners and how to track table and index usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/276-brin-correlation-poor-partitioning-10-beginner-tips-table-index-usage/

In this episode of Scaling Postgres, we discuss getting rid of vacuum, how to do zero-downtime cut-overs, analyzing the impact of slow networks and seeing a not in optimization. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/275-no-more-vacuum-zero-downtime-cut-over-network-impact-not-in-optimization/

In this episode of Scaling Postgres, we discuss subquery performance, how to avoid excessive locking when doing updates, how to change a columns datatype without excessive locking and lessons from an upgrade outage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/274-subquery-performance-avoid-update-locking-column-changes-outage-workshop/

In this episode of Scaling Postgres, we discuss how Debian & Ubuntu package Postgres, how ifflat indexes work, in vs any performance and how to log view usage. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/273-debian-ubuntu-packages-ivfflat-indexes-in-vs-any-view-logging/

In this episode of Scaling Postgres, we discuss the release of Postgres 16 Beta 2, the rise of vectors and storing them, Foreign Data Wrapper performance and how to identify unused indexes. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/272-postgres-16-beta-2-rise-of-vectors-fdw-performance-unused-indexes/

In this episode of Scaling Postgres, we discuss how to get 30% faster performance, the downsides of UUIDs, having too much WAL and whether Postgres should use processes or threads. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/271-30-percent-faster-uuid-downsides-growing-wal-processes-vs-threads/

In this episode of Scaling Postgres, we discuss how to handle data skew, tools for Postgres monitoring, how to load data remotely and Postgres documentation. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/270-data-skew-monitoring-remote-access-csv-documentation/

In this episode of Scaling Postgres, we discuss Postgres upgrade struggles, how and why to use hyperloglog, using pgbouncer for session vs. transaction pooling, and methods to scale Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/269-upgrade-struggles-hyperloglog-pgbouncer-usage-postgres-scaling/

In this episode of Scaling Postgres, we discuss faster COPY in Postgres 16, how to use psql variables, the importance of backup_label and issues with bad character encoding. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/268-faster-copy-psql-variables-backup_label-bad-encoding/

In this episode of Scaling Postgres, we discuss the release of PostgreSQL 16 Beta 1, creating Rust functions with PL/Rust, memory problems related to partitioning and prepared statements, and modeling tags with arrays. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/267-postgres-16-beta-1-rust-functions-partitioning-memory-problems-tags-arrays/

In this episode of Scaling Postgres, we discuss new Postgres releases, EDB Postgres Distributed, a privilege template and real-time dashboards. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/266-postgres-releases-postgres-distributed-privilege-template-real-time-dashboard/

In this episode of Scaling Postgres, we discuss different ways to use pg_stat_statements, how to handle transaction ID wraparound, consultant knowledge and all the videos of CitusCon. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/265-pg_stat_statements-transaction-id-wraparound-consultant-knowledge-cituscon/

In this episode of Scaling Postgres, we discuss the worst part of Postgres, the status of pluggable storage, what makes a busy system and methods for managing different data architectures. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/264-worst-part-pluggable-storage-busy-system-data-architecture/

In this episode of Scaling Postgres, we discuss LZ4 and ZSTD pg_dump compression, how to avoid problems, can triggers simplify and indexes can hurt. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/263-lz4-zstd-compression-avoiding-problems-triggers-simplify-indexes-can-hurt/

In this episode of Scaling Postgres, we discuss the pg_failover_slots extension, how PG16 allows logical decoding on standbys, what are trusted language extensions and how a package manager has been built for them. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/262-pg_failover_slots-standby-logical-decoding-trusted-language-extensions-postgres-package-manager/

In this episode of Scaling Postgres, we discuss how to easily crate a foreign data wrapper to consume an API, present a convenient JSONB cheatsheet, changes to updating the vacuum cost limit and new parallel aggregates. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/261-easy-foreign-data-wrappers-jsonb-cheatsheet-updating-cost-limit-parallel-aggregate/

In this episode of Scaling Postgres, we discuss PL/Rust 1.0 release, row locks, Postgres errors and the new SQL 2023 standard. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/260-plrust-row-locks-postgres-errors-sql-2023/

In this episode of Scaling Postgres, we discuss max_wal_size as it relates to recovery time, losing your data with collation changes, getting production ready and highlights coming in Postgres 16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/258-logical-replication-database-antipatterns-max_wal_size-delete-vs-truncate/

In this episode of Scaling Postgres, we discuss use cases for logical replication, database anti-patterns, how to set max_wal_size and the difference between delete and truncate. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/258-logical-replication-database-antipatterns-max_wal_size-delete-vs-truncate/

In this episode of Scaling Postgres, we discuss Instacart adopting PgCat, binning or bucketing your data by time, the best settings for work_mem and how to avoid bad check constraints. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/257-adopting-pgcat-time-bins-work_mem-settings-bad-constraints/

In this episode of Scaling Postgres, we discuss WAL growing to 11 Terabytes, pgec supporting writes, Patroni 3.0 & Citus for high availability, and setting up PostgREST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/255-integer-overflow-user-friendly-permissions-dump-logical-replication-worker-config/

In this episode of Scaling Postgres, we discuss how to detect & handle integer overflows, a wish for user-friendly permissions, using a dump to start logical replication and configuring background workers. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/255-integer-overflow-user-friendly-permissions-dump-logical-replication-worker-config/

In this episode of Scaling Postgres, we discuss PG Edge Cache, using Postgres & OpenAI, migrating citext to case-insenstive collations and PG16 compression options. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com

In this episode of Scaling Postgres, we discuss working with unlogged tables, the new pg_stat_io feature, handling complex type constraints and choosing the best text type. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com

In this episode of Scaling Postgres, we discuss new Postgres releases, performance secrets, things not to do and filter vs. case. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com

In this episode of Scaling Postgres, we discuss how to use the filter clause, create hypothetical indexes, store non-relational data and manage TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/251-filter-clause-hypothetical-index-non-relational-data-using-toast/

In this episode of Scaling Postgres, we discuss resolving a performance issue, how PG16 allows you to survive without a superuser, reserving connections and handling partition management. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/250-performance-issue-survive-without-superuser-reserved-connections-partition-management/

In this episode of Scaling Postgres, we discuss issues with locking tables, foreign keys and slow decimals. We also cover when joins use memoize. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/249-locking-tables-foreign-key-issue-slow-decimals-memoize-joins/

In this episode of Scaling Postgres, we discuss different pagination solutions, how to return modifications, soft deletion alternatives and how to use JSON with PostgreSQL. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/248-pagination-solutions-return-modifications-insert-deletions-how-to-json/

In this episode of Scaling Postgres, we discuss how to generate test data, how WAL archiving is faster in PG15, how to set date statistics on a timestamp and how to avoid useless indexes. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/247-generate-test-data-faster-archiving-date-statistics-useless-indexes/

In this episode of Scaling Postgres, we discuss columnar table storage, solving Advent of Code using Postgres, new features coming in Postgres 16 and when Postgres development happens. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/246-columnar-tables-advent-of-code-pg16-features-commit-times/

In this episode of Scaling Postgres, we discuss ENUMs vs. check constraints, querying table facets with roaring bitmaps, a better way to handle scaling and whether you should store your business logic in Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/245-enums-vs-check-constraints-faceting-with-roaring-bitmaps-better-scaling-in-db-business-logic/

In this episode of Scaling Postgres, we discuss merging indexes vs. a composite index, implementing transparent column encryption, developing trusted language extensions, and reviewing the WAL archive module. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/244-index-merge-vs-composite-transparent-column-encryption-trusted-language-extensions-wal-archive-module/

In this episode of Scaling Postgres, we discuss how PG15 helps reduce replication lag, how to get the parameters used in prepared statements, PostGIS Day and how to use multiple pgbouncers. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/243-in-vs-any-ghost-conditions-percentage-calculations-variadic-unnest/

In this episode of Scaling Postgres, we discuss how PG15 helps reduce replication lag, how to get the parameters used in prepared statements, PostGIS Day and how to use multiple pgbouncers. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/242-reduce-replication-lag-explain-parameterized-query-postgis-day-multiple-pgbouncers/

In this episode of Scaling Postgres, we discuss the release of Postgres 15.1, a Postgres 10 retrospective, how to reduce replication lag and using listen & notify. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/241-postgres-15.1-postgres-10-retrospective-reducing-replication-lag-listen-notify/

In this episode of Scaling Postgres, we discuss how sequential scans can be forced, the best way to rename a table without downtime, different Postgres terminology and the PGSQL Phriday blogging event. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/240-forced-sequential-scans-table-renaming-terminology-pgsql-phriday/

In this episode of Scaling Postgres, we discuss how to set shared buffers, the different WAL compression algorithm options, how to use the merge command and how to contribute to Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/239-shared-buffers-compression-algorithms-merge-command-postgres-contributions/

In this episode of Scaling Postgres, we discuss why and what to do when updates are slow, use cases for lateral joins, moving from serial to identity for auto-incrementing ids and changes to Postgres 15. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/238-slow-updates-lateral-joins-serial-to-identity-pg15-changes/

In this episode of Scaling Postgres, we discuss the release of Postgres 15, the performance of different file systems with Postgres, options for connection pooling and how to secure your connections. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/237-postgres-15-released-file-systems-connection-pooling-secure-connections/