Scaling Postgres

In this episode of Scaling Postgres, we discuss how to handle data skew, tools for Postgres monitoring, how to load data remotely and Postgres documentation. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/270-data-skew-monitoring-remote-access-csv-documentation/

In this episode of Scaling Postgres, we discuss Postgres upgrade struggles, how and why to use hyperloglog, using pgbouncer for session vs. transaction pooling, and methods to scale Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/269-upgrade-struggles-hyperloglog-pgbouncer-usage-postgres-scaling/

In this episode of Scaling Postgres, we discuss faster COPY in Postgres 16, how to use psql variables, the importance of backup_label and issues with bad character encoding. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/268-faster-copy-psql-variables-backup_label-bad-encoding/

In this episode of Scaling Postgres, we discuss the release of PostgreSQL 16 Beta 1, creating Rust functions with PL/Rust, memory problems related to partitioning and prepared statements, and modeling tags with arrays. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/267-postgres-16-beta-1-rust-functions-partitioning-memory-problems-tags-arrays/

In this episode of Scaling Postgres, we discuss new Postgres releases, EDB Postgres Distributed, a privilege template and real-time dashboards. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/266-postgres-releases-postgres-distributed-privilege-template-real-time-dashboard/

In this episode of Scaling Postgres, we discuss different ways to use pg_stat_statements, how to handle transaction ID wraparound, consultant knowledge and all the videos of CitusCon. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/265-pg_stat_statements-transaction-id-wraparound-consultant-knowledge-cituscon/

In this episode of Scaling Postgres, we discuss the worst part of Postgres, the status of pluggable storage, what makes a busy system and methods for managing different data architectures. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/264-worst-part-pluggable-storage-busy-system-data-architecture/

In this episode of Scaling Postgres, we discuss LZ4 and ZSTD pg_dump compression, how to avoid problems, can triggers simplify and indexes can hurt. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/263-lz4-zstd-compression-avoiding-problems-triggers-simplify-indexes-can-hurt/

In this episode of Scaling Postgres, we discuss the pg_failover_slots extension, how PG16 allows logical decoding on standbys, what are trusted language extensions and how a package manager has been built for them. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/262-pg_failover_slots-standby-logical-decoding-trusted-language-extensions-postgres-package-manager/

In this episode of Scaling Postgres, we discuss how to easily crate a foreign data wrapper to consume an API, present a convenient JSONB cheatsheet, changes to updating the vacuum cost limit and new parallel aggregates. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/261-easy-foreign-data-wrappers-jsonb-cheatsheet-updating-cost-limit-parallel-aggregate/

In this episode of Scaling Postgres, we discuss PL/Rust 1.0 release, row locks, Postgres errors and the new SQL 2023 standard. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/260-plrust-row-locks-postgres-errors-sql-2023/

In this episode of Scaling Postgres, we discuss max_wal_size as it relates to recovery time, losing your data with collation changes, getting production ready and highlights coming in Postgres 16. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/258-logical-replication-database-antipatterns-max_wal_size-delete-vs-truncate/

In this episode of Scaling Postgres, we discuss use cases for logical replication, database anti-patterns, how to set max_wal_size and the difference between delete and truncate. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/258-logical-replication-database-antipatterns-max_wal_size-delete-vs-truncate/

In this episode of Scaling Postgres, we discuss Instacart adopting PgCat, binning or bucketing your data by time, the best settings for work_mem and how to avoid bad check constraints. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/257-adopting-pgcat-time-bins-work_mem-settings-bad-constraints/

In this episode of Scaling Postgres, we discuss WAL growing to 11 Terabytes, pgec supporting writes, Patroni 3.0 & Citus for high availability, and setting up PostgREST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/255-integer-overflow-user-friendly-permissions-dump-logical-replication-worker-config/

In this episode of Scaling Postgres, we discuss how to detect & handle integer overflows, a wish for user-friendly permissions, using a dump to start logical replication and configuring background workers. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/255-integer-overflow-user-friendly-permissions-dump-logical-replication-worker-config/

In this episode of Scaling Postgres, we discuss PG Edge Cache, using Postgres & OpenAI, migrating citext to case-insenstive collations and PG16 compression options. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com

In this episode of Scaling Postgres, we discuss working with unlogged tables, the new pg_stat_io feature, handling complex type constraints and choosing the best text type. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com

In this episode of Scaling Postgres, we discuss new Postgres releases, performance secrets, things not to do and filter vs. case. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com

In this episode of Scaling Postgres, we discuss how to use the filter clause, create hypothetical indexes, store non-relational data and manage TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/251-filter-clause-hypothetical-index-non-relational-data-using-toast/

In this episode of Scaling Postgres, we discuss resolving a performance issue, how PG16 allows you to survive without a superuser, reserving connections and handling partition management. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/250-performance-issue-survive-without-superuser-reserved-connections-partition-management/

In this episode of Scaling Postgres, we discuss issues with locking tables, foreign keys and slow decimals. We also cover when joins use memoize. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/249-locking-tables-foreign-key-issue-slow-decimals-memoize-joins/

In this episode of Scaling Postgres, we discuss different pagination solutions, how to return modifications, soft deletion alternatives and how to use JSON with PostgreSQL. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/248-pagination-solutions-return-modifications-insert-deletions-how-to-json/

In this episode of Scaling Postgres, we discuss how to generate test data, how WAL archiving is faster in PG15, how to set date statistics on a timestamp and how to avoid useless indexes. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/247-generate-test-data-faster-archiving-date-statistics-useless-indexes/

In this episode of Scaling Postgres, we discuss columnar table storage, solving Advent of Code using Postgres, new features coming in Postgres 16 and when Postgres development happens. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/246-columnar-tables-advent-of-code-pg16-features-commit-times/

In this episode of Scaling Postgres, we discuss ENUMs vs. check constraints, querying table facets with roaring bitmaps, a better way to handle scaling and whether you should store your business logic in Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/245-enums-vs-check-constraints-faceting-with-roaring-bitmaps-better-scaling-in-db-business-logic/

In this episode of Scaling Postgres, we discuss merging indexes vs. a composite index, implementing transparent column encryption, developing trusted language extensions, and reviewing the WAL archive module. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/244-index-merge-vs-composite-transparent-column-encryption-trusted-language-extensions-wal-archive-module/

In this episode of Scaling Postgres, we discuss how PG15 helps reduce replication lag, how to get the parameters used in prepared statements, PostGIS Day and how to use multiple pgbouncers. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/243-in-vs-any-ghost-conditions-percentage-calculations-variadic-unnest/

In this episode of Scaling Postgres, we discuss how PG15 helps reduce replication lag, how to get the parameters used in prepared statements, PostGIS Day and how to use multiple pgbouncers. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/242-reduce-replication-lag-explain-parameterized-query-postgis-day-multiple-pgbouncers/

In this episode of Scaling Postgres, we discuss the release of Postgres 15.1, a Postgres 10 retrospective, how to reduce replication lag and using listen & notify. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/241-postgres-15.1-postgres-10-retrospective-reducing-replication-lag-listen-notify/

In this episode of Scaling Postgres, we discuss how sequential scans can be forced, the best way to rename a table without downtime, different Postgres terminology and the PGSQL Phriday blogging event. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/240-forced-sequential-scans-table-renaming-terminology-pgsql-phriday/

In this episode of Scaling Postgres, we discuss how to set shared buffers, the different WAL compression algorithm options, how to use the merge command and how to contribute to Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/239-shared-buffers-compression-algorithms-merge-command-postgres-contributions/

In this episode of Scaling Postgres, we discuss why and what to do when updates are slow, use cases for lateral joins, moving from serial to identity for auto-incrementing ids and changes to Postgres 15. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/238-slow-updates-lateral-joins-serial-to-identity-pg15-changes/

In this episode of Scaling Postgres, we discuss the release of Postgres 15, the performance of different file systems with Postgres, options for connection pooling and how to secure your connections. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/237-postgres-15-released-file-systems-connection-pooling-secure-connections/

In this episode of Scaling Postgres, we discuss the Postgres 15 RC2, optimizing shared buffers, how to secure your database connections and blog posts from PGSQL Phriday. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/236-postgres-15-rc2-shared-buffers-secure-connections-pgsql-phriday/

In this episode of Scaling Postgres, we discuss the release of the Postgres 15 Release Candidate 1, new ICU collations features, how to use listen & notify and understanding TOAST. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/235-postgres-15-rc1-icu-collations-listen-notify-understanding-toast/

In this episode of Scaling Postgres, we discuss using rust for Postgres extensions, performance comparisons of TimescaleDB vs. Postgres, uninterrupted writes when sharding in Citus and the Postgres data flow. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/234-rust-for-extensions-timescale-vs-postgres-uninterrupted-sharding-data-flow/

In this episode of Scaling Postgres, we discuss little known useful features, a monthly community blogging initiative, PG 15 Anticipation, and getting generic plans. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/233-useful-features-community-blogging-pg15-anticipation-generic-plans/

In this episode of Scaling Postgres, we discuss the release of Postgres 15 Beta 4, different primary key options, sequence limits and how to examine your Postgres configuration. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/232-pg15-beta-4-primary-key-options-sequence-limits-configuration/

In this episode of Scaling Postgres, we discuss the PG15 changes to public schema permissions, experiences with kubernetes for Postgres management, using dump manifests for restores and a fork of PgBouncer. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/231-pg15-public-schema-kubernetes-experiences-dump-manifests-pgbouncer-fork/

In this episode of Scaling Postgres, we discuss how the stats collector disappears in PG15, steps to mitigate high latency connections, how to run Postgres in the browser and the future of high availability. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/230-stats-collector-gone-handling-latency-postgres-in-browser-future-high-availability/

In this episode of Scaling Postgres, we discuss a new Postgres playground, a book about PG14 internals, how to corrupt your database and using anti-joins. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/229-postgres-playground-pg14-internals-db-corruption-anti-join/

In this episode of Scaling Postgres, we discuss new Postgres releases, a new privilege escalation CVE, chaos testing a high availability kubernetes cluster as well as addressing other H/A questions. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/228-new-postgres-releases-privilege-escalation-cve-chaos-testing-high-availability/

In this episode of Scaling Postgres, we discuss PG14's new SQL function In this episode of Scaling Postgres, we discuss research into a performance puzzle, results from a Postgres and pgAdmin survey as well as the impacts of long running queries on Aurora and Postgres. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/227-researching-performance-postgres-survey-pgadmin-survey-long-running-queries/

In this episode of Scaling Postgres, we discuss PG14's new SQL function syntax, including buffers when doing explain analyze, how to debug autovacuum and using row-level security to handle multi-tenancy. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/226-sql-functions-explain-analyze-buffers-debug-autovacuum-rls-multi-tenancy/

In this episode of Scaling Postgres, we discuss /gexec available in psql, how to delete duplicates using a window function, a new Postgres podcast and a performance talk about going from puny to powerful. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/225-psql-gexec-delete-duplicates-postgres-podcast-puny-powerful/

In this episode of Scaling Postgres, we discuss how too many columns in a table can affect performance, at what point BRIN indexes win over btree, and Postgres 15 supporting unique nulls and parallel distinct queries. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/224-column-performance-brin-win-unique-null-parallel-distinct/

In this episode of Scaling Postgres, we discuss the process of decomposing your database, how to search text in Postgres quickly, how to understand the output of pg_stat_activity and how to use window functions to solve a use case. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/223-database-decomposition-fast-text-search-understanding-pg_stat_activity-window-functions/

In this episode of Scaling Postgres, we discuss psql shortcuts, how to debug deadlocks, how to find & stop queries and how to understand and use SCRAM authentication. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/222-postgres-15-beta-2-concerning-locks-vacuum-tuning-transaction-anomalies/

In this episode of Scaling Postgres, we discuss psql shortcuts, how to debug deadlocks, how to find & stop queries and how to understand and use SCRAM authentication. To get the show notes as well as get notified of new episodes, visit: https://www.scalingpostgres.com/episodes/221-psql-shortcuts-debugging-deadlocks-find-and-stop-queries-using-scram/