6d4607e886
Building extended statistics of type "ndistinct" calls ndistinct_for_combination() once for every combination of columns. Each call allocates arrays for the whole sample and never frees them, with memory accumulating until the whole statistics object is built. The sample has 300 multiplied by target rows. With large statistics targets (default_statistics_target up to 10k), this can add up to gigabytes worth of memory, useless once a combination is computed. ndistinct_for_combination() is now called in a dedicated memory context, reset after each combination is computed. We only need the estimated number of distinct values, so there is no need to copy anything out of the memory context. Similar fixes have been done in83772cc78eandad8a166ca8for other areas of the extended stats computations. Author: Ilia Evdokimov <ilya.evdokimov@tantorlabs.com> Discussion: https://postgr.es/m/20d6689e-f490-4ca7-a92f-e92f691ba07e@tantorlabs.com Backpatch-through: 14
PostgreSQL Database Management System
This directory contains the source code distribution of the PostgreSQL database management system.
PostgreSQL is an advanced object-relational database management system that supports an extended subset of the SQL standard, including transactions, foreign keys, subqueries, triggers, user-defined types and functions. This distribution also contains C language bindings.
Copyright and license information can be found in the file COPYRIGHT.
General documentation about this version of PostgreSQL can be found at https://www.postgresql.org/docs/devel/. In particular, information about building PostgreSQL from the source code can be found at https://www.postgresql.org/docs/devel/installation.html.
The latest version of this software, and related software, may be obtained at https://www.postgresql.org/download/. For more information look at our web site located at https://www.postgresql.org/.