1
0
mirror of https://github.com/postgres/postgres.git synced 2025-05-28 05:21:27 +03:00

Try to avoid semaphore-related test failures on NetBSD/OpenBSD.

These two platforms have a remarkably tight default limit on the
number of SysV semaphores in the system: SEMMNS is only 60
out-of-the-box.  Unless manual action is taken to raise that,
we'll only be able to allocate 3 sets of 16 usable semaphores
each, leading to initdb setting max_connections to just 20.
That's problematic because the core regression tests expect
to be able to launch 20 concurrent sessions, leaving us with
no headroom.  This seems to be the cause of intermittent
buildfarm failures on some machines.

While there's no getting around the fact that you'd better raise
SEMMNS for production use on these platforms, it does seem desirable
for "make check" to pass reliably without that.  We can make that
happen, at least for awhile longer, with two small changes:

* Change sysv_sema.c's SEMAS_PER_SET to 19, so that we can eat up
all of the available semas not just most of them.

* Change initdb to make the smallest max_connections value it will
consider be 25 not 20.

This is a back-patch of recent HEAD commit 38da05346 into v17.
The motivation for doing this now is that an upcoming bug-fix
patch will give the new-in-17 slotsync worker process its own
reserved PGPROC and hence also semaphore.  With that patch but
without this change, v17 would fail to start at all under the
default SEMMNS on these platforms.

Discussion: https://postgr.es/m/db2773a2-aca0-43d0-99c1-060efcd9954e@gmail.com
Discussion: https://postgr.es/m/1808397.1735156190@sss.pgh.pa.us
This commit is contained in:
Tom Lane 2024-12-28 11:48:13 -05:00
parent fa61313770
commit a46311ed72
3 changed files with 15 additions and 9 deletions

View File

@ -781,19 +781,19 @@ psql: error: connection to server on socket "/tmp/.s.PGSQL.5432" failed: No such
<row> <row>
<entry><varname>SEMMNI</varname></entry> <entry><varname>SEMMNI</varname></entry>
<entry>Maximum number of semaphore identifiers (i.e., sets)</entry> <entry>Maximum number of semaphore identifiers (i.e., sets)</entry>
<entry>at least <literal>ceil((max_connections + autovacuum_max_workers + max_wal_senders + max_worker_processes + 7) / 16)</literal> plus room for other applications</entry> <entry>at least <literal>ceil((max_connections + autovacuum_max_workers + max_wal_senders + max_worker_processes + 7) / 19)</literal> plus room for other applications</entry>
</row> </row>
<row> <row>
<entry><varname>SEMMNS</varname></entry> <entry><varname>SEMMNS</varname></entry>
<entry>Maximum number of semaphores system-wide</entry> <entry>Maximum number of semaphores system-wide</entry>
<entry><literal>ceil((max_connections + autovacuum_max_workers + max_wal_senders + max_worker_processes + 7) / 16) * 17</literal> plus room for other applications</entry> <entry><literal>ceil((max_connections + autovacuum_max_workers + max_wal_senders + max_worker_processes + 7) / 19) * 20</literal> plus room for other applications</entry>
</row> </row>
<row> <row>
<entry><varname>SEMMSL</varname></entry> <entry><varname>SEMMSL</varname></entry>
<entry>Maximum number of semaphores per set</entry> <entry>Maximum number of semaphores per set</entry>
<entry>at least 17</entry> <entry>at least 20</entry>
</row> </row>
<row> <row>
@ -840,20 +840,20 @@ psql: error: connection to server on socket "/tmp/.s.PGSQL.5432" failed: No such
(<xref linkend="guc-max-connections"/>), allowed autovacuum worker process (<xref linkend="guc-max-connections"/>), allowed autovacuum worker process
(<xref linkend="guc-autovacuum-max-workers"/>), allowed WAL sender process (<xref linkend="guc-autovacuum-max-workers"/>), allowed WAL sender process
(<xref linkend="guc-max-wal-senders"/>), and allowed background (<xref linkend="guc-max-wal-senders"/>), and allowed background
process (<xref linkend="guc-max-worker-processes"/>), in sets of 16. process (<xref linkend="guc-max-worker-processes"/>), in sets of 19.
Each such set will Each such set will
also contain a 17th semaphore which contains a <quote>magic also contain a 20th semaphore which contains a <quote>magic
number</quote>, to detect collision with semaphore sets used by number</quote>, to detect collision with semaphore sets used by
other applications. The maximum number of semaphores in the system other applications. The maximum number of semaphores in the system
is set by <varname>SEMMNS</varname>, which consequently must be at least is set by <varname>SEMMNS</varname>, which consequently must be at least
as high as <varname>max_connections</varname> plus as high as <varname>max_connections</varname> plus
<varname>autovacuum_max_workers</varname> plus <varname>max_wal_senders</varname>, <varname>autovacuum_max_workers</varname> plus <varname>max_wal_senders</varname>,
plus <varname>max_worker_processes</varname>, plus one extra for each 16 plus <varname>max_worker_processes</varname>, plus one extra for each 19
allowed connections plus workers (see the formula in <xref allowed connections plus workers (see the formula in <xref
linkend="sysvipc-parameters"/>). The parameter <varname>SEMMNI</varname> linkend="sysvipc-parameters"/>). The parameter <varname>SEMMNI</varname>
determines the limit on the number of semaphore sets that can determines the limit on the number of semaphore sets that can
exist on the system at one time. Hence this parameter must be at exist on the system at one time. Hence this parameter must be at
least <literal>ceil((max_connections + autovacuum_max_workers + max_wal_senders + max_worker_processes + 7) / 16)</literal>. least <literal>ceil((max_connections + autovacuum_max_workers + max_wal_senders + max_worker_processes + 7) / 19)</literal>.
Lowering the number Lowering the number
of allowed connections is a temporary workaround for failures, of allowed connections is a temporary workaround for failures,
which are usually confusingly worded <quote>No space which are usually confusingly worded <quote>No space

View File

@ -50,8 +50,14 @@ typedef int IpcSemaphoreId; /* semaphore ID returned by semget(2) */
* we allocate. It must be *less than* your kernel's SEMMSL (max semaphores * we allocate. It must be *less than* your kernel's SEMMSL (max semaphores
* per set) parameter, which is often around 25. (Less than, because we * per set) parameter, which is often around 25. (Less than, because we
* allocate one extra sema in each set for identification purposes.) * allocate one extra sema in each set for identification purposes.)
*
* The present value of 19 is chosen with one eye on NetBSD/OpenBSD's default
* SEMMNS setting of 60. Remembering the extra sema per set, this lets us
* allocate three sets with 57 useful semaphores before exceeding that, which
* is enough to run our core regression tests. Users of those systems will
* still want to raise SEMMNS for any sort of production work, though.
*/ */
#define SEMAS_PER_SET 16 #define SEMAS_PER_SET 19
#define IPCProtection (0600) /* access/modify by user only */ #define IPCProtection (0600) /* access/modify by user only */

View File

@ -1119,7 +1119,7 @@ test_config_settings(void)
#define MIN_BUFS_FOR_CONNS(nconns) ((nconns) * 10) #define MIN_BUFS_FOR_CONNS(nconns) ((nconns) * 10)
static const int trial_conns[] = { static const int trial_conns[] = {
100, 50, 40, 30, 20 100, 50, 40, 30, 25
}; };
static const int trial_bufs[] = { static const int trial_bufs[] = {
16384, 8192, 4096, 3584, 3072, 2560, 2048, 1536, 16384, 8192, 4096, 3584, 3072, 2560, 2048, 1536,