mirror of
				https://github.com/postgres/postgres.git
				synced 2025-11-03 09:13:20 +03:00 
			
		
		
		
	backend update.
This commit is contained in:
		@@ -8,30 +8,30 @@ PostgreSQL Backend Flowchart
 | 
				
			|||||||
</H1>
 | 
					</H1>
 | 
				
			||||||
<H2 ALIGN=CENTER>
 | 
					<H2 ALIGN=CENTER>
 | 
				
			||||||
by Bruce Momjian
 | 
					by Bruce Momjian
 | 
				
			||||||
</H2 ALIGN=CENTER>
 | 
					</H2>
 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
Queries come into the backend via data packets coming in through TCP/IP
 | 
					A query come into the backend via data packets coming in through TCP/IP
 | 
				
			||||||
and Unix Domain sockets.   They are loaded into a string, and passed to
 | 
					and Unix Domain sockets.   It is loaded into a string, and passed to
 | 
				
			||||||
the
 | 
					the
 | 
				
			||||||
<A HREF="../../backend/parser">parser,</A> where the lexical scanner,
 | 
					<A HREF="../../backend/parser">parser,</A> where the lexical scanner,
 | 
				
			||||||
<A HREF="../../backend/parser/scan.l">scan.l,</A>
 | 
					<A HREF="../../backend/parser/scan.l">scan.l,</A>
 | 
				
			||||||
breaks the query up into tokens(words).  The parser
 | 
					breaks the query up into tokens(words).  The parser
 | 
				
			||||||
uses
 | 
					uses
 | 
				
			||||||
<A HREF="../../backend/parser/gram.y">gram.y</A> and the tokens to
 | 
					<A HREF="../../backend/parser/gram.y">gram.y</A> and the tokens to
 | 
				
			||||||
identify the query type, and load the proper query-type-specific
 | 
					identify the query type, and load the proper query-specific
 | 
				
			||||||
structure, like
 | 
					structure, like
 | 
				
			||||||
<A HREF="../../include/nodes/parsenodes.h">CreateStmt or SelectStmt.</A>
 | 
					<A HREF="../../include/nodes/parsenodes.h">CreateStmt or SelectStmt.</A>
 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
The query is then identified as a <I>Utility</I> function or a more
 | 
					The query is then identified as a <I>Utility</I> function or a more
 | 
				
			||||||
complex query.  <I>Utility</I> queries are processed by a
 | 
					complex query.  A <I>Utility</I> query is processed by a
 | 
				
			||||||
query-type-specific function in <A HREF="../../backend/commands">
 | 
					query-specific function in <A HREF="../../backend/commands">
 | 
				
			||||||
commands.</A> Complex queries, like <I>SELECT, UPDATE,</I> and
 | 
					commands.</A> A complex query, like <B>SELECT, UPDATE,</B> and
 | 
				
			||||||
<I>DELETE</I> require much more handling.  
 | 
					<B>DELETE</B> requires much more handling.
 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
The parser takes the complex queries, and creates a
 | 
					The parser takes a complex query, and creates a
 | 
				
			||||||
<A HREF="../../include/nodes/parsenodes.h">Query</A> structure that
 | 
					<A HREF="../../include/nodes/parsenodes.h">Query</A> structure that
 | 
				
			||||||
contains all the elements used by complex queries.  Query.qual holds the
 | 
					contains all the elements used by complex queries.  Query.qual holds the
 | 
				
			||||||
WHERE clause qualification, which is filled in by
 | 
					<B>WHERE</B> clause qualification, which is filled in by
 | 
				
			||||||
<A HREF="../../backend/parser/parse_clause.c">transformWhereClause().</A>
 | 
					<A HREF="../../backend/parser/parse_clause.c">transformWhereClause().</A>
 | 
				
			||||||
Each table referenced in the query is represented by a <A
 | 
					Each table referenced in the query is represented by a <A
 | 
				
			||||||
HREF="../../include/nodes/parsenodes.h"> RangeTableEntry,</A> and they
 | 
					HREF="../../include/nodes/parsenodes.h"> RangeTableEntry,</A> and they
 | 
				
			||||||
@@ -39,33 +39,32 @@ are linked together to form the <I>range table</I> of the query, which is
 | 
				
			|||||||
generated by <A HREF="../../backend/parser/parse_clause.c">
 | 
					generated by <A HREF="../../backend/parser/parse_clause.c">
 | 
				
			||||||
makeRangeTable().</A>  Query.rtable holds the queries range table.
 | 
					makeRangeTable().</A>  Query.rtable holds the queries range table.
 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
Certain queries, like SELECT, return columns of data.  Other queries,
 | 
					Certain queries, like <B>SELECT,</B> return columns of data.  Other
 | 
				
			||||||
like INSERT and UPDATE, specify the columns modified by the query. 
 | 
					queries, like <B>INSERT</B> and <B>UPDATE,</B> specify the columns
 | 
				
			||||||
These column references are converted to <A
 | 
					modified by the query.  These column references are converted to <A
 | 
				
			||||||
HREF="../../include/nodes/primnodes.h"> Resdom</A> entries, which are
 | 
					HREF="../../include/nodes/primnodes.h">Resdom</A> entries, which are
 | 
				
			||||||
linked together to make up the <I>target list</I> of the query. The
 | 
					linked together to make up the <I>target list</I> of the query. The
 | 
				
			||||||
target list is stored in Query.targetList, which is generated by
 | 
					target list is stored in Query.targetList, which is generated by
 | 
				
			||||||
<A HREF="../../backend/parser/parse_target.c">transformTargetList().</A>
 | 
					<A HREF="../../backend/parser/parse_target.c">transformTargetList().</A>
 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
Other query elements, like aggregates(SUM()), GROUP BY, ORDER BY are
 | 
					Other query elements, like aggregates(<B>SUM()</B>), <B>GROUP BY,</B>
 | 
				
			||||||
also stored in their own Query fields.
 | 
					<B>ORDER BY</B> are also stored in their own Query fields.
 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
The next step is for the Query to be modified by any VIEWS or RULES that
 | 
					The next step is for the Query to be modified by any <B>VIEWS</B> or
 | 
				
			||||||
may apply to the query.  This is performed by the <A
 | 
					<B>RULES</B> that may apply to the query.  This is performed by the <A
 | 
				
			||||||
HREF="../../backend/rewrite">rewrite</A> system.
 | 
					HREF="../../backend/rewrite">rewrite</A> system.
 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
The <A HREF="../../backend/optimizer">optimizer</A> takes the Query
 | 
					The <A HREF="../../backend/optimizer">optimizer</A> takes the Query
 | 
				
			||||||
structure, and generates an optimal
 | 
					structure and generates an optimal <A
 | 
				
			||||||
<A HREF="../..//include/nodes/plannodes.h">Plan</A> containing the
 | 
					HREF="../..//include/nodes/plannodes.h">Plan,</A> which contains the
 | 
				
			||||||
primitive operations to be performed by the executor to execute the
 | 
					operations to be performed to execute the query.  The <A
 | 
				
			||||||
query.  The <A HREF="../../backend/optimizer/path">path</A> module
 | 
					HREF="../../backend/optimizer/path">path</A> module determines the best
 | 
				
			||||||
determines the best table join order and join type of each table in the
 | 
					table join order and join type of each table in the RangeTable, using
 | 
				
			||||||
RangeTable, using Query.qual(WHERE clause) to consider optimal index
 | 
					Query.qual(<B>WHERE</B> clause) to consider optimal index usage.
 | 
				
			||||||
usage.
 | 
					 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
The Plan is then passed to the <A
 | 
					The Plan is then passed to the <A
 | 
				
			||||||
HREF="../../backend/executor">executor</A> for execution, and the result
 | 
					HREF="../../backend/executor">executor</A> for execution, and the result
 | 
				
			||||||
is returned to the client.
 | 
					returned to the client.
 | 
				
			||||||
<P>
 | 
					<P>
 | 
				
			||||||
There are many other modules that support this basic functionality.
 | 
					There are many other modules that support this basic functionality.
 | 
				
			||||||
They can be accessed by clicking on the flowchart.
 | 
					They can be accessed by clicking on the flowchart.
 | 
				
			||||||
@@ -73,39 +72,37 @@ They can be accessed by clicking on the flowchart.
 | 
				
			|||||||
Another area of interest is the shared memory area, containing
 | 
					Another area of interest is the shared memory area, containing
 | 
				
			||||||
table data/index blocks, locks, and backend information:
 | 
					table data/index blocks, locks, and backend information:
 | 
				
			||||||
<UL> 
 | 
					<UL> 
 | 
				
			||||||
<LI>ShmemIndex - contains an index of all other shared memory
 | 
					<LI>ShmemIndex - lookup of shared memory addresses using structure names
 | 
				
			||||||
structures, allowing quick lookup of other structure locations in shared
 | 
					 | 
				
			||||||
memory
 | 
					 | 
				
			||||||
<LI><A HREF="../../include/storage/buf_internals.h">Buffer
 | 
					<LI><A HREF="../../include/storage/buf_internals.h">Buffer
 | 
				
			||||||
Descriptors</A> - control header for shared memory buffer block
 | 
					Descriptors</A> - control header for buffer cache block
 | 
				
			||||||
 | 
					<LI><A HREF="../../include/storage/buf_internals.h">Buffer Blocks</A> -
 | 
				
			||||||
<LI><A HREF="../../include/storage/buf_internals.h">Buffer Blocks</A>
 | 
					data/index buffer cache block
 | 
				
			||||||
- block of table/index data shared by all backends
 | 
					<LI>Shared Buf Lookup Table - lookup of buffer cache block address using
 | 
				
			||||||
<LI>Shared Buf Lookup Table - lookup to see if a requested buffer
 | 
					table name and block number(<A HREF="../../include/storage/buf_internals.h">
 | 
				
			||||||
is already in the shared memory area
 | 
					BufferTag</A>)
 | 
				
			||||||
<LI><A HREF="../../include/storage/lock.h">LockTable</A>
 | 
					<LI><A HREF="../../include/storage/lock.h">LockTable (ctl)</A> - lock table
 | 
				
			||||||
- lock table structure, specifiying table, lock types, and
 | 
					structure, specifiying table, lock types, and backends holding or
 | 
				
			||||||
backends holding or waiting on lock
 | 
					waiting on lock
 | 
				
			||||||
<LI>LockTable (lock hash) - lookup of LockTable structures using
 | 
					<LI>LockTable (lock hash) - lookup of LockTable structures using relation
 | 
				
			||||||
table name
 | 
					and database object ids
 | 
				
			||||||
<LI>LockTable (xid hash) - lookup of LockTable structures using
 | 
					<LI>LockTable (xid hash) - lookup of LockTable structures using
 | 
				
			||||||
transaction id
 | 
					transaction id
 | 
				
			||||||
<LI><A HREF="../../include/storage/proc.h">Proc Header</A> - information
 | 
					<LI><A HREF="../../include/storage/proc.h">Proc Header</A> - information
 | 
				
			||||||
about each backend, including locks held/waiting,  indexed by process id
 | 
					about each backend, including locks held/waiting,  indexed by process id
 | 
				
			||||||
</UL>
 | 
					</UL>
 | 
				
			||||||
Each data structure is created by calling <A
 | 
					Each data structure is created by calling <A
 | 
				
			||||||
HREF="../../backend/storage/ipc/shmem.c"> ShmemInitStruct(),</A> and
 | 
					HREF="../../backend/storage/ipc/shmem.c">ShmemInitStruct(),</A> and
 | 
				
			||||||
the lookup hashes are created by
 | 
					the lookups are created by
 | 
				
			||||||
<A HREF="../../backend/storage/ipc/shmem.c">ShmemInitHash().</A>
 | 
					<A HREF="../../backend/storage/ipc/shmem.c">ShmemInitHash().</A>
 | 
				
			||||||
<HR>
 | 
					<HR>
 | 
				
			||||||
<CENTER>
 | 
					<CENTER>
 | 
				
			||||||
<EM><BIG>
 | 
					<EM><BIG>
 | 
				
			||||||
Click on an item to see more detail or click
 | 
					Click on an item to see more detail or
 | 
				
			||||||
<A HREF="backend_dirs.html">here</a> to see the full index.
 | 
					<A HREF="backend_dirs.html">click</A> to see the full index.
 | 
				
			||||||
</EM></BIG>
 | 
					</BIG></EM>
 | 
				
			||||||
<BR>
 | 
					<BR>
 | 
				
			||||||
<BR>
 | 
					<BR>
 | 
				
			||||||
<IMG src="flow.jpg" usemap="#flowmap">
 | 
					<IMG src="flow.jpg" usemap="#flowmap" alt="flowchart">
 | 
				
			||||||
</CENTER>
 | 
					</CENTER>
 | 
				
			||||||
<MAP name="flowmap">
 | 
					<MAP name="flowmap">
 | 
				
			||||||
<AREA COORDS="290,10,450,50" HREF="backend_dirs.html#main">
 | 
					<AREA COORDS="290,10,450,50" HREF="backend_dirs.html#main">
 | 
				
			||||||
 
 | 
				
			|||||||
		Reference in New Issue
	
	Block a user