You've already forked pgbackrest
mirror of
https://github.com/pgbackrest/pgbackrest.git
synced 2026-10-23 21:28:56 +03:00
59bd2cd96c
The build tool in src/build becomes build/build.py with its library in build/lib, and the C part of the documentation tool in doc/src becomes doc/doc.py with its library in doc/lib. They migrate together because doc/src was built on src/build, linking its config and help parsing along with its extensions to the core types. doc.pl runs doc.py rather than building and running a C binary, and meson runs build.py for the code it generates as it builds. The three libraries form the hierarchy the C include path did: build/lib is the base, doc/lib sits on it, and test/lib sits on both. They are implicit namespace packages so a package spans them, and a module lives in exactly one library and holds the union of what the tools need from it, since Python resolves a module name to a single file and cannot extend one the way the C included a core module and added to it. define.yaml declares which libraries each tool may import and the test runner puts only those on the path, so a test of the build library cannot reach the doc or test library any more than the build tool can. The declarations move with the code. config.yaml, error.yaml, and postgres.yaml are now at the root of build, and help.xml becomes doc/xml/reference.xml since it is documentation that the help happens to be generated from, so the generator is told where it is rather than knowing. dist.sh moves to build as well. The documentation tool's own option declarations are gone because they existed only to generate the option parser for the C binary and doc.py parses its command line directly. Three modules in src/build/common were never build tool code. exec, regExp, and string extend the core types for the test harness and the unit tests, which were their only users, so they move to test/src/harness. The json and xml extensions had no users outside the two tools and are removed with them, and the tests for both are trimmed to the core functions that remain. The help unit test built its fixture by calling the generator's C functions directly, which was the last thing outside the tools that depended on them. It now runs build.py help-data to write the packed help and loads that, so it still runs against the current declarations without needing the generated C, which may not have been written when the test runs. The manual page wrapping is a port of the wrapper the binary uses for its own help, so the manual page and pgbackrest help break lines the same way, including where a word longer than a line is left unbroken. libyaml is no longer needed to build pgBackRest since the only thing that read yaml was the C generator. It is dropped from the development container and from every CI platform, and meson no longer looks for it. Code generation needs nothing compiled first either, so a test run no longer builds a generator before it can select the tests. The common source list is merged into the pgbackrest source list since it existed only so the generator could be built from the same files, and the entries that were out of alphabetical order are put in order while the list is being rewritten anyway. Every file the generator writes is byte identical to what the C wrote, for the project declarations and for the documentation's own. The documentation is checked the same way: the HTML rendered on this branch is byte identical to the HTML rendered on integration, every file of it, which exercises the whole pipeline on the real content rather than only the four files the tool writes. Every module in both libraries is declared in define.yaml and has full line and branch coverage. The coverage list is keyed by file rather than by module name, since the same name in two languages is two files and one of them would have silently lost its requirement while both existed. TestError becomes ToolError, since it is the error type for three tools now rather than for the harness alone.
1312 lines
44 KiB
YAML
1312 lines
44 KiB
YAML
# **********************************************************************************************************************************
|
|
# Test Definition
|
|
#
|
|
# Contains definitions for all unit and integration tests.
|
|
#
|
|
# The definitions consist of modules and tests. Modules group together tests that are related and allow common settings for all the
|
|
# tests. Every module and test must have a name. Tests must also have a total. If this total does not match the actual number of
|
|
# runs in a test then an error will be thrown.
|
|
#
|
|
# Most options can be set for modules and tests (test option will override module option if both are set):
|
|
# * db - determines if the test will be run against multiple db versions
|
|
# * define - defines for C code (will also be applied to the test harness)
|
|
# * binReq - is the pgbackrest binary required for this test?
|
|
# * containerReq - is this test required to run in a container?
|
|
#
|
|
# Some options are unique to tests:
|
|
# * coverage - a list of code modules that the test provides coverage for. A code module may be covered by multiple tests. That
|
|
# means you must run all the tests by providing the --run option multiple times to get full coverage on the code module. If
|
|
# a code module contains only data it should be marked noCode (e.g. - help/help.auto: noCode). If a code module is included
|
|
# in another code module it should be marked as included (e.g. - md5.vendor: included).
|
|
# * feature - Defines a feature that is now available in the harness. For example, the "error" feature defines HRN_FEATURE_ERROR
|
|
# used to automatically check for errors in later tests. The common/error test is not able to access this error handling
|
|
# because it is used to implement the error handling, so it must do error testing in a more primitive way.
|
|
# * harness - Adds a harness module that contains functions to aid in testing. For example, the "log" harness includes the
|
|
# harness/log module to aid in expect log testing.
|
|
# * shim - list of modules that are shimmed in the harness, included in the order listed. This allows the harness to access
|
|
# static elements of the module to provide additional services for unit testing. An entry is either a bare module name or a
|
|
# map with a name and a 'function' list. In the latter case the listed functions in the C module will be appended with
|
|
# _SHIMMED and an implementation with the same function signature must be provided in the harness. Generally speaking this
|
|
# function will default to calling the original function, but after some initialization the shim may implement other logic
|
|
# that is useful for unit testing.
|
|
# * depend - Source modules that this test depends on that have not already been included in prior tests via coverage. Ideally
|
|
# this option would never be used because it is essentially documenting cross-dependencies in the code.
|
|
# * total - total runs in the test
|
|
# * vm - VMs that the test will be run on
|
|
# * include - modules to include directly into test.c (all files in coverage are automatically included)
|
|
# This is useful when a module's internal data needs to be manipulated for testing but no coverage is added by the test.
|
|
# **********************************************************************************************************************************
|
|
|
|
# **********************************************************************************************************************************
|
|
# Unit tests
|
|
# **********************************************************************************************************************************
|
|
unit:
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: common
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: error
|
|
total: 9
|
|
feature: error
|
|
harness:
|
|
name: error
|
|
shim:
|
|
- common/error/error
|
|
|
|
coverage:
|
|
- common/error/error
|
|
- common/error/error.auto: noCode
|
|
|
|
depend:
|
|
- common/stackTrace
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: stack-trace
|
|
total: 4
|
|
feature: stackTrace
|
|
harness:
|
|
name: stackTrace
|
|
shim:
|
|
- name: common/stackTrace
|
|
function:
|
|
- stackTraceBackCallback
|
|
|
|
coverage:
|
|
- common/stackTrace
|
|
|
|
depend:
|
|
- common/debug
|
|
- common/type/stringStatic
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: assert-off
|
|
total: 1
|
|
define: -DNDEBUG
|
|
|
|
coverage:
|
|
- common/assert: noCode
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: debug-off
|
|
total: 1
|
|
define: -DNDEBUG
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: assert-on
|
|
feature: assert
|
|
total: 1
|
|
|
|
coverage:
|
|
- common/assert: noCode
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-convert
|
|
total: 13
|
|
|
|
coverage:
|
|
- common/type/convert
|
|
|
|
depend:
|
|
- common/time
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: time
|
|
total: 3
|
|
harness:
|
|
name: time
|
|
shim:
|
|
- name: common/time
|
|
function:
|
|
- timeMSec
|
|
|
|
coverage:
|
|
- common/time
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: mem-context
|
|
total: 8
|
|
feature: memContext
|
|
|
|
coverage:
|
|
- common/memContext
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: encode
|
|
total: 3
|
|
|
|
coverage:
|
|
- common/encode
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-object
|
|
total: 1
|
|
|
|
coverage:
|
|
- common/type/object
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-blob
|
|
total: 1
|
|
|
|
coverage:
|
|
- common/type/blob
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-string
|
|
total: 26
|
|
feature: string
|
|
|
|
coverage:
|
|
- test/harness/string
|
|
- common/type/string: included
|
|
- common/type/stringZ
|
|
- common/type/stringId
|
|
- common/type/stringList
|
|
|
|
depend:
|
|
- common/type/buffer
|
|
- common/type/keyValue
|
|
- common/type/list
|
|
- common/type/variant
|
|
- common/type/variantList
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: error-retry
|
|
total: 1
|
|
harness:
|
|
name: errorRetry
|
|
shim:
|
|
- name: common/error/retry
|
|
function:
|
|
- errRetryMessage
|
|
|
|
coverage:
|
|
- common/error/retry
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-list
|
|
total: 4
|
|
|
|
coverage:
|
|
- common/type/list
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-buffer
|
|
total: 5
|
|
|
|
coverage:
|
|
- common/type/buffer
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-variant
|
|
total: 12
|
|
|
|
coverage:
|
|
- common/type/variant
|
|
- common/type/variantList
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: reg-exp
|
|
total: 3
|
|
|
|
coverage:
|
|
- test/harness/regExp
|
|
- common/regExp: included
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: log
|
|
total: 6
|
|
feature: log
|
|
harness:
|
|
name: log
|
|
shim:
|
|
- common/log
|
|
|
|
coverage:
|
|
- common/log
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: debug-on
|
|
total: 4
|
|
feature: debug
|
|
|
|
coverage:
|
|
- common/debug
|
|
- common/type/stringStatic
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: fork
|
|
total: 1
|
|
|
|
coverage:
|
|
- common/fork
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: wait
|
|
total: 1
|
|
|
|
coverage:
|
|
- common/wait
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-json
|
|
total: 2
|
|
|
|
coverage:
|
|
- common/type/json
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-key-value
|
|
total: 2
|
|
|
|
coverage:
|
|
- common/type/keyValue
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-xml
|
|
total: 1
|
|
|
|
coverage:
|
|
- common/type/xml
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: stat
|
|
total: 1
|
|
feature: STAT
|
|
|
|
coverage:
|
|
- common/stat
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: user
|
|
total: 1
|
|
|
|
coverage:
|
|
- common/user
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: io
|
|
total: 6
|
|
feature: IO
|
|
harness:
|
|
- pack
|
|
- name: fd
|
|
shim:
|
|
- name: common/io/fd
|
|
function:
|
|
- fdReady
|
|
- name: common/io/fdWrite
|
|
function:
|
|
- ioFdWriteInternal
|
|
|
|
coverage:
|
|
- common/io/bufferRead
|
|
- common/io/bufferWrite
|
|
- common/io/fd
|
|
- common/io/fdRead
|
|
- common/io/fdWrite
|
|
- common/io/filter/buffer
|
|
- common/io/filter/filter
|
|
- common/io/filter/group
|
|
- common/io/filter/sink
|
|
- common/io/filter/size
|
|
- common/io/io
|
|
- common/io/limitRead
|
|
- common/io/read
|
|
- common/io/write
|
|
|
|
depend:
|
|
- common/type/pack
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type-pack
|
|
total: 1
|
|
|
|
coverage:
|
|
- common/type/pack
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: compress
|
|
total: 5
|
|
|
|
coverage:
|
|
- common/compress/bz2/common
|
|
- common/compress/bz2/compress
|
|
- common/compress/bz2/decompress
|
|
- common/compress/gz/common
|
|
- common/compress/gz/compress
|
|
- common/compress/gz/decompress
|
|
- common/compress/lz4/common
|
|
- common/compress/lz4/compress
|
|
- common/compress/lz4/decompress
|
|
- common/compress/zst/common
|
|
- common/compress/zst/compress
|
|
- common/compress/zst/decompress
|
|
- common/compress/common
|
|
- common/compress/helper
|
|
|
|
depend:
|
|
- storage/posix/read
|
|
- storage/posix/storage
|
|
- storage/posix/write
|
|
- storage/iterator
|
|
- storage/list
|
|
- storage/read
|
|
- storage/readMulti
|
|
- storage/storage
|
|
- storage/write
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: crypto
|
|
total: 4
|
|
feature: STORAGE
|
|
harness:
|
|
name: storage
|
|
shim:
|
|
- storage/posix/storage
|
|
|
|
coverage:
|
|
- common/crypto/cipherBlock
|
|
- common/crypto/common
|
|
- common/crypto/hash
|
|
- common/crypto/md5.vendor: included
|
|
- common/crypto/xxhash
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: io-tls
|
|
total: 6
|
|
feature: SOCKET
|
|
harness:
|
|
- server
|
|
- name: socket
|
|
shim:
|
|
- name: common/io/socket/client
|
|
function:
|
|
- sckClientOpen
|
|
- sckClientOpenWait
|
|
|
|
coverage:
|
|
- common/io/client
|
|
- common/io/server
|
|
- common/io/session
|
|
- common/io/tls/client
|
|
- common/io/tls/common
|
|
- common/io/tls/server
|
|
- common/io/tls/session
|
|
- common/io/socket/address
|
|
- common/io/socket/client
|
|
- common/io/socket/common
|
|
- common/io/socket/server
|
|
- common/io/socket/session
|
|
|
|
include:
|
|
- common/io/fdRead
|
|
- common/io/read
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: io-http
|
|
total: 7
|
|
|
|
coverage:
|
|
- common/io/http/client
|
|
- common/io/http/common
|
|
- common/io/http/header
|
|
- common/io/http/query
|
|
- common/io/http/request
|
|
- common/io/http/response
|
|
- common/io/http/session
|
|
- common/io/http/url
|
|
|
|
include:
|
|
- common/io/socket/address
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: exec
|
|
total: 2
|
|
|
|
coverage:
|
|
- test/harness/exec
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: ini
|
|
total: 2
|
|
|
|
coverage:
|
|
- common/ini
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: lock
|
|
total: 1
|
|
harness:
|
|
- name: config
|
|
shim:
|
|
- config/load
|
|
- name: lock
|
|
shim:
|
|
- name: common/lock
|
|
function:
|
|
- lockInit
|
|
- name: storageHelper
|
|
shim:
|
|
- name: storage/helper
|
|
function:
|
|
- storageRepoGet
|
|
|
|
coverage:
|
|
- common/lock
|
|
|
|
depend:
|
|
- command/lock
|
|
- config/common
|
|
- config/config
|
|
- config/parse
|
|
- config/exec
|
|
- config/load
|
|
- config/protocol
|
|
- command/command
|
|
- postgres/interface
|
|
- postgres/interface/crc32
|
|
- postgres/interface/page
|
|
- protocol/client
|
|
- protocol/helper
|
|
- protocol/server
|
|
- storage/helper
|
|
- storage/remote/read
|
|
- storage/remote/readMulti
|
|
- storage/remote/protocol
|
|
- storage/remote/storage
|
|
- storage/remote/write
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: protocol
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: protocol
|
|
total: 8
|
|
harness:
|
|
name: protocol
|
|
shim:
|
|
- name: protocol/helper
|
|
function:
|
|
- protocolLocalExec
|
|
- protocolRemoteExec
|
|
containerReq: true
|
|
binReq: true
|
|
|
|
coverage:
|
|
- protocol/client
|
|
- protocol/helper
|
|
- protocol/parallel
|
|
- protocol/parallelJob
|
|
- protocol/server
|
|
|
|
include:
|
|
- test/harness/exec
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: config
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: parse
|
|
total: 6
|
|
|
|
coverage:
|
|
- config/common
|
|
- config/config
|
|
- config/parse
|
|
- config/parse.auto: noCode
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: load
|
|
total: 4
|
|
|
|
coverage:
|
|
- config/load
|
|
|
|
include:
|
|
- common/io/socket/common
|
|
- common/io/tls/common
|
|
- common/user
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: exec
|
|
total: 1
|
|
|
|
coverage:
|
|
- config/exec
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: protocol
|
|
total: 1
|
|
|
|
coverage:
|
|
- config/protocol
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: storage
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: posix
|
|
total: 24
|
|
|
|
coverage:
|
|
- storage/cifs/helper
|
|
- storage/cifs/storage
|
|
- storage/posix/read
|
|
- storage/posix/storage
|
|
- storage/posix/write
|
|
- storage/helper
|
|
- storage/iterator
|
|
- storage/list
|
|
- storage/read
|
|
- storage/storage
|
|
- storage/write
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: remote
|
|
total: 12
|
|
|
|
coverage:
|
|
- storage/remote/read
|
|
- storage/remote/readMulti
|
|
- storage/remote/protocol
|
|
- storage/remote/storage
|
|
- storage/remote/write
|
|
- storage/helper
|
|
- storage/readMulti
|
|
- storage/storage
|
|
|
|
include:
|
|
- protocol/client
|
|
- storage/read
|
|
- storage/write
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: azure
|
|
total: 4
|
|
|
|
coverage:
|
|
- storage/azure/helper
|
|
- storage/azure/read
|
|
- storage/azure/storage
|
|
- storage/azure/write
|
|
|
|
include:
|
|
- storage/helper
|
|
- storage/readMulti
|
|
- storage/storage
|
|
- storage/write
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: gcs
|
|
total: 4
|
|
|
|
coverage:
|
|
- storage/gcs/helper
|
|
- storage/gcs/read
|
|
- storage/gcs/storage
|
|
- storage/gcs/write
|
|
|
|
include:
|
|
- storage/helper
|
|
- storage/readMulti
|
|
- storage/storage
|
|
- storage/write
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: s3
|
|
total: 3
|
|
|
|
coverage:
|
|
- storage/s3/helper
|
|
- storage/s3/read
|
|
- storage/s3/storage
|
|
- storage/s3/write
|
|
- storage/read
|
|
- storage/readMulti
|
|
- storage/write
|
|
- storage/helper
|
|
|
|
include:
|
|
- storage/storage
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: sftp
|
|
total: 14
|
|
harness:
|
|
name: libSsh2
|
|
integration: false
|
|
|
|
coverage:
|
|
- storage/sftp/helper
|
|
- storage/sftp/read
|
|
- storage/sftp/storage
|
|
- storage/sftp/write
|
|
|
|
include:
|
|
- storage/helper
|
|
- storage/read
|
|
- storage/storage
|
|
- storage/write
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: postgres
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: client
|
|
total: 1
|
|
harness:
|
|
name: pq
|
|
integration: false
|
|
|
|
coverage:
|
|
- postgres/client
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: interface
|
|
total: 10
|
|
harness: postgres
|
|
|
|
coverage:
|
|
- postgres/interface
|
|
- postgres/interface/crc32
|
|
- postgres/interface/page
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: build
|
|
lang: python
|
|
vm: [none, u24, rh9]
|
|
|
|
# The build library, which every tool is built on. These are python so they are run directly rather than built, which means no
|
|
# total is needed since there are no runs to select. They are declared before the doc and test libraries so that those inherit
|
|
# them, which is the same direction the import hierarchy runs in.
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/error
|
|
|
|
coverage:
|
|
- build/common/error
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/log
|
|
|
|
coverage:
|
|
- build/common/log
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/storage
|
|
|
|
coverage:
|
|
- build/common/storage
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/string
|
|
|
|
coverage:
|
|
- build/common/string_id
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/render
|
|
|
|
coverage:
|
|
- build/common/render
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/yaml
|
|
|
|
coverage:
|
|
- build/common/yaml
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/pack
|
|
|
|
coverage:
|
|
- build/common/pack
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/xml
|
|
|
|
coverage:
|
|
- build/common/xml
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: config/common
|
|
|
|
coverage:
|
|
- build/config/common
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: config/parse
|
|
|
|
coverage:
|
|
- build/config/parse
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: config/render
|
|
|
|
coverage:
|
|
- build/config/render
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: error/parse
|
|
|
|
coverage:
|
|
- build/error/parse
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: error/render
|
|
|
|
coverage:
|
|
- build/error/render
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: postgres/parse
|
|
|
|
coverage:
|
|
- build/postgres/parse
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: postgres/render
|
|
|
|
coverage:
|
|
- build/postgres/render
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: help/parse
|
|
|
|
coverage:
|
|
- build/help/parse
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: help/render
|
|
|
|
coverage:
|
|
- build/help/render
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/main
|
|
|
|
coverage:
|
|
- build/command/main
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: info
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: info
|
|
total: 3
|
|
harness: info
|
|
|
|
coverage:
|
|
- info/info
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: info-pg
|
|
total: 2
|
|
|
|
coverage:
|
|
- info/infoPg
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: info-archive
|
|
total: 2
|
|
|
|
coverage:
|
|
- info/infoArchive
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: manifest
|
|
total: 6
|
|
harness:
|
|
name: manifest
|
|
shim:
|
|
- info/manifest/manifest
|
|
|
|
coverage:
|
|
- info/manifest/manifest
|
|
|
|
depend:
|
|
- command/backup/common
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: info-backup
|
|
total: 3
|
|
|
|
coverage:
|
|
- info/infoBackup
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: db
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: db
|
|
total: 3
|
|
containerReq: true
|
|
binReq: true
|
|
|
|
coverage:
|
|
- db/db
|
|
- db/helper
|
|
- db/protocol
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: command
|
|
|
|
test:
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: lock
|
|
total: 1
|
|
|
|
coverage:
|
|
- command/lock
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: control
|
|
total: 4
|
|
|
|
coverage:
|
|
- command/control/common
|
|
- command/control/start
|
|
- command/control/stop
|
|
|
|
include:
|
|
- command/lock
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: annotate
|
|
total: 1
|
|
|
|
coverage:
|
|
- command/annotate/annotate
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: archive-common
|
|
total: 9
|
|
|
|
coverage:
|
|
- command/archive/common
|
|
- command/archive/find
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: archive-get
|
|
total: 3
|
|
binReq: true
|
|
|
|
coverage:
|
|
- command/archive/common
|
|
- command/archive/get/file
|
|
- command/archive/get/get
|
|
- command/archive/get/protocol
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: archive-push
|
|
total: 4
|
|
binReq: true
|
|
|
|
coverage:
|
|
- command/archive/common
|
|
- command/archive/push/file
|
|
- command/archive/push/protocol
|
|
- command/archive/push/push
|
|
- command/command
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: stanza
|
|
total: 4
|
|
|
|
coverage:
|
|
- command/stanza/common
|
|
- command/stanza/create
|
|
- command/stanza/upgrade
|
|
- command/stanza/delete
|
|
|
|
depend:
|
|
- command/check/common
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: check
|
|
total: 4
|
|
|
|
coverage:
|
|
- command/check/common
|
|
- command/check/check
|
|
- command/check/report
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command
|
|
total: 1
|
|
|
|
coverage:
|
|
- command/command
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: expire
|
|
total: 9
|
|
|
|
coverage:
|
|
- command/expire/expire
|
|
|
|
include:
|
|
- info/infoBackup
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: help
|
|
total: 4
|
|
|
|
coverage:
|
|
- command/help/help
|
|
- command/help/help.auto: noCode
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: info
|
|
total: 3
|
|
|
|
coverage:
|
|
- command/info/info
|
|
|
|
include:
|
|
- command/lock
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: backup
|
|
total: 12
|
|
harness:
|
|
- name: backup
|
|
integration: false
|
|
shim:
|
|
- name: command/backup/backup
|
|
function:
|
|
- backupProcess:
|
|
inc: process
|
|
- name: blockIncr
|
|
shim:
|
|
- command/restore/blockDelta
|
|
|
|
coverage:
|
|
- command/backup/backup
|
|
- command/backup/blockIncr
|
|
- command/backup/blockMap
|
|
- command/backup/common
|
|
- command/backup/complete.inc: included
|
|
- command/backup/db.inc: included
|
|
- command/backup/file.inc: included
|
|
- command/backup/incr.inc: included
|
|
- command/backup/label.inc: included
|
|
- command/backup/option.inc: included
|
|
- command/backup/pageChecksum
|
|
- command/backup/process.inc: included
|
|
- command/backup/protocol
|
|
- command/restore/blockDelta
|
|
|
|
include:
|
|
- info/info
|
|
- info/manifest/manifest
|
|
- storage/storage
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: restore
|
|
total: 16
|
|
|
|
harness: restore
|
|
|
|
coverage:
|
|
- command/restore/blockChecksum
|
|
- command/restore/blockDelta
|
|
- command/restore/clean.inc: included
|
|
- command/restore/config.inc: included
|
|
- command/restore/file.inc: included
|
|
- command/restore/process.inc: included
|
|
- command/restore/protocol
|
|
- command/restore/remap.inc: included
|
|
- command/restore/restore
|
|
- command/restore/select.inc: included
|
|
- command/restore/timeline
|
|
- command/restore/validate.inc: included
|
|
|
|
include:
|
|
- common/user
|
|
- info/infoBackup
|
|
- info/manifest/manifest
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: manifest
|
|
total: 1
|
|
|
|
include:
|
|
- command/manifest/manifest
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: repo
|
|
total: 3
|
|
|
|
coverage:
|
|
- command/repo/common
|
|
- command/repo/get
|
|
- command/repo/ls
|
|
- command/repo/put
|
|
- command/repo/rm
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: verify
|
|
total: 14
|
|
|
|
coverage:
|
|
- command/verify/file
|
|
- command/verify/protocol
|
|
- command/verify/verify
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: local
|
|
total: 1
|
|
|
|
coverage:
|
|
- command/local/local
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: remote
|
|
total: 1
|
|
|
|
coverage:
|
|
- command/remote/remote
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: exit
|
|
total: 3
|
|
|
|
coverage:
|
|
- command/exit
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: server
|
|
total: 2
|
|
harness: systemd
|
|
|
|
coverage:
|
|
- command/server/ping
|
|
- command/server/server
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: doc
|
|
lang: python
|
|
vm: [none, u24, rh9]
|
|
|
|
test:
|
|
# The doc library, which sits on top of the build library. These are python so they are run directly rather than built, which
|
|
# means no total is needed since there are no runs to select.
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/build/var_store
|
|
|
|
coverage:
|
|
- doc/command/build/var_store
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/build/eval
|
|
|
|
coverage:
|
|
- doc/command/build/eval
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/build/pre
|
|
|
|
coverage:
|
|
- doc/command/build/pre
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/build/reference
|
|
|
|
coverage:
|
|
- doc/command/build/reference
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/build/man
|
|
|
|
coverage:
|
|
- doc/command/build/man
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/build/build
|
|
|
|
coverage:
|
|
- doc/command/build/build
|
|
|
|
# ********************************************************************************************************************************
|
|
# Tests for the test harness itself. These are python so they are run directly rather than built, which means no total is needed
|
|
# since there are no runs to select. The harness is the same everywhere so there is nothing to gain from running these on every vm.
|
|
#
|
|
# This group is last so that nothing it declares can affect the modules compiled into any other test.
|
|
# ********************************************************************************************************************************
|
|
- name: test
|
|
lang: python
|
|
vm: [none, u24, rh9]
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/exec
|
|
|
|
coverage:
|
|
- test/common/exec
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/user
|
|
|
|
coverage:
|
|
- test/common/user
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: common/vm
|
|
|
|
coverage:
|
|
- test/common/vm
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: config/cli
|
|
|
|
coverage:
|
|
- test/config/cli
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: config/config
|
|
|
|
coverage:
|
|
- test/config/config
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/test/define
|
|
|
|
coverage:
|
|
- test/command/test/define
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/lint/lint
|
|
|
|
coverage:
|
|
- test/command/lint/ascii
|
|
- test/command/lint/string_id
|
|
- test/command/lint/lint
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/code/format
|
|
|
|
coverage:
|
|
- test/command/code/format
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/test/python
|
|
|
|
coverage:
|
|
- test/command/test/python
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/test/list
|
|
|
|
coverage:
|
|
- test/command/test/list
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/test/container
|
|
|
|
coverage:
|
|
- test/command/test/container
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/test/job
|
|
|
|
coverage:
|
|
- test/command/test/job
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/test/test
|
|
|
|
coverage:
|
|
- test/command/test/test
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/coverage/report
|
|
|
|
coverage:
|
|
- test/command/coverage/report
|
|
|
|
# The report renders the coverage model, which is defined with the command that builds it
|
|
depend:
|
|
- test/command/coverage/coverage
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/coverage/filter_py
|
|
|
|
coverage:
|
|
- test/command/coverage/filter_py
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/coverage/filter_c
|
|
|
|
coverage:
|
|
- test/command/coverage/filter_c
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/coverage/coverage
|
|
|
|
coverage:
|
|
- test/command/coverage/coverage
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/test/build
|
|
|
|
coverage:
|
|
- test/command/test/build
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: command/test/unit
|
|
|
|
coverage:
|
|
- test/command/test/unit
|
|
|
|
# **********************************************************************************************************************************
|
|
# Integration tests
|
|
#
|
|
# Integration tests are not run in a container. They are expected to create their own containers since most integration runs will
|
|
# create more than one. For this reason each run is executed individually.
|
|
# **********************************************************************************************************************************
|
|
integration:
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: integration
|
|
db: true
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: all
|
|
total: 1
|
|
harness: host
|
|
|
|
# **********************************************************************************************************************************
|
|
# Performance tests
|
|
#
|
|
# Performance tests run in a single container but are more like integration tests than unit tests since they call the pgbackrest
|
|
# executable directly.
|
|
# **********************************************************************************************************************************
|
|
performance:
|
|
|
|
# ********************************************************************************************************************************
|
|
- name: performance
|
|
|
|
test:
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: type
|
|
total: 6
|
|
|
|
# ----------------------------------------------------------------------------------------------------------------------------
|
|
- name: storage
|
|
total: 2
|
|
|
|
include:
|
|
- storage/helper
|