drh
e137e97af6
Improved orderly-shutdown in testrunner. Windows lets running jobs complete.
...
Unix just invokes exit and lets the OS deal with cleaning up the mess.
FossilOrigin-Name: ce822e8dc137128a6c495600205c6659a9cd2ba6ba188d86567ed97c04b7aeea
2026-09-04 14:02:05 +00:00
drh
b5e3cf0655
The testrunner.tcl script is enhanced so that --stop-on-error does not
...
exit immediately, but instead marks all pending tasks as "halt" so
that no new tasks are scheduled, but allows "running" tasks to continue
on to completion, as an immediate halt can cause hung processes on Windows.
Also, in Makefile.msc, the "test" target now includes --stop-on-error.
FossilOrigin-Name: 0fba9b52b41a5fade0d162c947712669653c4619c89a79800017703e978d8a24
2026-09-04 13:37:51 +00:00
stephan
be3dc6699e
Cygwin portability patches sent off-list from from Jan Nijtmans.
...
FossilOrigin-Name: f8306cd54d28ceda631ce9053d94df2bb28cffccce2a7e72d088b4b1f2a0d3ed
2026-09-01 16:26:50 +00:00
drh
9e3e03dfcf
Try to make test/testrunner.tcl work on other BSD variants. This change
...
is untested as I don't have access to any of those BSDs.
[bugs:/info/2026-08-13T17:55:42Z|Bug 2026-08-13T17:55:42Z].
FossilOrigin-Name: c406ce3f1e3b1a8edea2dbb03aff5649d5217019b23c88b0ae73e627a3a983ee
2026-08-13 18:55:01 +00:00
dan
5a9c01b01a
Further fixes for running [make devtest] with Fil-C.
...
FossilOrigin-Name: 1ed5e5bed26e3d38dd09541ce73dc68188574e236ecb60142260a0c40bf8902a
2026-07-28 14:16:52 +00:00
dan
18bee1617f
Fix a 32-bit integer overflow in sqlite3changegroup_change_blob() that could lead to a buffer overwrite.
...
FossilOrigin-Name: 8a289158e2baeee8aa5e601bde46b0482361064ede09e4108f519270efdd5f69
2026-05-26 14:18:50 +00:00
drh
7e20b624db
Fix to testrunner.tcl so that it will run on FreeBSD.
...
[forum:/info/2026-05-25T18:50:36Z|Forum post 2026-05-25T18:50:36Z]
FossilOrigin-Name: 97b66687b3f772e225e1792194a7f54a2ae187c84de1d76227846503631b5c2f
2026-05-25 19:32:52 +00:00
drh
fd9eba554a
Improvements to testrunner.tcl: Make C-program tests responsive to the
...
pattern list. Do not remove build steps until the very end when we are
certain that the build step is not required. The pattern list matches
the exact text of the displayname column of the jobs table.
FossilOrigin-Name: 3f409c0e1be6b71eca92eccf0b9de3ef5923a6a57be49540ebe190fc6a6d06d4
2026-05-20 00:16:20 +00:00
drh
cbbeddbd67
Add the "make" subcommand to testrunner.tcl
...
FossilOrigin-Name: 00d546812810252a4d51ff796931dc2ff5bdd5173ddb8f95fb5efccd897087ff
2026-05-19 15:13:03 +00:00
dan
4e4962f6b3
Have testrunner.tcl return a non-zero exit status if one or more tests have failed.
...
FossilOrigin-Name: 50ddc36d32540b6d98990b5c9a465beb5b68cc31ae3f0ed162f6fe07e7c74e2d
2026-04-23 15:54:00 +00:00
drh
d6c985ad0b
Fix testrunner.tcl so that it does not create directories with names
...
ending in "sqlite3.o" or "sqlite3.lo". Use "sqlite3obj" for those
directory names instead. Otherwise "make clean" gets confused.
FossilOrigin-Name: a4bf9289c9cdb12b22bfb24e7e2b0243384e9edece12ae3fed14afbfe9b93260
2026-04-16 19:50:52 +00:00
drh
1696740fdc
Improved comments explaining the logic, and improved diagnostic messages
...
when testrunner.tcl encounters trouble loading the sqlite3 extension.
FossilOrigin-Name: 8d820b0ccfccff94ed5b7297fa587ac27a74e990f233cfe229da7409ab2e3af8
2026-04-16 19:33:04 +00:00
drh
2cefd5954a
Minor updates to testrunner documentation.
...
FossilOrigin-Name: f8507bd5e221783175be2bb7b907c098e0970b1cbcb01817df7217005eab9ab4
2026-04-16 17:07:23 +00:00
dan
483f0ef13c
Ensure c-tests use the locally built sqlite3.h file, not the system copy.
...
FossilOrigin-Name: 2d81ee65ffbed30fd98bdda96dc79c1929c73f806cea3c9e4c244b618980b202
2026-04-14 18:12:09 +00:00
dan
0523cfda5a
Fixes for running C tests on windows.
...
FossilOrigin-Name: 1fcacdc41ab1bb66a628acdac29412e66decdc2578dd9d084baaffb74679f984
2026-04-11 18:05:49 +00:00
dan
bc68ec78de
Enhance testrunner.tcl to run individual tests written in C from the test/c/ directory.
...
FossilOrigin-Name: 6f140f76f47aadb10d3f35358503d91adb43e0c1802326f6e599effe1b08e7aa
2026-04-11 17:03:27 +00:00
drh
b0d9039c8c
Updates to testrunner.tcl: Shorten the prefix on created subdirectories from
...
"testrunner_bld_" to just "testrun_". Do not append ".exe" to the names of
created subdirectories. Add the "clean" command to recursively remove all
subdirectories and files created by a test run.
FossilOrigin-Name: 450c7edf1247024db4b66f38bf9561c5c6b0c4175c4df8de17019aea6cbde5cf
2026-04-09 16:08:29 +00:00
drh
7ff8b558e8
Enhance testrunner.tcl so that a PATTERN argument that begins with "~" is
...
an "anti-pattern". Only run tests that match one or more patterns if there
are any patterns *and* do not match any anti-pattern.
FossilOrigin-Name: c313d91bb67b56be2db46194c3baa5a72b469595de3b2abe249612838dc175e4
2026-04-03 19:48:01 +00:00
drh
d964b8cfa3
Add the new "retest" command to testrunner.tcl, which reruns any tests that
...
failed or never completed in the previous invocation. New makefile target
"retest" for both unix and Windows that runs testrunner.tcl with "retest".
FossilOrigin-Name: 9b668d56bf0eca3eb826df3edd6705cc809d920494c192a9949cafda791d83f9
2025-12-31 17:21:30 +00:00
drh
634a915132
Enhance testrunner.tcl so that it can always be run from an ordinary tclsh
...
as long as that tclsh can load the sqlite3 package.
FossilOrigin-Name: 1a08b85a862e8c9ac56c11e05f76abc25ad98b510fb13ad0716206ba797e53a8
2025-12-31 14:17:51 +00:00
drh
059b8d9c04
Tweak testrunner.tcl to allow it to use more cores.
...
FossilOrigin-Name: 71b916d4de7a4611f6ada597bfd58b59cab18e3a732de17c92b7346ecff31c04
2025-11-26 00:41:20 +00:00
drh
d1b133cd16
When "testrunner.tcl status -d N" is run but the test database is not yet
...
available, it enters a wait loop until the testing begins.
FossilOrigin-Name: 7abc25ff3b24b11c171e715ae96c8e97651d340b7a8bb8125a73902e1ad881ab
2025-11-25 23:59:31 +00:00
drh
7efded5edc
Improved concurrency for "make devtest" by splitting fuzzdata1.db and
...
fuzzdata2.db into slices for asan and ubsan testing.
FossilOrigin-Name: 2c31176607f02a73cf2626cda2dd0711ae74bdf0b4520d4c84ff299c860e419e
2025-11-10 20:01:39 +00:00
dan
f1c37a357e
Add new column "cwd" to the jobs table in testrunner.db. For recording the directory in which the test ran or is running.
...
FossilOrigin-Name: 334305a469a51ef0d768ba8443d8cab217f45394cc9f720748a489b10703193d
2025-11-03 15:29:51 +00:00
drh
87f53152ed
Fix typo in the previous check-in that prevented the script from running.
...
FossilOrigin-Name: 797664700701effefbf4d87a791febae3bb68544bac23470351a11bcb3a87651
2025-10-06 16:56:12 +00:00
drh
ad7118fa68
Update testrunner.tcl so that the new option is --cases rather than singular
...
--case, and so that it is a glob pattern.
FossilOrigin-Name: 9488b4f00c9278de8c03f4a3cbd4f54e48e71c1eff45de4454f8bd49c080a930
2025-10-06 16:50:37 +00:00
drh
0611aeeed4
New testrunner.tcl option "--case DISPLAYLNAME" only runs the single case
...
(and its build dependencies) that exactly matches DISPLAYNAME.
FossilOrigin-Name: 8ea2e097b731514c284f255f12b08e15f63c7f49641a698e61ee7e47cc9d3c45
2025-10-06 15:53:52 +00:00
drh
566348f68b
Fix testrunner.tcl so that --help output goes to stdout, not stderr.
...
FossilOrigin-Name: 441a759c225d4e710a693339402624e7ba52852c08aa64439ed4568c193ad529
2025-10-06 14:30:22 +00:00
drh
625d0b70fe
Improve the accuracy of the ETC on both devtest and releasetest.
...
FossilOrigin-Name: a3f96cafdc0e1f2eeccc6509f1f9c26d2c48668953550f299cf2805a0a063014
2025-07-10 20:45:00 +00:00
drh
45bff0ea64
Add the estkey column to the jobs table of testrunner.db. The plan is to
...
use this to collect measurements that will help generate improved ETAs for
a test run.
FossilOrigin-Name: 9eccf5267c6423c9dd4da1d61b62bbb6fbba44fb8089da79f89c84e8b77ff0f0
2025-07-10 17:19:08 +00:00
drh
2ba946b341
Add the "--fuzzdb FILENAME" to testrunner.tcl as an alternative to setting
...
the FUZZDB environment variable (as that can be awkward to do on Windows).
Further improvements to the testrunner.tcl documentation.
FossilOrigin-Name: 6fb84156a262ff89d1a2d1df6fbfac4c1a43fb55b9d15205508662e2c9b0894f
2025-04-29 14:23:21 +00:00
drh
873fc5dff2
Update testrunner.tcl documentation. Fix typo in testrunner.tcl output.
...
FossilOrigin-Name: ba8800b4ba0a690c89d9fb96bb9a0d8789d04160ff9c47ea9afb2b403bec7f0b
2025-04-29 11:35:51 +00:00
drh
c171d7624e
Improved --explain display of FUZZDB test plans in testrunner.tcl.
...
FossilOrigin-Name: 42bdd7262ec4f8163263e0535c2cc35b526754d77e1f3ccf5b73b0f44d470d9c
2025-04-29 10:41:16 +00:00
drh
ece7709f18
Do not run FUZZDB on either Windows-Memdebug or Windows-Win32Heap.
...
FossilOrigin-Name: 10d8401d59136dda7051af0da398b06a18031560f2734f4fa347d339765d2089
2025-04-29 10:29:35 +00:00
drh
8a68ab963e
Make testrunner.tcl more restrictive about which configurations run
...
fuzzcheck-asan and fuzzcheck-ubsan.
FossilOrigin-Name: 785599394dde0fb36ae2e07d611f9523a05a0817dbd8c416582b3b682dbfa4ff
2025-04-29 01:37:31 +00:00
drh
246dc92354
Testrunner.tcl now runs fuzzcheck-asan and fuzzcheck-ubsan tests.
...
FossilOrigin-Name: 3d8f3a255843c063157265702b76d40c38c774d29d658eea2d77efac92ac8789
2025-04-28 19:15:46 +00:00
drh
d4cc3a42e2
If the FUZZDB environment variable is set when running testrunner.tcl and
...
that env-var points to a fuzzcheck database, then suppliment the fuzzcheck
tests with that extra database.
FossilOrigin-Name: c08530dd6a71cb547d164e2313657c917f280e7988211bf199c8776e78a4e2a6
2025-04-28 17:56:23 +00:00
drh
1365bcffbf
Enhance testrunner.tcl so that it does not build testfixture unnecessarily -
...
if the pattern does not match any TCL test.
FossilOrigin-Name: 896d767f1cba64bda7b91b0daebd60ebe4457a58d762da443bf61cf5b39ad2d9
2025-04-28 16:28:00 +00:00
drh
7fec7c96c4
Fix testrunner.tcl so that it honors pattern matches in non-testfixture
...
tests, such as fuzzcheck and sessionfuzz.
FossilOrigin-Name: 81857474fe90f50b760c22d61a6ad477642dabe1052390cd1614dcec8adb1376
2025-04-28 16:17:17 +00:00
drh
738443c523
Remove a stray blank line from the test/testrunner.tcl script.
...
FossilOrigin-Name: 7d6005b0d17d86d72757f3578872e82fd12f61ac9160a0277e397df09f6338a9
2025-04-28 15:00:28 +00:00
jan.nijtmans
1588d3de37
More ==/!= => eq/ne fixes
...
FossilOrigin-Name: 2aa6c4fa6c9c47c7a8548ac3493bfb9ed4e4dec1b6dc4f3599a0373086b3e917
2025-03-27 14:37:07 +00:00
stephan
52e2a79304
Test script patches from Jan Nijtmans: always use -DUSE_TCL_STUBS in buildtclext.tcl and improvements in how TRG is populated in testrunner.tcl.
...
FossilOrigin-Name: aa192203aa1aa188866fe00a5d40dc7b7c72b4f38b06da8708ed0a6c8b8638a6
2025-03-19 13:49:34 +00:00
stephan
1fc7844d40
Teach testrunner.tcl to distinguish Cygwin from Windows. This gets it running but then all downstream tests fail, at least in part because of the build target name discrepancies between the platform which requires .exe and those which do not.
...
FossilOrigin-Name: 2861788e479aea12354f2d34d8e6a2706d193642674ef1f4f852f24c877e0140
2025-03-11 11:24:52 +00:00
stephan
e1e822ca23
Teach testrunner how to run local binaries which have a .exe extension. Also teach it to recognized mingw environments (but actually building the test programs there currently doesn't work).
...
FossilOrigin-Name: e2bd23f251359e7a818c4cfacf114aa9fd8c0a9a1cb802654e96fad67b505508
2025-02-26 19:22:52 +00:00
stephan
94c42564f3
Test testrunner.tcl to identify an msys environment.
...
FossilOrigin-Name: e9f777ceda9fca51c37caca0afeadfc3f99b86e945496f52c71adcc520dcee98
2025-02-26 18:31:42 +00:00
drh
9c8235b1bd
Fix minor problems in testrunner.tcl that pop up when the command-line arguments
...
are such that no tests are run.
FossilOrigin-Name: 321ded32f67550e964cd64d61aa0cbc0029ce2fdee4588a46b01dbb5aa87150b
2024-11-18 13:29:16 +00:00
drh
2139c35da0
Ensure that the one-line running status output from testrunner.tcl does not
...
exceed the 80-char line width of a standard terminal.
FossilOrigin-Name: 1eae0f9ed3c4530d117a8efc4adaf0b2cc422083f0407830a1a6d2a5b970fa1a
2024-11-05 11:59:45 +00:00
drh
bce0d04c98
In testrunner.tcl, only show the ETC on the status line if it will fit within
...
the 80-character line limit.
FossilOrigin-Name: 45a3213d23f4691732ba2eb54d440355ce5757aad4cec8eb92f53b4bd7e7f5cd
2024-10-31 18:29:55 +00:00
drh
0064c43a88
Improvements to the PATTERN option of the "testrunner.tcl joblist" command.
...
The pattern match is case insensitive and applies to the state and displaytype
in addition to displayname.
FossilOrigin-Name: 63a8f60f98115d4ee6e40de3ae775770aba76e19df6ddde68bccb7967b0200dc
2024-10-27 10:48:06 +00:00
drh
f896e2bd5b
Add the "halt" command to testrunner.tcl
...
FossilOrigin-Name: 2cc25d5dbbc729f3b6deb8c6a45b975c535b4d20ad240e4ec0c85b3733a170ed
2024-10-22 20:09:18 +00:00