6c42aa4a0e
Initialize variables used as outputs of custom tokenizer method calls in fts4.
...
FossilOrigin-Name: 514505a84bcc677518d60a42896598f85ed78265
2012-10-17 20:15:10 +00:00
d5578433ff
Fix all known instances of 'repeated the' style typos in comments. No changes to code.
...
FossilOrigin-Name: 9b19b847533f944f289d93dcdba29c0d67bf251c
2012-08-25 10:01:29 +00:00
4dc3d73d69
Add the SQLITE_DISABLE_FTS4_DEFERRED compile time option.
...
FossilOrigin-Name: e799222f3b8246e65657a758437914ece7069ba9
2012-08-20 17:24:48 +00:00
1c30debd41
Fix an obscure memory leak in FTS3 that can come about when two memory
...
allocations are immediately adjacent to one another.
FossilOrigin-Name: 025227be5495f950c466dfabac140cba69e498be
2012-06-08 14:01:53 +00:00
cf9f6f1375
Add fault-injection tests that use the unicode61 tokenizer. Fix a problem revealed by the same.
...
FossilOrigin-Name: ed28c48a3dd7e766e60db0d96ef5460bf9913e6b
2012-05-26 15:44:08 +00:00
85e7243acf
Fix harmless static-analysis warnings, mosting having to do with memory
...
leaks in the command-line shell. Add a clang analysis of the command-line
shell to the "warnings-clang.sh" script. Other minor cleanups to the
command-line shell code.
FossilOrigin-Name: 93a0f452a7023898ad3d62ee81b39a80477c332f
2012-04-11 11:38:53 +00:00
4e245a4c35
Fix compiler warnings on GCC and MSVC and fix a C89-ism that
...
broke the build for MSVC.
FossilOrigin-Name: b451c0f97f0abe78ebe6c62ff489ec1ad8a1f767
2012-03-30 00:00:36 +00:00
311ec02587
Remove the fts3merge.test script in favour of changing the fts4merge.test script so that it runs tests using both fts4 and fts3. Fix some problems with incr-merge and FTS3 tables.
...
FossilOrigin-Name: 5c447e226afca0d46b9ed994dea26a16a9ae168c
2012-03-27 15:00:06 +00:00
5da0aa1603
Allow multiple incremental merges to proceed concurrently. This is required to prevent a large crisis-merge from occuring while an even larger incremental-merge is underway.
...
FossilOrigin-Name: 7ed9d2f24a650b424b97dfc19b8042c4cf09c82c
2012-03-27 11:48:02 +00:00
6f4df8ac83
Modify the FTS integrity-check so that the checksums do not depend on the results of signed integer overflow, which is undefined in C.
...
FossilOrigin-Name: f907fc3fb387e74bb66babcbf050748cb253a6fa
2012-03-26 10:57:31 +00:00
84bce14f77
Add a comment to explain how the FTS integrity-check works.
...
FossilOrigin-Name: 64e8a116f39434a3b7347f01a47f88eef3276742
2012-03-26 10:47:03 +00:00
cbcd9f5357
Add an experimental integrity-check function to FTS.
...
FossilOrigin-Name: 40fc8804743dfb005991e9c5ef7b0ebcb3c2e731
2012-03-26 10:36:55 +00:00
6c2e7e19fa
Enable fts3 tables to use incremental merge by automatically creating the
...
%_stat table when it is needed.
FossilOrigin-Name: cc051fc0b2d89603b27b94cf2afdbda417ee9d94
2012-03-24 17:29:05 +00:00
61fa09dbf2
Fix a failing assert() in the FTS3_LOG_MERGES related code.
...
FossilOrigin-Name: 4220d52cb3426f1680b72d57ecc9f4ade029357d
2012-03-24 17:09:11 +00:00
790964ebc4
Fix a bug in debugging code enabled when FTS3_LOG_MERGES is defined.
...
FossilOrigin-Name: 2e06babf49de844d0e878d68114dbcc5ad4d6e54
2012-03-24 16:18:08 +00:00
45eddd6855
Remove the Fts3Table.mxLevel variable.
...
FossilOrigin-Name: 67a0cffc9d07be7f09dad9d019a18160711295cd
2012-03-24 16:11:21 +00:00
4b1e4dabc3
Modify the way the number of leaves written and the maximum relative level are calculated in the auto-incr-merge code.
...
FossilOrigin-Name: 0d841c957c6ec4afecb49504177c6279e09d7012
2012-03-24 14:45:19 +00:00
4ef9dfff97
An attempt at automatic incremental merging for FTS4.
...
FossilOrigin-Name: ed69434cd89084f4b57bd2cc4f5cc558904af565
2012-03-24 02:20:43 +00:00
d59de73e27
Fix a spurious SQLITE_CONSTRAINT error that may be returned by an incr-merge operation.
...
FossilOrigin-Name: ed7c17ea165f6348506bd23ebc58c427bb65d697
2012-03-23 18:26:11 +00:00
3501a91677
Remove an incorrect assert() statement. Fix a const-related warning.
...
FossilOrigin-Name: 96ed47493b3d46344fd2105642f31690aee06674
2012-03-23 14:38:49 +00:00
e81eaec754
Following an incr-merge operation that does not completely consume its input segments, store context in the rowid==1 row of the %_stat table that allows the next incr-merge to pick up where the previous left off.
...
FossilOrigin-Name: ab0a4f44fb67e9f0cb82297b80e728ca58cdb0fb
2012-03-22 16:48:12 +00:00
d1ab097d45
Fix various incorrect and missing comments and other style issues in and around the FTS incremental merge code.
...
FossilOrigin-Name: 7aabb62c8ccbd2b8d216e25226f06e5820dec38a
2012-03-17 16:56:57 +00:00
81b35dc66c
Fix some integer overflow problems that can occur when using large langauge id values.
...
FossilOrigin-Name: 3475092cff862080a020d386076d739f0d22c9b2
2012-03-16 15:54:19 +00:00
e931b7f45f
Add a comment to the FTS getAbsoluteLevel() function. No actual code changes.
...
FossilOrigin-Name: 7e0f861beda4d74d0c3c9fb4abb3ddb5fee346bd
2012-03-16 14:54:07 +00:00
4ab6f2b9c1
Modify incremental merge code to merge nMin segments at a time.
...
FossilOrigin-Name: cd34bc1af4ba608ea3b52bab55bcfe0086711900
2012-03-15 17:45:50 +00:00
5730ef599c
Add tests for incremental merge code.
...
FossilOrigin-Name: 570473729d6561d81e6e5f8884fd18487008636e
2012-03-14 20:01:52 +00:00
a2af0aecdb
Avoid allocating a large object on the stack in the incremental merge code. Use sqlite3_malloc() instead.
...
FossilOrigin-Name: 36ae510de45be44efd34cff242d02fb21b7419ac
2012-03-14 12:17:40 +00:00
8af1fc721e
Fix another bug in the incremental merge code.
...
FossilOrigin-Name: f97b12e0955c4c29f9c31a186d72d87f7407782e
2012-03-14 11:51:31 +00:00
604f58a686
Fix some bugs in the incremental merge code. Some remain.
...
FossilOrigin-Name: bff21683705a61b8b8672e0b44c287d1dc7c32a9
2012-03-13 19:56:34 +00:00
ab4f6385de
Minor commenting and stylistic changes only.
...
FossilOrigin-Name: a1747086c5e0c152fcf4bd9fa80a61b6f03f4a94
2012-03-09 12:52:43 +00:00
593c9824bc
Add the 'merge=?,?' command to fts4. This still needs some work.
...
FossilOrigin-Name: 741b8f897750eac3c9774fd65de7e40bb89781b1
2012-03-08 18:39:03 +00:00
996073b3ae
Add the xLanguageid method to sqlite3_fts3_tokenizer versions 1 and greater.
...
FossilOrigin-Name: f8e9c445dd358c40e5a7bf3756b9f291909dbea7
2012-03-03 18:46:41 +00:00
8fb662b0be
Fix the FTS 'optimize' command on multi-lingual databases.
...
FossilOrigin-Name: 65fa693729a336e4d905ce72e6b9ccf4faa772bd
2012-03-02 12:26:19 +00:00
e3ddd1ac42
Fix a bug in merging FTS language tables for languages other than language 0.
...
FossilOrigin-Name: d281cb8984c911a4c0cce2ec299e1351d8e580e4
2012-03-02 11:48:50 +00:00
7fcb214b93
Add the "languageid=" option to fts4. This code is still largely untested and alsmost certainly buggy.
...
FossilOrigin-Name: bea257f70f10dd1111d79cabd1e1462dc651704d
2012-03-01 19:44:20 +00:00
548af8b69e
Fix a compiler warning in FTS4.
...
FossilOrigin-Name: b4cad1ce78e6bb967c472bec5c562a24b4dfebaf
2012-01-31 23:34:21 +00:00
585db0e23a
Fix an FTS problem triggered by querying for an N character prefix using an N+1 character prefix index after rows have been deleted from the FTS table.
...
FossilOrigin-Name: c05c3fd20d93f430140d762ead23bacd337ffb4d
2012-01-25 16:29:45 +00:00
64803bd2fa
Fix minor issues with FTS and RTREE discovered by coverity.
...
FossilOrigin-Name: 1c27d842163e27c39bbe9409f50657b9de9ade6e
2011-12-22 17:31:17 +00:00
0c8cda6e0d
Fix a problem in fts3_write.c causing stack memory to be referenced after it is out of scope.
...
FossilOrigin-Name: f9c4a7c8f4e5821b47c1393d6272e32416d8886c
2011-12-22 15:30:46 +00:00
6ed18b7110
Fix harmless compiler warnings in FTS4.
...
FossilOrigin-Name: 1af4a25631c4077a9bfc64e15eb92fbf5146c89c
2011-10-19 18:21:47 +00:00
e459b07601
Merge the fts4-content branch with the trunk.
...
FossilOrigin-Name: 8a4077057ddeb08e8edc5f20a75abaaba7a278ba
2011-10-19 16:20:40 +00:00
d17f70a624
Change the way ^ tokens work in FTS so that the filtering is done as part of reading the FTS index instead of waiting until an entire doclist has been retrieved and then filtering it.
...
FossilOrigin-Name: 9b58c59eb4efaa38ce50a3ce1b52f9ba578c71d6
2011-10-19 11:57:13 +00:00
3f1ea8d114
If a token within an FTS query is prefixed with a '^' character, it must be the first token in a column of data to match.
...
FossilOrigin-Name: 63ac33c860eb32ce96699f06bf83121cec2ffaca
2011-10-18 19:39:41 +00:00
8dab211632
Handle updating the only row of an FTS table correctly. Fix for [9fd058691].
...
FossilOrigin-Name: 7e24645be2fe0ffe092212e7bcfa5b4500305811
2011-10-13 17:16:45 +00:00
deb9473250
Change FTS4 so that if both the content=xxx option and column names are specified, the virtual table assumes that the named columns correspond to columns of table xxx.
...
FossilOrigin-Name: 289ee43179369fce2fde50870d72c445e184e896
2011-10-05 15:11:30 +00:00
8361b189c9
Fix a problem with IO error handling in the rebuild-index code.
...
FossilOrigin-Name: c6ba81fcad32192674bd510e607f787adc1f7038
2011-10-05 06:07:00 +00:00
d8e454e19a
Add experimental 'content' option to FTS4.
...
FossilOrigin-Name: 1d27ea741f61c624e18bdc6a3b1c2d8574a64ddc
2011-10-04 11:22:59 +00:00
7fd3392981
More compiler warning fixes.
...
FossilOrigin-Name: ed2dda9329ca42e9c0be1986c78b091051e7598f
2011-06-20 19:00:30 +00:00
d4d21fea8e
Fix a problem with NEAR queries executed inside a transaction that writes the FTS table.
...
FossilOrigin-Name: 051c756c367837908f6691c0a36108e088c94f99
2011-06-16 16:06:05 +00:00
6b96771b82
Changes to #ifdefs so that the build goes correctly if the only FTS macro
...
defined is SQLITE_ENABLE_FTS4.
FossilOrigin-Name: a0b43a320e6491de7070966ed7c3ec55fd660a85
2011-06-16 00:54:45 +00:00