1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-05-28 13:01:26 +03:00

5933 Commits

Author SHA1 Message Date
Gagan Goel
2f1f9c0ef0 MDEV-25080 Some fixes:
1. In TupleUnion::writeNull(), add the missing switch case for
   wide decimal with 16bytes column width.
2. MCOL-5432 Disable complete/partial pushdown of UNION operation
   if the query involves an ORDER BY or a LIMIT clause, until
   MCOL-5222 is fixed. Also add MTR test cases for this.
2023-02-27 06:38:31 -05:00
Gagan Goel
4e2123ca80 MDEV-25080 Fix some corner cases in DataConvert::joinColTypeForUnion(). 2023-02-27 06:38:31 -05:00
Gagan Goel
e4100928d1 MDEV-25080 DISABLE pushdown of SELECT_LEX_UNIT for the prepare
phase of PS/SP statements.
2023-02-27 06:38:31 -05:00
Gagan Goel
e987a766e0 MDEV-25080 Some updates to the MDEV-25080 MTR test cases. 2023-02-27 06:38:31 -05:00
Gagan Goel
86dcf92d56 MCOL-5215 Fix overflow of UNION operation involving DECIMAL datatypes.
When a UNION operation involving DECIMAL datatypes with scale and digits
before the decimal exceeds the currently supported maximum precision
of 38, we throw an error to the user:
"MCS-2060: Union operation exceeds maximum DECIMAL precision of 38".

This is until MCOL-5417 is implemented where ColumnStore will have
full parity with MariaDB server in terms of maximum supported DECIMAL
precision and scale of 65 and 38 digits respectively.
2023-02-27 06:38:31 -05:00
Gagan Goel
8cdcae0d2f MDEV-25080 Disable pushdown of SELECT_LEX_UNIT for CREATE VIEW statements. 2023-02-27 06:38:31 -05:00
Gagan Goel
45a779f743 MDEV-25080 Implement ColumnStore-side changes for pushdown of SELECT_LEX_UNITs. 2023-02-27 06:38:31 -05:00
Andrey Piskunov
8671f55784
MCOL-5333: Full MTR tests for custom Build (#2732)
* Add MTR_SUITE_LIST

* Typo

* Add data download

* Install tar and lz4

* Change the way MTR_SUITE_LIST is set up

* Use bash for MTR_SUITE_LIST

* Another one

* Fix reference results for full MTR develop, disable broken JSON test and tests with 10GB database

* Fix timestamps and truncate cos

* Fix some more references

* Fix dokcerhub step for custom build

* One more fix for dockerhub step on custom build

* Fix tests for regr functions with truncate

* Full mtr set on nghtly + MTR_FULL_SET flag

* One more fix for dockerhub

* Fix MTR_FULL_SET

* Testing MTR_FULL_SET

* sorted_result in tests + fix typo

* Truncate even more

* Typo

* truncate 2 more tests

* Disable regr_* functions tests

* fix setup mtr step

* correct settings for table creation

* Put setup for tests into drone

* Fix for debian based distros

* More truncates

* Disable the rest

---------

Co-authored-by: Leonid Fedorov <leonid.fedorov@mariadb.com>
2023-02-27 13:42:48 +03:00
Roman Nozdrin
71a6f691fd
Merge pull request #2737 from mariadb-corporation/MCOL-5433-build-log
ci: #MCOL-5433 always publish build log, #MCOL-5434 always run regresion
2023-02-26 14:36:14 +00:00
Gagan Goel
a0c996e601
Revert "ci: #MCOL-5423 change ent branch" (#2743) 2023-02-24 00:00:45 +03:00
Gagan Goel
523afbf441
Merge pull request #2740 from mariadb-corporation/MCOL-5423-ent-branch
ci: #MCOL-5423 change ent branch
2023-02-23 09:01:38 -05:00
mariadb-RomanNavrotskiy
2ad46a983d
ci: #MCOL-5433 always publish build log, #MCOL-5434 always run regresion 2023-02-23 10:28:33 +02:00
Roman Nozdrin
d641581493
README version fix and files cleanup (#2738)
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2023-02-23 00:35:03 +03:00
Roman Nozdrin
f66a1b3a04
Raise Columnstore version up to 23.02.1 (#2739) 2023-02-23 00:34:49 +03:00
mariadb-RomanNavrotskiy
0aafdf3218
ci: #MCOL-5423 change ent branch 2023-02-22 23:15:46 +02:00
Leonid Fedorov
4fe1856d4c Remove galera files from debian install 2023-02-22 15:36:39 +02:00
Leonid Fedorov
e6127ab9bc
MCOL-5242: fix Columnstore tmp_files dir owner (#2731)
* When dbrmroot created, it has columnstore_tmp_files as parent, and this parent was still with root owner

* Change f-string to format
2023-02-21 22:04:20 +03:00
Andrey Piskunov
a0893a57db
Add service logs to CI build (#2730)
* Add service logs to CI build

* Run logs.sh in drone

* write to core dir

* Proper dir and better script

* Fix typo

* load logs.sh in regr
2023-02-14 16:11:58 +03:00
Roman Nozdrin
929f7b3922
Merge pull request #2728 from mariadb-corporation/ci-ignore-regression-results
ci: align steps failure ignores
2023-02-10 12:48:32 +03:00
mariadb-RomanNavrotskiy
ecdc2bbae5
ci: align steps failure ignores 2023-02-09 22:08:41 +02:00
Roman Nozdrin
b2206521ce
Merge pull request #2723 from drrtuy/MCOL-5384-develop
MCOL-5384 This commit replaces shared pointer to CSC with CSC ctor th…
2023-02-09 00:16:54 +03:00
mariadb-RomanNavrotskiy
4659f41efa ci: fix publish results latest regression 2023-02-08 18:27:43 +02:00
Roman Nozdrin
ff534dba7f MCOL-5384 This commit replaces shared pointer to CSC with CSC ctor that is cleaned up leaving a scope
CSC default ctor was private b/c it must not allow to use CSC outside thread cache.
  However there are some places in the plugin code that need a standalone syscat that
  is cleaned up leaving the scope. The decision is to make the restriction mentioned
  organizational rather than syntactical.
2023-02-08 14:03:41 +00:00
Roman Nozdrin
00e766253c
Merge pull request #2721 from tntnatbry/MCOL-5318-MCOL-5319-dev
Revert "This commit fixes an incorrect predicate in the if condition (#2608)"
2023-02-08 15:26:07 +03:00
mariadb-RomanNavrotskiy
c3c0e869ce
ci(regression): #MCOL-5406-split-tests (#2717)
This commit breaks a monolithic regression into a set of tests to reduce housekeeping and RAM-related issues detection
2023-02-08 00:40:55 +03:00
Leonid Fedorov
f7118b53a8
Turn on ASAN for unitests (#2719)
Fix asan error on compression tests
Fix warn of nonreturn function
2023-02-02 15:08:01 +02:00
Gagan Goel
006b92bba2 Revert "This commit fixes an incorrect predicate in the if condition (#2608)"
This reverts commit f4e3022fbdecc25a22ae6eaf072e462aa6695f35.

The commit apparently caused MCOL-5318 and MCOL-5319 which involve the
internal ColumnStore batch insert mechanism passing through the SQL
layer. The code block involved in this change is a predicate checking
for the HWM extent in WriteEngineServer at the end of the batch insert.
This is done in WE_DMLCommandProc::processBatchInsertHwm(). The original
predicate check in this function for the HWM extent is restored until
further investigation.
2023-02-02 08:07:18 -05:00
Roman Nozdrin
c1168e33aa
Merge pull request #2712 from drrtuy/MCOL-5400
MCOL-5400 Disable group by pushdown
2023-01-27 16:17:24 +03:00
Leonid Fedorov
d87206c3e4
Fix segfault in getLocalNetIfacesSins (#2713) 2023-01-26 16:21:21 +03:00
Roman Nozdrin
1b51d265ed MCOL-5400 Disable group by pushdown 2023-01-26 12:09:00 +00:00
Roman Nozdrin
ebe9bd0aa5
Merge pull request #2670 from denis0x0D/MCOL-5195
MCOL-5195 Correlated subquery with equi/non-equi scalar filter and join condition
2023-01-19 13:35:08 +03:00
mariadb-RomanNavrotskiy
faf58a086c MCOL-5127 run mtr on 3 nodes cluster with docker-compose 2023-01-19 01:22:17 +02:00
Roman Nozdrin
c7c182ebd2
Merge pull request #2684 from drrtuy/MCOL-5385
MCOL-5385 This patch reduces RAM consumption and adds GROUP_CONCAT RA…
2023-01-18 11:58:47 +03:00
Roman Nozdrin
0099b253f3
Merge pull request #2694 from tntnatbry/MCOL-5367
MCOL-5367 Fix a bug introduced in MCOL-5021 (AUX column implementation).
2023-01-18 11:58:26 +03:00
Roman Nozdrin
a5637551c7
Merge pull request #2698 from thesamesam/transitive-incldues
Add missing includes
2023-01-18 11:57:00 +03:00
Sam James
20b5dbb617
Add missing includes
These seem to have all fallen out of a recent Boost update to 1.81 which
dropped some internal includes. All of these uses within columnstore
relied on these transitive includes, so explicitly include what we need
to fix build.

Signed-off-by: Sam James <sam@gentoo.org>
2023-01-17 01:18:41 +00:00
Roman Nozdrin
35c8359d90
Merge pull request #2695 from mariadb-corporation/update-thift
Remove commited old thrift
2023-01-16 20:32:16 +03:00
Roman Nozdrin
bec8c6f6a3
Merge pull request #2690 from mariadb-corporation/MCOL-5384-Karol-Roslaniec
MCOL-5384: Connection resource cleaning by Karol Roslaniec
2023-01-16 20:30:24 +03:00
Roman Nozdrin
6700003983
Merge pull request #2691 from mariadb-corporation/mcol-5233-5388
ci: 22.08 branch, unify build platforms, debug unit storage manager
2023-01-16 19:26:50 +03:00
Leonid Fedorov
3b68353429 remove commited old thrift, replace with static lib build from exterrnal project 2023-01-16 15:37:01 +03:00
mariadb-RomanNavrotskiy
f817f8d4f4
ci changes:
- #MCOL-5392 develop-22.08 branch trigger
- #MCOL-5388 unify build platforms
- #MCOL-5233 list unit test storage manager binary
- #MCOL-5387 disable allow failure full regression
2023-01-16 13:05:14 +02:00
Gagan Goel
ad59ed5402 MCOL-5367 Fix a bug introduced in MCOL-5021 (AUX column implementation).
In the implementation of MCOL-5021, an assert was added in
`WE_DMLCommandProc::processBatchInsertHwm()` that assumed the
`WriteEngine::TableMetaData` cache is uniform across the cluster.
However, this assumption is incorrect.

This bug caused undefined behaviour in ColumnStore resulting in bugs
such as MCOL-5367. In MCOL-5367, in a multi-node ColumnStore cluster,
an INSERT ... SELECT in a transaction with system variable
`columnstore_use_import_for_batchinsert=OFF/ON` did not show inserted
records when a SELECT query was issued. Assuming a 3-node cluster setup,
DMLProc only sends a given batch of records to be inserted to one of the
3 nodes, and not all nodes. As a result, the `WriteEngine::TableMetaData`
cache is only populated for that one node and is not uniform across the
cluster, causing the assert to fail.

As a fix, we simply remove this assert as it is redundant and should not
have been added in the first place.
2023-01-16 05:54:44 -05:00
Leonid Fedorov
81f0334698 Connection resource cleaning by Karol Roslaniec 2023-01-13 16:35:12 +03:00
Roman Nozdrin
f6318f515a
Merge pull request #2677 from mariadb-corporation/clang16-fix
Fix clang 16 warnings for comfort build
2023-01-13 14:57:10 +03:00
Leonid Fedorov
d42485656c Fix clang 16 warnings for comfort build 2023-01-12 22:11:28 +03:00
Leonid Fedorov
b4a6a35b40
Fix coredumps utils path (#2689) 2023-01-12 22:08:27 +03:00
Roman Nozdrin
d0eea0ffe8 MCOL-5385 This patch reduces RAM consumption and adds GROUP_CONCAT RAM accounting feature 2023-01-11 09:52:10 +00:00
David.Hall
53af74b027
MCOL-1170 Fix ANALYZE to not error (#2682)
Analyze needs to be completed differently than a normal query. In server, when an ANALYZE is seen, it calls init_scan() immediatly followed by end_scan(). This leaves the sqlfrontendsession (ExeMgr) in a state where it expects to return rows. This patch fixes end_scan to clean this up via reads and writes to get everything back in synch.

ANALYZE should display the number of rows to be displayed if the query were run normally. We have that information available, but no way to return it. A modification to server side to ask for that in the handler is required.

This patch also includes a beautification of sqlfrontsessionthread.cpp since it looked bad. The important change is at line 774
if (!swallowRows)
which short circuits the actual return of data
2023-01-09 13:59:26 -06:00
Roman Nozdrin
6b5eff5525
Merge pull request #2683 from mariadb-corporation/unparallel-tests
ci: unparallel mtr and regression
2023-01-09 18:10:44 +03:00
mariadb-RomanNavrotskiy
32e0371d70
ci: unparallel mtr and regression 2023-01-09 13:25:49 +02:00