1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-07-27 21:01:50 +03:00
Commit Graph

6318 Commits

Author SHA1 Message Date
0a118292eb Revert "fix(datatypes,cpimport)!: MCOL-5746 Do not convert ascii to binary fo…"
This reverts commit f75baa8a40.
2024-05-16 18:49:16 +04:00
5ca68831fb enable mariadb-backup Debian packaging and disable TTY for Docker exec in regression test 2024-05-16 17:12:54 +04:00
c01ab42e87 MCOL-5747 gcc-14.1.1 compile error - calloc - transposed args
The arguments of calloc are the number of members and the sizeof the
member. Gcc-14.1.1 worked out how to tell the difference.

We correct this by transposing to gcc's will.
2024-05-16 16:53:52 +04:00
f75baa8a40 fix(datatypes,cpimport)!: MCOL-5746 Do not convert ascii to binary for the "BLOB" data type (#3175) 2024-05-16 10:53:42 +01:00
49541993f4 fix(join): Fixes MCOL-5056, an error of joining TEXT column from InnoDB (#3160)
We incorrectly identified TEXT columns from external tables as BLOB.
Alexander Barkov suggested a way to discriminate them which I
implemented here.
2024-05-15 16:04:10 +01:00
5b982469a2 added mcs-storagemanager journal output for S3 --logs bundle 2024-05-13 21:14:21 +04:00
5b9ddd902e feat(ddl): MCOL-5744: better handling of utf8 charset aliases (#3174)
Server expands ut8_XXX aliases to utf8mb3_XXX or utf8mb4_XXX depending
on the UTF8_IS_UTF8MB3 setting in the OLD_MODE environment variable.

Server already has the necessary code implemented in the get_utf8_flag()
method of class THD. There are several uses of this flag and all we have
to do to be in line with server is to use it.

This patch does that for DDL as work on MCOL-5705 uncovered some
problems in that area.
2024-05-10 17:17:57 +01:00
8204c131bf fix(CI): Docker multinode provision script expects container names in the cli (#3172)
Co-authored-by: mariadb-SusilBehera <root@susil-centos7.c.columnstore-test.internal>
2024-05-07 18:30:47 +03:00
1795065ddb fix(em): MCOL-5732 Add missing system OID to RebuildEM tool (#3168) 2024-04-27 22:50:02 +03:00
fd612d2578 fix(cmapi): MCOL-5594: Fix after testing.. (#3150)
- [fix] wrong invoke already imported constants and function from signal lib
2024-04-19 12:29:16 +03:00
fe0f77a1a8 sorted mtr results 2024-04-18 18:31:30 +03:00
71185efe54 Fixed review notices, added the loop over selects, to collect error on more tnan two selects 2024-04-18 18:31:30 +03:00
8efdee6eca apply clang-format 2024-04-18 18:31:30 +03:00
904ac415e4 fix(plugin) MCOL-5699: throw error for unimplemented INTERSECT and EXCEPT 2024-04-18 18:31:30 +03:00
a8d3fff79e chore(build) Rocky8 gcc vanilla build fix 2024-04-16 17:08:06 +03:00
b79c34b90e Fix MTR mcol-5236 2024-04-16 17:06:26 +03:00
1c88a7fcd8 MCOL-5597 Rollback changes introduced for DJS.
This patch changes:
1. The number of buckets created on each split.
2. The heuristic which calculates the bucket size.
2024-04-15 19:37:29 +03:00
3b7e69135d Fixes MCOL-5700, Oracle mode test results
This changeset contains fixes in Oracle mode tests and for the
implementation of the CONCAT_ORACLE. Also, we harmonise our
translation process with the recent changes in the server.

Due to changed behavior of the server, some CREATE VIEW/EXPLAIN
statements' results begun to output unexpected results and need to be
fixed.

Also, concatenation operation's name also changed. This lead to
disabled func_concat_oracle test to be enabled to test it and it
turned out that our implementation of this function was broken
and need to be fixed too.
2024-04-15 19:35:21 +03:00
80ef84d4fd Merge pull request #3166 from mariadb-corporation/MCOL-5328-qa-test
Add qa test for MCOL-5328
2024-04-12 20:30:13 +05:30
28b957915d Add qa test for MCOL-5328 2024-04-12 11:10:50 +00:00
6844923b9a feat(cmapi,cli): MCOL-5618: Add backup, restore, backup-dbrm, restore-dbrm commands for mcs cli tool. (#3130)
* MCOL-5618: Add backup, restore, backup-dbrm, restore-dbrm commands for mcs cli tool.

[add] mcs_cluster_tool/helpers.py file with cook_sh_arg function inside
[add] MCS_BACKUP_MANAGER_SH to mcs_cluster_tool/constants.py
[add] backup and restore commands to "mcs" Typer APP

* MCOL-5618: Move mcs_backup_manager.sh to cmapi/scripts.

* MCOL-5618: Install mcs_backup_manager.sh with CMAPI package.
2024-04-01 16:51:38 +03:00
77cd733a6d fix(plugin): MCOL-5236 Take Item from Ref_Item for group by list. (#3162) 2024-04-01 14:13:39 +03:00
197acba704 Merge pull request #3158 from mariadb-corporation/revert-3156-sz-fix-oracle-mode
Revert "Fixes MCOL-5700, Oracle mode test results"
2024-03-27 17:58:57 +03:00
af5ae35413 Revert "Fixes MCOL-5700, Oracle mode test results" 2024-03-27 18:52:30 +04:00
56b35d5cf6 Merge pull request #3156 from mariadb-corporation/sz-fix-oracle-mode
Fixes MCOL-5700, Oracle mode test results
2024-03-27 14:45:52 +06:00
34acd3559b Fixes MCOL-5700, Oracle mode test results
This changeset contains fixes in Oracle mode tests and for the
implementation of the CONCAT_ORACLE. Also, we harmonise our
translation process with the recent changes in the server.

Due to changed behavior of the server, some CREATE VIEW/EXPLAIN
statements' results begun to output unexpected results and need to be
fixed.

Also, concatenation operation's name also changed. This lead to
disabled func_concat_oracle test to be enabled to test it and it
turned out that our implementation of this function was broken
and need to be fixed too.
2024-03-27 10:00:39 +03:00
444cf4c65e fix(aggregation, disk-based) MCOL-5691 distinct aggregate disk based (#3145)
* fix(aggregation, disk-based): MCOL-5689 this fixes disk-based distinct aggregation functions
Previously disk-based distinct aggregation functions produced incorrect results b/c there was no finalization applied for previous generations stored on disk.

*  fix(aggregation, disk-based): Fix disk-based COUNT(DISTINCT ...) queries. (Case 2). (Distinct & Multi-Distinct, Single- & Multi-Threaded).

* fix(aggregation, disk-based): Fix disk-based DISTINCT & GROUP BY queries. (Case 1). (Distinct & Multi-Distinct, Single- & Multi-Threaded).

---------

Co-authored-by: Theresa Hradilak <theresa.hradilak@gmail.com>
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2024-03-26 00:39:53 +03:00
8cb7bc8e54 Boost version for Awwor 2024-03-25 19:54:39 +03:00
9fe6efe84a chore(arrow) bump apache arrow version and fix test load generator for memory usage (#3149)
* bump apache arrow version and fix test load generator for memory usage
* limit arrow simd by SSE4.2
2024-03-22 20:47:55 +04:00
49757ba8d5 Merge pull request #3132 from mariadb-SergeyZefirov/MCOL-5035-update-inserts-null-for-all-zeroes-date
Fix MCOL-5035, a difference in INSERT and UPDATE behavior
2024-03-21 10:12:18 +03:00
7a2ca9d6bc MCOL-4480: TEXT type added (#3142)
* TEXT type added
* tests
2024-03-21 00:26:35 +04:00
5780bfa15f Fix MCOL-5035, a difference in INSERT and UPDATE behavior
The UPDATE statement wrote NULL when the column set is DATETIME and
value is '0000-00-00 00:00:00'. The problem was inside WriteEngine's
handling of UPDATE statements and this is where heart of change is.

Other changes are related to some obsolete data structures in DML/DDL
handling that just hanging around there, doing nothing.
2024-03-19 12:44:22 +03:00
5f40fb32d0 MCOL-5328: use PCRE2 and JPCRE wrapper (#3137)
PCRE2 for regexp functions in columnstore
2024-03-14 19:39:29 +04:00
c01e1f4ed8 Use of newly introduced schema-based name resolution for (#3138)
Oracle-compatible functions
Server changed the way to resolve functions' names and we need to adapt.
2024-03-11 19:17:46 +04:00
8f91029f6a Merge pull request #3133 from mariadb-corporation/test_mcs_50_fix
Update mcs50_cpimport_stdin.test
2024-02-26 21:05:25 +06:00
3e73af331d Update mcs50_cpimport_stdin.test 2024-02-26 20:31:34 +06:00
dec8350f0e MCOL-5594: Interactive "mcs cluster stop" command for CMAPI. (#3024)
* MCOL-5594: Interactive "mcs cluster stop" command for CMAPI.

[add] NodeProcessController class to handle Node operations
[add] two endpoints: stop_dmlproc (PUT) and is_process_running (GET)
[add] NodeProcessController.put_stop_dmlproc method to separately stop DMLProc on primary Node
[add] NodeProcessController.get_process_running method to check if specified process running or not
[add] build_url function to helpers.py. It needed to build urls with query_params
[add] MCSProcessManager.gracefully_stop_dmlproc method
[add] MCSProcessManager.is_service_running method as a top level wrapper to the same method in dispatcher
[fix] MCSProcessManager.stop by using new gracefully_stop_dmlproc
[add] interactive option and mode to mcs cluster stop command
[fix] requirements.txt with typer version to 0.9.0 where supports various of features including "Annotated"
[fix] requirements.txt click version (8.1.3 -> 8.1.7) and typing-extensions (4.3.0 -> 4.8.0). This is dependencies for typer package.
[fix] multiple minor formatting, docstrings and comments

* MCOL-5594: Add new CMAPI transaction manager.

- [add] TransactionManager ContextDecorator to manage transactions in less code and in one place
- [add] TransactionManager to cli cluster stop command and to API cluster shutdown command
- [fix] id -> txn_id in ClusterHandler class
- [fix] ClusterHandler.shutdown class to use inside existing transaction
- [add] docstrings in multiple places

* MCOL-5594: Review fixes.
2024-02-23 21:40:50 +03:00
ed9ec93358 mcs_backup_manager rename -vs-ssl to -nv-ssl 2024-02-15 05:31:52 +03:00
8ac8d08d48 added short hand versions of some variables and small fixes to parameter naming - vs _ 2024-02-15 05:31:52 +03:00
83c2408f8d fix(join, threadpool): MCOL-5565: MCOL-5636: MCOL-5645: port from develop-23.02 to [develop] (#3128)
* fix(threadpool): MCOL-5565 queries stuck in FairThreadScheduler. (#3100)

Meta Primitive Jobs, .e.g ADD_JOINER, LAST_JOINER stuck
	in Fair scheduler without out-of-band scheduler. Add OOB
	scheduler back to remedy the issue.

* fix(messageqcpp): MCOL-5636 same node communication crashes transmiting PP errors to EM b/c error messaging leveraged socket that was a nullptr. (#3106)

* fix(threadpool): MCOL-5645 errenous threadpool Job ctor implictly sets socket shared_ptr to nullptr causing sigabrt when threadpool returns an error (#3125)

---------

Co-authored-by: drrtuy <roman.nozdrin@mariadb.com>
2024-02-13 19:01:16 +03:00
fcd46ab00a fix(DEC): MCOL-5637 Initialize a new bytestream before write to PS (#3118) 2024-02-09 22:27:14 +03:00
ebcf43a517 fix(join, disk-based): MCOL-5597: large side read errors (#3117)
The large side read errors mentioned there can be due to failure to
close file stream properly. Some of the data may still reside in the
file stream buffers, closing must flush it. The flush is an I/O
operation and can fail, leading to partial write and subsequent partial
read.

This patch tries to provide better diagnostics.
2024-02-09 22:25:43 +03:00
8de4eec362 MCOL-5650: CMAPI python3 binary crash. (#3122)
[fix] python prebuilded interpreter to interpreter without AVX512 instructions
2024-02-09 22:19:08 +03:00
1e8172f74b MCOL-5338: Fixed issue related to mcs-loadbrm. (#3107)
[fix] eventually wrong logging messages format
2024-02-05 21:27:57 +03:00
9681841cfc added comments to functions for next release 2024-01-23 19:52:47 +03:00
aa6b68aacc update to latest version of mcs backup manager with PR comments addressed 2024-01-23 19:52:47 +03:00
f57bdb6d2e update mcs_backup_manager.sh - add ubuntu/debian support 2024-01-23 19:52:47 +03:00
ec0c5ea045 mcs_backup_manager.sh - typo in comments of bsl license 2024-01-23 19:52:47 +03:00
10c953fcf3 add bsl license to mcs_backup_manager.sh + skip removing locks when poll_wait fails 2024-01-23 19:52:47 +03:00
3643a2e401 updated columnstore_backup.sh -> mcs_backup_manager.sh 2024-01-23 19:52:47 +03:00