1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-09-11 08:50:45 +03:00
Commit Graph

6318 Commits

Author SHA1 Message Date
Denis Khalikov
0a118292eb Revert "fix(datatypes,cpimport)!: MCOL-5746 Do not convert ascii to binary fo…"
This reverts commit f75baa8a40.
2024-05-16 18:49:16 +04:00
Timofey Turenko
5ca68831fb enable mariadb-backup Debian packaging and disable TTY for Docker exec in regression test 2024-05-16 17:12:54 +04:00
Daniel Black
c01ab42e87 MCOL-5747 gcc-14.1.1 compile error - calloc - transposed args
The arguments of calloc are the number of members and the sizeof the
member. Gcc-14.1.1 worked out how to tell the difference.

We correct this by transposing to gcc's will.
2024-05-16 16:53:52 +04:00
Denis Khalikov
f75baa8a40 fix(datatypes,cpimport)!: MCOL-5746 Do not convert ascii to binary for the "BLOB" data type (#3175) 2024-05-16 10:53:42 +01:00
Sergey Zefirov
49541993f4 fix(join): Fixes MCOL-5056, an error of joining TEXT column from InnoDB (#3160)
We incorrectly identified TEXT columns from external tables as BLOB.
Alexander Barkov suggested a way to discriminate them which I
implemented here.
2024-05-15 16:04:10 +01:00
Allen Herrera
5b982469a2 added mcs-storagemanager journal output for S3 --logs bundle 2024-05-13 21:14:21 +04:00
Sergey Zefirov
5b9ddd902e feat(ddl): MCOL-5744: better handling of utf8 charset aliases (#3174)
Server expands ut8_XXX aliases to utf8mb3_XXX or utf8mb4_XXX depending
on the UTF8_IS_UTF8MB3 setting in the OLD_MODE environment variable.

Server already has the necessary code implemented in the get_utf8_flag()
method of class THD. There are several uses of this flag and all we have
to do to be in line with server is to use it.

This patch does that for DDL as work on MCOL-5705 uncovered some
problems in that area.
2024-05-10 17:17:57 +01:00
Susil Kumar Behera
8204c131bf fix(CI): Docker multinode provision script expects container names in the cli (#3172)
Co-authored-by: mariadb-SusilBehera <root@susil-centos7.c.columnstore-test.internal>
2024-05-07 18:30:47 +03:00
Denis Khalikov
1795065ddb fix(em): MCOL-5732 Add missing system OID to RebuildEM tool (#3168) 2024-04-27 22:50:02 +03:00
Alan Mologorsky
fd612d2578 fix(cmapi): MCOL-5594: Fix after testing.. (#3150)
- [fix] wrong invoke already imported constants and function from signal lib
2024-04-19 12:29:16 +03:00
Leonid Fedorov
fe0f77a1a8 sorted mtr results 2024-04-18 18:31:30 +03:00
Leonid Fedorov
71185efe54 Fixed review notices, added the loop over selects, to collect error on more tnan two selects 2024-04-18 18:31:30 +03:00
Leonid Fedorov
8efdee6eca apply clang-format 2024-04-18 18:31:30 +03:00
Leonid Fedorov
904ac415e4 fix(plugin) MCOL-5699: throw error for unimplemented INTERSECT and EXCEPT 2024-04-18 18:31:30 +03:00
Leonid Fedorov
a8d3fff79e chore(build) Rocky8 gcc vanilla build fix 2024-04-16 17:08:06 +03:00
Leonid Fedorov
b79c34b90e Fix MTR mcol-5236 2024-04-16 17:06:26 +03:00
Denis Khalikov
1c88a7fcd8 MCOL-5597 Rollback changes introduced for DJS.
This patch changes:
1. The number of buckets created on each split.
2. The heuristic which calculates the bucket size.
2024-04-15 19:37:29 +03:00
Serguey Zefirov
3b7e69135d Fixes MCOL-5700, Oracle mode test results
This changeset contains fixes in Oracle mode tests and for the
implementation of the CONCAT_ORACLE. Also, we harmonise our
translation process with the recent changes in the server.

Due to changed behavior of the server, some CREATE VIEW/EXPLAIN
statements' results begun to output unexpected results and need to be
fixed.

Also, concatenation operation's name also changed. This lead to
disabled func_concat_oracle test to be enabled to test it and it
turned out that our implementation of this function was broken
and need to be fixed too.
2024-04-15 19:35:21 +03:00
Susil Kumar Behera
80ef84d4fd Merge pull request #3166 from mariadb-corporation/MCOL-5328-qa-test
Add qa test for MCOL-5328
2024-04-12 20:30:13 +05:30
Susil Behera
28b957915d Add qa test for MCOL-5328 2024-04-12 11:10:50 +00:00
Alan Mologorsky
6844923b9a feat(cmapi,cli): MCOL-5618: Add backup, restore, backup-dbrm, restore-dbrm commands for mcs cli tool. (#3130)
* MCOL-5618: Add backup, restore, backup-dbrm, restore-dbrm commands for mcs cli tool.

[add] mcs_cluster_tool/helpers.py file with cook_sh_arg function inside
[add] MCS_BACKUP_MANAGER_SH to mcs_cluster_tool/constants.py
[add] backup and restore commands to "mcs" Typer APP

* MCOL-5618: Move mcs_backup_manager.sh to cmapi/scripts.

* MCOL-5618: Install mcs_backup_manager.sh with CMAPI package.
2024-04-01 16:51:38 +03:00
Denis Khalikov
77cd733a6d fix(plugin): MCOL-5236 Take Item from Ref_Item for group by list. (#3162) 2024-04-01 14:13:39 +03:00
Sergey Zefirov
197acba704 Merge pull request #3158 from mariadb-corporation/revert-3156-sz-fix-oracle-mode
Revert "Fixes MCOL-5700, Oracle mode test results"
2024-03-27 17:58:57 +03:00
Leonid Fedorov
af5ae35413 Revert "Fixes MCOL-5700, Oracle mode test results" 2024-03-27 18:52:30 +04:00
mariadb-KirillPerov
56b35d5cf6 Merge pull request #3156 from mariadb-corporation/sz-fix-oracle-mode
Fixes MCOL-5700, Oracle mode test results
2024-03-27 14:45:52 +06:00
Serguey Zefirov
34acd3559b Fixes MCOL-5700, Oracle mode test results
This changeset contains fixes in Oracle mode tests and for the
implementation of the CONCAT_ORACLE. Also, we harmonise our
translation process with the recent changes in the server.

Due to changed behavior of the server, some CREATE VIEW/EXPLAIN
statements' results begun to output unexpected results and need to be
fixed.

Also, concatenation operation's name also changed. This lead to
disabled func_concat_oracle test to be enabled to test it and it
turned out that our implementation of this function was broken
and need to be fixed too.
2024-03-27 10:00:39 +03:00
drrtuy
444cf4c65e fix(aggregation, disk-based) MCOL-5691 distinct aggregate disk based (#3145)
* fix(aggregation, disk-based): MCOL-5689 this fixes disk-based distinct aggregation functions
Previously disk-based distinct aggregation functions produced incorrect results b/c there was no finalization applied for previous generations stored on disk.

*  fix(aggregation, disk-based): Fix disk-based COUNT(DISTINCT ...) queries. (Case 2). (Distinct & Multi-Distinct, Single- & Multi-Threaded).

* fix(aggregation, disk-based): Fix disk-based DISTINCT & GROUP BY queries. (Case 1). (Distinct & Multi-Distinct, Single- & Multi-Threaded).

---------

Co-authored-by: Theresa Hradilak <theresa.hradilak@gmail.com>
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2024-03-26 00:39:53 +03:00
Leonid Fedorov
8cb7bc8e54 Boost version for Awwor 2024-03-25 19:54:39 +03:00
Leonid Fedorov
9fe6efe84a chore(arrow) bump apache arrow version and fix test load generator for memory usage (#3149)
* bump apache arrow version and fix test load generator for memory usage
* limit arrow simd by SSE4.2
2024-03-22 20:47:55 +04:00
Sergey Zefirov
49757ba8d5 Merge pull request #3132 from mariadb-SergeyZefirov/MCOL-5035-update-inserts-null-for-all-zeroes-date
Fix MCOL-5035, a difference in INSERT and UPDATE behavior
2024-03-21 10:12:18 +03:00
Leonid Fedorov
7a2ca9d6bc MCOL-4480: TEXT type added (#3142)
* TEXT type added
* tests
2024-03-21 00:26:35 +04:00
Serguey Zefirov
5780bfa15f Fix MCOL-5035, a difference in INSERT and UPDATE behavior
The UPDATE statement wrote NULL when the column set is DATETIME and
value is '0000-00-00 00:00:00'. The problem was inside WriteEngine's
handling of UPDATE statements and this is where heart of change is.

Other changes are related to some obsolete data structures in DML/DDL
handling that just hanging around there, doing nothing.
2024-03-19 12:44:22 +03:00
Leonid Fedorov
5f40fb32d0 MCOL-5328: use PCRE2 and JPCRE wrapper (#3137)
PCRE2 for regexp functions in columnstore
2024-03-14 19:39:29 +04:00
Sergey Zefirov
c01e1f4ed8 Use of newly introduced schema-based name resolution for (#3138)
Oracle-compatible functions
Server changed the way to resolve functions' names and we need to adapt.
2024-03-11 19:17:46 +04:00
mariadb-KirillPerov
8f91029f6a Merge pull request #3133 from mariadb-corporation/test_mcs_50_fix
Update mcs50_cpimport_stdin.test
2024-02-26 21:05:25 +06:00
mariadb-KirillPerov
3e73af331d Update mcs50_cpimport_stdin.test 2024-02-26 20:31:34 +06:00
Alan Mologorsky
dec8350f0e MCOL-5594: Interactive "mcs cluster stop" command for CMAPI. (#3024)
* MCOL-5594: Interactive "mcs cluster stop" command for CMAPI.

[add] NodeProcessController class to handle Node operations
[add] two endpoints: stop_dmlproc (PUT) and is_process_running (GET)
[add] NodeProcessController.put_stop_dmlproc method to separately stop DMLProc on primary Node
[add] NodeProcessController.get_process_running method to check if specified process running or not
[add] build_url function to helpers.py. It needed to build urls with query_params
[add] MCSProcessManager.gracefully_stop_dmlproc method
[add] MCSProcessManager.is_service_running method as a top level wrapper to the same method in dispatcher
[fix] MCSProcessManager.stop by using new gracefully_stop_dmlproc
[add] interactive option and mode to mcs cluster stop command
[fix] requirements.txt with typer version to 0.9.0 where supports various of features including "Annotated"
[fix] requirements.txt click version (8.1.3 -> 8.1.7) and typing-extensions (4.3.0 -> 4.8.0). This is dependencies for typer package.
[fix] multiple minor formatting, docstrings and comments

* MCOL-5594: Add new CMAPI transaction manager.

- [add] TransactionManager ContextDecorator to manage transactions in less code and in one place
- [add] TransactionManager to cli cluster stop command and to API cluster shutdown command
- [fix] id -> txn_id in ClusterHandler class
- [fix] ClusterHandler.shutdown class to use inside existing transaction
- [add] docstrings in multiple places

* MCOL-5594: Review fixes.
2024-02-23 21:40:50 +03:00
Allen Herrera
ed9ec93358 mcs_backup_manager rename -vs-ssl to -nv-ssl 2024-02-15 05:31:52 +03:00
Allen Herrera
8ac8d08d48 added short hand versions of some variables and small fixes to parameter naming - vs _ 2024-02-15 05:31:52 +03:00
Leonid Fedorov
83c2408f8d fix(join, threadpool): MCOL-5565: MCOL-5636: MCOL-5645: port from develop-23.02 to [develop] (#3128)
* fix(threadpool): MCOL-5565 queries stuck in FairThreadScheduler. (#3100)

Meta Primitive Jobs, .e.g ADD_JOINER, LAST_JOINER stuck
	in Fair scheduler without out-of-band scheduler. Add OOB
	scheduler back to remedy the issue.

* fix(messageqcpp): MCOL-5636 same node communication crashes transmiting PP errors to EM b/c error messaging leveraged socket that was a nullptr. (#3106)

* fix(threadpool): MCOL-5645 errenous threadpool Job ctor implictly sets socket shared_ptr to nullptr causing sigabrt when threadpool returns an error (#3125)

---------

Co-authored-by: drrtuy <roman.nozdrin@mariadb.com>
2024-02-13 19:01:16 +03:00
Denis Khalikov
fcd46ab00a fix(DEC): MCOL-5637 Initialize a new bytestream before write to PS (#3118) 2024-02-09 22:27:14 +03:00
Sergey Zefirov
ebcf43a517 fix(join, disk-based): MCOL-5597: large side read errors (#3117)
The large side read errors mentioned there can be due to failure to
close file stream properly. Some of the data may still reside in the
file stream buffers, closing must flush it. The flush is an I/O
operation and can fail, leading to partial write and subsequent partial
read.

This patch tries to provide better diagnostics.
2024-02-09 22:25:43 +03:00
Alan Mologorsky
8de4eec362 MCOL-5650: CMAPI python3 binary crash. (#3122)
[fix] python prebuilded interpreter to interpreter without AVX512 instructions
2024-02-09 22:19:08 +03:00
Alan Mologorsky
1e8172f74b MCOL-5338: Fixed issue related to mcs-loadbrm. (#3107)
[fix] eventually wrong logging messages format
2024-02-05 21:27:57 +03:00
Allen Herrera
9681841cfc added comments to functions for next release 2024-01-23 19:52:47 +03:00
Allen Herrera
aa6b68aacc update to latest version of mcs backup manager with PR comments addressed 2024-01-23 19:52:47 +03:00
Allen Herrera
f57bdb6d2e update mcs_backup_manager.sh - add ubuntu/debian support 2024-01-23 19:52:47 +03:00
Allen Herrera
ec0c5ea045 mcs_backup_manager.sh - typo in comments of bsl license 2024-01-23 19:52:47 +03:00
Allen Herrera
10c953fcf3 add bsl license to mcs_backup_manager.sh + skip removing locks when poll_wait fails 2024-01-23 19:52:47 +03:00
Allen Herrera
3643a2e401 updated columnstore_backup.sh -> mcs_backup_manager.sh 2024-01-23 19:52:47 +03:00