1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-07-29 08:21:15 +03:00

6351 Commits

Author SHA1 Message Date
3b7e69135d Fixes MCOL-5700, Oracle mode test results
This changeset contains fixes in Oracle mode tests and for the
implementation of the CONCAT_ORACLE. Also, we harmonise our
translation process with the recent changes in the server.

Due to changed behavior of the server, some CREATE VIEW/EXPLAIN
statements' results begun to output unexpected results and need to be
fixed.

Also, concatenation operation's name also changed. This lead to
disabled func_concat_oracle test to be enabled to test it and it
turned out that our implementation of this function was broken
and need to be fixed too.
2024-04-15 19:35:21 +03:00
80ef84d4fd Merge pull request #3166 from mariadb-corporation/MCOL-5328-qa-test
Add qa test for MCOL-5328
2024-04-12 20:30:13 +05:30
28b957915d Add qa test for MCOL-5328 2024-04-12 11:10:50 +00:00
6844923b9a feat(cmapi,cli): MCOL-5618: Add backup, restore, backup-dbrm, restore-dbrm commands for mcs cli tool. (#3130)
* MCOL-5618: Add backup, restore, backup-dbrm, restore-dbrm commands for mcs cli tool.

[add] mcs_cluster_tool/helpers.py file with cook_sh_arg function inside
[add] MCS_BACKUP_MANAGER_SH to mcs_cluster_tool/constants.py
[add] backup and restore commands to "mcs" Typer APP

* MCOL-5618: Move mcs_backup_manager.sh to cmapi/scripts.

* MCOL-5618: Install mcs_backup_manager.sh with CMAPI package.
2024-04-01 16:51:38 +03:00
77cd733a6d fix(plugin): MCOL-5236 Take Item from Ref_Item for group by list. (#3162) 2024-04-01 14:13:39 +03:00
197acba704 Merge pull request #3158 from mariadb-corporation/revert-3156-sz-fix-oracle-mode
Revert "Fixes MCOL-5700, Oracle mode test results"
2024-03-27 17:58:57 +03:00
af5ae35413 Revert "Fixes MCOL-5700, Oracle mode test results" 2024-03-27 18:52:30 +04:00
56b35d5cf6 Merge pull request #3156 from mariadb-corporation/sz-fix-oracle-mode
Fixes MCOL-5700, Oracle mode test results
2024-03-27 14:45:52 +06:00
34acd3559b Fixes MCOL-5700, Oracle mode test results
This changeset contains fixes in Oracle mode tests and for the
implementation of the CONCAT_ORACLE. Also, we harmonise our
translation process with the recent changes in the server.

Due to changed behavior of the server, some CREATE VIEW/EXPLAIN
statements' results begun to output unexpected results and need to be
fixed.

Also, concatenation operation's name also changed. This lead to
disabled func_concat_oracle test to be enabled to test it and it
turned out that our implementation of this function was broken
and need to be fixed too.
2024-03-27 10:00:39 +03:00
444cf4c65e fix(aggregation, disk-based) MCOL-5691 distinct aggregate disk based (#3145)
* fix(aggregation, disk-based): MCOL-5689 this fixes disk-based distinct aggregation functions
Previously disk-based distinct aggregation functions produced incorrect results b/c there was no finalization applied for previous generations stored on disk.

*  fix(aggregation, disk-based): Fix disk-based COUNT(DISTINCT ...) queries. (Case 2). (Distinct & Multi-Distinct, Single- & Multi-Threaded).

* fix(aggregation, disk-based): Fix disk-based DISTINCT & GROUP BY queries. (Case 1). (Distinct & Multi-Distinct, Single- & Multi-Threaded).

---------

Co-authored-by: Theresa Hradilak <theresa.hradilak@gmail.com>
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2024-03-26 00:39:53 +03:00
8cb7bc8e54 Boost version for Awwor 2024-03-25 19:54:39 +03:00
9fe6efe84a chore(arrow) bump apache arrow version and fix test load generator for memory usage (#3149)
* bump apache arrow version and fix test load generator for memory usage
* limit arrow simd by SSE4.2
2024-03-22 20:47:55 +04:00
49757ba8d5 Merge pull request #3132 from mariadb-SergeyZefirov/MCOL-5035-update-inserts-null-for-all-zeroes-date
Fix MCOL-5035, a difference in INSERT and UPDATE behavior
2024-03-21 10:12:18 +03:00
7a2ca9d6bc MCOL-4480: TEXT type added (#3142)
* TEXT type added
* tests
2024-03-21 00:26:35 +04:00
5780bfa15f Fix MCOL-5035, a difference in INSERT and UPDATE behavior
The UPDATE statement wrote NULL when the column set is DATETIME and
value is '0000-00-00 00:00:00'. The problem was inside WriteEngine's
handling of UPDATE statements and this is where heart of change is.

Other changes are related to some obsolete data structures in DML/DDL
handling that just hanging around there, doing nothing.
2024-03-19 12:44:22 +03:00
5f40fb32d0 MCOL-5328: use PCRE2 and JPCRE wrapper (#3137)
PCRE2 for regexp functions in columnstore
2024-03-14 19:39:29 +04:00
c01e1f4ed8 Use of newly introduced schema-based name resolution for (#3138)
Oracle-compatible functions
Server changed the way to resolve functions' names and we need to adapt.
2024-03-11 19:17:46 +04:00
8f91029f6a Merge pull request #3133 from mariadb-corporation/test_mcs_50_fix
Update mcs50_cpimport_stdin.test
2024-02-26 21:05:25 +06:00
3e73af331d Update mcs50_cpimport_stdin.test 2024-02-26 20:31:34 +06:00
dec8350f0e MCOL-5594: Interactive "mcs cluster stop" command for CMAPI. (#3024)
* MCOL-5594: Interactive "mcs cluster stop" command for CMAPI.

[add] NodeProcessController class to handle Node operations
[add] two endpoints: stop_dmlproc (PUT) and is_process_running (GET)
[add] NodeProcessController.put_stop_dmlproc method to separately stop DMLProc on primary Node
[add] NodeProcessController.get_process_running method to check if specified process running or not
[add] build_url function to helpers.py. It needed to build urls with query_params
[add] MCSProcessManager.gracefully_stop_dmlproc method
[add] MCSProcessManager.is_service_running method as a top level wrapper to the same method in dispatcher
[fix] MCSProcessManager.stop by using new gracefully_stop_dmlproc
[add] interactive option and mode to mcs cluster stop command
[fix] requirements.txt with typer version to 0.9.0 where supports various of features including "Annotated"
[fix] requirements.txt click version (8.1.3 -> 8.1.7) and typing-extensions (4.3.0 -> 4.8.0). This is dependencies for typer package.
[fix] multiple minor formatting, docstrings and comments

* MCOL-5594: Add new CMAPI transaction manager.

- [add] TransactionManager ContextDecorator to manage transactions in less code and in one place
- [add] TransactionManager to cli cluster stop command and to API cluster shutdown command
- [fix] id -> txn_id in ClusterHandler class
- [fix] ClusterHandler.shutdown class to use inside existing transaction
- [add] docstrings in multiple places

* MCOL-5594: Review fixes.
2024-02-23 21:40:50 +03:00
ed9ec93358 mcs_backup_manager rename -vs-ssl to -nv-ssl 2024-02-15 05:31:52 +03:00
8ac8d08d48 added short hand versions of some variables and small fixes to parameter naming - vs _ 2024-02-15 05:31:52 +03:00
83c2408f8d fix(join, threadpool): MCOL-5565: MCOL-5636: MCOL-5645: port from develop-23.02 to [develop] (#3128)
* fix(threadpool): MCOL-5565 queries stuck in FairThreadScheduler. (#3100)

Meta Primitive Jobs, .e.g ADD_JOINER, LAST_JOINER stuck
	in Fair scheduler without out-of-band scheduler. Add OOB
	scheduler back to remedy the issue.

* fix(messageqcpp): MCOL-5636 same node communication crashes transmiting PP errors to EM b/c error messaging leveraged socket that was a nullptr. (#3106)

* fix(threadpool): MCOL-5645 errenous threadpool Job ctor implictly sets socket shared_ptr to nullptr causing sigabrt when threadpool returns an error (#3125)

---------

Co-authored-by: drrtuy <roman.nozdrin@mariadb.com>
2024-02-13 19:01:16 +03:00
fcd46ab00a fix(DEC): MCOL-5637 Initialize a new bytestream before write to PS (#3118) 2024-02-09 22:27:14 +03:00
ebcf43a517 fix(join, disk-based): MCOL-5597: large side read errors (#3117)
The large side read errors mentioned there can be due to failure to
close file stream properly. Some of the data may still reside in the
file stream buffers, closing must flush it. The flush is an I/O
operation and can fail, leading to partial write and subsequent partial
read.

This patch tries to provide better diagnostics.
2024-02-09 22:25:43 +03:00
8de4eec362 MCOL-5650: CMAPI python3 binary crash. (#3122)
[fix] python prebuilded interpreter to interpreter without AVX512 instructions
2024-02-09 22:19:08 +03:00
1e8172f74b MCOL-5338: Fixed issue related to mcs-loadbrm. (#3107)
[fix] eventually wrong logging messages format
2024-02-05 21:27:57 +03:00
9681841cfc added comments to functions for next release 2024-01-23 19:52:47 +03:00
aa6b68aacc update to latest version of mcs backup manager with PR comments addressed 2024-01-23 19:52:47 +03:00
f57bdb6d2e update mcs_backup_manager.sh - add ubuntu/debian support 2024-01-23 19:52:47 +03:00
ec0c5ea045 mcs_backup_manager.sh - typo in comments of bsl license 2024-01-23 19:52:47 +03:00
10c953fcf3 add bsl license to mcs_backup_manager.sh + skip removing locks when poll_wait fails 2024-01-23 19:52:47 +03:00
3643a2e401 updated columnstore_backup.sh -> mcs_backup_manager.sh 2024-01-23 19:52:47 +03:00
2740e33c5b added first backup restore test 2024-01-23 19:52:47 +03:00
7259b0c693 feat(tooling): add rhel support in cs_package_manager.sh (#3105) 2024-01-12 10:53:24 +03:00
0d1c72a563 compilation fix for gcc12 on known gcc bug https://gcc.gnu.org/bugzilla/show_bug.cgi?id=105329 2024-01-04 11:43:03 +03:00
72a4f916cf Update boost to 1.84 2024-01-04 11:43:03 +03:00
d226c85fc5 MCOL-5630: fix multi node MTR. Typer dependency bump version.
- [fix] requirements.txt to bump typer and indirect dependencies versions
2024-01-02 12:14:41 +03:00
49abbb4d7e MCOL-5630: fix multi node MTR. Add "cmapi is-ready" cli command.
This task is a next logical part of MCOL-5470 that implements AppManager and API endpoint
to check if CMAPI ready or not.

- [add] cmapi_app.py with is-ready command implementation
- [fix] add cmapi is-ready command to main typer app
2023-12-28 15:17:15 +03:00
318db3ef84 feat(brm): MCOL-5623 This patch changes the logic applied to save function for EM (#3076) 2023-12-27 09:48:29 +03:00
7ca4b9da32 feat(brm): MCOL-5631 Optimize BRM load operation. (#3085) 2023-12-27 09:43:27 +03:00
4fa937c086 remove boost from deps, add procsps, due without ps installation halts (#3063) 2023-12-26 15:46:05 +04:00
e5385fdde7 MCOL-5610: Aliases on internally dependent tools. (#3026)
[add] mcs_aws and mcs_gsutil template files
[fix] cmapi CMakeLists to add mcs_aws and mcs_gsutil tools to usr/bin folder
2023-12-26 15:29:40 +04:00
c6e9b7d448 MCOL-5624: dont force columnstore_use_import_for_batchinsert option to be required to start mariadb server (#3078) 2023-12-26 15:12:01 +04:00
4fbf5ff78d Update cs package manager dev ubuntu (#3060)
* cs_package_manager.sh - fix ubuntu dev installs

* cs_package_manager.sh - remove some useless comments

* debian/ubuntu dev install to use drone repo + remove wget dependancy

* + exits if repo files missing

* auto install aws cli for dev builds

* removed commented section from cs_package_manager
2023-12-22 04:42:22 +04:00
588480c88d installation env helper 2023-12-21 16:45:32 +03:00
063fa27c77 Brief instruction for CI packages 2023-12-21 16:45:32 +03:00
4d7a6a0be5 perf(primproc) MCOL-5601: Initilize two fields once in ctor instead of calling makeConfig
std::string fTmpDir = config::Config::makeConfig()->getTempFileDir(config::Config::TempDirPurpose::Aggregates);
std::string fCompStr = config::Config::makeConfig()->getConfig("RowAggregation", "Compression");
2023-12-19 15:25:19 +03:00
9d5ad925eb fix(linkage) link libm to libmarias3 2023-12-18 14:10:14 +03:00
fadb102712 fix(writeengine) MCOL-4202: use schema name when renaming table and change it's fields in syscat 2023-12-18 09:59:38 +03:00