1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-04-18 21:44:02 +03:00

6347 Commits

Author SHA1 Message Date
Denis Khalikov
77cd733a6d
fix(plugin): MCOL-5236 Take Item from Ref_Item for group by list. (#3162) 2024-04-01 14:13:39 +03:00
Sergey Zefirov
197acba704
Merge pull request #3158 from mariadb-corporation/revert-3156-sz-fix-oracle-mode
Revert "Fixes MCOL-5700, Oracle mode test results"
2024-03-27 17:58:57 +03:00
Leonid Fedorov
af5ae35413
Revert "Fixes MCOL-5700, Oracle mode test results" 2024-03-27 18:52:30 +04:00
mariadb-KirillPerov
56b35d5cf6
Merge pull request #3156 from mariadb-corporation/sz-fix-oracle-mode
Fixes MCOL-5700, Oracle mode test results
2024-03-27 14:45:52 +06:00
Serguey Zefirov
34acd3559b Fixes MCOL-5700, Oracle mode test results
This changeset contains fixes in Oracle mode tests and for the
implementation of the CONCAT_ORACLE. Also, we harmonise our
translation process with the recent changes in the server.

Due to changed behavior of the server, some CREATE VIEW/EXPLAIN
statements' results begun to output unexpected results and need to be
fixed.

Also, concatenation operation's name also changed. This lead to
disabled func_concat_oracle test to be enabled to test it and it
turned out that our implementation of this function was broken
and need to be fixed too.
2024-03-27 10:00:39 +03:00
drrtuy
444cf4c65e fix(aggregation, disk-based) MCOL-5691 distinct aggregate disk based (#3145)
* fix(aggregation, disk-based): MCOL-5689 this fixes disk-based distinct aggregation functions
Previously disk-based distinct aggregation functions produced incorrect results b/c there was no finalization applied for previous generations stored on disk.

*  fix(aggregation, disk-based): Fix disk-based COUNT(DISTINCT ...) queries. (Case 2). (Distinct & Multi-Distinct, Single- & Multi-Threaded).

* fix(aggregation, disk-based): Fix disk-based DISTINCT & GROUP BY queries. (Case 1). (Distinct & Multi-Distinct, Single- & Multi-Threaded).

---------

Co-authored-by: Theresa Hradilak <theresa.hradilak@gmail.com>
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2024-03-26 00:39:53 +03:00
Leonid Fedorov
8cb7bc8e54 Boost version for Awwor 2024-03-25 19:54:39 +03:00
Leonid Fedorov
9fe6efe84a
chore(arrow) bump apache arrow version and fix test load generator for memory usage (#3149)
* bump apache arrow version and fix test load generator for memory usage
* limit arrow simd by SSE4.2
2024-03-22 20:47:55 +04:00
Sergey Zefirov
49757ba8d5
Merge pull request #3132 from mariadb-SergeyZefirov/MCOL-5035-update-inserts-null-for-all-zeroes-date
Fix MCOL-5035, a difference in INSERT and UPDATE behavior
2024-03-21 10:12:18 +03:00
Leonid Fedorov
7a2ca9d6bc
MCOL-4480: TEXT type added (#3142)
* TEXT type added
* tests
2024-03-21 00:26:35 +04:00
Serguey Zefirov
5780bfa15f Fix MCOL-5035, a difference in INSERT and UPDATE behavior
The UPDATE statement wrote NULL when the column set is DATETIME and
value is '0000-00-00 00:00:00'. The problem was inside WriteEngine's
handling of UPDATE statements and this is where heart of change is.

Other changes are related to some obsolete data structures in DML/DDL
handling that just hanging around there, doing nothing.
2024-03-19 12:44:22 +03:00
Leonid Fedorov
5f40fb32d0
MCOL-5328: use PCRE2 and JPCRE wrapper (#3137)
PCRE2 for regexp functions in columnstore
2024-03-14 19:39:29 +04:00
Sergey Zefirov
c01e1f4ed8
Use of newly introduced schema-based name resolution for (#3138)
Oracle-compatible functions
Server changed the way to resolve functions' names and we need to adapt.
2024-03-11 19:17:46 +04:00
mariadb-KirillPerov
8f91029f6a
Merge pull request #3133 from mariadb-corporation/test_mcs_50_fix
Update mcs50_cpimport_stdin.test
2024-02-26 21:05:25 +06:00
mariadb-KirillPerov
3e73af331d
Update mcs50_cpimport_stdin.test 2024-02-26 20:31:34 +06:00
Alan Mologorsky
dec8350f0e
MCOL-5594: Interactive "mcs cluster stop" command for CMAPI. (#3024)
* MCOL-5594: Interactive "mcs cluster stop" command for CMAPI.

[add] NodeProcessController class to handle Node operations
[add] two endpoints: stop_dmlproc (PUT) and is_process_running (GET)
[add] NodeProcessController.put_stop_dmlproc method to separately stop DMLProc on primary Node
[add] NodeProcessController.get_process_running method to check if specified process running or not
[add] build_url function to helpers.py. It needed to build urls with query_params
[add] MCSProcessManager.gracefully_stop_dmlproc method
[add] MCSProcessManager.is_service_running method as a top level wrapper to the same method in dispatcher
[fix] MCSProcessManager.stop by using new gracefully_stop_dmlproc
[add] interactive option and mode to mcs cluster stop command
[fix] requirements.txt with typer version to 0.9.0 where supports various of features including "Annotated"
[fix] requirements.txt click version (8.1.3 -> 8.1.7) and typing-extensions (4.3.0 -> 4.8.0). This is dependencies for typer package.
[fix] multiple minor formatting, docstrings and comments

* MCOL-5594: Add new CMAPI transaction manager.

- [add] TransactionManager ContextDecorator to manage transactions in less code and in one place
- [add] TransactionManager to cli cluster stop command and to API cluster shutdown command
- [fix] id -> txn_id in ClusterHandler class
- [fix] ClusterHandler.shutdown class to use inside existing transaction
- [add] docstrings in multiple places

* MCOL-5594: Review fixes.
2024-02-23 21:40:50 +03:00
Allen Herrera
ed9ec93358 mcs_backup_manager rename -vs-ssl to -nv-ssl 2024-02-15 05:31:52 +03:00
Allen Herrera
8ac8d08d48 added short hand versions of some variables and small fixes to parameter naming - vs _ 2024-02-15 05:31:52 +03:00
Leonid Fedorov
83c2408f8d
fix(join, threadpool): MCOL-5565: MCOL-5636: MCOL-5645: port from develop-23.02 to [develop] (#3128)
* fix(threadpool): MCOL-5565 queries stuck in FairThreadScheduler. (#3100)

Meta Primitive Jobs, .e.g ADD_JOINER, LAST_JOINER stuck
	in Fair scheduler without out-of-band scheduler. Add OOB
	scheduler back to remedy the issue.

* fix(messageqcpp): MCOL-5636 same node communication crashes transmiting PP errors to EM b/c error messaging leveraged socket that was a nullptr. (#3106)

* fix(threadpool): MCOL-5645 errenous threadpool Job ctor implictly sets socket shared_ptr to nullptr causing sigabrt when threadpool returns an error (#3125)

---------

Co-authored-by: drrtuy <roman.nozdrin@mariadb.com>
2024-02-13 19:01:16 +03:00
Denis Khalikov
fcd46ab00a
fix(DEC): MCOL-5637 Initialize a new bytestream before write to PS (#3118) 2024-02-09 22:27:14 +03:00
Sergey Zefirov
ebcf43a517
fix(join, disk-based): MCOL-5597: large side read errors (#3117)
The large side read errors mentioned there can be due to failure to
close file stream properly. Some of the data may still reside in the
file stream buffers, closing must flush it. The flush is an I/O
operation and can fail, leading to partial write and subsequent partial
read.

This patch tries to provide better diagnostics.
2024-02-09 22:25:43 +03:00
Alan Mologorsky
8de4eec362
MCOL-5650: CMAPI python3 binary crash. (#3122)
[fix] python prebuilded interpreter to interpreter without AVX512 instructions
2024-02-09 22:19:08 +03:00
Alan Mologorsky
1e8172f74b
MCOL-5338: Fixed issue related to mcs-loadbrm. (#3107)
[fix] eventually wrong logging messages format
2024-02-05 21:27:57 +03:00
Allen Herrera
9681841cfc added comments to functions for next release 2024-01-23 19:52:47 +03:00
Allen Herrera
aa6b68aacc update to latest version of mcs backup manager with PR comments addressed 2024-01-23 19:52:47 +03:00
Allen Herrera
f57bdb6d2e update mcs_backup_manager.sh - add ubuntu/debian support 2024-01-23 19:52:47 +03:00
Allen Herrera
ec0c5ea045 mcs_backup_manager.sh - typo in comments of bsl license 2024-01-23 19:52:47 +03:00
Allen Herrera
10c953fcf3 add bsl license to mcs_backup_manager.sh + skip removing locks when poll_wait fails 2024-01-23 19:52:47 +03:00
Allen Herrera
3643a2e401 updated columnstore_backup.sh -> mcs_backup_manager.sh 2024-01-23 19:52:47 +03:00
Allen Herrera
2740e33c5b added first backup restore test 2024-01-23 19:52:47 +03:00
Allen Herrera
7259b0c693
feat(tooling): add rhel support in cs_package_manager.sh (#3105) 2024-01-12 10:53:24 +03:00
Leonid Fedorov
0d1c72a563 compilation fix for gcc12 on known gcc bug https://gcc.gnu.org/bugzilla/show_bug.cgi?id=105329 2024-01-04 11:43:03 +03:00
Leonid Fedorov
72a4f916cf Update boost to 1.84 2024-01-04 11:43:03 +03:00
mariadb-AlanMologorsky
d226c85fc5 MCOL-5630: fix multi node MTR. Typer dependency bump version.
- [fix] requirements.txt to bump typer and indirect dependencies versions
2024-01-02 12:14:41 +03:00
mariadb-AlanMologorsky
49abbb4d7e MCOL-5630: fix multi node MTR. Add "cmapi is-ready" cli command.
This task is a next logical part of MCOL-5470 that implements AppManager and API endpoint
to check if CMAPI ready or not.

- [add] cmapi_app.py with is-ready command implementation
- [fix] add cmapi is-ready command to main typer app
2023-12-28 15:17:15 +03:00
Denis Khalikov
318db3ef84
feat(brm): MCOL-5623 This patch changes the logic applied to save function for EM (#3076) 2023-12-27 09:48:29 +03:00
Denis Khalikov
7ca4b9da32
feat(brm): MCOL-5631 Optimize BRM load operation. (#3085) 2023-12-27 09:43:27 +03:00
Leonid Fedorov
4fa937c086
remove boost from deps, add procsps, due without ps installation halts (#3063) 2023-12-26 15:46:05 +04:00
Alan Mologorsky
e5385fdde7
MCOL-5610: Aliases on internally dependent tools. (#3026)
[add] mcs_aws and mcs_gsutil template files
[fix] cmapi CMakeLists to add mcs_aws and mcs_gsutil tools to usr/bin folder
2023-12-26 15:29:40 +04:00
Leonid Fedorov
c6e9b7d448
MCOL-5624: dont force columnstore_use_import_for_batchinsert option to be required to start mariadb server (#3078) 2023-12-26 15:12:01 +04:00
Allen Herrera
4fbf5ff78d
Update cs package manager dev ubuntu (#3060)
* cs_package_manager.sh - fix ubuntu dev installs

* cs_package_manager.sh - remove some useless comments

* debian/ubuntu dev install to use drone repo + remove wget dependancy

* + exits if repo files missing

* auto install aws cli for dev builds

* removed commented section from cs_package_manager
2023-12-22 04:42:22 +04:00
Leonid Fedorov
588480c88d installation env helper 2023-12-21 16:45:32 +03:00
Leonid Fedorov
063fa27c77 Brief instruction for CI packages 2023-12-21 16:45:32 +03:00
Leonid Fedorov
4d7a6a0be5 perf(primproc) MCOL-5601: Initilize two fields once in ctor instead of calling makeConfig
std::string fTmpDir = config::Config::makeConfig()->getTempFileDir(config::Config::TempDirPurpose::Aggregates);
std::string fCompStr = config::Config::makeConfig()->getConfig("RowAggregation", "Compression");
2023-12-19 15:25:19 +03:00
Leonid Fedorov
9d5ad925eb fix(linkage) link libm to libmarias3 2023-12-18 14:10:14 +03:00
Leonid Fedorov
fadb102712 fix(writeengine) MCOL-4202: use schema name when renaming table and change it's fields in syscat 2023-12-18 09:59:38 +03:00
Denis Khalikov
74c1a38f2c
fix(disk-based-join): MCOL-5626 Fix for race in DJS with outer join. (#3064) 2023-12-15 11:20:27 +03:00
Allen Herrera
fb496644f8 update columnstore_review.sh to v1.4.4 - smls and kernal ulimits+ added to --logs 2023-12-12 17:42:39 +03:00
Serguey Zefirov
1f958c9ed2 MCOL-5625: Fixes json_query implementation
Also extends func_json_value.test.
2023-12-12 15:45:03 +03:00
Leonid Fedorov
29447430eb fix dependency on upgrade logs 2023-12-08 22:41:12 +03:00