database/mariadb-columnstore-engine
1
0
Fork 0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-11-03 17:13:17 +03:00
Code Activity
6,852 Commits 383 Branches 90 Tags
cmapi-json-in-out-by-default
Commit Graph

644 Commits

Author SHA1 Message Date
drrtuy
a8909a27a9 fix(shmem,brm,scripts): mcs-savebrm.py wrapper now cleans shmem locks before calling save_brm. mcs-shmem-locks now has --reset-all flag 2025-09-24 22:52:11 +04:00
Alexander Presnyakov
384dd56a61 Moved locks cleanup into cmapi 2025-09-09 17:23:20 +04:00
Alexander Presnyakov
c75a095a77 Support older systemd versions 2025-09-09 17:23:20 +04:00
Alexander Presnyakov
48e14ed5e5 MCOL-6094: reset shmem locks before stopping workernode 2025-09-09 17:23:20 +04:00
Leonid Fedorov
28517a8fb9 chore(ci): Run basic MTR with no extern as the Jenkins does 2025-07-31 22:51:14 +04:00
Leonid Fedorov
82421c208f chore(ci): collect asan ubsan and libc++ build with mtr and regression status ignored (#3672) 
* MSan added with fixes for libc++

* libc++ sepatare build

* add libc++ to ci

* libstdc++ in CI

* libcpp and msan to external projects

* std::sqrt

* awful_hack(ci): install whole llvm instead of libc++ in terrible way for test containers

* Adding ddeb packages for teststages and repos

* libc++ more for test container

* save some money on debug

* colored coredumps

* revert ci

* chore(ci): collect asan ubsan and libc++ build with mtr and regression status ignored
 2025-07-31 00:32:32 +04:00
Leonid Fedorov
b1ecea0957 Fix config files in packages for sanitizers, do not abort on errors for packages 
add options for ASAN via code linkage
 2025-07-28 20:08:41 +04:00
Leonid Fedorov
1384cf64aa Revert "chore(install): no more deps for awk and ps for postinstall script" 
This reverts commit a0c861adbb.
 2025-06-24 22:18:36 +04:00
Leonid Fedorov
a0c861adbb chore(install): no more deps for awk and ps for postinstall script 2025-06-13 13:44:16 +01:00
Leonid Fedorov
aa7e0fb9b4 Deep build refactoring phase 1 (#3562) 
* configcpp refactored
* logging and datatypes refactored

* more dataconvert
* chore(build): massive removals, auto add files to debian install file
* chore(codemanagement): nodeps headers, potentioal library
* chore(build): configure before autobake
* chore(build): use custom cmake commands for components, mariadb-plugin-columnstore.install generated
* chore(build): install deps as separate step for build-packages
* more deps
* check  debian/mariadb-plugin-columnstore.install automatically
* chore(build): add option for multibracnh compilation
* Fix warning
 2025-05-30 14:05:21 +04:00
Leonid Fedorov
a1019b7c0e chore(build): refactor main CMakeLists.txt (#3543) 
* chore(build): refactor main CMakeLists.txt

* chore(build): fix boost version for packages, set clang-20 only for amd and arm

* chore(build): boost 4 sm

* chore(build): boost dep for rowgroup

* chore(build): toolset for boost

* chore(build): suppress clang warnings for boost

* chore(ci, build): use ASAN for unittest on ubuntu 24.04 only, added custom cmake flag option for bootstrap, custom params for new and existing pipelines

* chore(build): sort bootstrap flags

* chore(CI): remove publish pkg step, adding clickable link instead to publish steps, fix customenv
 2025-05-20 05:00:48 +04:00
Allen Herrera
07be8e3fa1 feat(installation): MCOL-4886 skip chown if top folder permissions good (#3093) 
* MCOL-4886 skip chown if top folder permissions good

* remove '-type f' check permissions of directories too
 2025-04-01 18:03:07 +04:00
Denis Khalikov
7b25f1bee4 fix(build): Fixing build for S3 with "LocalStorage" type. 2025-04-01 18:03:07 +04:00
Alan Mologorsky
e531ec49fc fix(CMAPI): reduce timeout value for couple CMAPI endpoints (#3153) 
* Minor fix in timeout for /notfound "endpoint" call.

- [fix] timeout to urlopen /notfound "endpoint" in mcs-savebrm and mcs-loadbrm

* chore(CMAPI): reduced a second Time Out asking MDB for a async replication status. The latency must be small b/c MDB Server to be requested is local.

---------

Co-authored-by: drrtuy <drrtuy@gmail.com>
 2025-04-01 18:03:07 +04:00
Alan Mologorsky
e639138a7b MCOL-5338: Fixed issue related to mcs-loadbrm. (#3107) 
[fix] eventually wrong logging messages format
 2025-04-01 18:03:07 +04:00
Sergei Golubchik
54c6b7352e don't add new build dependencies 
and particularly, *not for unit tests*
 2024-08-05 20:39:38 +04:00
Leonid Fedorov
cd626ac8a0 fix(): MCOL-5587: revert quick mode due the interactive console bug (#3255) 2024-07-30 13:40:49 +01:00
Roman Nozdrin
8a0d2654c9 fix(mcs-savebrm): replace debug with error to put mcs-savebrm.py log messages in order 2024-07-25 21:02:54 +04:00
Sergey Zefirov
7f0c281518 fix(client): MCOL-5587: enable quick mode for predictable performance (#3240) (#3243) 
This changeset enables quick (mariadb -q) mode when columnstore is
installed. Quick mode precludes client CLI program from storing too
much data in memory, preventing out of memory conditions.
 2024-07-11 19:05:36 +01:00
Alan Mologorsky
2c44af30c7 fix(save-brm): MCOL-5709: Review fix. (#3207) (#3210) 
[fix] if file_path_prefix is None throwing TypeError
 2024-06-21 12:47:34 +01:00
Alan Mologorsky
e6c02c8832 feat(save_brm)!: MCOL-5709: protect from S3/NFS IO errors (#3206) 
* feat(save_brm)!: protect from S3/NFS IO errors

* feat(save_brm)!: future refactoring

* cleanup

* feat(save_brm)!: forgotten template

* feat(save-brm,ci)!: python3 package for rocky8

---------

Co-authored-by: Roman Nozdrin <roman.nozdrin@mariadb.com>
 2024-06-18 18:41:43 +01:00
drrtuy
426557380c fix(cmapi, brm): MCOL-5535 Use an accurate glob when forcing owner of files in /dev/shm on startup (#2923) 
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
 2023-08-11 20:04:12 +03:00
mariadb-AlanMologorsky
66ec9f039b MCOL-5553: Not running save_brm on a single node without CMAPI. 
[add] LOCALHOSTS tuple to mcs-savebrm script
[fix] detecting primary when no working CMAPI found
 2023-08-11 18:22:59 +03:00
drrtuy
385e580e9c MCOL-5175 Bump overlooked libmariaS3 and added more ENV variables to fine tune initial installation on S3 (#2870) 
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
 2023-06-27 17:33:39 +03:00
Leonid Fedorov
8f93fc3623 MCOL-5493: First portion of UBSan fixes (#2842) 
Multiple UB fixes
 2023-06-02 17:02:09 +03:00
Gagan Goel
a388d691ac [serg changes] mcs-savebrm.py: don't abort with "[Errno 1] Unknown host". 2023-05-08 18:56:29 +00:00
Leonid Fedorov
3ce19abdae Options to build with TSAN, UBSAN and skipping smoke (#2826) 2023-04-21 21:24:48 +03:00
Leonid Fedorov
2e1394149b MCOL-5464: Fixes of bugs from ASAN warnings, part one (#2792) 
* Fixes of bugs from ASAN warnings, part one

* MQC as static library, with nifty counter for global map and mutex

* Switch clang to 16

* link messageqcpp to execplan
 2023-04-04 02:33:23 +03:00
Leonid Fedorov
e6127ab9bc MCOL-5242: fix Columnstore tmp_files dir owner (#2731) 
* When dbrmroot created, it has columnstore_tmp_files as parent, and this parent was still with root owner

* Change f-string to format
 2023-02-21 22:04:20 +03:00
Leonid Fedorov
6d81cde000 Typo errpr (#2671) 2022-12-20 21:21:09 +03:00
mariadb-AlanMologorsky
0ad8c7e758 MCOL-5302: Fix brm-save to prevent overwrites Extent Map files multiple times with shared(non-S3) storage setup. 
[fix] oam/install_scripts/mcs-savebrm.py.in , now everytime using method to detect primary node
[fix] condition style in oam/install_scripts/mcs-loadbrm.py.in
 2022-11-24 21:59:02 +04:00
Andrey Piskunov
96c40d5081 Add core dumps and stack trace (#2604) 
* Add core dumps and stack trace
 2022-11-22 03:29:34 +03:00
mariadb-AlanMologorsky
0ee1d94f71 MCOL-5218: Additional fix to mcs-loadbrm and mcs-savebrm + postinstall. 
[fix] bug in detecting primary.
[fix] minor bugs.
[add] not getting meta on secondaries if no cmapi available on primary node.
[fix] postinstall script to mask mariadb-columnstore service on multinode configurations.
 2022-09-23 22:01:16 +03:00
mariadb-AlanMologorsky
70c850ca71 MCOL-5218: Fix mcs-loadbrm nd mcs-savebrm service run while reisntall. 
Removed "requests" external python dependency to keep working with preinstalled python3.
Add fallback to detect primary if CMAPI is unreachable with hostname resolving.
Fix various minor python code styling.

f
 2022-09-23 04:11:36 +03:00
Roman Nozdrin
8b15e2f6a4 Merge pull request #2490 from benthompson15/MCOL-5163-dev 
MCOL-5163: remove systemd coupling of processes.
 2022-08-09 14:44:10 +03:00
mariadb-AlanMologorsky
7de8589139 MCOL-5174: Create bash script to restart processes in a loop. 
[add] loop_process_starter.sh to oam/install_scripts
[fix] oam/install_scripts/CMakeLists.txt
 2022-08-05 17:37:52 +03:00
benthompson15
fd2ebba6de MCOL-5163: remove systemd coupling of processes. 2022-08-04 18:04:42 -05:00
Roman Nozdrin
dc82c080f6 MCOL-5097 This patch fixes bash syntax issue and removes ExeMgr systemd unit on post-install 2022-07-08 07:53:34 +02:00
benthompson15
652c9299b7 MCOL-4989: Fix error handling for misconfigured StorageManager startup. (#2385) 2022-06-02 08:50:41 -05:00
Roman Nozdrin
4e46645124 Merge pull request #2398 from drrtuy/MCOL-5060-post-install-containers-dev 
MCOL-5060 Fixes post-install script failures in containers
 2022-05-31 14:20:32 +05:30
Roman Nozdrin
c89864c37d MCOL-5060 Fixes post-install script failures in containers 2022-05-30 11:41:09 +00:00
Roman Nozdrin
965ca1ca26 MCOL-5105 DMLProc startup/shutdown timeouts affect rollback and graceful shutdown cases, workernode shutdown timeout affects save_brm (#2391) 2022-05-27 13:35:56 -05:00
Roman Nozdrin
7453db6b02 MCOL-5001 This patch removes ExeMgr traces 2022-04-04 12:50:42 +00:00
Roman Nozdrin
e174696351 MCOL-5001 This patch merges ExeMgr and PrimProc runtimes 
EM and PP are most resource-hungry runtimes.
        The merge enables to control their cummulative
        resource consumption, thread allocation + enables
        zero-copy data exchange b/w local EM and PP facilities.
 2022-04-04 11:46:33 +00:00
benthompson15
64a6b8a041 MCOL-4965: upgrade breaks trying to use deprecated autoConfigure executable. (#2243) 2022-02-03 16:41:43 -06:00
Roman Nozdrin
b5d500e97b MCOL-4094 shell test argument quotation fix (#2246) 
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
 2022-02-03 16:14:47 -06:00
Roman Nozdrin
22b0e4addc MCOL-4943 Moved SQL script call into columnstore-post-install 2021-12-18 03:59:58 +00:00
Roman Nozdrin
199d89f681 MCOL-4832 Removing needless error output 2021-12-15 10:35:03 +00:00
David Hall
1d2114a0d5 MCOL-4751: done run mycnfUpgrade anymore just reuse existing cnf if possible 2021-08-05 11:12:17 -05:00
benthompson15
21e6e88d0f MCOL-4751: autoConfigure to run in post-install on files in correct paths. 2021-08-05 11:11:54 -05:00