1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-05 16:15:50 +03:00
Commit Graph

6391 Commits

Author SHA1 Message Date
aleksei.bukhalov
ddbed4eacc MCOL-5966 set pipefail so that build step will fail if bootstrap_mcs fails 2025-04-15 16:19:27 +04:00
Leonid Fedorov
4b17d1aa02 errorcode check + shell formatting applied 2025-04-15 16:19:27 +04:00
mariadb-AlanMologorsky
7c27d803ba feat(cmapi, mcs): MCOL-5525 Single start command for Single Node.
* feat(mcs): new mcs bootstrap-single-node command added into tools pane
2025-04-15 04:57:12 +03:00
drrtuy
727627a012 fix(BRM): removes load_brm extra printouts (#3489) 2025-04-14 15:14:09 +01:00
Leonid Fedorov
c294c64bb0 chore(tests) lowercase database name due different distro settings 2025-04-11 19:10:37 +04:00
Aleksei Antipovskii
aa5f4fc5e7 fix(aggregation): fix dumping RGDatas to disk
`amount` parameter of `RGData::serialize` is the raw size of `rowData`
buffer without StringStore/UserDataStore/etc
2025-04-11 15:21:07 +02:00
Aleksei Antipovskii
c618fa284d fix(PrimProc): MCOL-5394 JSON_ARRAYAGG in MCS works differently than in InnoDB 2025-04-11 15:21:07 +02:00
Aleksei Antipovskii
21ebd1ac20 feat(bytestream): serialize long strings in the common way 2025-04-11 15:21:07 +02:00
Aleksei Antipovskii
4bea7e59a0 feat(PrimProc): MCOL-5852 disk-based GROUP_CONCAT & JSON_ARRAYAGG
* move GROUP_CONCAT/JSON_ARRAYAGG storage to the RowGroup from
  the RowAggregation*
* internal data structures (de)serialization
* get rid of a specialized classes for processing JSON_ARRAYAGG
* move the memory accounting to disk-based aggregation classes
* allow aggregation generations to be used for queries with
  GROUP_CONCAT/JSON_ARRAYAGG
* Remove the thread id from the error message as it interferes with the mtr
2025-04-11 15:21:07 +02:00
Aleksei Antipovskii
87d47fd7ae fix(PrimProc): MCOL-5852 use only long string storage
for the group_concat data to reduce memory usage
2025-04-11 15:21:07 +02:00
aleksei.bukhalov
ea6d2d873e MCOL-5911 migrate build packages step from drone to bootstrap_mcs.sh 2025-04-10 19:42:11 +02:00
Leonid Fedorov
667d5a05a0 chore(compilation): gcc warning for array init 2025-04-10 19:42:11 +02:00
aleksei.bukhalov
fe0e67e8a1 MCOL-4607 add tests 2025-04-10 19:54:26 +04:00
Leonid Fedorov
3e20a3d566 MCOL-5890: DROP TABLE IF EXISTS should not generate errors for non existing tables 2025-04-08 20:30:01 +04:00
Akhmad Oripov
a6ab9bd615 fix(funcexp): MCOL-5386 Bitwise aggregation functions do not work with wide decimals (internal error) (#3485) 2025-04-08 16:47:47 +01:00
mariadb-AlanMologorsky
fde9155d18 chore(cmapi, deps): MCOL-5905 Bump versions of CMAPI dependencies. 2025-04-08 15:48:47 +03:00
mariadb-AlanMologorsky
d17fc7d9be Review fixes. 2025-04-08 14:56:06 +03:00
mariadb-AlanMologorsky
aa57a7684c feat(cmapi): MCOL-5019: review fixes.
[fix] CEJPasswordHandler class methods to use directory for cskeys file
[fix] CEJPasswordHandler.encrypt_password to return password in hex format
[fix] CEJPasswordHandler key_length
[fix] CEJPasswordHandler os.urandom call typo
[upd] mcs cli README.md and man page
[upd] mcs cli README_DEV.md
[fix] mcs_cluster_tool/decorators.py to handle typer.Exit exception
[add] various docstrings
2025-04-08 14:56:06 +03:00
mariadb-AlanMologorsky
215e4eea4d feat(cmapi): MCOL-5019: distributing cskeys secrets file, move cskeys and cspasswd functions to mcs cli.
[add] distribute .secrets file to all nodes while adding a new node
[add] encrypt_password, generate_secrets_data, save_secrets to CEJPasswordHandler
[add] tools section to mcs cli tool
[add] mcs_cluster_tool/tools_commands.py file with cskeys and cspasswd commands
[add] cskeys and cspasswd commands to tools section of mcs cli
[mv] backup/restore commands to tools section mcs cli
[fix] minor imports ordering
[fix] constants
2025-04-08 14:56:06 +03:00
mariadb-AlanMologorsky
10dec6ea94 fix(cmapi): MCOL-5962 Fix rollback in mcs cli and passing errors during broadcasting config
* fix(cmapi): ClusterControllerClient request error handling
* fix(cmapi): broadcast_new_config request error handling
* style(cmapi): logs
2025-04-07 14:34:13 +03:00
Allen Herrera
f04b189476 feat(backup): update to mcs_backup_manager to v3.14 adding integer checks on inputs (#3465) 2025-04-04 21:28:43 +01:00
Akhmad Oripov
b8c0b74f2b fix(funexp): MCOL-4622 Implicit FLOAT->INT and DOUBLE->INT conversion is not like in InnoDB (#3480) 2025-04-04 21:28:16 +01:00
drrtuy
6b8adb822b chore(connector): remove unused and disabled group by handler (#3481) 2025-04-04 21:27:07 +01:00
aleksei.bukhalov
72480e512c MCOL-5922 add more datatypes for test 2025-04-02 19:54:47 +04:00
Denis Khalikov
80277a5e7d DBBuilder: check syscat files instead dirs 2025-04-01 19:53:28 +04:00
mariadb-AlanMologorsky
55b09a71fc fix(cmapi): MCOL-5638 Improve Client Error Messaging and async broadcasting config.
* fix(cmapi): broadcast_new_config function using aiohttp and improved errors handling mechanics
* fix(cmapi): requirements updating aiohttp version and it's dependencies
* fix(cmapi, deps): unused imports
* fix(cmapi, tests): test_broadcast_new_config
2025-04-01 17:27:22 +03:00
mariadb-AlanMologorsky
89c892ab2f fix(bootstrap_mcs): Manual sync with 75f95d3a6b
Only edd crb repo enable for Rocky9 and fix Cmake typo.
2025-04-01 18:03:07 +04:00
drrtuy
e154fcd1d9 feat(bootstrap): add flags to bypass costly operations to reduce recompilation time 2025-04-01 18:03:07 +04:00
Allen Herrera
07be8e3fa1 feat(installation): MCOL-4886 skip chown if top folder permissions good (#3093)
* MCOL-4886 skip chown if top folder permissions good

* remove '-type f' check permissions of directories too
2025-04-01 18:03:07 +04:00
Denis Khalikov
7b25f1bee4 fix(build): Fixing build for S3 with "LocalStorage" type. 2025-04-01 18:03:07 +04:00
Alan Mologorsky
e531ec49fc fix(CMAPI): reduce timeout value for couple CMAPI endpoints (#3153)
* Minor fix in timeout for /notfound "endpoint" call.

- [fix] timeout to urlopen /notfound "endpoint" in mcs-savebrm and mcs-loadbrm

* chore(CMAPI): reduced a second Time Out asking MDB for a async replication status. The latency must be small b/c MDB Server to be requested is local.

---------

Co-authored-by: drrtuy <drrtuy@gmail.com>
2025-04-01 18:03:07 +04:00
Alan Mologorsky
e639138a7b MCOL-5338: Fixed issue related to mcs-loadbrm. (#3107)
[fix] eventually wrong logging messages format
2025-04-01 18:03:07 +04:00
Allen Herrera
11dd3f0422 feat(cs-package-manager): added multinode install via --nodes flag & dev upgrade along with some help texts (#3279)
Co-authored-by: Allen Herrera <allen@AllensBlackMBP.attlocal.net>
2025-04-01 18:03:07 +04:00
mariadb-AlanMologorsky
2f25c47a57 fix(cmapi): MCOL-5133 remove has_active_nodes handler for cluster shutdown because TransactionManager has advance variant of this check 2025-04-01 18:03:07 +04:00
mariadb-AlanMologorsky
0e5842abcc fix(cmapi tests): MCOL-5133 test mode set without nodes now returns adequate message 2025-04-01 18:03:07 +04:00
mariadb-AlanMologorsky
8a4f857df4 fix(cmapi): MCOL-5133 maintainance flag typo. 2025-04-01 18:03:07 +04:00
mariadb-AlanMologorsky
27e3b8d808 feat(cmapi): MCOL-5133: Stage3 stand alone cli tool.
MAJOR: Some logic inside node remove changed significantly using active
    nodes list from Columnstore.xml to broadcast config after remove.

 [fix] TransactionManager passsing  extra, remove and optional nodes arguments to start_transaction function
 [fix] commit and rollback methods of TransactionManager adding nodes argument
 [fix] TransactionManager using success_txn_nodes inside
 [fix] remove node logic to use Transaction manager
 [fix] cluster set api key call using totp on a top level cli call
 [add] missed docstrings
 [fix] cluster shutdown timeout for next release
2025-04-01 18:03:07 +04:00
mariadb-AlanMologorsky
c40e4ba00d feat(cmapi): MCOL-5133: Stage2 stand alone cli tool.
[fix] client class methods
[fix] Transaction management at endpoint handling level
[fix] add_node and set_mode methods to use TransactionManager
2025-04-01 18:03:07 +04:00
Alan Mologorsky
a60a5288d8 feat(cmapi): MCOL-5133: Stage1 to stand alone cli tool. (#3378)
[add] cluster api client class
[fix] cli cluster_app using cluster api client
[add] ClusterAction Enum
[add] toggle_cluster_state function to reduce code duplication
2025-04-01 18:03:07 +04:00
Alan Mologorsky
a00711cc16 fix!(cmapi): MCOL-5454: Self-signed certificate autorenew. (#3213)
[add] managers/certificate.py with CertificateManger class
[mv] creating self-signed certificate logic into CertificateManger class
[add] renew and days_before_expire methods to CertificateManger class
[mv] several certificate dependent constants to managers/certificate.py
[add] CherryPy BackgroundTask to invoke certificate check hourly (3600 secs)
[fix] tests
[fix] bug with txn timer clean (clean_txn_by_timeout, worker and invoking of it)
2025-04-01 18:03:07 +04:00
drrtuy
c64d4b950f chore(): fix compilation issue 2025-03-31 22:47:46 +01:00
drrtuy
481267dca8 chore(): reduced error-prone boilerplate for STS functionality 2025-03-31 22:47:46 +01:00
Alexander Presniakov
ade75eb4d7 Merge pull request #3472 from mariadb-corporation/minor-cmapi-fixes
Minor CMAPI fixes
2025-03-31 16:37:46 -03:00
Alexander Presnyakov
de7a4a2d7e feat(mcs): add -v option to enable logging to console
refactor(ci): switch S3 uploading to AWS CLI for logging S3 link

docs: update README with to reflect changes in Drone pipeline

feat(env): add activate script for portable Python

fix(logging): log RequestException response body
2025-03-31 16:54:46 +00:00
Akhmad Oripov
a329f4d428 Fix(MCOL-4607): SEC_TO_TIME(wideDecimal) returns 0 in DECIMAL context (#3474) 2025-03-31 15:05:07 +01:00
Akhmad Oripov
1bcf63a436 Fix(MCOL-4611): mod loses precision on huge narrow decimal (#3473) 2025-03-31 14:59:40 +01:00
Leonid Fedorov
848f5bf162 fix(joblist,sorting): columnstore_orderby_threads for subquery (#3079) 2025-03-28 21:03:31 +04:00
drrtuy
546be21ef9 chore(logging): re-enable forgotten logging 2025-03-28 16:56:05 +00:00
mariadb-AlanMologorsky
91e82f4d15 fix(mcs): MCOL-5618: change list option to --list and refactor.
fix(mcs):  list option to -li/--list for mcs backup, restore and dbrm_restore commands
fix(mcs): add missed option "aro"
fix(mcs): resort options for backup and dbrm_backup to keep same ordering as in original scrypt
fix(mcs docs): updated README.md + mcs.1
2025-03-28 13:02:19 +03:00
mariadb-AlanMologorsky
271e3d5956 MCOL-5618: Sync with PR3410.
[add] list option but in argument notation "list" for backup, restore, dbrm_restore
[fix] help messages for --config-file
[fix] -p/--path > -bl/--backup-location option for dbrm_backup and dbrm_restore
[fix] -d/--directory > '-l', '--load' option for dbrm_restore
2025-03-28 13:02:19 +03:00