1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-07-29 08:21:15 +03:00

6351 Commits

Author SHA1 Message Date
4f71071766 feat(bootstrap): add flags to bypass costly operations to reduce recompilation time 2024-11-14 19:38:13 +04:00
932546f47c fix(CMAPI): reduce timeout value for couple CMAPI endpoints (#3153)
* Minor fix in timeout for /notfound "endpoint" call.

- [fix] timeout to urlopen /notfound "endpoint" in mcs-savebrm and mcs-loadbrm

* chore(CMAPI): reduced a second Time Out asking MDB for a async replication status. The latency must be small b/c MDB Server to be requested is local.

---------

Co-authored-by: drrtuy <drrtuy@gmail.com>
2024-11-12 10:56:16 +00:00
c6b747b7c0 fix(DEC):MCOL-5805,5808 to resolve UM-only node crash inside DEC when there is no local PP to send the local requests to. (#3349) 2024-11-11 18:29:53 +00:00
6f4274760e fix(plugin): MCOL-5703 fix server crash on 'UNION ALL VALUES' queries (#3335)
* fix(plugin): MCOL-5703 fix server crash on 'UNION ALL VALUES' queries
2024-11-10 18:31:38 +00:00
a6eb5ca689 MCOL-5719: Move ownership mechanism to KV storage. (#3266)
* MCOL-5719 Move ownership mechanism to FDB
2024-11-09 19:47:04 +00:00
8ae5a3da40 Fix/mcol 5787 rgdata buffer max size dev (#3325)
* fix(rowgroup): RGData now uses uint64_t counter for the fixed sizes columns data buf.
	The buffer can utilize > 4GB RAM that is necessary for PM side join.
	RGData ctor uses uint32_t allocating data buffer.
 	This fact causes implicit heap overflow.

* feat(bytestream,serdes): BS buffer size type is uint64_t
	This necessary to handle 64bit RGData, that comes as
	a separate patch. The pair of patches would allow to
	have PM joins when SmallSide size > 4GB.

* feat(bytestream,serdes): Distribute BS buf size data type change to avoid implicit data type narrowing

* feat(rowgroup): this returns bits lost during cherry-pick. The bits lost caused the first RGData::serialize to crash a process
2024-11-09 19:44:02 +00:00
842a3c8a40 fix(PrimProc): MCOL-5651 Add a workaround to avoid choosing an incorr… (#3320)
* fix(PrimProc): MCOL-5651 Add a workaround to avoid choosing an incorrect TupleHashJoinStep as a joiner
2024-11-08 17:44:20 +00:00
42be2cb7e0 fix(dbcon) MCOL-5812 server crash related to stored functions
Using the stored function's return value as an argument
for another function was handled incorrectly, leading
to a server crash.
2024-11-05 20:32:26 +04:00
bd9dfdf38c feat(installation): MCOL-4886 skip chown if top folder permissions good (#3093)
* MCOL-4886 skip chown if top folder permissions good

* remove '-type f' check permissions of directories too
2024-09-11 14:50:41 +03:00
3489b2c542 fix(logging): Add setddldebuglevel command (#3312) 2024-09-10 19:10:42 +03:00
4f49c7870a fix(SM): check for duplicates (#3314)
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2024-09-10 17:50:59 +03:00
31aaa7df50 fix(logging): MCOL-5789 Add logs on failure. (#3308) 2024-09-10 17:44:25 +03:00
029a573639 chore(tests): canonize tests after server MDEV-19052
chore(tests): canonize hex(-1) after some server fixes
chore(tools) update fullmtr manual runner
chore(tests): canonize hex values for negative
2024-09-06 00:13:52 +04:00
47d01b2d2f fix(join, UM, perf): UM join is multi-threaded now (#3286)
* chore: UM join is multi-threaded now

* fix(UMjoin):  replace TR1 maps with stdlib versions
2024-09-04 18:56:24 +04:00
1d40b4bb45 MCOL-5695: Fix CI. Use specific branches from docker repo. 2024-09-04 18:55:22 +04:00
f6c9d3b89d MCOL-5695: Add FoundationDB package as a dependency for CMAPI. 2024-09-02 13:10:48 +04:00
148063e07a feat(ddl,partitions): better partition-related commands logging 2024-09-02 12:05:02 +04:00
7979c8b0ca fix(aggregation, RAM): MCOL-5715 Changes the second phase aggregation. (#3171)
This patch changes the second phase aggregation pipeline - takes into
account current memory consumption.

Co-authored-by: Leonid Fedorov <79837786+mariadb-LeonidFedorov@users.noreply.github.com>
Co-authored-by: drrtuy <roman.nozdrin@mariadb.com>
2024-08-29 14:24:47 +03:00
0d78f2f6c6 feat(cs-package-manager): added multinode install via --nodes flag & dev upgrade along with some help texts (#3279)
Co-authored-by: Allen Herrera <allen@AllensBlackMBP.attlocal.net>
2024-08-28 20:17:40 +03:00
a46232f830 MCOL-5779: use encoding to check alter table alter column statement correctly 2024-08-28 16:27:02 +04:00
eeac2addd2 MTR runner improved 2024-08-28 16:27:02 +04:00
bb861f8fab FDB
This patch moves FDB to utils dir and adds test on `remove keys range`.
2024-08-28 15:02:08 +04:00
a02d15ad11 MCOL-5771 fixed -spoll for newer versions and config-file defaults 2024-08-23 13:30:26 +03:00
e2941628d1 fix(): fix the naming 2024-08-21 20:45:16 +04:00
25c20bae9b MCOL-4696: get rid of boost::iequals 2024-08-21 20:45:16 +04:00
90023272dd MCOL-5784 Add test to MTR test suite. 2024-08-21 20:25:11 +04:00
c22409760f feat(SM): MCOL-5785 Add timeout options for S3Storage (#3265)
* Update libmarias3

fix build with the recent libmarias3

* feat(SM): MCOL-5785 Add timeout options for S3Storage

    In some unfortunate situations StorageManager may get stuck on
    network operations. This commit adds the ability to set network
    timeouts which will help to ensure that the system is more
    responsive.

* feat(SM): MCOL-5785 Add smps & smkill tools

    * `smps` shows all active S3 network operations
    * `smkill` terminates S3 network operations

    NB! At the moment smkill is able to terminate operations
    that are stuck on retries, but not hang inside the libcurl
    call. In other words if you want to terminate all operations
    you should configure `connect_timeout` & `timeout`
---------

Co-authored-by: Leonid Fedorov <leonid.fedorov@mariadb.com>
2024-08-21 18:38:49 +03:00
f36ca611eb Merge pull request #3280 from mariadb-corporation/foundation-db
Use FoundationDB packages
2024-08-19 15:59:54 +03:00
75f95d3a6b helper to install foundationdb locally 2024-08-19 00:32:12 +04:00
b155354d40 comment the test temporaly 2024-08-18 01:30:37 +04:00
cc9a1b0491 chore(deps): try to use prebuild packages within CI process 2024-08-18 00:36:11 +04:00
15514e15b2 MCOL-5784 Add C++ wrapper for FDB 2024-08-17 21:48:36 +04:00
aaa39e6860 don't add new build dependencies
and particularly, *not for unit tests*
2024-08-06 18:19:06 +04:00
fa8631c6cb match the rename in the handler rows_changed->rows_stats.updated 2024-08-06 18:18:37 +04:00
f62ef0041c fix(joblist,sorting): columnstore_orderby_threads for subquery (#3079) 2024-07-31 14:50:18 +01:00
70a7a01941 fix(dbcon): MCOL-4756: having not() provokes an ERROR 2013
The `NOT()` function in the HAVING clause was handled
    incorrectly, which caused the server to crash.
2024-07-31 16:33:34 +04:00
f7ff055808 Added more tests 2024-07-30 23:13:38 +04:00
5f9ccfa8a1 fix(mcol-4499): Correct handling of LIKE/NOT LIKE NULL 2024-07-30 23:13:38 +04:00
7bec46e685 Merge pull request #3177 from mariadb-corporation/u24
chore(build) add Ubuntu 24.04 to the CI
2024-07-30 18:46:02 +03:00
774ca69589 Merge branch 'develop' into u24 2024-07-30 18:29:23 +04:00
1d25cf3afd chore(codestyle): MCOL-5405: repace windows CRLF with virtious linux one 2024-07-26 18:01:35 +04:00
323c8822d5 MCOL-5587: Fix columnstore.cnf.
fix(client): Fix columnstore.cnf file

This fix changes option file to apply '--quick' option only for 'mariadb' and 'mysql' clients instead of all MariaDB clients.
Otherwise 'mysqladmin' uses this option, but it doesn't exist. As a result broken CI multinode MTR stage.
2024-07-26 17:16:31 +04:00
e7c1582910 fix(mcs-savebrm): replace debug with error to put mcs-savebrm.py log messages in order 2024-07-25 21:05:43 +04:00
687aa463af fix!(cmapi): MCOL-5454: Self-signed certificate autorenew. (#3213)
[add] managers/certificate.py with CertificateManger class
[mv] creating self-signed certificate logic into CertificateManger class
[add] renew and days_before_expire methods to CertificateManger class
[mv] several certificate dependent constants to managers/certificate.py
[add] CherryPy BackgroundTask to invoke certificate check hourly (3600 secs)
[fix] tests
[fix] bug with txn timer clean (clean_txn_by_timeout, worker and invoking of it)
2024-07-21 05:25:32 +01:00
1964f4243c MCOL-5618: Fix action names in wrapper.
[fix] backup-dbrm -> dbrm_backup + restore-dbrm -> dbrm_restore
2024-07-19 12:06:12 +03:00
6e995e2e80 fix: MCOL-5755: incorrect handling of BLOB (and TEXT) in GROUP BY
BLOB fields did not work as grouping keys at all, they were assigned
value NULL for any value, be it NULL or not. The fix is in the
rowaggregation.cpp in the initMapping(), a switch/case branch was added
to handle BLOB field copying there.

Also, TEXT columns did not distinguish between NULL and empty string in
the grouping algorithm, now they do. The fix is in the equals()
function, now we specifically check for isNull() equality between
values.
2024-07-11 11:03:05 +03:00
f5089c7d80 fix(client): MCOL-5587: enable quick mode for predictable performance (#3240)
This changeset enables quick (mariadb -q) mode when columnstore is
installed. Quick mode precludes client CLI program from storing too
much data in memory, preventing out of memory conditions.
2024-07-07 13:52:21 +01:00
ffd7be2080 fix(build) Remove _GLIBXX flags for Columnstore debug builds 2024-07-04 23:46:47 +04:00
27722fe48c chore(build) add Ubuntu 24.04 to the CI 2024-07-04 12:25:58 +00:00
57e2375dbc fix(funcexp): MCOL-4671 Fix behaviour of LEFT/RIGHT functions when negative trim length value is passedB 2024-07-04 12:51:01 +04:00