Leonid Fedorov
8a535e872c
Revert "Deep build refactoring phase 2 ( #3564 )" ( #3678 )
...
This reverts commit 449029a827
2025-08-01 02:56:31 +04:00
Leonid Fedorov
82421c208f
chore(ci): collect asan ubsan and libc++ build with mtr and regression status ignored ( #3672 )
...
* MSan added with fixes for libc++
* libc++ sepatare build
* add libc++ to ci
* libstdc++ in CI
* libcpp and msan to external projects
* std::sqrt
* awful_hack(ci): install whole llvm instead of libc++ in terrible way for test containers
* Adding ddeb packages for teststages and repos
* libc++ more for test container
* save some money on debug
* colored coredumps
* revert ci
* chore(ci): collect asan ubsan and libc++ build with mtr and regression status ignored
2025-07-31 00:32:32 +04:00
drrtuy
9f5ddd33bc
chore(): a note about unprotected crit section
2025-07-21 12:54:07 +01:00
Leonid Fedorov
449029a827
Deep build refactoring phase 2 ( #3564 )
...
* configcpp refactored
* chore(build): massive removals, auto add files to debian install file
* chore(build): configure before autobake
* chore(build): use custom cmake commands for components, mariadb-plugin-columnstore.install generated
* chore(build): install deps as separate step for build-packages
* more deps
* chore(codemanagement, build): build refactoring stage2
* chore(safety): Locked Map for MessageqCpp with a simpler way
Please enter the commit message for your changes. Lines starting
* chore(codemanagement, ci): better coredumps handling, deps fixed
* Delete build/bootstrap_mcs.py
* Update charset.cpp (add license)
2025-07-17 16:14:10 +04:00
drrtuy
79008f4f69
feat(CSEP): CSEP printer with indentations to simplify reading + rewriter skeleton + some test binary to describe minimalistic CSEP localy
2025-06-26 18:35:33 +01:00
Leonid Fedorov
aa7e0fb9b4
Deep build refactoring phase 1 ( #3562 )
...
* configcpp refactored
* logging and datatypes refactored
* more dataconvert
* chore(build): massive removals, auto add files to debian install file
* chore(codemanagement): nodeps headers, potentioal library
* chore(build): configure before autobake
* chore(build): use custom cmake commands for components, mariadb-plugin-columnstore.install generated
* chore(build): install deps as separate step for build-packages
* more deps
* check debian/mariadb-plugin-columnstore.install automatically
* chore(build): add option for multibracnh compilation
* Fix warning
2025-05-30 14:05:21 +04:00
Sergey Zefirov
11324c468d
feat(primproc,aggregegation)!: Changes for ROLLUP with single-phase aggregation ( #3025 )
...
The fix is simple: enable subtotals in single-phase aggregation and
disable parallel processing when there are subtotals and aggregation is
single-phase.
2025-05-23 05:12:17 +04:00
Leonid Fedorov
2036e521c7
named linkage
2025-05-20 18:22:59 +04:00
drrtuy
af1864f544
feat(memory): custom OOM exception
2025-05-20 18:22:16 +04:00
drrtuy
e9973c46e4
feat(TNS): change ORDER BY out-of-memory error message. Replaced bad_alloc with IDBExcept in TNS.
2025-05-20 18:22:16 +04:00
Leonid Fedorov
a0bee173f6
chore(build): fixes to satisfy clang19 warnings
2025-05-15 19:05:38 +04:00
drrtuy
d8bef9dc11
fix(UT): added dummy RM ctor to be used with UTs
2025-05-02 10:11:40 +01:00
drrtuy
246c5775a3
chore(TNS): removed extra sorting queue definitions.
2025-05-02 10:11:40 +01:00
drrtuy
42417764d8
chore(): cleanup.
2025-05-02 10:11:40 +01:00
drrtuy
4d32a59775
fix(perf,allocator): reduce CountingAllocator step size to improve its memory consumption reaction speed.
2025-05-02 10:11:40 +01:00
drrtuy
01cc73d416
fix(perf,allocator): test build with reduced CountingAllocator parameter values.
2025-05-02 10:11:40 +01:00
drrtuy
252b3ddbef
fix(perf,allocator): adding unit test to check CountingAllocator behavior when it is wrapped in STLPoolAllocator
2025-05-02 10:11:40 +01:00
=
671b7301f3
fix(allocator,perf): performance degradation caused by lack of STLPoolAllocator replaced by CountingAllocator
2025-05-02 10:11:40 +01:00
Serguey Zefirov
bd1622f331
feat(MCOL-5886): support InnoDB's table partitions in cross-engine joins
...
The purpose of this changeset is to obtain list of partitions from
SELECT_LEX structure and pass it down to joblist and then to
CrossEngineStep to pass to InnoDB.
2025-04-23 08:24:10 +03:00
drrtuy
a16fbd137b
fix(disk-based-join): this fixes multiple SEGV for disk-based join algo
2025-04-15 15:06:49 +01:00
drrtuy
c9f9cf8988
fix(CES): Server doesn't terminate MDB client connection that it did previously delivering incomplete result set
2025-04-15 15:06:49 +01:00
drrtuy
6e98ef3037
chore(): removed extra printout
2025-04-15 15:06:49 +01:00
drrtuy
e4ca7425e2
feat(stats): CES reports table name and HJS reports total matched rows
2025-04-15 15:06:49 +01:00
Leonid Fedorov
432d0cf7f8
fix(build): replace std::ranges usage for gcc9 and std::span with boost::span
2025-04-15 17:58:11 +04:00
Leonid Fedorov
6a712dc0ad
MCOL-5932: fix heap buffer overflow with minimal revert of MCOL-5776 breaking change ( #3445 )
2025-04-15 14:46:25 +01:00
Aleksei Antipovskii
c618fa284d
fix(PrimProc): MCOL-5394 JSON_ARRAYAGG in MCS works differently than in InnoDB
2025-04-11 15:21:07 +02:00
Aleksei Antipovskii
4bea7e59a0
feat(PrimProc): MCOL-5852 disk-based GROUP_CONCAT & JSON_ARRAYAGG
...
* move GROUP_CONCAT/JSON_ARRAYAGG storage to the RowGroup from
the RowAggregation*
* internal data structures (de)serialization
* get rid of a specialized classes for processing JSON_ARRAYAGG
* move the memory accounting to disk-based aggregation classes
* allow aggregation generations to be used for queries with
GROUP_CONCAT/JSON_ARRAYAGG
* Remove the thread id from the error message as it interferes with the mtr
2025-04-11 15:21:07 +02:00
Aleksei Antipovskii
87d47fd7ae
fix(PrimProc): MCOL-5852 use only long string storage
...
for the group_concat data to reduce memory usage
2025-04-11 15:21:07 +02:00
drrtuy
6b8adb822b
chore(connector): remove unused and disabled group by handler ( #3481 )
2025-04-04 21:27:07 +01:00
drrtuy
c64d4b950f
chore(): fix compilation issue
2025-03-31 22:47:46 +01:00
drrtuy
481267dca8
chore(): reduced error-prone boilerplate for STS functionality
2025-03-31 22:47:46 +01:00
Leonid Fedorov
848f5bf162
fix(joblist,sorting): columnstore_orderby_threads for subquery ( #3079 )
2025-03-28 21:03:31 +04:00
drrtuy
d1de121476
fix(): periodically return from UM JOIN loop that can produce a lot of RGData-s and thus overcommit for RAM
2025-03-27 22:12:48 +00:00
drrtuy
b649af5a0c
chore(): merge cleanup
2025-03-27 22:12:48 +00:00
drrtuy
729db829a2
feat(RM,allocators): use atomic counters math abstraction
2025-03-27 22:12:48 +00:00
drrtuy
b14613a66b
fix(aggregation): replaced instances with references
2025-03-27 22:12:48 +00:00
drrtuy
8ca8119f36
fix(TNS): fix for duplicate DISTINCT output
2025-03-27 22:12:48 +00:00
drrtuy
09926b3157
feat(TNS, sorting, distinct): TNS now accounts data used by RGDatas and distinct maps.
2025-03-27 22:12:48 +00:00
drrtuy
c6dabe7eb5
feat(TNS): distribute SortingPQ that supports CountingAllocator
2025-03-27 22:12:48 +00:00
drrtuy
be5711cf0d
feat(): replace getMaxDataSize with getMaxDataSizeWithStrings to accurately account for mem
2025-03-27 22:12:48 +00:00
drrtuy
da28750ffc
fix(TNS): removed optimization
2025-03-27 22:12:48 +00:00
drrtuy
0bfe10a7d0
feat(): use CountingAllocator for DISTINCT
2025-03-27 22:12:48 +00:00
drrtuy
7ad4022d96
fix(): remove an additional and errenous CountingAllocator for RGData so it does not throw at an unexpected spot
2025-03-27 22:12:48 +00:00
drrtuy
a4c4d33ee7
feat(): zerocopy TNS case and JOIN results RGData with CountingAllocator
2025-03-27 22:12:48 +00:00
drrtuy
3dfc8cd454
feat(): first cleanup
2025-03-27 22:12:48 +00:00
drrtuy
4c1d9bceb7
feat(): Replacing STLPoolAllocator with CountingAllocator for in-memory joins
2025-03-27 22:12:48 +00:00
drrtuy
1aa2f3a42b
feat(): TupleHashJoin now handles bad_alloc case switching to disk-based if it is enabled
2025-03-27 22:12:48 +00:00
drrtuy
f594d27685
feat(): accounts hash tables RAM allocations/removes STLPoolAllocator
2025-03-27 22:12:48 +00:00
drrtuy
90b4322470
feat(): propagated changes into SLTPoolAllocator and friends
2025-03-27 22:12:48 +00:00
drrtuy
397b3ff729
feat(): change ref to atomic with ptr to atomic
2025-03-27 22:12:48 +00:00
