1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-01 06:46:55 +03:00
Commit Graph

6015 Commits

Author SHA1 Message Date
c049d85d63 MCOL-5206 This patch brings some EMIndex and treeish EM leftovers from develop-5 2022-08-24 19:13:34 +00:00
72e264e8ef MCOL-5199 This patch solves the overal performance degradation introduced with a new way of char columns hashing
in aggregation code
The patch disables padding that forces hasher to calculate over the whole 2k buffer. This patch also moves hashing code
into the common place where it belongs.
2022-08-24 19:07:06 +00:00
fabb975b8a Merge pull request #2524 from denis0x0D/MCOL-5091_1
MCOL-5091/MCOL-4917 ExtentMap as RBTree.
2022-08-24 18:18:39 +03:00
3d10d0707b regressions everywhere 2022-08-24 14:50:21 +00:00
8ff4192f52 get rid of getbinaryfield in ranking window functions 2022-08-24 14:50:03 +00:00
20f57b713a MCOL-5198 This patch enables RowStorage to dump data on disk
using startNewGeneration if there is 50 Megs left free
2022-08-24 14:00:43 +00:00
15ce531270 Randomly start a new generation if the free memory is less than 30% 2022-08-24 14:00:37 +00:00
7251f58818 Merge pull request #2525 from NTH19/useHashmapOrForLoop
Add threshold for eqFilter in p_Dictionary of pp
2022-08-24 11:34:20 +03:00
2f5f9cdbe1 MCOL-5091/MCOL-4917 ExtentMap as RBTree.
This patch replaces a `linear array` to `Red black tree` for ExtentMap.
2022-08-23 17:33:16 +03:00
df7c967d54 when eq Filtercount <6 ,the speed of for loop is faster than hashmap
add threshold for eqFilter
2022-08-23 18:45:36 +08:00
50d95bf60a MCOL-5196 REPLACE function may trigger invalid capacity assertion (#2522)
When length of string to replace minus length of string to replace to is
bigger than input string and processing mode allows for binary (memcmp
or std::string::find()) comparison, REPLACE may trigger invalid capacity
assertion and query processing will stop.

The fix is to properly count the number of occurences of the string to
replace, basically.
2022-08-22 21:34:38 +03:00
bbb3c69e31 Merge pull request #2517 from mariadb-corporation/dlee_mtr_cleanup_2208
Dlee mtr cleanup 2208
2022-08-22 15:26:52 +03:00
8a08df24d3 some ci improvements:
- add ddebs env for debug symbos packaging
- tee build log to file
- fix backup testErrorLogs2 dependency
2022-08-20 00:19:05 +02:00
14bbba2c97 Merge pull request #2510 from tntnatbry/MCOL-5021-followup
MCOL-5021 Followup.
2022-08-19 20:44:56 +03:00
590780e510 Merge pull request #2515 from mariadb-AlexeyAntipovsky/agg-append-fixdev
Fix excessive memory consumption at the last stage of aggregation
2022-08-19 17:56:45 +03:00
54329d3ab8 Updated autopilot adn extended cases 2022-08-18 21:08:05 -05:00
6a6fee5969 MCOL-5021 Followup.
Allow the compiler to inline the call to nextColValue() in column.cpp.
2022-08-18 19:35:35 +00:00
3089f97613 Merge pull request #2511 from mariadb-corporation/MDEV-28711-libmariadb
MDEV-28711: add libmariadb to columnstore deps
2022-08-18 22:03:50 +03:00
6a8a464afc Merge pull request #2512 from mariadb-corporation/MCOL-5013-params
MCOL-5013 : Changed function name, schema and params order
2022-08-18 20:50:11 +03:00
4fc43c3c93 Merge pull request #2506 from mariadb-corporation/MCOL-5092-addendum
MCOL-5092 addendum modify moda() mtr tests with order by
2022-08-18 20:49:01 +03:00
dca359c2ab Fix excessive memory consumption at the last stage of aggregation 2022-08-18 14:00:53 +03:00
d02b3403b7 Changed function name, schema and params order to achieve
columnstore_info.load_from_s3("<bucket>", "<file_name>", "<db_name>", "<table_name>");
2022-08-18 10:41:22 +00:00
3798dd8d38 MDEV-28711: add libmariadb to columnstore deps 2022-08-18 10:02:09 +00:00
471b8e3e09 Updated test case 2022-08-17 16:56:26 +00:00
8166e0284f Disabled warnings and add drop table commands 2022-08-17 11:29:04 -05:00
10a8d274cd Updated reference results to match that of innodb tables 2022-08-17 11:28:05 -05:00
4e2d4984cf Merge pull request #2508 from denis0x0D/MCOL-5172
MCOL-5172 RebuildEM: improve internal representation of sys.cat files
2022-08-17 18:52:31 +03:00
0f2f0fc0ba Merge pull request #2507 from denis0x0D/MCOL-4715
MCOL-4715 Mixed inner and outer joins with "null" filter for the table which is not involved into the outer join produces wrong results.
2022-08-17 18:50:43 +03:00
5c62d96b71 MCOL-5092 Use sorted_result to get consistent results in mtr 2022-08-17 09:07:47 -05:00
ab25337c0a MCOL-5172 RebuildEM: improve internal representation of sys.cat files 2022-08-17 15:59:32 +03:00
edbd477528 Merge pull request #2472 from tntnatbry/MCOL-5162
MCOL-5162 This patch allows for an automatic upgrade of syscat tables via dbbuilder.
2022-08-17 14:39:03 +03:00
5099133642 MCOL-5092 correct mtr result 2022-08-16 09:14:16 -05:00
59166608b1 MCOL-4715 Mixed inner and outer joins with "null" filter for the table which is not involved into the outer join produces wrong results. 2022-08-16 17:13:03 +03:00
1a849c88e8 MCOL-5162 This patch allows for an automatic upgrade of syscat tables via dbbuilder.
We have added a new function, SystemCatalog::upgrade(), which will
create a new column in the database and fill it with default values.
It uses a reference column to fill the column, which is passed as a
std::unordered_map<key, value> value to SystemCatalog::upgrade()
function, where key is the target column which needs to be created.
In addition, we pass additional std::unordered_map's to
SystemCatalog::upgrade() containing information such as the datatypes
and colwidths of the target and reference columns, as well as the
default value which will be used to fill the target column.
2022-08-15 21:03:13 +00:00
05bdddf3a9 MCOL-5092 addendum modify moda() mtr tests with order by
fix an issue in moda() evaluate for string types
2022-08-15 15:50:15 -05:00
56bbef62e6 Merge pull request #2406 from tntnatbry/MCOL-5021-dev
MCOL-5021 AUX column implementation to improve DELETE performance.
2022-08-15 19:03:42 +03:00
a7a9ccf889 Serg dev (#2504)
* more build dependencies

* fix for cmake < 3.11

It cannot do ADD_LIBRARY(... ALIAS ...) on IMPORTED targets

* another fix for cmake 3.10.2

It doesn't know about CMAKE_CXX_STANDARD=20,
let's add the correct flag manually

* gcc 8 on aarch64

utils/common/simd_arm.h:241:16: error: need ‘typename’ before ‘simd::TypeToVecWrapperType<T>::WrapperType’ because ‘simd::TypeToVecWrapperType<T>’ is a dependent scope
2022-08-15 13:35:30 +03:00
dee50318ad Serg dev (#2502)
* build boost during build phase, not during configure

* add dependency for generated header files errorids.h messageids.h

see 7e868bc588

* set explicit dependencies on external_boost for #include's

* clang-14 compatibility fix
2022-08-13 07:18:30 +03:00
35f0f7bf0a Merge pull request #2498 from drrtuy/unittests-failure
Looking into unittests.
2022-08-12 01:19:31 +03:00
2020f35e88 Mcol 5092 MODA uses wrong column width for some types (#2450)
* MCOL-5092 Ensure column width is correct for datatype
                       Change MODA return type to STRING
                       Modify MODA to handle every numeric type
* MCOL-5162 MODA to support char and varchar with collation support

Fixes to the aggregate bit functions
When we fixed the storage sign issue for MCOL-5092, it uncovered a problem in the bit aggregates (bit_and, bit_or and bit_xor). These aggregates should always return UBIGINT, but they relied on the type of the argument column, which gave bad results.
2022-08-11 15:16:11 -05:00
f40175dc32 This patch solves the ocassional issues with the FairThreadPool unit test 2022-08-11 16:56:17 +00:00
c906172bf5 MCOL-5180 Check CPU vector instructions set in installer and PrimProc on start (#2499)
* Add check for simd acrh support

* Updates

* More polite and detailed error messages

* Updates

* Always true to conditional

Co-authored-by: Leonid Fedorov <leonid.fedorov@mariadb.com>
2022-08-11 15:28:22 +03:00
0174c8ec08 Merge pull request #2497 from drrtuy/MCOL-5167
[MCOL-5167] Add support for on clause filter for a table which is not…
2022-08-11 12:19:51 +03:00
61cf18b92d [MCOL-5167] Add support for on clause filter for a table which is not involved in join.
This patch adds support for on clause filter for a table which is not involved in particular join
by disabling an `merge optimization` for those particular cases.
The `merge optimization` is optimization when CS
tries to create a one BPP join with one `large side` table and multiple `small sides` tables, in this
case we cannot apply a FE filter if this filter requires a columns from `small side` table which is not
involved in particular join.
2022-08-10 10:46:43 +00:00
4c9d6e39ac Dlee mtr restructure (#2494)
* Restructured test suites and added autopilot and extended suites

* Updated autopilot with correct branch - develop

* Moved setup test case to a 'setup' directory, for consistency

* Fixed a path issue

* Updated some tests cases to keep up with development

Co-authored-by: root <root@rocky8.localdomain>
2022-08-09 21:20:56 +03:00
8b15e2f6a4 Merge pull request #2490 from benthompson15/MCOL-5163-dev
MCOL-5163: remove systemd coupling of processes.
2022-08-09 14:44:10 +03:00
dd96e686c0 MCOL-5153 This patch replaces MDB collation aware hash function with the (#2488)
exact functionality that does not use MDB hash function.
This patch also takes a bit from Robin Hood hash map implementation forgotten
that reduces hash function collision rate.
2022-08-07 02:36:03 +03:00
cbfdae3481 MCOL-5021 Code changes based on review feedback. 2022-08-05 14:40:50 -04:00
11b7ee2f11 MCOL-5021 Disallow the following ALTER TABLE ADD COLUMN statement:
ALTER TABLE calpontsys.systable ADD COLUMN (auxcolumnoid INT NOT NULL DEFAULT 0);
2022-08-05 14:40:50 -04:00
1355237ca3 MCOL-5021 Some minor fixes. 2022-08-05 14:40:50 -04:00