1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-05 16:15:50 +03:00
Commit Graph

6391 Commits

Author SHA1 Message Date
Denis Khalikov
575852d2e0 feat(brm): MCOL-5631 Optimize BRM load operation. (#3090) 2023-12-27 09:45:11 +03:00
Alan Mologorsky
14e936976d MCOL-5610: Aliases on internally dependent tools. (#3026)
[add] mcs_aws and mcs_gsutil template files
[fix] cmapi CMakeLists to add mcs_aws and mcs_gsutil tools to usr/bin folder
2023-12-26 17:01:30 +03:00
Denis Khalikov
55ffacf546 MCOL-5555 Add support for startreadonly command. (#3081)
This patch adds support for `startreadonly` command which waits
until all active cpimport jobs are done and then puts controller node to readonly
mode.
2023-12-26 15:11:33 +04:00
Leonid Fedorov
0c6876d8e4 perf(primproc) MCOL-5601: Initilize two fields once in ctor instead of calling makeConfig
std::string fTmpDir = config::Config::makeConfig()->getTempFileDir(config::Config::TempDirPurpose::Aggregates);
std::string fCompStr = config::Config::makeConfig()->getConfig("RowAggregation", "Compression");
2023-12-21 18:19:17 +03:00
Denis Khalikov
6315546557 Revert "MCOL-5555 Add support for startreadonly command."
This reverts commit 441cd9d34f.
2023-12-20 01:05:37 +03:00
Denis Khalikov
041eb2ec8a fix(disk-based-join): MCOL-5626 Fix for race in DJS with outer join. 2023-12-18 17:24:27 +03:00
Leonid Fedorov
a8f7777951 fix(linkage) link libm to libmarias3 2023-12-18 17:18:53 +03:00
Leonid Fedorov
97abd9866b fix(writeengine) MCOL-4202: use schema name when renaming table and change it's fields in syscat 2023-12-18 09:59:44 +03:00
Serguey Zefirov
a9ab71e675 MCOL-5625: Fixes json_query implementation
Also extends func_json_value.test.
2023-12-13 16:15:26 +03:00
Leonid Fedorov
bc88cd05b3 fix dependency on upgrade logs 2023-12-08 22:56:17 +03:00
Leonid Fedorov
b62636a6ab fix mtr according server updates 2023-12-07 00:29:47 +03:00
drrtuy
1d416bc6ed fix(DEC): MCOL-5602 fixing potentially endless loop in DEC (#3049) 2023-12-05 18:39:24 +03:00
drrtuy
63b032e3fd fix(rowstorage): SplitMix64 PRNG implementation to replace stdlib MT PRNG that uses /dev/urandom guarded by spinlock (#3050) 2023-12-05 18:30:31 +03:00
Denis Khalikov
58e18eeb56 fix(aggregation): MCOL-5467 Add support for duplicate expressions in group by. (#3052)
This patch adds support for duplicate expressions (builtin_functions) with
one argument in select statement and group by statement.
2023-12-05 18:29:44 +03:00
Sergey Zefirov
71f6a39078 fix(logging): Fixes MCOL-5599 where LIKE operator never finishes (#3048)
This is a fix of logging subsystem, nothing else.

The old code expanded an argument into string and advanced too little
and, if expansion contained argument's index, it expanded it again. And
again.
2023-12-03 20:17:43 +03:00
Serguey Zefirov
ab1a3fe471 Same columns fom diffeernt views in GROUP BY do not produce errors
Fixes MCOL-5643.

The problem was that different views with same column names in GROUP BY
and on the SELECT clause produced an error about "projection column is
not an aggergate neither in GROUP BY list."

This was due to incorrect search in expressions's list that lead to
duplicate columns in GROUP BY list.
2023-11-30 01:42:41 +04:00
Serguey Zefirov
9e37ab82d8 MCOL-5607: JSON function use crashes query execution
JSON functions were implemented violating an assumption of their
pureness, as they should not have any state. This concrete patch
fixes implementation of JSON_VALUE function.
2023-11-30 01:40:36 +04:00
drrtuy
aa0cf1399b fix(build): MCOL-5612 const func pointer assignement must happen after func definition to satisfy modern compilers static analyzer (#3039)
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2023-11-29 19:34:10 +03:00
drrtuy
cbbffb63f4 fix(cmake): raise cmake version to satisfy all the requirements for the current cmake code (#3037)
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2023-11-29 19:33:49 +03:00
Leonid Fedorov
104b4d6fcf Port last changes for bootstrap from develop 2023-11-29 20:12:59 +04:00
Leonid Fedorov
466580cc9c chore(ci) Centos7 packaging: Very hard bug with not matching
MariaDB-shared-10.1-kvm-rpm-centos74-amd64.rpm
MariaDB-shared-5.3-amd64.rpm
to
FILE(GLOB compat53 RELATIVE ${CMAKE_SOURCE_DIR}
    "${CMAKE_SOURCE_DIR}/../MariaDB-shared-5.3.*.rpm")
FILE(GLOB compat101 RELATIVE ${CMAKE_SOURCE_DIR}
    "${CMAKE_SOURCE_DIR}/../MariaDB-shared-10.1.*.rpm")

files renamed to
MariaDB-shared-10.1.kvm-rpm-centos74-amd64.rpm'
MariaDB-shared-5.3.amd64.rpm'

(dash changed to dot after numbers)
to match uncontrollable glob in the server code

Added server 10.6.14-9 for upgrade testing
2023-11-29 20:12:59 +04:00
Leonid Fedorov
2ae171f96c chore(ci) refactor reports from tests stage, add it to upgrade 2023-11-29 20:12:59 +04:00
Leonid Fedorov
79ad7fd01f chore(ci) allow nightly execution for stable 2023-11-29 01:59:41 +04:00
Denis Khalikov
2b01ab1b15 fix(primproc,stringstore): MCOL-5597 Set length for nullptr string to 0. (#3034) 2023-11-23 15:37:37 +03:00
drrtuy
276d7d330a fix(git): rename doc file names is to fix git clone on Windows 2023-11-15 00:20:09 +03:00
drrtuy
15fc0328c6 fix(git): rename doc file names is to fix git clone on Windows vcolumnstore-23.10.0-2 2023-11-03 19:26:19 +03:00
Roman Nozdrin
c22757cd37 chore(docs): rename the doc that affects git clone on Windows 2023-11-03 19:22:25 +03:00
mariadb-AlanMologorsky
2ccfc149c6 MCOL-5595: Wrong metadata in CMAPI packages.
[fix] cmapi packages metadata version format for debian systems and version + release in RHEL systems
2023-10-27 05:34:54 +03:00
drrtuy
e3c5e10207 fix(datatypes, funcexp): static_cast typo fix (#3001) 2023-10-25 20:14:38 +03:00
Sergey Zefirov
b826fc1fd6 fix(datatypes, funcexp): Overflow detection for MCOL-5568 use case (and some other) (#2987)
We add intermediate calculations in int128_t when target is UBIGINT and
check for overflow before converting into the UBIGINT. This is so
because we can overflow on addition and multiplication, with (some)
signed operands or both unsigned.
2023-10-25 20:14:38 +03:00
Denis Khalikov
441cd9d34f MCOL-5555 Add support for startreadonly command.
This patch adds support for `startreadonly` command which waits
until all active cpimport jobs are done and then puts controller node to readonly
mode.
2023-10-16 16:11:50 +03:00
Roman Nozdrin
99542e90ca chore(docs): rename the doc that affects git clone on Windows 2023-10-16 16:09:41 +03:00
Leonid Fedorov
ba276cba5f Stable branch for .drone 2023-10-10 12:30:30 -04:00
Leonid Fedorov
1f71847e99 fix(packaging) dh_missing: warning are treated as errors for buildbot debians
dh_missing: warning: Compatibility levels before 10 are deprecated (level 9 in use)
dh_missing: warning: usr/lib/x86_64-linux-gnu/libmessageqcpp.a exists in debian/tmp but is not installed to anywhere
dh_missing: warning: usr/lib/x86_64-linux-gnu/libpron.a exists in debian/tmp but is not installed to anywhere

so do not install static libraries as targets on CMake
vcolumnstore-23.10.0-1
2023-10-04 13:20:24 -04:00
Allen Herrera
221dea1788 fixed on premise s3 backup & restore --endpoint-url flag 2023-10-03 01:58:55 +03:00
Allen Herrera
d2b05afdc1 init columnstore_backup.sh 2023-10-03 01:58:55 +03:00
Leonid Fedorov
b2f2a0c78a Revert "Disable Debian 12 due to mirrors errors (#2952)"
This reverts commit 11b3aed91b.
2023-10-02 15:12:24 -04:00
Denis Khalikov
fce971dcd2 feat(IO): MCOL-5555 Reduce number of direct writes to the file storing BRM journal and tablelocks (#2974) 2023-09-30 19:00:39 +03:00
Leonid Fedorov
86c1c5d537 fix(rgdata)!: Fix assertion failure leading to disk-based aggregation failure
The new added invariant checking that RGData knows the number of columns and fixed size columns was failing for disk-based aggregation workloads, leading them to provide a wrong result. (The assertion failure happened in RGData::getRow(uint32_t num, Row* row) which is called in the finalization of sub-aggregation results, necessary for merging part results. As the merging failed, duplicate results were output for disk-based aggregation queries.
The assertion failure was caused by RGData::deserialize(ByteStream& bs,
uint32_t defAmount) not setting rowSize and colCount if necessary (e.g.
when the deserialization happens into a new, default RGData, which
doesn't know anything about its structure yet. This is the case when the
default constructor for RGData() is used, which sets rowSize and
columnCount to 0 each.
There are three code parts that make use of the default RGData() ctor.
The fix is for the use in RowGroupStorage::loadRG(uint64_t rgid,
std::unique_ptr<RGData>& rgdata, bool unlinkDump = false), where the
default RGData object is used to directly deserialize a ByteStream into
it. The deserialize method now checks if both rowSize and columnCount
are 0 and if yes sets the read values from the ByteStream for both.
We should probably check the other two code parts making use of the
default RGData ctor, too. This happens in joinpartition.cpp and
tuplejoiner.cpp.

---------

Co-authored-by: Theresa Hradilak <34538290+phoeinx@users.noreply.github.com>
2023-09-30 00:02:31 +03:00
Gagan Goel
6f52039658 Bump VERSION to 23.10.0-1. (#2979) 2023-09-29 20:07:23 +03:00
Gagan Goel
320df831c6 MCOL-5572 Force the charset on the autoincrement column of (#2976)
calpontsys.syscolumn syscat table to be latin1.

This change is done in one of the ctors of pColStep which is
initiated while building the job list from the execution plan.
2023-09-28 22:03:39 +03:00
Sergey Zefirov
920607520c feat(runtime)!: MCOL-678 A "GROUP BY ... WITH ROLLUP" support
Adds a special column which helps to differentiate data and rollups of
various depts and a simple logic to row aggregation to add processing of
subtotals.
2023-09-26 17:01:53 +03:00
Leonid Fedorov
5013717730 fix(plugin): Fix wrong ask for stat call for table mode 2023-09-26 14:43:06 +03:00
Allen Herrera
a97ff73cea init columnstore_review.sh & cs_package_manager.sh (#2969) 2023-09-26 05:59:00 +03:00
Leonid Fedorov
3be86a7131 Revert "feat(BRM) MCOL-5555 Reduce a number of direct writes to BRM journal/tablelocks files" (#2972)
This reverts commit 02114b5b7c.
2023-09-26 05:52:59 +03:00
Denis Khalikov
02114b5b7c feat(BRM) MCOL-5555 Reduce a number of direct writes to BRM journal/tablelocks files 2023-09-25 23:39:49 +03:00
mariadb-KirillPerov
46fa03378c chore(regression-tests): add regr test to test MCS survivability 2023-09-25 22:42:05 +03:00
mariadb-AlexeyVorovich
fd94ab5042 chore(logging): move cgroup /cgroup version log from constructor to getTotalMemory to avoid duplicate log as constructor is called per query 2023-09-25 22:17:09 +03:00
Sergey Zefirov
4bfce51628 Fix autoincrement filtering problems with utf-8 (#2964)
MCOL-5572: Widen the autoincrement column to accomodate utf-8  encoded into weights with strnxfrm function.
2023-09-22 16:40:10 +03:00
Leonid Fedorov
1eb053b46c After container starts, wait for systemd to start for every detached one (#2965) 2023-09-21 17:55:48 +03:00