1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-08 14:22:09 +03:00
Commit Graph

6336 Commits

Author SHA1 Message Date
Roman Nozdrin
5af508e530 Merge pull request #2416 from mariadb-corporation/remove-gtest-discovery
Replace gtest_discovery_tests with gtests_add_tests
2022-06-14 17:30:57 +03:00
Leonid Fedorov
3638f4ac8c Replace gtest_discovery_tests with gtests_add_tests
Despite we have another number of tests in result, they all still run
gtests_add_test cannot parse TYPED_TEST_SUITE one by one and run them
in one bunch
2022-06-13 15:05:10 +00:00
Roman Nozdrin
928bb510fd Merge pull request #2412 from drrtuy/MCOL-5105-dev
MCOL-5105 This patch raises pipe read operation timeout to 20 minutes
2022-06-10 21:21:19 +03:00
Roman Nozdrin
a36681c6cf Merge pull request #2415 from drrtuy/MCOL-5044-revert
This reverts MCOL-5044 AKA FairThreadPool that breaks regr test002
2022-06-10 21:19:35 +03:00
Roman Nozdrin
61359119ad This reverts MCOL-5044 AKA FairThreadPool that breaks regr test002
This reverts commit e40c16bd56, reversing
changes made to 18e6b1d77b.
2022-06-10 14:17:59 +00:00
David.Hall
272246e9fa Merge branch 'develop' into MCOL-4841 2022-06-09 16:58:33 -05:00
Roman Nozdrin
e40c16bd56 Merge pull request #2404 from drrtuy/MCOL-5044-dev
MCOL-5044 FairThreadPool implementation
2022-06-09 22:23:52 +03:00
Roman Nozdrin
18e6b1d77b Merge pull request #2409 from mariadb-corporation/storage-manager-revert
Revert blind config read patch
2022-06-09 19:45:42 +03:00
david.hall
3b6449842f Merge branch 'develop' into MCOL-4841
# Conflicts:
#	exemgr/main.cpp
#	oam/etc/Columnstore.xml.singleserver
#	primitives/primproc/primproc.cpp
2022-06-09 10:07:26 -05:00
Roman Nozdrin
7c9da5709d MCOL-5105 This patch raises pipe read operation timeout to 20 minutes
to enable DMLProc to survive rollbacks on startup.
The patch also fixes linter warnings in service.h and pipe.h.
2022-06-09 14:34:50 +00:00
Leonid Fedorov
184a4b370b Revert blind config read patch 2022-06-09 09:59:47 +00:00
Roman Nozdrin
2d2a6223f5 MCOL-5044 This patch introduces current active jobs estimate counter and replaces some attributes with atomics 2022-06-08 16:58:50 +00:00
Denis Khalikov
467fe0b401 [MCOL-5109] Make a singleton from ServicePrimProc.
This patch makes a singleton from ServicePrimProc.
2022-06-07 13:27:45 +03:00
Roman Nozdrin
94ba91c687 Merge pull request #2402 from mariadb-corporation/std_dev_improvememnts
MCOL-5104: Improved algorithm for STD/VAR functions
2022-06-06 23:53:48 +03:00
Andrey Piskunov
c7e67aedd9 Renamed variables + removed server tests 2022-06-03 15:30:25 +03:00
Andrey Piskunov
3fbc982ab2 Enable mtr checking for arm 2022-06-03 15:29:30 +03:00
Andrey Piskunov
66c69c7609 Welford's algorithm STD and VAR on window functions 2022-06-03 15:29:30 +03:00
Andrey Piskunov
c5fa27475d Welford algorithm for STD and VAR
Naive algorithm for calculating STD and VAR is subject to catastrophic
cancellation. A well-known Welford's algorithms is used instead.
2022-06-03 15:29:30 +03:00
Roman Nozdrin
4e50fca460 Merge pull request #2401 from denis0x0D/statistic_man
StatisticsManager initialize all plugins.
2022-06-03 15:41:28 +05:30
Roman Nozdrin
fd8ba33f21 MCOL-5044 This patch replaces PriorityThreadPool with FairThreadPool that uses a simple
operations + morsel size weight model to equally allocate CPU b/w parallel query morsels.
This patch delivers better parallel query timings distribution(timings graph resembles normal
distribution with a bigger left side thus more queries runs faster comparing with PrioThreadPool-based
single-node installation).
See changes in batchprimitiveprocessor-jl.h and comments in fair_threadpool.h for
important implementation details
2022-06-03 10:08:12 +00:00
Roman Nozdrin
0f0b3a2bed Disable FairThreadPool unit tests in develop-6 b/c its unit test segfaults in containers 2022-06-02 17:05:30 +00:00
Roman Nozdrin
c92dc08264 MCOL-5044 Initial version of a fair thread pool
PP now uses PriorityThreadPool that arbitrary picks another jobs pack
    to run. This scheduling discipline tend to run portions of a single query
    forcing other simultaneous queries to wait. In result parallel queries
    timings variance is high. The FairThreadPool picks the job with the smallest
    amount of work done so far(see the code for details)
2022-06-02 17:05:12 +00:00
benthompson15
652c9299b7 MCOL-4989: Fix error handling for misconfigured StorageManager startup. (#2385) 2022-06-02 08:50:41 -05:00
Denis Khalikov
6c0ebd568b StatisticsManager initialize all plugins.
This patch adds support for initializing all plugins in the system.
2022-05-31 12:42:00 +03:00
Roman Nozdrin
4e46645124 Merge pull request #2398 from drrtuy/MCOL-5060-post-install-containers-dev
MCOL-5060 Fixes post-install script failures in containers
2022-05-31 14:20:32 +05:30
Roman Nozdrin
c89864c37d MCOL-5060 Fixes post-install script failures in containers 2022-05-30 11:41:09 +00:00
Roman Nozdrin
73a388baac Merge pull request #2394 from drrtuy/MCOL-4912-add-forgotten-funcs-dev
MCOL-4912 This patch adds some forgotten MDB functions
2022-05-28 00:57:37 +05:30
Roman Nozdrin
965ca1ca26 MCOL-5105 DMLProc startup/shutdown timeouts affect rollback and graceful shutdown cases, workernode shutdown timeout affects save_brm (#2391) 2022-05-27 13:35:56 -05:00
Roman Nozdrin
f29d5e7869 MCOL-4912 This patch adds some forgotten MDB functions 2022-05-27 16:27:07 +00:00
Leonid Fedorov
2ad4ae2cd2 Merge pull request #2377 from mariadb-SergeyZefirov/small-fix-for-wf-percentile
Actual fix for percentile window function
2022-05-19 18:57:00 +03:00
Serguey Zefirov
0dab97da7d Actual fix for percentile window function
We fix 'partial out-of-bounds reference' warning uncovered when building
with gcc11.
2022-05-19 15:48:23 +03:00
Roman Nozdrin
d840bb2d52 Merge pull request #2376 from denis0x0D/MCOL-5001
[MCOL-5001] Explicitly initialize `startupRaceFlag`.
2022-05-18 19:05:40 +05:30
Denis Khalikov
94ca6fdd34 [MCOL-5001] Explicitly initialize startupRaceFlag.
Explicitly initialize `startupRaceFlag_` to avoid PrimProc freezing on some platforms.
2022-05-18 13:38:31 +03:00
Roman Nozdrin
46a964598a Merge pull request #2375 from drrtuy/MCOL-5050-develop
MCOL-5050 EM Index dbroot container out-of-bound access checks doing …
2022-05-17 20:46:43 +05:30
Roman Nozdrin
8bf4e0eaa5 MCOL-5050 EM Index dbroot container out-of-bound access checks doing EM deletes 2022-05-17 12:53:33 +00:00
benthompson15
e147184b8d MCOL-5065: return values of getSystemReady/getSystemQueryReady should be > 0 (#2354) 2022-05-10 12:32:17 -05:00
Roman Nozdrin
5d53d609fd Merge pull request #2366 from mariadb-corporation/boost-tarball
Use boost tarball instead of clone
2022-05-06 17:29:45 +02:00
Leonid Fedorov
0489682f9d Use boost tarball instead of clone 2022-05-05 16:44:23 +00:00
mariadb-AlexeyVorovich
5f01e42700 Merge pull request #2363 from mariadb-corporation/container-repo
ci: upd dockerfile repo
2022-05-05 08:17:57 -04:00
Roman Nozdrin
e4b67690e2 Merge pull request #2362 from mariadb-corporation/mcol4912-extentindex
Mcol4912 extentindex
2022-05-05 11:01:48 +02:00
mariadb-RomanNavrotskiy
d21834d103 ci: upd dockerfile repo 2022-05-04 15:36:44 +02:00
Leonid Fedorov
6aadc6cc17 boost::interprocess::vector instead of std::vector 2022-05-04 12:59:40 +00:00
Roman Nozdrin
4c26e4f960 MCOL-4912 This patch introduces Extent Map index to improve EM scaleability
EM scaleability project has two parts: phase1 and phase2.
        This is phase1 that brings EM index to speed up(from O(n) down
        to the speed of boost::unordered_map) EM lookups looking for
        <dbroot, oid, partition> tuple to turn it into LBID,
        e.g. most bulk insertion meta info operations.
        The basis is boost::shared_managed_object where EMIndex is
        stored. Whilst it is not debug-friendly it allows to put a
        nested structs into shmem. EMIndex has 3 tiers. Top down description:
        vector of dbroots, map of oids to partition vectors, partition
        vectors that have EM indices.
        Separate EM methods now queries index before they do EM run.
        EMIndex has a separate shmem file with the fixed id
        MCS-shm-00060001.
2022-05-04 12:59:16 +00:00
Roman Nozdrin
fb3eaabd29 Merge pull request #2338 from mariadb-corporation/external-boost
Use external boost 1.78
2022-05-04 13:25:22 +02:00
Leonid Fedorov
c25ae4f378 Use external boost 1.78 2022-05-02 18:23:37 +00:00
mariadb-RomanNavrotskiy
53695cf0db add container image steps
disable suse and centos8 builds
2022-04-29 16:32:04 +02:00
Leonid Fedorov
1eec9f8ad2 Merge pull request #2340 from commander-trashdin/mcs_UDFs
Added word bytes
2022-04-22 01:04:43 +03:00
Commander thrashdin
4bb3743110 Added word bytes 2022-04-20 16:04:14 +03:00
David.Hall
bbb168a846 Mcol 4560 (#2337)
* MCOL-4560 remove unused xml entries and code that references it.
There is reader code and variables for some of these settings, but nobody uses them.
2022-04-18 18:00:17 -04:00
Roman Nozdrin
bd4c911ddb Merge pull request #2334 from mariadb-corporation/gtest-discovery
set gtest discovery mode to pre_test
2022-04-14 13:18:44 +02:00