database/mariadb-columnstore-engine
1
0
Fork 0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-11-02 06:13:16 +03:00
Code Activity
5,728 Commits 383 Branches 90 Tags
05d3ac82d9ff93bf41be1b4dd264881ef1a018cc
Commit Graph

5728 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
david.hall
3b6449842f Merge branch 'develop' into MCOL-4841 
# Conflicts:
#	exemgr/main.cpp
#	oam/etc/Columnstore.xml.singleserver
#	primitives/primproc/primproc.cpp
 2022-06-09 10:07:26 -05:00
Roman Nozdrin
7c9da5709d MCOL-5105 This patch raises pipe read operation timeout to 20 minutes 
to enable DMLProc to survive rollbacks on startup.
The patch also fixes linter warnings in service.h and pipe.h.
 2022-06-09 14:34:50 +00:00
Leonid Fedorov
184a4b370b Revert blind config read patch 2022-06-09 09:59:47 +00:00
Roman Nozdrin
2d2a6223f5 MCOL-5044 This patch introduces current active jobs estimate counter and replaces some attributes with atomics 2022-06-08 16:58:50 +00:00
Denis Khalikov
467fe0b401 [MCOL-5109] Make a singleton from ServicePrimProc. 
This patch makes a singleton from ServicePrimProc.
 2022-06-07 13:27:45 +03:00
Roman Nozdrin
94ba91c687 Merge pull request #2402 from mariadb-corporation/std_dev_improvememnts 
MCOL-5104: Improved algorithm for STD/VAR functions
 2022-06-06 23:53:48 +03:00
Andrey Piskunov
c7e67aedd9 Renamed variables + removed server tests 2022-06-03 15:30:25 +03:00
Andrey Piskunov
3fbc982ab2 Enable mtr checking for arm 2022-06-03 15:29:30 +03:00
Andrey Piskunov
66c69c7609 Welford's algorithm STD and VAR on window functions 2022-06-03 15:29:30 +03:00
Andrey Piskunov
c5fa27475d Welford algorithm for STD and VAR 
Naive algorithm for calculating STD and VAR is subject to catastrophic
cancellation. A well-known Welford's algorithms is used instead.
 2022-06-03 15:29:30 +03:00
Roman Nozdrin
4e50fca460 Merge pull request #2401 from denis0x0D/statistic_man 
StatisticsManager initialize all plugins.
 2022-06-03 15:41:28 +05:30
Roman Nozdrin
fd8ba33f21 MCOL-5044 This patch replaces PriorityThreadPool with FairThreadPool that uses a simple 
operations + morsel size weight model to equally allocate CPU b/w parallel query morsels.
This patch delivers better parallel query timings distribution(timings graph resembles normal
distribution with a bigger left side thus more queries runs faster comparing with PrioThreadPool-based
single-node installation).
See changes in batchprimitiveprocessor-jl.h and comments in fair_threadpool.h for
important implementation details
 2022-06-03 10:08:12 +00:00
Roman Nozdrin
0f0b3a2bed Disable FairThreadPool unit tests in develop-6 b/c its unit test segfaults in containers 2022-06-02 17:05:30 +00:00
Roman Nozdrin
c92dc08264 MCOL-5044 Initial version of a fair thread pool 
PP now uses PriorityThreadPool that arbitrary picks another jobs pack
    to run. This scheduling discipline tend to run portions of a single query
    forcing other simultaneous queries to wait. In result parallel queries
    timings variance is high. The FairThreadPool picks the job with the smallest
    amount of work done so far(see the code for details)
 2022-06-02 17:05:12 +00:00
benthompson15
652c9299b7 MCOL-4989: Fix error handling for misconfigured StorageManager startup. (#2385) 2022-06-02 08:50:41 -05:00
Denis Khalikov
6c0ebd568b StatisticsManager initialize all plugins. 
This patch adds support for initializing all plugins in the system.
 2022-05-31 12:42:00 +03:00
Roman Nozdrin
4e46645124 Merge pull request #2398 from drrtuy/MCOL-5060-post-install-containers-dev 
MCOL-5060 Fixes post-install script failures in containers
 2022-05-31 14:20:32 +05:30
Roman Nozdrin
c89864c37d MCOL-5060 Fixes post-install script failures in containers 2022-05-30 11:41:09 +00:00
Roman Nozdrin
73a388baac Merge pull request #2394 from drrtuy/MCOL-4912-add-forgotten-funcs-dev 
MCOL-4912 This patch adds some forgotten MDB functions
 2022-05-28 00:57:37 +05:30
Roman Nozdrin
965ca1ca26 MCOL-5105 DMLProc startup/shutdown timeouts affect rollback and graceful shutdown cases, workernode shutdown timeout affects save_brm (#2391) 2022-05-27 13:35:56 -05:00
Roman Nozdrin
f29d5e7869 MCOL-4912 This patch adds some forgotten MDB functions 2022-05-27 16:27:07 +00:00
Leonid Fedorov
2ad4ae2cd2 Merge pull request #2377 from mariadb-SergeyZefirov/small-fix-for-wf-percentile 
Actual fix for percentile window function
 2022-05-19 18:57:00 +03:00
Serguey Zefirov
0dab97da7d Actual fix for percentile window function 
We fix 'partial out-of-bounds reference' warning uncovered when building
with gcc11.
 2022-05-19 15:48:23 +03:00
Roman Nozdrin
d840bb2d52 Merge pull request #2376 from denis0x0D/MCOL-5001 
[MCOL-5001] Explicitly initialize `startupRaceFlag`.
 2022-05-18 19:05:40 +05:30
Denis Khalikov
94ca6fdd34 [MCOL-5001] Explicitly initialize startupRaceFlag. 
Explicitly initialize `startupRaceFlag_` to avoid PrimProc freezing on some platforms.
 2022-05-18 13:38:31 +03:00
Roman Nozdrin
46a964598a Merge pull request #2375 from drrtuy/MCOL-5050-develop 
MCOL-5050 EM Index dbroot container out-of-bound access checks doing …
 2022-05-17 20:46:43 +05:30
Roman Nozdrin
8bf4e0eaa5 MCOL-5050 EM Index dbroot container out-of-bound access checks doing EM deletes 2022-05-17 12:53:33 +00:00
benthompson15
e147184b8d MCOL-5065: return values of getSystemReady/getSystemQueryReady should be > 0 (#2354) 2022-05-10 12:32:17 -05:00
Roman Nozdrin
5d53d609fd Merge pull request #2366 from mariadb-corporation/boost-tarball 
Use boost tarball instead of clone
 2022-05-06 17:29:45 +02:00
Leonid Fedorov
0489682f9d Use boost tarball instead of clone 2022-05-05 16:44:23 +00:00
mariadb-AlexeyVorovich
5f01e42700 Merge pull request #2363 from mariadb-corporation/container-repo 
ci: upd dockerfile repo
 2022-05-05 08:17:57 -04:00
Roman Nozdrin
e4b67690e2 Merge pull request #2362 from mariadb-corporation/mcol4912-extentindex 
Mcol4912 extentindex
 2022-05-05 11:01:48 +02:00
mariadb-RomanNavrotskiy
d21834d103 ci: upd dockerfile repo 2022-05-04 15:36:44 +02:00
Leonid Fedorov
6aadc6cc17 boost::interprocess::vector instead of std::vector 2022-05-04 12:59:40 +00:00
Roman Nozdrin
4c26e4f960 MCOL-4912 This patch introduces Extent Map index to improve EM scaleability 
EM scaleability project has two parts: phase1 and phase2.
        This is phase1 that brings EM index to speed up(from O(n) down
        to the speed of boost::unordered_map) EM lookups looking for
        <dbroot, oid, partition> tuple to turn it into LBID,
        e.g. most bulk insertion meta info operations.
        The basis is boost::shared_managed_object where EMIndex is
        stored. Whilst it is not debug-friendly it allows to put a
        nested structs into shmem. EMIndex has 3 tiers. Top down description:
        vector of dbroots, map of oids to partition vectors, partition
        vectors that have EM indices.
        Separate EM methods now queries index before they do EM run.
        EMIndex has a separate shmem file with the fixed id
        MCS-shm-00060001.
 2022-05-04 12:59:16 +00:00
Roman Nozdrin
fb3eaabd29 Merge pull request #2338 from mariadb-corporation/external-boost 
Use external boost 1.78
 2022-05-04 13:25:22 +02:00
Leonid Fedorov
c25ae4f378 Use external boost 1.78 2022-05-02 18:23:37 +00:00
mariadb-RomanNavrotskiy
53695cf0db add container image steps 
disable suse and centos8 builds
 2022-04-29 16:32:04 +02:00
Leonid Fedorov
1eec9f8ad2 Merge pull request #2340 from commander-trashdin/mcs_UDFs 
Added word bytes
 2022-04-22 01:04:43 +03:00
Commander thrashdin
4bb3743110 Added word bytes 2022-04-20 16:04:14 +03:00
David.Hall
bbb168a846 Mcol 4560 (#2337) 
* MCOL-4560 remove unused xml entries and code that references it.
There is reader code and variables for some of these settings, but nobody uses them.
 2022-04-18 18:00:17 -04:00
Roman Nozdrin
bd4c911ddb Merge pull request #2334 from mariadb-corporation/gtest-discovery 
set gtest discovery mode to pre_test
 2022-04-14 13:18:44 +02:00
mariadb-RomanNavrotskiy
1a2e541255 set gtest discovery mode to pre_test 2022-04-13 21:22:42 +02:00
Leonid Fedorov
5820a21e19 Merge pull request #2331 from drrtuy/MCOL-5001-pp-em-combo-merge-1 
Mcol 5001 pp em combo merge 1
 2022-04-13 15:16:18 +03:00
Leonid Fedorov
ef77c74ace Merge pull request #2303 from drrtuy/MCOL-4809-small-chars-filtering-vectorization 
MCOL-4809 This patch introduces vectorized scanning/filtering for sho…
 2022-04-13 15:15:26 +03:00
Roman Nozdrin
7453db6b02 MCOL-5001 This patch removes ExeMgr traces 2022-04-04 12:50:42 +00:00
Roman Nozdrin
e174696351 MCOL-5001 This patch merges ExeMgr and PrimProc runtimes 
EM and PP are most resource-hungry runtimes.
        The merge enables to control their cummulative
        resource consumption, thread allocation + enables
        zero-copy data exchange b/w local EM and PP facilities.
 2022-04-04 11:46:33 +00:00
benthompson15
2ec502aaf3 MCOL-4576: remove S3 options from cpimport. (#2328) 2022-04-01 09:18:34 -05:00
Roman Nozdrin
7cdc914b4e MCOL-4809 This patch introduces vectorized scanning/filtering for short CHAR/VARCHAR columns 
Short CHAR/VARCHAR column values contain integer-encoded strings.
    After certain manipulations(orderSwap(strnxfrm(str))) the values
    become integers that preserve original strings order relation
    according to a certain translation rules(collation). Prepared
    values are ready to be SIMD-processed.
 2022-04-01 10:28:33 +00:00
Roman Nozdrin
f7e4cefda3 Merge pull request #2318 from commander-trashdin/mcs_UDFs 
Renamed cal-prefixed UDFs to mcs-prefixed
 2022-03-29 15:20:43 +02:00