database/mariadb-columnstore-engine
1
0
Fork 0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-09-11 08:50:45 +03:00
Code Activity
5,661 Commits 377 Branches 89 Tags
2020f35e88be9ff2ead9f57f06a799c8fe9a227a
Commit Graph

5661 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Roman Nozdrin
77b7ed94ae Merge pull request #2440 from dhall-MariaDB/restore-calonlinealter 
Restore calonlinealter
 2022-07-06 21:25:53 +03:00
david.hall
c71d11cb3f Restore calonlinealter 2022-07-06 09:22:49 -05:00
Leonid Fedorov
242769d542 Mistype bug error handler fix 2022-07-05 18:48:30 +03:00
Roman Nozdrin
a3bc3de5f4 Merge pull request #2432 from mariadb-corporation/dataload-raw 
MCOL-5013: Load Data from S3 into Columnstore
 2022-07-05 13:06:53 +03:00
Roman Nozdrin
38c4b973dd Merge pull request #2421 from denis0x0D/MCOL-4778 
[MCOL-4778] Return if we have an error in push_down_init.
 2022-07-04 21:16:13 +03:00
Roman Nozdrin
15ffcdfda6 Merge pull request #2434 from drrtuy/em_pp_in_mem_exchange_3 
MCOL-5152 This patch enables PP to put ByteStreams into DEC input que…
 2022-07-04 21:11:56 +03:00
Leonid Fedorov
110d9cfab5 Review fixes 2022-07-04 19:52:37 +03:00
Leonid Fedorov
f5b2a6885f MCOL-5013: Load Data from S3 into Columnstore 
Introduced UDF and stored prodecure.
usage:

set columnstore_s3_key='<s3_key>';
set columnstore_s3_secret='<s3_secret>';
set columnstore_s3_region='region';

and then use UDF
select columnstore_dataload("<tablename>", "<filename>", "<bucket>", "<db_name>");
for UDF db_name can be ommited, then current connection db will be used

or stored function
call calpontsys.columnstore_load_from_s3("<tablename>", "<filename>", "<bucket>", "<db_name>");
 2022-07-04 19:52:37 +03:00
Roman Nozdrin
1624c347f6 MCOL-5152 This patch enables PP to put ByteStreams into DEC input queue directly for a local PP-EM connection 2022-07-04 09:06:40 +00:00
Roman Nozdrin
7d955a0f85 This patch fixes changed errno brought by the recent 10.8 changes 2022-07-02 17:12:50 +03:00
Roman Nozdrin
445bf70dc9 Merge pull request #2429 from mariadb-corporation/disable001 
disable 001 for develop
 2022-06-27 10:24:29 +03:00
mariadb-RomanNavrotskiy
dd78265515 disable 001 for develop 2022-06-26 14:49:03 +02:00
Roman Nozdrin
5a368830f2 Merge pull request #2427 from NTH19/MCOL_4995 
WIP MCOL-4995 Research/implement basic vectorized filtering for ARM platforms
 2022-06-24 21:39:12 +03:00
Roman Nozdrin
1e2e3c67b0 Merge pull request #2423 from mariadb-corporation/enable001 
enable 001 on PRs develop
 2022-06-24 20:40:58 +03:00
NTH19
d451b5c7c5 fix 2022-06-24 18:06:04 +08:00
NTH19
a4842ef998 rename 2022-06-24 16:53:02 +08:00
NTH19
4c0b8fd829 simd of arm neon 
unit testing

pass unit test for simdprocessor

add test cases

implement specific _mm_movemask for different types

float movemask change

rename
 2022-06-24 11:24:59 +08:00
mariadb-RomanNavrotskiy
77a9daa41c enable 001 on PRs 2022-06-21 22:57:09 +02:00
Roman Nozdrin
fcf8596089 Merge pull request #2403 from denis0x0D/MCOL-5109 
[MCOL-5109] Make PPS as singleton
 2022-06-21 16:17:05 +03:00
Denis Khalikov
e8f83121d2 [MCOL-4778] Return if we have an error in push_down_init. 2022-06-21 00:06:25 +03:00
benthompson15
ca79d94954 Merge pull request #2255 from dhall-MariaDB/MCOL-4841 
Mcol 4841
 2022-06-15 11:56:02 -05:00
david.hall
9a24934728 MCOL-4841 remove BOOST_BIND_GLOBAL_PLACEHOLDERS 
drone has this defined on the command line
 2022-06-14 16:16:38 -05:00
david.hall
a227fccfa4 MCOL-4841 compiler fixes 2022-06-14 15:02:05 -05:00
david.hall
6d47529499 Merge branch 'develop' into MCOL-4841 2022-06-14 14:41:41 -05:00
david.hall
d4cf894edc MCOL-4841 fix some compiler issues 2022-06-14 14:32:01 -05:00
Roman Nozdrin
5af508e530 Merge pull request #2416 from mariadb-corporation/remove-gtest-discovery 
Replace gtest_discovery_tests with gtests_add_tests
 2022-06-14 17:30:57 +03:00
Leonid Fedorov
3638f4ac8c Replace gtest_discovery_tests with gtests_add_tests 
Despite we have another number of tests in result, they all still run
gtests_add_test cannot parse TYPED_TEST_SUITE one by one and run them
in one bunch
 2022-06-13 15:05:10 +00:00
Roman Nozdrin
928bb510fd Merge pull request #2412 from drrtuy/MCOL-5105-dev 
MCOL-5105 This patch raises pipe read operation timeout to 20 minutes
 2022-06-10 21:21:19 +03:00
Roman Nozdrin
a36681c6cf Merge pull request #2415 from drrtuy/MCOL-5044-revert 
This reverts MCOL-5044 AKA FairThreadPool that breaks regr test002
 2022-06-10 21:19:35 +03:00
Roman Nozdrin
61359119ad This reverts MCOL-5044 AKA FairThreadPool that breaks regr test002 
This reverts commit e40c16bd56, reversing
changes made to 18e6b1d77b.
 2022-06-10 14:17:59 +00:00
David.Hall
272246e9fa Merge branch 'develop' into MCOL-4841 2022-06-09 16:58:33 -05:00
Roman Nozdrin
e40c16bd56 Merge pull request #2404 from drrtuy/MCOL-5044-dev 
MCOL-5044 FairThreadPool implementation
 2022-06-09 22:23:52 +03:00
Roman Nozdrin
18e6b1d77b Merge pull request #2409 from mariadb-corporation/storage-manager-revert 
Revert blind config read patch
 2022-06-09 19:45:42 +03:00
david.hall
3b6449842f Merge branch 'develop' into MCOL-4841 
# Conflicts:
#	exemgr/main.cpp
#	oam/etc/Columnstore.xml.singleserver
#	primitives/primproc/primproc.cpp
 2022-06-09 10:07:26 -05:00
Roman Nozdrin
7c9da5709d MCOL-5105 This patch raises pipe read operation timeout to 20 minutes 
to enable DMLProc to survive rollbacks on startup.
The patch also fixes linter warnings in service.h and pipe.h.
 2022-06-09 14:34:50 +00:00
Leonid Fedorov
184a4b370b Revert blind config read patch 2022-06-09 09:59:47 +00:00
Roman Nozdrin
2d2a6223f5 MCOL-5044 This patch introduces current active jobs estimate counter and replaces some attributes with atomics 2022-06-08 16:58:50 +00:00
Denis Khalikov
467fe0b401 [MCOL-5109] Make a singleton from ServicePrimProc. 
This patch makes a singleton from ServicePrimProc.
 2022-06-07 13:27:45 +03:00
Roman Nozdrin
94ba91c687 Merge pull request #2402 from mariadb-corporation/std_dev_improvememnts 
MCOL-5104: Improved algorithm for STD/VAR functions
 2022-06-06 23:53:48 +03:00
Andrey Piskunov
c7e67aedd9 Renamed variables + removed server tests 2022-06-03 15:30:25 +03:00
Andrey Piskunov
3fbc982ab2 Enable mtr checking for arm 2022-06-03 15:29:30 +03:00
Andrey Piskunov
66c69c7609 Welford's algorithm STD and VAR on window functions 2022-06-03 15:29:30 +03:00
Andrey Piskunov
c5fa27475d Welford algorithm for STD and VAR 
Naive algorithm for calculating STD and VAR is subject to catastrophic
cancellation. A well-known Welford's algorithms is used instead.
 2022-06-03 15:29:30 +03:00
Roman Nozdrin
4e50fca460 Merge pull request #2401 from denis0x0D/statistic_man 
StatisticsManager initialize all plugins.
 2022-06-03 15:41:28 +05:30
Roman Nozdrin
fd8ba33f21 MCOL-5044 This patch replaces PriorityThreadPool with FairThreadPool that uses a simple 
operations + morsel size weight model to equally allocate CPU b/w parallel query morsels.
This patch delivers better parallel query timings distribution(timings graph resembles normal
distribution with a bigger left side thus more queries runs faster comparing with PrioThreadPool-based
single-node installation).
See changes in batchprimitiveprocessor-jl.h and comments in fair_threadpool.h for
important implementation details
 2022-06-03 10:08:12 +00:00
Roman Nozdrin
0f0b3a2bed Disable FairThreadPool unit tests in develop-6 b/c its unit test segfaults in containers 2022-06-02 17:05:30 +00:00
Roman Nozdrin
c92dc08264 MCOL-5044 Initial version of a fair thread pool 
PP now uses PriorityThreadPool that arbitrary picks another jobs pack
    to run. This scheduling discipline tend to run portions of a single query
    forcing other simultaneous queries to wait. In result parallel queries
    timings variance is high. The FairThreadPool picks the job with the smallest
    amount of work done so far(see the code for details)
 2022-06-02 17:05:12 +00:00
benthompson15
652c9299b7 MCOL-4989: Fix error handling for misconfigured StorageManager startup. (#2385) 2022-06-02 08:50:41 -05:00
Denis Khalikov
6c0ebd568b StatisticsManager initialize all plugins. 
This patch adds support for initializing all plugins in the system.
 2022-05-31 12:42:00 +03:00
Roman Nozdrin
4e46645124 Merge pull request #2398 from drrtuy/MCOL-5060-post-install-containers-dev 
MCOL-5060 Fixes post-install script failures in containers
 2022-05-31 14:20:32 +05:30