1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-04-18 21:44:02 +03:00

186 Commits

Author SHA1 Message Date
Denis Khalikov
6a6db672db
feat(FDB): [FDB BlobHandler] Add writeOrUpdateBlob, update read and remove. (#3373)
This patch:
1) Adds a `writeOrUpdateBlob` function.
2) Updates `read` and `remove` to take in account the size of the
`keys` and `values` for one FDB transaction.
2025-03-14 11:39:06 +00:00
Aleksei Antipovskii
5556d818f8 chore(codestyle): mark virtual methods as override 2025-02-21 20:02:38 +04:00
Sergey Zefirov
3bc8bd8cc6
fix(group by, having): MCOL-5776: GROUP BY/HAVING closer to server's (#3257)
This patch introduces an internal aggregate operator SELECT_SOME that
is automatically added to columns that are not in GROUP BY. It
"computes" some plausible value of the column (actually, last one
passed).

Along the way it fixes incorrect handling of HAVING being transferred
into WHERE, window function handling and a bit of other inconsistencies.
2024-12-20 19:12:32 +00:00
Denis Khalikov
8f8620210b
feat(SM,FDB): MCOL-5720 Move meta to FDB. (#3369) 2024-12-17 10:05:18 +00:00
Denis Khalikov
bba2133cd0
fix(fdb,regression): Add cluster path for test config (#3359) 2024-12-03 09:17:34 +00:00
Denis Khalikov
a6eb5ca689
MCOL-5719: Move ownership mechanism to KV storage. (#3266)
* MCOL-5719 Move ownership mechanism to FDB
2024-11-09 19:47:04 +00:00
Alexey Antipovsky
4f49c7870a
fix(SM): check for duplicates (#3314)
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2024-09-10 17:50:59 +03:00
Denis Khalikov
bb861f8fab FDB
This patch moves FDB to utils dir and adds test on `remove keys range`.
2024-08-28 15:02:08 +04:00
Denis Khalikov
90023272dd MCOL-5784 Add test to MTR test suite. 2024-08-21 20:25:11 +04:00
Alexey Antipovsky
c22409760f
feat(SM): MCOL-5785 Add timeout options for S3Storage (#3265)
* Update libmarias3

fix build with the recent libmarias3

* feat(SM): MCOL-5785 Add timeout options for S3Storage

    In some unfortunate situations StorageManager may get stuck on
    network operations. This commit adds the ability to set network
    timeouts which will help to ensure that the system is more
    responsive.

* feat(SM): MCOL-5785 Add smps & smkill tools

    * `smps` shows all active S3 network operations
    * `smkill` terminates S3 network operations

    NB! At the moment smkill is able to terminate operations
    that are stuck on retries, but not hang inside the libcurl
    call. In other words if you want to terminate all operations
    you should configure `connect_timeout` & `timeout`
---------

Co-authored-by: Leonid Fedorov <leonid.fedorov@mariadb.com>
2024-08-21 18:38:49 +03:00
Leonid Fedorov
b155354d40 comment the test temporaly 2024-08-18 01:30:37 +04:00
Leonid Fedorov
cc9a1b0491 chore(deps): try to use prebuild packages within CI process 2024-08-18 00:36:11 +04:00
Denis Khalikov
15514e15b2 MCOL-5784 Add C++ wrapper for FDB 2024-08-17 21:48:36 +04:00
Roman Nozdrin
cacbbee1c2
MCOL-5175 Increase the maximum effective length of S3 secret used as SHA256 key producing S3 signature (#2859)
Co-authored-by: Roman Nozdrin <rnozdrin@mariadb.com>
2023-06-07 15:24:02 +03:00
Roman Nozdrin
4fe9cd64a3
Revert "No boost condition (#2822)" (#2828)
This reverts commit f916e64927cd81569327014f20c4cc0b8aca40ff.
2023-04-22 15:49:50 +03:00
Leonid Fedorov
f916e64927
No boost condition (#2822)
This patch replaces boost primitives with stdlib counterparts.
2023-04-22 00:42:45 +03:00
Leonid Fedorov
c2d0fa24da replace boost::shared_array<T> to std::shared_ptr<T[]> 2023-04-14 10:33:27 +00:00
Leonid Fedorov
a508b86091 remove boost/shared_array include 2023-04-14 09:42:50 +00:00
Leonid Fedorov
2e1394149b
MCOL-5464: Fixes of bugs from ASAN warnings, part one (#2792)
* Fixes of bugs from ASAN warnings, part one

* MQC as static library, with nifty counter for global map and mutex

* Switch clang to 16

* link messageqcpp to execplan
2023-04-04 02:33:23 +03:00
Otto Kekäläinen
70124ecc01 Fix trivial spelling errors
- occured -> occurred
- reponse -> response
- seperated -> separated

All new code of the whole pull request, including one or several files
that are either new files or modified ones, are contributed under the
BSD-new license. I am contributing on behalf of my employer Amazon Web
Services, Inc.
2023-03-11 11:59:47 -08:00
Sam James
20b5dbb617
Add missing includes
These seem to have all fallen out of a recent Boost update to 1.81 which
dropped some internal includes. All of these uses within columnstore
relied on these transitive includes, so explicitly include what we need
to fix build.

Signed-off-by: Sam James <sam@gentoo.org>
2023-01-17 01:18:41 +00:00
Leonid Fedorov
d42485656c Fix clang 16 warnings for comfort build 2023-01-12 22:11:28 +03:00
david.hall
9935431b31 Remove blank lines 2022-11-17 12:02:31 -06:00
Leonid Fedorov
37fd915a08 Serg`s patch for develop-6 revised for develop https://github.com/mariadb-corporation/mariadb-columnstore-engine/pull/2614 2022-11-09 22:41:38 +00:00
benthompson15
4630db9206
MCOL-5177: Error handling for HTTP 301 response from AWS S3. (#2570) 2022-09-27 11:49:20 -05:00
Leonid Fedorov
58f96ac9ae Sanitizers are not ready for all Distros 2022-09-19 19:26:17 +03:00
Leonid Fedorov
51a04ba960 Fixing some test for StorageManagerm commenting all broken rest 2022-09-16 18:51:10 +00:00
Leonid Fedorov
7e17d88254 cmake version set to 3.10 2022-09-01 16:03:29 +03:00
Leonid Fedorov
726cc3684b Proper external_boost for storage manager, cmake version REQUIRES 2022-08-30 22:41:44 +00:00
Sergei Golubchik
a7a9ccf889
Serg dev (#2504)
* more build dependencies

* fix for cmake < 3.11

It cannot do ADD_LIBRARY(... ALIAS ...) on IMPORTED targets

* another fix for cmake 3.10.2

It doesn't know about CMAKE_CXX_STANDARD=20,
let's add the correct flag manually

* gcc 8 on aarch64

utils/common/simd_arm.h:241:16: error: need ‘typename’ before ‘simd::TypeToVecWrapperType<T>::WrapperType’ because ‘simd::TypeToVecWrapperType<T>’ is a dependent scope
2022-08-15 13:35:30 +03:00
Leonid Fedorov
184a4b370b Revert blind config read patch 2022-06-09 09:59:47 +00:00
benthompson15
652c9299b7
MCOL-4989: Fix error handling for misconfigured StorageManager startup. (#2385) 2022-06-02 08:50:41 -05:00
Leonid Fedorov
c25ae4f378 Use external boost 1.78 2022-05-02 18:23:37 +00:00
Leonid Fedorov
65252df4f6 C++20 fixes 2022-03-28 12:32:29 +00:00
benthompson15
dc4f6865d1
MCOL-3983: always set threadpool max threads in storagemanager (#2269) 2022-02-23 12:21:43 -06:00
Leonid Fedorov
3919c541ac
New warnfixes (#2254)
* Fix clang warnings

* Remove vim tab guides

* initialize variables

* 'strncpy' output truncated before terminating nul copying as many bytes from a string as its length

* Fix ISO C++17 does not allow 'register' storage class specifier for outdated bison

* chars are unsigned on ARM, having  if (ival < 0) always false

* chars are unsigned by default on ARM and comparison with -1 if always true
2022-02-17 13:08:58 +03:00
Leonid Fedorov
04752ec546 clang format apply 2022-01-21 16:43:49 +00:00
Leonid Fedorov
01f3ceb437 replace header guards with #pragma once 2022-01-21 15:24:58 +00:00
Leonid Fedorov
5c5f103f98
MCOL-4839: Fix clang build (#2100)
* Fix clang build

* Extern C returned to plugin_instance

Co-authored-by: Leonid Fedorov <l.fedorov@mail.corp.ru>
2021-08-23 10:45:10 -05:00
David.Hall
211d047186
Merge pull request #1907 from benthompson15/MCOL-4598
MCOL-4598: Fix the syslog setup script.
2021-04-29 16:41:08 -05:00
benthompson15
1eea9f9e47 MCOL-4598: Fix the syslog setup script. Add syslog options for broken/non-syslog setup. 2021-04-29 16:34:53 -05:00
benthompson15
b4b9bdf046 MCOL-4599: Comment in storagemanager.cnf explaining default endpoint usage. 2021-04-29 14:35:00 -05:00
benthompson15
401c0fd5c7 MCOL-3542: Add ability to set libmarias3 options via StorageManager cnf file. 2021-03-31 16:13:03 -05:00
benthompson15
8dde6c5cb0 MCOL-4386: remove debug logging 2021-03-30 13:10:31 -05:00
benthompson15
a953409df5 MCOL-4386: Create new StorageManager setting for EC2 using assigned IAM credentials. 2021-03-30 13:10:12 -05:00
benthompson15
438d6949d5 MCOL-4437: change VLArray definition for ScopedCloser 2020-12-10 09:33:05 -06:00
benthompson15
02dd4f6ab6 MCOL-3889: use ENGINE_DATADIR cmake value for storagemanager.cnf paths 2020-12-03 16:32:00 -06:00
Alexey Antipovsky
b25fee320a Remove variable-length arrays (-Wvla) 2020-11-17 15:03:10 +03:00
Alexey Antipovsky
0e29b0b0f9 Fix -Wtype-limits 2020-11-17 15:03:10 +03:00
Alexander Barkov
ab44ef6ddb MCOL-4170 Refactor services/systemd units to finish their bootstrap ... 2020-11-09 12:01:16 +04:00