database/mariadb-columnstore-engine
1
0
Fork 0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-07-01 06:21:41 +03:00
Code Activity
6,055 Commits 343 Branches 88 Tags
feat/counting-alloc-23.02
Commit Graph

11 Commits

Author SHA1 Message Date
drrtuy
4a2c73780a fix(messageqcpp): MCOL-5636 same node communication crashes transmiting PP errors to EM b/c error messaging leveraged socket that was a nullptr. (#3106) 2024-01-17 20:18:23 +03:00
drrtuy
79ad78f91f fix(threadpool): MCOL-5565 queries stuck in FairThreadScheduler. (#3100) 
Meta Primitive Jobs, .e.g ADD_JOINER, LAST_JOINER stuck
	in Fair scheduler without out-of-band scheduler. Add OOB
	scheduler back to remedy the issue.
 2024-01-13 11:54:08 +03:00
drrtuy
2802e2810f fix(pp-threadpool): MCOL-5565 the workaround for a stuck tests001 in CI (#2947) 
CI ocassionaly stuck running test001 b/c PP threadpool endlessly reschedules
    meta jobs, e.g. BATCH_PRIMITIVE_CREATE, which ByteStreams were somehow damaged or read out.

Co-authored-by: Leonid Fedorov <leonid.fedorov@mariadb.com>
 2023-09-01 18:09:44 +03:00
Roman Nozdrin
0907ca414f MCOL-5044 This patch simplifies addJob interfaces removing extra bool that control mutex locking, 
adds additional nullptr dereference check in removeJobs and fixes FairThreadPool
hashmap iter invalidation issues
 2022-07-09 12:50:30 +00:00
Roman Nozdrin
a3c582d9fe WIP with map clean-up 2022-07-09 12:38:52 +00:00
Roman Nozdrin
0e8014db02 MCOL-5044 Adding EXTRA thread logic into FairThreadPool 2022-07-09 12:38:52 +00:00
Roman Nozdrin
6cff14997d Revert "This reverts MCOL-5044 AKA FairThreadPool that breaks regr test002" 
This reverts commit 61359119ad.
 2022-07-09 12:38:51 +00:00
Roman Nozdrin
61359119ad This reverts MCOL-5044 AKA FairThreadPool that breaks regr test002 
This reverts commit e40c16bd56, reversing
changes made to 18e6b1d77b.
 2022-06-10 14:17:59 +00:00
Roman Nozdrin
2d2a6223f5 MCOL-5044 This patch introduces current active jobs estimate counter and replaces some attributes with atomics 2022-06-08 16:58:50 +00:00
Roman Nozdrin
fd8ba33f21 MCOL-5044 This patch replaces PriorityThreadPool with FairThreadPool that uses a simple 
operations + morsel size weight model to equally allocate CPU b/w parallel query morsels.
This patch delivers better parallel query timings distribution(timings graph resembles normal
distribution with a bigger left side thus more queries runs faster comparing with PrioThreadPool-based
single-node installation).
See changes in batchprimitiveprocessor-jl.h and comments in fair_threadpool.h for
important implementation details
 2022-06-03 10:08:12 +00:00
Roman Nozdrin
c92dc08264 MCOL-5044 Initial version of a fair thread pool 
PP now uses PriorityThreadPool that arbitrary picks another jobs pack
    to run. This scheduling discipline tend to run portions of a single query
    forcing other simultaneous queries to wait. In result parallel queries
    timings variance is high. The FairThreadPool picks the job with the smallest
    amount of work done so far(see the code for details)
 2022-06-02 17:05:12 +00:00