1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-09-02 12:41:17 +03:00
Commit Graph

2164 Commits

Author SHA1 Message Date
David Hill
3b026f44b4 MCOL-1762 - added joblist ThreadPoolSize 2018-10-09 15:34:35 -05:00
David.Hall
e183557b67 Merge pull request #577 from mariadb-corporation/MCOL-1750b
MCOL-1750 Fix threadpool stack leaks
2018-09-28 10:26:54 -05:00
Andrew Hutchings
5092b4fd13 MCOL-1750 unique_ptr doesn't work in all OSes 2018-09-28 07:55:06 +01:00
Andrew Hutchings
94dfacfe25 MCOL-1750 Fix threadpool stack leaks
When a thread has been idle for 10 minutes and we have too many threads
in the threadpool the thread will be pruned. This is done by the
thread's main function just returning. Unfortunately this does not free
up the memory, the thread either needs to be joined or detatched.

We cannot use detached threads since there are mutexes and conditional
variables between the main thread and the threadpool threads. If the
main thread finishes before the threadpool threads (as would happen in
cpimport) then crashes occur. The parent needs to wait on the child
threads which is the whole point in joining.

So this fix spawns a new thread which every minute will check the list
of threads to be joined due to timeout and join them.

We have had to use an adapted version of boost::thread_group so that we
can join a single thread based off its thread ID.

In addition with have modified PriorityThreadPool to use detached
threads since this does not need to signal the child threads at the end.
2018-09-28 07:21:49 +01:00
Roman Nozdrin
f78c90cd3c Merge pull request #575 from mariadb-corporation/MCOL-1737
MCOL-1737 Add debug logging options for LRU cache
2018-09-21 17:19:38 +03:00
Andrew Hutchings
24c5e93756 MCOL-1737 Add debug logging options for LRU cache
This adds options which are user enabled to debug the LRU cache inside
ColumnStore. Specifically cache flushing.

It adds the following:
* PrimProc flush information when SIGUSR2 mode is enabled
* cpimport dictionary flush information when -d2 is used
* WriteEngineServer DML flush information to STDERR
2018-09-21 09:50:10 +01:00
benthompson15
b74838bb50 Merge pull request #561 from mariadb-corporation/MCOL-1523-2
MCOL-1523 - additional fixes
2018-09-17 10:41:49 -05:00
David Hill
3ac9d93597 MCOL-1523 - addiiotnal fixes 2018-09-15 14:28:46 -05:00
benthompson15
8be2e5bb4b Merge pull request #559 from mariadb-corporation/MCOL-1699
MCOL-1699 - fix iss with adddbroot amazon
2018-09-13 11:22:47 -05:00
benthompson15
c8e041009c Merge pull request #558 from mariadb-corporation/MCOL-1523
Mcol 1523
2018-09-13 11:22:21 -05:00
David Hill
8ec02bfce5 MCOL-1423 2018-09-12 14:31:23 -05:00
David Hill
21f108896d MCOL-1523 - fix compile issue 2018-09-12 08:36:13 -05:00
David Hill
f7a2b50b21 MCOL-1699 - fix iss with adddbroot amazon 2018-09-11 15:47:25 -05:00
Andrew Hutchings
441961904f Merge pull request #553 from mariadb-corporation/MCOL-1188-1.1
Mcol 1188 1.1
2018-09-11 14:13:27 +01:00
david hill
43b97e7fa3 Merge branch 'develop-1.1' into MCOL-1523 2018-09-10 14:15:32 -05:00
benthompson15
563ff34ae4 Merge pull request #557 from mariadb-corporation/version1.1.7
bump version
2018-09-10 14:11:33 -05:00
David Hill
c50f5fa05d bump version 2018-09-10 13:03:35 -05:00
David.Hall
a3cc11e003 Merge pull request #554 from mariadb-corporation/MCOL-1694
MCOL-1694 & MCOL-1505 Improved exception handling
2018-09-07 17:01:39 -05:00
Andrew Hutchings
14d3a34c28 MCOL-1694 & MCOL-1505 Improved exception handling
This patch catches exceptions in DDLProc, DMLProc and ExeMgr which could
potentially happen during startup. Logging them instead of silently
ignoring them (or crashing in ExeMgr).
2018-09-07 11:43:54 +01:00
David Hill
8b0507b987 MCOL-1523 2018-09-05 14:53:13 -05:00
David Hill
e5f18964f0 MCOL-1523 2018-09-04 16:41:44 -05:00
Ravi Prakash
5247dfa082 MCOL-1188 assertion 'fColumn.get() && fSub && fFunc' failed,...
Some cleanup for the previous check-in.
2018-09-04 12:20:40 -07:00
Ravi Prakash
58bc867ca1 MCOL-1188 assertion 'fColumn.get() && fSub && fFunc' failed, ... MySQL server crashed.
The problem was in processing a subquery in the where clause that was categorized as a
CACHE_ITEM in the parse tree. The fix involved how we walk the parse tree in gp_walk().
2018-08-30 20:24:24 -07:00
Andrew Hutchings
81761840ac Merge pull request #550 from drrtuy/MCOL-1675
MCOL-1675 When insert record calculate HWM using a column with the smallest width instead of the first column in the same way as in MCOL-984.
2018-08-29 12:01:15 +01:00
Roman Nozdrin
4572c25534 MCOL-1675 When insert record calculate HWM using a column with the smallest width instead of the first column in the same way as in MCOL-984. 2018-08-28 11:29:38 +03:00
David.Hall
128b1b7ffa Merge pull request #547 from drrtuy/MCOL-1660
MCOL-1660/1659 Table/column identifiers support spaces in DDL.
2018-08-20 10:05:05 -05:00
Roman Nozdrin
07bd413053 MCOL-1660/1659 Table/column identifiers support spaces in DDL.
MCOL-1660/1659 Table/column identifiers support spaces in DDL.
2018-08-18 15:29:52 +03:00
Andrew Hutchings
fdb4ef7f79 Merge pull request #542 from drrtuy/MCOL-1655
MCOL-1655 removed hardcoded %debug from ddl.y.
2018-08-17 08:02:02 +01:00
Roman Nozdrin
a98aec07fa MCOL-1655 removed hardcoded %debug from ddl.y. 2018-08-17 01:10:00 +03:00
benthompson15
b5c38888c0 Merge pull request #536 from mariadb-corporation/MCOL-1523-1
MCOL-1523 - fix issue with query failing and enablemodule failing try…
2018-08-16 10:55:17 -05:00
Andrew Hutchings
88bdfccea8 Merge pull request #538 from mariadb-corporation/MCOL-1635-1.1
Fix MCOL-1635 where an "insert into table select query" crashes the s…
2018-08-15 08:38:15 +01:00
Ravi Prakash
5df447b6ec Fix MCOL-1635 where an "insert into table select query" crashes the server. This happens
for a MEDIUMBLOB column type.
2018-08-14 11:59:09 -07:00
David Hill
e903e47201 MCOL-1523 - fix issue with query failing and enablemodule failing trying to get um1 back. 2018-08-10 18:37:40 -05:00
David Hill
b5a39ea789 MCOL-1523 - fix issue with query failing and enablemodule failing trying to get um1 back. 2018-08-10 16:15:58 -05:00
David Hill
5927b1cf81 MCOL-1523 - fix issue with query failing and enablemodule failing trying to get um1 back. 2018-08-10 16:01:12 -05:00
benthompson15
150171b714 Merge pull request #535 from mariadb-corporation/MCOL-1605
MCOL-1605 - changed error to debug, alarms trying to get issued befor…
2018-08-09 17:49:01 -05:00
david hill
1068679fbf Merge pull request #534 from mariadb-corporation/MCOL-1610
MCOL-1610
2018-08-07 08:57:07 -05:00
David Hill
8a4294978f MCOL-1605 - changed error to debug, alarms trying to get issued before procmgr is up 2018-08-07 08:54:08 -05:00
benthompson15
ee40c3ac05 Merge pull request #523 from mariadb-corporation/MCOL-1579
MCOL-1579 Remove chmod of /dev/shm
2018-08-06 13:02:08 -05:00
benthompson15
0df1b92226 Merge pull request #525 from mariadb-corporation/MCOL-1472
MCOL-1472 Add switch to handle nested case
2018-08-06 12:33:47 -05:00
Ben Thompson
515cc31d4f MCOL-1610: modify so if moving a dbroot fails with gluster it is reassigned to original owner. Add logging around failure for mounting gluster volumes. 2018-08-06 10:10:52 -05:00
benthompson15
d1969e4f6e Merge pull request #532 from mariadb-corporation/MCOL-1498
Mcol 1498 - add password prompt for non-dstribution install
2018-08-03 10:10:20 -05:00
benthompson15
c342042711 Merge pull request #531 from mariadb-corporation/MCOL-1591
MCOL-1591 - add umask test to tester
2018-08-03 10:09:53 -05:00
benthompson15
06c4bd97a9 Merge pull request #530 from mariadb-corporation/MCOL-1145-1
MCOL-1145/1146 - fix nonroot install lib issue
2018-08-03 10:09:38 -05:00
benthompson15
7c4f0ada0f Merge pull request #529 from mariadb-corporation/MCOL-1523
Mcol 1523 - um failover when ddl/dml process fail to start
2018-08-03 10:09:22 -05:00
David Hill
0837f9a520 MCOL-1498 - add prompt for password on non-distibute installs 2018-08-02 11:51:27 -05:00
David Hill
5d245c8932 MCOL-1498 - add prompt for password on non-distibute installs 2018-08-02 10:59:38 -05:00
David Hill
8043674432 MCOL-1591 - add umask test to tester 2018-08-01 16:34:40 -05:00
David Hill
d86fabff65 MCOL-1145/1146 - fix nonroot install lib issue 2018-08-01 10:17:13 -05:00
David Hill
a3862a42f7 um failover changes 2018-07-31 15:51:32 -05:00