1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-21 13:40:58 +03:00
Commit Graph

5453 Commits

Author SHA1 Message Date
Patrick LeBlanc
c2aaf6cea2 Fixed compiler warning in resource manager. 2019-12-02 15:18:42 -05:00
Gagan Goel
a5bfd484f4 Enable unhex function and make minor implementation changes. 2019-11-27 17:22:17 +00:00
Roman Nozdrin
5cedeb110b MCOL-3529 This patch implements direct_update and direct_delete features
to properly report the number of rows affected by UPDATE|DELETE.
2019-11-27 09:33:21 -06:00
benthompson15
83ef73a982 add generated script files to gitignore 2019-11-26 13:47:29 -06:00
Andrew Hutchings
57724e5515 Merge pull request #953 from drrtuy/MCOL-3602_MCOL-3593_3
Selected optimizer rewrites addition.
columnstore-1.4.1
2019-11-25 21:50:38 +00:00
David.Hall
ccfc0dc16d Merge pull request #948 from LinuxJedi/fix-code-errors
MCOL-3621 Fix a few cppcheck issues
2019-11-25 15:04:55 -06:00
Roman Nozdrin
aff40f0dbc Merge pull request #949 from tntnatbry/fix-bitcount
Implement bit_count() distributed function and handle hexadecimal string literals in buildReturnedColumn().
2019-11-25 21:51:44 +03:00
Roman Nozdrin
3fabf01e93 MCOL-3593 Disabled full optimizer run and enabled copy-pasted simplify_joins.
Disabled 4th if block in buildOuterJoin to handle non-optimized MDB query
    structures.

    Broke getSelectPlan into pieces: processFrom, processWhere.

MCOL-3593 UNION processing depends on two flags isUnion that comes as
arg of getSelectPlan and unionSel that is a local variable in
getSelectPlan. Modularization of getSelectPlan broke the mechanizm.
This patch is supposed to partially fix it.

MCOL-3593 Removed unused if condition from buildOuterJoin that allows
unsupported construct subquery in ON expression.
Fixed an improper if condition that ignors tableMap entries w/o condition
in external_lock thus external_lock doesn't clean up when the query
finishes.
Fixed wrong logging for queries processed in tableMode. Now rnd_init
properly sends queryText down to ExeMgr to be logged.

MCOL-3593 Unused attribute FromSubQuery::fFromSub was removed.
 getSelectPlan has been modularized into: setExecutionParams,
 processFrom, processWhere. SELECT, HAVING, GROUP BY, ORDER BY
 still lives in getSelectPlan.
Copied optimization function simplify_joins_ into our pushdown
 code to provide the plugin code with some rewrites from MDB it
 expects.
The columnstore_processing_handlers_fallback session variable
 has been removed thus CS can't fallback from SH to partial
 execution paths, e.g. DH, GBH or plugin API.

MCOL-3602 Moved MDB optimizer rewrites into a separate file.

Add SELECT_LEX::optimize_unflattened_subqueries() call to fix IN
 into EXISTS rewrite for semi-JOINs with subqueries.

disable_indices_for_CEJ() add index related hints to disable
 index access methods in Cross Engine Joins.

create_SH() now flattens JOIN that has both physical tables and
 views. This fixes most of views related tests in the regression.
2019-11-25 10:03:32 -06:00
Andrew Hutchings
e1435a34ac Merge pull request #951 from tntnatbry/fix-charset-collation
Fix for charset() and collation() functions.
2019-11-25 10:42:13 +00:00
benthompson15
0ae4969a4d MCOL-3563: new SyncTask was added also had this issue. 2019-11-22 18:42:49 -06:00
benthompson15
a0ffc427ec MCOL-3563: remove the dumb errorHandle test. Misread what this was doing. described the connection test behavior. 2019-11-22 18:36:53 -06:00
benthompson15
3565d237ed MCOL-3563: Fix OpenTask and PingTask for read returning int to a bool. 2019-11-22 17:05:40 -06:00
benthompson15
8d6c2a33bf MCOL-3563: Modify all *TASK tests to use processtask and test connection failures and short message error handling on disconnect. 2019-11-22 17:05:40 -06:00
benthompson15
3e3e0ed89b MCOL-3563: convert some cout to logging messages and default fd for ctrl socket. 2019-11-22 17:05:40 -06:00
benthompson15
3a730a4222 MCOL-3563: fix compiler warnings / type errors.
A previous commit made posix::read changed return value
from bool to int. However some callers still expected
bool and compared a bool<0 which is always false.
2019-11-22 17:05:40 -06:00
Gagan Goel
2e16fe674c 1. Implement bit_count() distributed function.
2. Handle hexadecimal string literals in buildReturnedColumn().
2019-11-22 18:02:47 -05:00
benthompson15
6b916675d5 Merge pull request #952 from LinuxJedi/MCOL-3564
MCOL-3564 Don't double-execute ProcMon
2019-11-22 23:06:56 +01:00
Andrew Hutchings
627f8345ad MCOL-3564 Don't double-execute ProcMon
It is possible for ProcMon can be left behind during a node shutdown.
This patch makes sure it is killed and makes sure it is killed before a new
one starts.
2019-11-22 20:19:56 +00:00
Patrick LeBlanc
947e0f6543 Merge pull request #946 from benthompson15/MCOL-3577
MCOL-3577
2019-11-22 13:45:35 -06:00
Patrick LeBlanc
935826a4fb Merge pull request #950 from pleblanc1976/threadedUMjoin-squashed
Threaded um join squashed
2019-11-22 12:01:20 -06:00
Patrick LeBlanc
acdd8ca9f1 Removed a debugging printout, used RM to get core count. 2019-11-22 10:38:05 -05:00
Gagan Goel
a76ceb5aa0 Get the associated string values for charset()/collation() functions applied to a field. 2019-11-22 01:34:29 +00:00
benthompson15
f3dae6bf0d MCOL-3577: Fix messaging for filesytem sync. 2019-11-21 18:50:05 -06:00
Patrick LeBlanc
449b51defe Merge pull request #947 from jmrojas2332/MCOL-3585
MCOL-3585 update some defaults in config file
2019-11-21 15:39:57 -06:00
benthompson15
d377defa31 MCOL-3577: update syncNow with prefix
to behave like syncNow no prefix.
This should be corrected eventually but is safer now as
previous implementation would possibly result in deadlock.
2019-11-21 15:19:03 -06:00
benthompson15
830490c846 MCOL-3577: Make this run syncFS for storagemanager on all nodes when suspend writes is done from mcsadmin. 2019-11-21 15:19:03 -06:00
benthompson15
18d31fae82 MCOL-3577: cleanup debug logging and comments from copy/paste. 2019-11-21 15:19:03 -06:00
benthompson15
abd7444809 MCOL-3577: Found an issues with the order of dropPrefix Cache before Sync. 2019-11-21 15:19:03 -06:00
benthompson15
5bbd21b8e0 MCOL-3577: Add functionality to sync S3 storage for suspendDatabaseWrites. 2019-11-21 15:19:03 -06:00
Patrick LeBlanc
c866715efe Removed CalpontHome config param. 2019-11-21 14:51:46 -05:00
Patrick LeBlanc
0d26dc447c Squash merge of the threaded UM hash table construction feature.
Conflicts:
	oam/etc/Columnstore.xml.singleserver
2019-11-21 14:41:00 -05:00
Patrick LeBlanc
8c2cef3727 Merge branch 'develop' of github.com:mariadb-corporation/mariadb-columnstore-engine into develop 2019-11-21 14:29:34 -05:00
Andrew Hutchings
dba7220ad3 Fix a few cppcheck issues
Found the following:

* Potential stack explosions with alloca() usage on potentially large
strings
* Memory leaks in WriteEngineServer
* Stack usage out of scope in dataconvert
* A typo in an 'if' statement in dataconvert
2019-11-21 13:52:53 +00:00
jmrojas2332
e712df5d0b MCOL 3585 update some defaults in config file 2019-11-21 06:08:49 +00:00
benthompson15
dbb9b21d26 Merge pull request #943 from LinuxJedi/MCOL-3559
MCOL-3559 Stop postConfigure if mysqld is running
2019-11-20 20:52:40 +01:00
benthompson15
d4d1f4d578 Merge pull request #942 from LinuxJedi/MCOL-3527-2
MCOL-3527 (attempt 2) Fix proc security settings
2019-11-20 20:46:41 +01:00
benthompson15
0f86a3ab14 Merge pull request #945 from LinuxJedi/MCOL-3619
MCOL-3619 Fix multinode initial start on PM > 1
2019-11-19 23:07:31 +01:00
Andrew Hutchings
2275f4fd26 MCOL-3619 Fix multinode initial start on PM > 1
The new "columnstore stop" command doesn't work well if the cluster is
already down. Instead we need to use the older method to stop
ProcMon/ProcMgr on the node before starting it.
2019-11-19 15:14:16 +00:00
Andrew Hutchings
95d0bceae7 MCOL-3559 Stop postConfigure if mysqld is running
It is possible that a user will already have a MariaDB Server running
before executing postConfigure. Exit early in this scenario.
2019-11-18 13:54:06 +00:00
Roman Nozdrin
7c6a086cfb Merge pull request #941 from LinuxJedi/fix-plugin-cpimport
Use execvp instead execv for cpimport
2019-11-18 12:11:30 +03:00
Andrew Hutchings
a079cb8d59 MCOL-3527 (attempt 2) Fix proc security settings
Setting the definer didn't work and gave errors. This is because I
forgot to set the definer for the function too. This patch instead sets
the security level to INVOKER which is probably a better way of handling
this anyway.
2019-11-18 09:01:49 +00:00
Andrew Hutchings
1a94d530fd Use execvp instead execv for cpimport
execv() doesn't use PATH settings so can't find cpimport for
INSERT...SELECT and LOAD DATA INFILE. Switch to execvp() as we have done
in other parts of the codebase.
2019-11-18 07:35:48 +00:00
benthompson15
f291d88979 Merge pull request #940 from LinuxJedi/fix-rep-password
MCOL-3553 Use a rep password MENT will accept
2019-11-15 21:13:48 +01:00
Andrew Hutchings
ac093eacee Merge pull request #939 from LinuxJedi/fix-post-mysql
Fix post-mysql-install
2019-11-15 17:10:25 +00:00
Andrew Hutchings
d432a0ac7a MCOL-3553 Use a rep password MENT will accept
MariaDB Enterprise won't accept our canned replication passed. This
patch updates it to a stronger one it will accept.
2019-11-15 16:59:03 +00:00
benthompson15
22f2b049ef Merge pull request #937 from LinuxJedi/fix-rpms
Fix RPM building
2019-11-15 17:48:49 +01:00
Andrew Hutchings
1fba3f0289 Merge pull request #938 from benthompson15/MCOL-3589
MCOL-3589: Add mcsadmin stopmodule command and modify columnstore stop.
2019-11-15 15:36:51 +00:00
Andrew Hutchings
1814e6c65d Merge pull request #935 from jmrojas2332/MCOL-3597
MCOL 3597
2019-11-15 15:35:28 +00:00
Andrew Hutchings
45f3dd294f Fix post-mysql-install
It was executing based on a condition that will never be true
2019-11-15 15:30:04 +00:00
benthompson15
5ad303e52b MCOL-3589: Add mcsadmin stopmodule command and modify columnstore stop to use it. 2019-11-14 16:01:17 -06:00