1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-24 14:20:59 +03:00
Commit Graph

3508 Commits

Author SHA1 Message Date
Roman Nozdrin
f3ae87a1ca Merge pull request #856 from tntnatbry/fix-round-datetime
Add support for DateTime data type in ROUND()
2019-09-07 03:15:03 -07:00
Gagan Goel
c766620d22 Add support for DateTime data type in ROUND() 2019-09-06 21:49:47 -04:00
benthompson15
b658080f06 Merge pull request #854 from mariadb-corporation/remove-vpj
Remove vpj files
2019-09-06 10:01:52 -05:00
benthompson15
016523ef47 Merge pull request #851 from mariadb-corporation/fix-packaging
Fix my.cnf clash
2019-09-05 18:27:45 -05:00
Andrew Hutchings
7da5b21fe2 Add required variable back 2019-09-05 19:03:32 +01:00
Andrew Hutchings
426cb3e1d0 Update gitignore 2019-09-05 17:47:22 +01:00
Andrew Hutchings
3fef0f21d3 Remove vpj files
They shouldn't be here
2019-09-05 17:38:03 +01:00
Roman Nozdrin
64ceb8686f Merge pull request #852 from tntnatbry/fix-exists-limit-subselectitem-orderby
Enable Item::SUBSELECT_ITEM in the order by clause and Do not set the limit to 1 for "exists" in a subquery.
2019-09-05 04:12:59 -07:00
Patrick LeBlanc
dd7bd6fe4a Merge pull request #853 from mariadb-corporation/LoggingFix
StorageManager logging should show up with columnstore logging.
2019-09-04 17:25:51 -05:00
benthompson15
0e5f276d12 StorageManager logging should show up with columnstore logging. 2019-09-04 17:21:46 -05:00
Gagan Goel
67738303ba 1. Enable Item::SUBSELECT_ITEM in the order by clause.
2. Do not set the limit to 1 for "exists" in a subquery.
2019-09-04 16:25:11 -04:00
Andrew Hutchings
74d68b4db3 Fix my.cnf clash
This patch:

* Moves ColumnStore my.cnf to /etc/my.cnf.d/columnstore.cnf
* Removes unneeded entries from columnstore.cnf
* Removes some things that used my.cnf and are now dead
* Also removes utils/scenarios
* Modifies things that use extra defaults file to use the standard one
* Makes sure that C++11 standard is used for older CMake versions

With this patch we no longer need to set -DINSTALL_SYSCONF2DIR and
-DINSTALL_SYSCONFDIR when building MariaDB server.
2019-09-04 18:51:02 +01:00
Andrew Hutchings
ad1f1bc33a Merge pull request #850 from mariadb-corporation/SM-CMake-Fixes
MCOL-3455: link to jemalloc. Fix packaging issues for RPMs
2019-09-04 17:49:32 +01:00
benthompson15
89eff8bc45 MCOL-3455: link to jemalloc. Fix packaging issues for RPMs and other compile issues encounter. 2019-09-03 14:16:34 -05:00
Patrick LeBlanc
ee1537406d Merge pull request #841 from pleblanc1976/random-mods
A couple random SM things
2019-09-03 11:06:03 -05:00
Andrew Hutchings
4d2a1594aa Merge pull request #835 from tntnatbry/union-subquery
Disable processing of a union in a subquery by the select_handler
2019-09-02 06:58:06 +01:00
Andrew Hutchings
658d50eecd Merge pull request #847 from tntnatbry/disable-uservar-funcs
Disable handlers for set_user_var and get_user_var functions in the SELECT clause
2019-09-02 06:57:33 +01:00
Andrew Hutchings
416624f62a Merge pull request #849 from tntnatbry/limit-fix
Fix limit processing.
2019-09-02 06:55:41 +01:00
Gagan Goel
af988635d4 1. Execution plan now sets limitNum and limitOffset for all cases if an explicit limit is supplied in the query.
2. Fallback to using sql_select_limit system variable value if an explicit limit is not supplied.
3. Remove checks that did not allow (2^64 - 1) as a valid limit value.
2019-09-01 23:22:10 -04:00
Gagan Goel
e2084493f3 Disable handlers for set_user_var and get_user_var functions in the SELECT clause 2019-08-30 23:59:37 -04:00
Roman Nozdrin
c3458eaeea Merge pull request #848 from mariadb-corporation/fix-test010
Add missing UDF functions
2019-08-30 18:10:22 -07:00
Andrew Hutchings
40a0c30940 Add missing UDF functions
Some UDF functions were missed when I fixed the install permissions
issue. This adds them back and fixes test010
2019-08-30 17:16:45 +01:00
Gagan Goel
a2a1ab30a2 Merge pull request #846 from drrtuy/FE_crash_subqueries_limit
MCOL-2178 Fix for handlers fallback mechanism patch.
2019-08-29 20:33:33 -04:00
Roman Nozdrin
734518bb41 MCOL-2178 Fix for handlers fallback mechanism patch.
I returned if predicate that guards FE-BE initial connection
block. This predicated had been removed by accident in cb36041

Since we switched to internal ORDER BY FE now reduces the
default limit value to uint64-2 this broke a predicate check
for correlated subqueries. I replaced a predicate with more
reasonable to avoid false positives.
2019-08-30 02:00:03 +03:00
benthompson15
9e1282e437 put unit_test exe in correct place 2019-08-29 17:35:58 -05:00
benthompson15
9b602afab7 Merge pull request #845 from pleblanc1976/excise-hdfs-option
Got rid of the option to use HDFS storage in postconfig.
2019-08-29 14:33:48 -05:00
benthompson15
91067f320e Merge pull request #842 from pleblanc1976/sm-config-documentation
MCOL-3467. Documented all of the vars in the SM config file.  Also add'l # parsi…
2019-08-29 14:29:30 -05:00
Patrick LeBlanc
040f349798 Got rid of the option to use HDFS storage in postconfig.
The code to do whatever OAM/postconfig does with HDFS is still there,
I just removed the ability to select it in postConfig.
2019-08-29 12:14:38 -05:00
Patrick LeBlanc
b58fcc2651 Merge pull request #844 from mariadb-corporation/fix-build
Fix develop build breakages
2019-08-29 08:45:13 -05:00
Andrew Hutchings
4f86b0f909 Fix develop build breakages 2019-08-29 09:44:14 +01:00
Andrew Hutchings
6241b5144c Merge pull request #843 from tntnatbry/remove-curly
Remove a curly brace and add a check in a for loop in create_columnstore_select_handler()
2019-08-29 09:34:11 +01:00
Gagan Goel
92ee66f5fd Remove a curly brace and add a check in a for loop in create_columnstore_select_handler() 2019-08-28 19:29:12 -04:00
Patrick LeBlanc
1982b38e8a Added a couple warnings of what values should not be changed after postConfig. 2019-08-28 16:30:35 -05:00
Patrick LeBlanc
2a78777e06 Documented all of the vars in the SM config file. Also add'l # parsing to Config.
Realized our Config class wouldn't handle tera- (T/t) processing but
no reason it shouldn't.  Ex, they want a 1TB cache, they can specify
'1t' as the cache_size.
2019-08-28 15:19:03 -05:00
Andrew Hutchings
0602a57c61 Merge pull request #840 from drrtuy/unsupported_features_check_2
MCOL-2178 Moving MDEV-19831 logic into the plugin code.
2019-08-28 20:00:22 +01:00
Patrick LeBlanc
fc8f68e391 A couple random things
- Re-added the StorageManager/Enabled key in the default config file.
  Thought I had switched all that stuff to only look at DBRootStorageType
  but I was wrong.
- Made the unit_tests bin for SM stay in the SM dir
- Collapsed one level of build dirs for SM.  For some reason it was
  putting test data in storage-manager/storage-manager/testData
- Limited a single read() call to 100MB as a paranoid safety measure.
  Normal usage won't read that much at once anyway.
2019-08-28 12:56:52 -05:00
Roman Nozdrin
cb36041587 MCOL-2178 CS now explicitly calls MDB's optimizer using JOIN::optimizer_inner
call.

CS doesn't use SH for SELECT..INTO OUTFILE queries.

Clean up gwi::physTableList when processing Storage API request.

SH now explicitly set an execution error in THD::stmt_da.

SH now set queryState in select_next() to mark a begging of the execution.
2019-08-28 12:22:11 -05:00
Patrick LeBlanc
e203ea262f Merge pull request #839 from mariadb-corporation/MCOL-3426
MCOL-3426: Fix writes that start past current EOF.
2019-08-28 10:55:51 -05:00
benthompson15
bb015a600b Fix some error case handling to not update counts or write metadata when not required. 2019-08-28 10:48:50 -05:00
benthompson15
fab69d1717 Merge pull request #838 from pleblanc1976/j-merge-opt
Wrote a version of mergejournal that uses more mem but reduces the io op requirement.
2019-08-27 14:59:44 -05:00
Patrick LeBlanc
e5a6e8401e MCOL-3460. Found that indeed this is a worthwhile optimization.
Write and appendtask were breaking the incoming data into 1MB chunks
to call IOC::write/append() with.  Keeping the limit for safety,
but bumping it to 100MB.
2019-08-27 14:40:40 -05:00
benthompson15
4d8523cf86 MCOL-3426: Fix writes that start past current EOF. 2019-08-26 13:52:51 -05:00
Roman Nozdrin
2c63258537 MCOL-2178 SH now allows to fallback to other pushdown handlers.
SH query execution migrated from SH::init() into create_SH().
There is a session variable columnstore_processing_handlers_fallback
that allows to fallback to DH, GBH if SH fails. DH now uses semantic
tree check for unsupported features to allow to fallback to GBH or
storage API.

Fixes GBH related bug when create_GBH() returns a handler for
queries with impossible WHERE/HAVING.

Fixed bug in FromSubquery::transform() where isUnion is set to true.

Enabled RTTI b/c server team enabled it for MDB.

Removed unused code supposed to be used with vtable.
2019-08-25 04:05:59 +03:00
Patrick LeBlanc
281443cb0a Wrote a version of mergejournal that uses more mem but reduces the io op
requirement.  Added a safety valve; if the journal file is > 100MB, it
will fall back to the previous IO op heavy but mem friendly version.

This also includes a compiler warning fix for smls & smput.
2019-08-22 16:38:27 -05:00
Patrick LeBlanc
c567e9d046 Merge pull request #837 from mariadb-corporation/MCOL-3421
MCOL-3421
2019-08-22 14:09:03 -05:00
benthompson15
b9dbc079ac Cleanup changes and make more flexible to run 2019-08-22 13:18:28 -05:00
Gagan Goel
e60fbf260f Disable processing of a union in a subquery by the select_handler 2019-08-21 21:59:27 -04:00
benthompson15
5249066ada Checkout unit_test fixes. 2019-08-21 16:04:09 -05:00
benthompson15
77f311c086 Handle if you set common_prefix_depth to -1 as described in .cnf file 2019-08-21 16:03:47 -05:00
benthompson15
050f8c0be5 Lock condition possible exposed by unit_test. 2019-08-21 16:00:57 -05:00