1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-21 13:40:58 +03:00
Commit Graph

5453 Commits

Author SHA1 Message Date
benthompson15
fab69d1717 Merge pull request #838 from pleblanc1976/j-merge-opt
Wrote a version of mergejournal that uses more mem but reduces the io op requirement.
2019-08-27 14:59:44 -05:00
Patrick LeBlanc
e5a6e8401e MCOL-3460. Found that indeed this is a worthwhile optimization.
Write and appendtask were breaking the incoming data into 1MB chunks
to call IOC::write/append() with.  Keeping the limit for safety,
but bumping it to 100MB.
2019-08-27 14:40:40 -05:00
Andrew Hutchings
a35e011e6d Merge pull request #836 from mariadb-corporation/MCOL-3423
Mcol 3423
2019-08-27 14:04:24 +01:00
Andrew Hutchings
b3ef33173d Merge pull request #809 from mariadb-corporation/MCOL-174
Mcol 174
2019-08-27 13:58:50 +01:00
benthompson15
4d8523cf86 MCOL-3426: Fix writes that start past current EOF. 2019-08-26 13:52:51 -05:00
Roman Nozdrin
2c63258537 MCOL-2178 SH now allows to fallback to other pushdown handlers.
SH query execution migrated from SH::init() into create_SH().
There is a session variable columnstore_processing_handlers_fallback
that allows to fallback to DH, GBH if SH fails. DH now uses semantic
tree check for unsupported features to allow to fallback to GBH or
storage API.

Fixes GBH related bug when create_GBH() returns a handler for
queries with impossible WHERE/HAVING.

Fixed bug in FromSubquery::transform() where isUnion is set to true.

Enabled RTTI b/c server team enabled it for MDB.

Removed unused code supposed to be used with vtable.
2019-08-25 04:05:59 +03:00
davidjmott
90eb1c1369 Merge pull request #821 from mariadb-corporation/MCOL-3419
MCOL-3419 Get rid of std::locale::global() from MCOL-1559.
2019-08-22 16:46:39 -05:00
David Hall
881410d397 MCOL-174 fix compile errors 2019-08-22 16:39:02 -05:00
Patrick LeBlanc
281443cb0a Wrote a version of mergejournal that uses more mem but reduces the io op
requirement.  Added a safety valve; if the journal file is > 100MB, it
will fall back to the previous IO op heavy but mem friendly version.

This also includes a compiler warning fix for smls & smput.
2019-08-22 16:38:27 -05:00
David Hall
418ceb73dc Merge branch 'develop-1.2' into MCOL-174 2019-08-22 16:37:50 -05:00
Patrick LeBlanc
c567e9d046 Merge pull request #837 from mariadb-corporation/MCOL-3421
MCOL-3421
2019-08-22 14:09:03 -05:00
benthompson15
b9dbc079ac Cleanup changes and make more flexible to run 2019-08-22 13:18:28 -05:00
Gagan Goel
e60fbf260f Disable processing of a union in a subquery by the select_handler 2019-08-21 21:59:27 -04:00
benthompson15
5249066ada Checkout unit_test fixes. 2019-08-21 16:04:09 -05:00
benthompson15
77f311c086 Handle if you set common_prefix_depth to -1 as described in .cnf file 2019-08-21 16:03:47 -05:00
benthompson15
050f8c0be5 Lock condition possible exposed by unit_test. 2019-08-21 16:00:57 -05:00
benthompson15
83789d7180 iocBytesRead was not getting set in ctor 2019-08-21 16:00:13 -05:00
benthompson15
6454b53572 Fix SM_TRACE flag. 2019-08-21 15:59:29 -05:00
benthompson15
fa0da4b9bb Merge pull request #834 from pleblanc1976/develop
Bring in the fixes to make S3 lib work with google cloud storage.
2019-08-21 15:50:27 -05:00
benthompson15
ea1cf03e5f Merge pull request #833 from pleblanc1976/toolkit-useability
MCOL-3438. SM Toolkit usability
2019-08-21 15:49:28 -05:00
David Hall
608a042065 MCOL-3423 revert PR #806, which reverted ostensibly no longer needed code from MCOL-3343. That code is needed. 2019-08-20 16:02:39 -05:00
Patrick LeBlanc
d36d8b6831 Bring in the fixes to make S3 lib work with google cloud storage. 2019-08-20 15:52:40 -05:00
Patrick LeBlanc
47a662b231 MCOL-3438. Made it more sensible. Ownership is still confusing even to
me, the author, but this makes the view of the SM-managed files consistent
for the sm* toolkit.
2019-08-20 15:06:21 -05:00
Andrew Hutchings
4ef1133d9f Merge pull request #832 from drrtuy/fix-fixed
Fix MDB crash bug with failed assertion on Item_func::fixed.
2019-08-20 19:35:53 +01:00
Roman Nozdrin
630f926dc6 Fix MDB crash bug with failed assertion on Item_func::fixed. 2019-08-20 21:12:09 +03:00
David Hall
612eac145b Merge branch 'develop-1.2' into MCOL-3423 2019-08-20 09:52:08 -05:00
David Hall
95fcc3dcbb MCOL-3423 Don't move decimal for LONG DOUBLE. Clear long double extra bits after copy, not before. 2019-08-20 09:50:43 -05:00
benthompson15
0024f6615b Merge pull request #831 from mariadb-corporation/MCOL-3441
MCOL-3441 Fix in-tree builds
2019-08-20 09:47:26 -05:00
Andrew Hutchings
94e77a33c5 MCOL-3441 Fix in-tree builds
A copy command was failing for in-tree builds.
2019-08-20 11:15:54 +01:00
Roman Nozdrin
99d5d96bec Merge pull request #830 from tntnatbry/between-in-case-fix
Fixes for BETWEEN/IN/CASE functions
2019-08-20 11:29:01 +03:00
Patrick LeBlanc
a7fd3bf5d1 A few fixes in Synchronizer. If you have a prefix with a '_'
char, the key breakout wouldn't be correct until this.
2019-08-19 17:02:29 -05:00
Patrick LeBlanc
bcd50eaf6b Made IOC only return files that end with .meta 2019-08-19 15:04:19 -05:00
Patrick LeBlanc
bba8009c75 Checkpointing a possible insanity-fix to Ownership. 2019-08-19 13:37:10 -05:00
benthompson15
7ddb755ee1 Merge pull request #829 from pleblanc1976/toolkit-fix
SM toolkit fix (mcol-3402)
2019-08-19 10:16:49 -05:00
Gagan Goel
f5af10a0c4 1. For BETWEEN/IN functions in the SELECT clause, build a function column
2. CASE function should return false when it evaluates to NULL (e.g. due to absense of ELSE clause)

3. Set the operation type of IN function to varchar if all parameters are char/varchar/text
2019-08-18 21:23:41 -04:00
Patrick LeBlanc
2c2cb219f2 A little cleanup & added a comment to a change made earlier. 2019-08-16 16:41:48 -05:00
Patrick LeBlanc
815a0fda9f All tools will now work when SM is on- and offline. 2019-08-16 16:01:59 -05:00
Roman Nozdrin
489c09c4dc Merge pull request #827 from drrtuy/MCOL-3317
MCOL-3317 Moved fill-next-block from writeRow() into allocRowId.
2019-08-16 22:42:26 +03:00
Andrew Hutchings
121e41e252 Merge pull request #828 from pleblanc1976/develop-1.2
makes downloaded BRM files go into a unique random dir (MCOL-2152)
2019-08-16 20:06:17 +01:00
Roman Nozdrin
e0dd3d2c32 Merge pull request #825 from tntnatbry/distinct-fix
MCOL-2146 MCOL-2159  Fix for group_concat(distinct ... ) to use all unique values in a row
2019-08-16 22:02:41 +03:00
Roman Nozdrin
3acabdefb5 Merge pull request #826 from mariadb-corporation/MCOL-3432
MCOL-3432 Fix plugin install for non-root
2019-08-16 21:49:00 +03:00
Roman Nozdrin
e2f1b07e70 MCOL-3317 Moved fill-next-block from writeRow() into allocRowId.
Intro* INSERT statements could face a non-existant block when MCOL-498 feature
    is enabled. writeRow() guard blocks was supposed to proactively create empty
    blocks. The pre-patch logic failed when first value in the block has been
    removed by DELETE and this overwrites the whole valid block with empty magics.
    This patch moves proactive creation logic into allocRowId().
2019-08-16 21:28:07 +03:00
Patrick LeBlanc
26a0768b88 Include the right header file... 2019-08-16 13:19:13 -05:00
Patrick LeBlanc
5f497a0517 Create dir to download BRM data to. 2019-08-16 13:11:37 -05:00
Patrick LeBlanc
ee42d56b03 Reversed a previous change. Will make that part of another ticket. 2019-08-16 12:10:43 -05:00
Patrick LeBlanc
7f4d060dc3 Removed some storage-manager specific stuff from a cherry-picked
commit.
2019-08-16 11:54:29 -05:00
Patrick LeBlanc
ac4902c22f Tentative fix for procmon d/ling DBRM files into data1. That screws things
up on shared filesystems, and storagemanager, which has sort-of a shared
filesystem view.
2019-08-16 11:41:53 -05:00
Patrick LeBlanc
95953624de Checkpointing some changes. 2019-08-16 10:16:52 -05:00
Andrew Hutchings
8ad979cb28 Merge pull request #824 from pleblanc1976/S3-project
S3 project tentative merge
2019-08-16 08:41:50 +01:00
benthompson15
49afb843c3 Change this for ssh to https for external tools. 2019-08-15 15:02:04 -05:00