1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-10 22:42:30 +03:00
Commit Graph

3637 Commits

Author SHA1 Message Date
Roman Nozdrin
f99395cfee Merge pull request #742 from mariadb-corporation/develop-merge-up-20190425
Merge develop-1.2 into develop
2019-04-25 12:56:00 +03:00
Andrew Hutchings
291fbac506 Fix merge issue 2019-04-25 10:51:02 +01:00
Andrew Hutchings
784bbe09d4 Merge branch 'develop-1.2' into develop-merge-up-20190425 2019-04-25 10:27:59 +01:00
Roman Nozdrin
b8de456f1c Merge pull request #741 from mariadb-corporation/MCOL-1985
MCOL-1985 Server set decimal count for UDF based on both parameters. …
2019-04-25 10:28:45 +03:00
Patrick LeBlanc
7eebc7f06f Fixed a really dumb error where I had Sync writing 0's over the data.
Also added a couple things out of paranoia.
2019-04-24 11:33:34 -05:00
Andrew Hutchings
240648e7d9 Merge pull request #738 from mariadb-corporation/MCOL-498_5
MCOL-498 The knob to disable disk space preallocation for segment files.
2019-04-24 09:04:58 +01:00
Andrew Hutchings
723ca53669 Merge branch 'develop' into MCOL-498_5 2019-04-24 09:04:39 +01:00
Andrew Hutchings
f975b6ebe1 Merge pull request #740 from mariadb-corporation/MCOL-3267
MCOL-3267 CS now executes sorting inside UNION ALL sub-selects.
2019-04-24 08:09:06 +01:00
Patrick LeBlanc
08923813cb Fixed the error path in SMDataFile read() and write() 2019-04-23 16:01:19 -05:00
David Hall
2b9f54d682 MCOL-1985 Server set decimal count for UDF based on both parameters. This doesn't work for regr_avgx and regr_avgy, which only care about one of them. Do our best to handle it reasonably. Still gives unlimited decimals for InnoDB when the unused parameter is not numeric. 2019-04-23 15:41:20 -05:00
Patrick LeBlanc
4d49f9cc1e Somehow forgot to do this. Made open() impl O_TRUNC. Also added
a couple assertions for debugging's sake.
2019-04-23 15:37:15 -05:00
Patrick LeBlanc
5ad6246575 Debugged mergeJournal() using some data that failed to merge in a
'real' run.  Added the files that failed to merge, & added to the unit test.
2019-04-23 10:37:54 -05:00
Roman Nozdrin
f4f053dd8c MCOL-3267 CS now executes sorting inside UNION ALL sub-selects. 2019-04-23 14:34:49 +03:00
Roman Nozdrin
ee83287c32 Merge pull request #735 from davidjmott/branches/davidjmott/enable-stdcxx11
Enable c++11 support.
2019-04-23 14:20:47 +03:00
Gagan Goel
e89d1ac3cf MCOL-265 Add support for TIMESTAMP data type 2019-04-23 00:00:09 -04:00
Patrick LeBlanc
1dd0563d8f B/c I needed to validate a journal file, and to exercise my
python skills, I wrote a journal dump tool.
2019-04-22 17:51:19 -05:00
Patrick LeBlanc
3cb971e98b Tentative, unappetizing, but quick to implement fix for a mem
corruption issue where the size of the array passed in was too small.
2019-04-22 12:35:06 -05:00
Roman Nozdrin
22c0c98e61 MCOL-498 Reduced number of blocks created for abbreviated extents
thus reduced IO load when creating a table.
    Uncompressed abbreviated segment and dicts aren't affected by
    this b/c CS'es system catalog uses uncompressed dict files. CS
    now doesn't work with empty dicts files.
2019-04-22 20:02:04 +03:00
Roman Nozdrin
bc3c780e35 MCOL-498 Revived unit tests for writeengine/shared and add new tests
for extent extention.
Added a getter, moved some methods from protected into public to use
with unit tests, e.g createFile, setPreallocSpace. Added code stub in
FileOp::oid2FileName to use with UT.
2019-04-22 20:02:00 +03:00
Roman Nozdrin
ecbf6b7606 MCOL-498 Returned changes in we_colbufcompressed.* b/c they are neccesary
to track compressed data size.
2019-04-22 20:01:55 +03:00
Roman Nozdrin
abf7ef80c2 MCOL-498 Changes made according with review suggestions.
Add more comments.
    Changed return value for HDFS'es fallocate.
    Removed unnecessary code in ColumnBufferCompressed::writeToFile
    Replaced Nulls with Empties in variable names.
2019-04-22 20:01:50 +03:00
Roman Nozdrin
cbdcdb9f10 MCOL-498 Add DBRootX.PreallocSpace setting in the XML. Dict files extents now contain a correct number of blocks available. 2019-04-22 20:01:43 +03:00
Roman Nozdrin
29becc2971 MCOL-498 Passed test100. 2019-04-22 20:01:36 +03:00
Roman Nozdrin
46a46aa6b1 MCOL-498 Support for non dict compressed columns. 2019-04-22 20:01:30 +03:00
Roman Nozdrin
8037af5161 MCOL-498 Fill up next block with empty values if insert values up to the block boundary. 2019-04-22 20:01:26 +03:00
Roman Nozdrin
6db8b1f432 MCOL-498: Fill up the last used block with empty values, whilst doing bulk insertion with uncompressed files. 2019-04-22 20:01:23 +03:00
Roman Nozdrin
7cf0d55dd0 MCOL-498: Fill up the block with NULLs when CS touches for the first time it with INSERT..VALUES. 2019-04-22 20:01:18 +03:00
Roman Nozdrin
81fe7fa1a9 MCOL-498. Add the knob to disable segment|dict file preallocation. Dict files extension uses fallocate() if possible. 2019-04-22 20:01:14 +03:00
Roman Nozdrin
1d9f47a55c MCOL-498. Segment files extension uses fallocate() now to optimize load put on SSD disks. 2019-04-22 20:01:09 +03:00
Patrick LeBlanc
39b93dac2d In boost < 1.65 +/-, the RNG for uuids isn't threadsafe. Put a lock around it. 2019-04-22 11:46:53 -05:00
Patrick LeBlanc
ebc78e0597 Fixed length check in mergeJournalInMem. 2019-04-22 10:21:18 -05:00
Ben Thompson
1ccc876fec Fix for older boost versions that makes read json not crash and burn. 2019-04-22 10:13:00 -05:00
Roman Nozdrin
6ad79509df Merge pull request #737 from mariadb-corporation/MCOL-1985
Refactor regr functions(from  regrmysql.cpp) that could be used with any engine.
2019-04-22 09:51:30 +03:00
David Mott
138a6c5592 move cmake scripts to cmake folder
add boost super build project (currently disabled)
declare BOOST_NO_CXX11_SCOPED_ENUMS on projects that use boost::filesystem
2019-04-19 11:00:43 -05:00
Roman Nozdrin
b3a7559ffc Merge pull request #736 from gscteam/develop-1.2
Impove cpimport ingestion speed when insert into Dictionary columns.
2019-04-18 21:57:44 +03:00
David Hall
b38f192e2e MCOL-1985 Don't change umber of decimals if DECIMAL_NOT_SPECIFIED 2019-04-18 13:31:16 -05:00
Patrice Linel
06f24df724 change signature array in a std::set ! lookup performance is now log(N). About 10x performance can be expected on cpimport containing varchars.
Signed-off-by: Patrice Linel <plinel@mendel-master2.cm.cluster>
2019-04-18 09:16:00 -04:00
David Mott
b2810bf35d fix ambiguous symbol 2019-04-18 04:43:28 -05:00
David Mott
67880c2319 Fully qualify ambiguous isnan() with std:: 2019-04-17 17:28:47 -05:00
Roman Nozdrin
d4d7f55c9e Merge pull request #731 from mariadb-corporation/MCOL-2091
MCOL-2091 CS now supports  multiply distincts and UDaF calls in projection using special UDAF reset code for such queries.
2019-04-17 20:34:54 +03:00
David Mott
241d0b0446 rollback unintended changes 2019-04-17 11:36:56 -05:00
David Mott
2a9c5387c3 Enable c++11 2019-04-17 05:03:28 -05:00
Roman Nozdrin
e078d701f3 Merge pull request #733 from kabike/develop-1.1-fix-typo
Fix typo in postConfigure's storage configuration section.
2019-04-16 14:44:51 +03:00
Andrew Hutchings
8a7ccd7d93 Merge pull request #734 from mariadb-corporation/MCOL-3247_2
MCOL-3247 Fixing the thread leak regression.
2019-04-16 11:09:58 +01:00
davidjmott
4d9608cbf2 Merge pull request #707 from mariadb-corporation/MCOL-2001
MCOL-2001 Don't print the line "redistributeData must have one of STA…
2019-04-16 03:24:23 -05:00
数组越界
4e72b1f2d9 fix typo in postConfigure 2019-04-16 09:31:49 +08:00
David Hall
c17e32d5e0 MCOL-1985 Modify regrmysql to use long double where practical and to use the latest algorithms for regr_xxx functions. 2019-04-15 16:36:27 -05:00
David Hall
9846d6b595 MCOL-2091 align margin 2019-04-15 12:52:00 -05:00
David Hall
853dc2a2c1 MCOL-2091 Don't use in-line initializers, a C++x11 feature. 2019-04-15 12:49:43 -05:00
Andrew Hutchings
19ebde8b2a Merge pull request #732 from mariadb-corporation/replication-option
MCOL-593 Add optional MariaDB replication support
2019-04-15 19:56:36 +03:00