1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-21 13:40:58 +03:00
Commit Graph

5453 Commits

Author SHA1 Message Date
David Mott
15c32babe7 Merge branch 'branches/davidjmott/cxx11_stage2' of https://github.com/davidjmott/mariadb-columnstore-engine into branches/davidjmott/cxx11_stage2
# Conflicts:
#	exemgr/main.cpp
2019-04-26 08:47:18 -05:00
David Mott
f8b5fed978 Fully resolve potentially ambiguous symbols by removing using namespace statements from headers which have a cascading effect. This causes potential behavior changes when switching to c++11 since symbols can be exported from std and boost while both have been imported into the global namespace. 2019-04-26 08:40:21 -05:00
David Mott
f6fb523d65 Fully resolve potentially ambiguous symbols by removing using namespace statements from headers which have a cascading effect. This causes potential behavior changes when switching to c++11 since symbols can be exported from std and boost while both have been imported into the global namespace. 2019-04-26 08:21:47 -05:00
Andrew Hutchings
1813add162 Merge pull request #743 from davidjmott/develop
Add -DSERVER_BUILD_DIR configure parameter to interrogate the server …
2019-04-26 14:02:20 +01:00
David Mott
35ab11cbb6 remove std::auto_ptr 2019-04-26 04:46:46 -05:00
David Mott
e65f80f493 delete visual c++ project files. cmake can generate these if needed 2019-04-25 23:35:03 -05:00
David Mott
40194c2f3c remove unnecessary build target 2019-04-25 22:58:17 -05:00
David Mott
8b715fed44 permit script execution when sources reside on non-executable file system 2019-04-25 22:41:26 -05:00
David Mott
55acbf8c5c permit execution of scripts when source is located on a non-executable file system 2019-04-25 22:15:51 -05:00
Patrick LeBlanc
701534e3d3 Integrated S3 lib's s3-to-s3 copy fcn. 2019-04-25 14:33:56 -05:00
Patrick LeBlanc
3c32f6d888 Added SMDataFile::fallocate(), it's just a call to truncate() for now.
Updated ref of storage-manager subproject.
2019-04-25 14:15:25 -05:00
Patrick LeBlanc
1dd328bbb1 Merge branch 'develop' into S3-project 2019-04-25 13:40:22 -05:00
Patrick LeBlanc
6e2247e2b1 Updated ref for Andrew's lib 2019-04-25 13:24:53 -05:00
Patrick LeBlanc
1ee3c760b1 Changed Sync s.t. it starts processing jobs every 10 seconds instead
of every time there's an event.  Big improvement in efficiency.
2019-04-25 12:07:30 -05:00
Patrick LeBlanc
fc717886c6 Fixed a really dumb bug in threadpool that would leave no threads
left to process jobs.  Also added an accessor to see how big
the job queue is.
2019-04-25 12:05:52 -05:00
David Mott
f29f909482 Add -DSERVER_BUILD_DIR configure parameter to interrogate the server build cache and derive variables and settings 2019-04-25 06:27:28 -05:00
Roman Nozdrin
f99395cfee Merge pull request #742 from mariadb-corporation/develop-merge-up-20190425
Merge develop-1.2 into develop
2019-04-25 12:56:00 +03:00
Andrew Hutchings
291fbac506 Fix merge issue 2019-04-25 10:51:02 +01:00
Andrew Hutchings
784bbe09d4 Merge branch 'develop-1.2' into develop-merge-up-20190425 2019-04-25 10:27:59 +01:00
Roman Nozdrin
b8de456f1c Merge pull request #741 from mariadb-corporation/MCOL-1985
MCOL-1985 Server set decimal count for UDF based on both parameters. …
2019-04-25 10:28:45 +03:00
Patrick LeBlanc
7eebc7f06f Fixed a really dumb error where I had Sync writing 0's over the data.
Also added a couple things out of paranoia.
2019-04-24 11:33:34 -05:00
Andrew Hutchings
240648e7d9 Merge pull request #738 from mariadb-corporation/MCOL-498_5
MCOL-498 The knob to disable disk space preallocation for segment files.
2019-04-24 09:04:58 +01:00
Andrew Hutchings
723ca53669 Merge branch 'develop' into MCOL-498_5 2019-04-24 09:04:39 +01:00
Andrew Hutchings
f975b6ebe1 Merge pull request #740 from mariadb-corporation/MCOL-3267
MCOL-3267 CS now executes sorting inside UNION ALL sub-selects.
2019-04-24 08:09:06 +01:00
Patrick LeBlanc
08923813cb Fixed the error path in SMDataFile read() and write() 2019-04-23 16:01:19 -05:00
David Hall
2b9f54d682 MCOL-1985 Server set decimal count for UDF based on both parameters. This doesn't work for regr_avgx and regr_avgy, which only care about one of them. Do our best to handle it reasonably. Still gives unlimited decimals for InnoDB when the unused parameter is not numeric. 2019-04-23 15:41:20 -05:00
Patrick LeBlanc
4d49f9cc1e Somehow forgot to do this. Made open() impl O_TRUNC. Also added
a couple assertions for debugging's sake.
2019-04-23 15:37:15 -05:00
Patrick LeBlanc
5ad6246575 Debugged mergeJournal() using some data that failed to merge in a
'real' run.  Added the files that failed to merge, & added to the unit test.
2019-04-23 10:37:54 -05:00
Roman Nozdrin
f4f053dd8c MCOL-3267 CS now executes sorting inside UNION ALL sub-selects. 2019-04-23 14:34:49 +03:00
Roman Nozdrin
ee83287c32 Merge pull request #735 from davidjmott/branches/davidjmott/enable-stdcxx11
Enable c++11 support.
2019-04-23 14:20:47 +03:00
Gagan Goel
e89d1ac3cf MCOL-265 Add support for TIMESTAMP data type 2019-04-23 00:00:09 -04:00
Patrick LeBlanc
1dd0563d8f B/c I needed to validate a journal file, and to exercise my
python skills, I wrote a journal dump tool.
2019-04-22 17:51:19 -05:00
Patrick LeBlanc
3cb971e98b Tentative, unappetizing, but quick to implement fix for a mem
corruption issue where the size of the array passed in was too small.
2019-04-22 12:35:06 -05:00
Roman Nozdrin
22c0c98e61 MCOL-498 Reduced number of blocks created for abbreviated extents
thus reduced IO load when creating a table.
    Uncompressed abbreviated segment and dicts aren't affected by
    this b/c CS'es system catalog uses uncompressed dict files. CS
    now doesn't work with empty dicts files.
2019-04-22 20:02:04 +03:00
Roman Nozdrin
bc3c780e35 MCOL-498 Revived unit tests for writeengine/shared and add new tests
for extent extention.
Added a getter, moved some methods from protected into public to use
with unit tests, e.g createFile, setPreallocSpace. Added code stub in
FileOp::oid2FileName to use with UT.
2019-04-22 20:02:00 +03:00
Roman Nozdrin
ecbf6b7606 MCOL-498 Returned changes in we_colbufcompressed.* b/c they are neccesary
to track compressed data size.
2019-04-22 20:01:55 +03:00
Roman Nozdrin
abf7ef80c2 MCOL-498 Changes made according with review suggestions.
Add more comments.
    Changed return value for HDFS'es fallocate.
    Removed unnecessary code in ColumnBufferCompressed::writeToFile
    Replaced Nulls with Empties in variable names.
2019-04-22 20:01:50 +03:00
Roman Nozdrin
cbdcdb9f10 MCOL-498 Add DBRootX.PreallocSpace setting in the XML. Dict files extents now contain a correct number of blocks available. 2019-04-22 20:01:43 +03:00
Roman Nozdrin
29becc2971 MCOL-498 Passed test100. 2019-04-22 20:01:36 +03:00
Roman Nozdrin
46a46aa6b1 MCOL-498 Support for non dict compressed columns. 2019-04-22 20:01:30 +03:00
Roman Nozdrin
8037af5161 MCOL-498 Fill up next block with empty values if insert values up to the block boundary. 2019-04-22 20:01:26 +03:00
Roman Nozdrin
6db8b1f432 MCOL-498: Fill up the last used block with empty values, whilst doing bulk insertion with uncompressed files. 2019-04-22 20:01:23 +03:00
Roman Nozdrin
7cf0d55dd0 MCOL-498: Fill up the block with NULLs when CS touches for the first time it with INSERT..VALUES. 2019-04-22 20:01:18 +03:00
Roman Nozdrin
81fe7fa1a9 MCOL-498. Add the knob to disable segment|dict file preallocation. Dict files extension uses fallocate() if possible. 2019-04-22 20:01:14 +03:00
Roman Nozdrin
1d9f47a55c MCOL-498. Segment files extension uses fallocate() now to optimize load put on SSD disks. 2019-04-22 20:01:09 +03:00
Patrick LeBlanc
39b93dac2d In boost < 1.65 +/-, the RNG for uuids isn't threadsafe. Put a lock around it. 2019-04-22 11:46:53 -05:00
Patrick LeBlanc
ebc78e0597 Fixed length check in mergeJournalInMem. 2019-04-22 10:21:18 -05:00
Ben Thompson
1ccc876fec Fix for older boost versions that makes read json not crash and burn. 2019-04-22 10:13:00 -05:00
Roman Nozdrin
6ad79509df Merge pull request #737 from mariadb-corporation/MCOL-1985
Refactor regr functions(from  regrmysql.cpp) that could be used with any engine.
2019-04-22 09:51:30 +03:00
David Mott
138a6c5592 move cmake scripts to cmake folder
add boost super build project (currently disabled)
declare BOOST_NO_CXX11_SCOPED_ENUMS on projects that use boost::filesystem
2019-04-19 11:00:43 -05:00