1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-06-07 19:22:02 +03:00

406 Commits

Author SHA1 Message Date
Roman Nozdrin
6db8b1f432 MCOL-498: Fill up the last used block with empty values, whilst doing bulk insertion with uncompressed files. 2019-04-22 20:01:23 +03:00
Roman Nozdrin
7cf0d55dd0 MCOL-498: Fill up the block with NULLs when CS touches for the first time it with INSERT..VALUES. 2019-04-22 20:01:18 +03:00
Roman Nozdrin
81fe7fa1a9 MCOL-498. Add the knob to disable segment|dict file preallocation. Dict files extension uses fallocate() if possible. 2019-04-22 20:01:14 +03:00
Roman Nozdrin
1d9f47a55c MCOL-498. Segment files extension uses fallocate() now to optimize load put on SSD disks. 2019-04-22 20:01:09 +03:00
David Mott
138a6c5592 move cmake scripts to cmake folder
add boost super build project (currently disabled)
declare BOOST_NO_CXX11_SCOPED_ENUMS on projects that use boost::filesystem
2019-04-19 11:00:43 -05:00
Patrice Linel
06f24df724 change signature array in a std::set ! lookup performance is now log(N). About 10x performance can be expected on cpimport containing varchars.
Signed-off-by: Patrice Linel <plinel@mendel-master2.cm.cluster>
2019-04-18 09:16:00 -04:00
David Mott
b2810bf35d fix ambiguous symbol 2019-04-18 04:43:28 -05:00
Andrew Hutchings
a955b56f4d Merge branch 'develop-1.2' into develop-merge-up-20190218 2019-02-18 15:55:11 +00:00
Andrew Hutchings
d4a5c2823b Merge branch 'develop-1.1' into develop-1.2-merge-up-20190214 2019-02-14 15:55:15 +00:00
Andrew Hutchings
159df155a7 Merge branch 'develop-1.0' into develop-1.1-merge-up-20190214 2019-02-14 14:15:07 +00:00
Andrew Hutchings
f805478eb9 MCOL-2149 Fix cpimport decimal saturation
If we saturate int64_t during string -> decimal conversion then end
processing there instead of continuing. This preserves a good saturation
value.
2019-02-08 17:55:50 +00:00
Andrew Hutchings
ab74bec10b Merge branch 'develop-1.1' into 1.2-merge-up-20190111 2019-01-11 20:16:38 +00:00
Andrew Hutchings
8f5fb1a71e Merge branch 'develop-1.0' into 1.1-merge-up-20190111 2019-01-11 18:44:15 +00:00
Patrick LeBlanc
fe94776ac6 MCOL-2062: bug parsing scientific notation in cpimport
Made it use strtold instead of the 'manual' string parsing
stuff it was doing.
2019-01-09 16:31:38 -06:00
Gagan Goel
d1ada75395 MCOL-270 Add support for MEDIUMINT data type 2018-12-30 19:13:16 -05:00
Andrew Hutchings
82bd9e29f5 Merge branch 'develop-1.1' into 1.1-merge-up-2018-12-20b 2018-12-20 20:55:00 +00:00
Andrew Hutchings
e4ee1095de Merge branch 'develop-1.1' into 1.1-merge-up-2018-12-20 2018-12-20 20:37:24 +00:00
Andrew Hutchings
9888f88ac5 MCOL-1662 Use version buffer for UPDATEs
For some reason version buffer is not turned up for update queries which
means that the version number for dictionary blocks is not changed.
This can lead to dirty cache reads resulting in _CpNoTf_ in the results.

This patch turns on version buffer for updates.
2018-12-17 09:08:30 +00:00
Roman Nozdrin
d807aaee0a MCOL-1347 ALTER TABLE ADD COLUMN now creates a column with correct width for a varchar columns. 2018-12-10 10:11:11 -08:00
David Hall
c3477fe243 Merge branch 'develop' into MCOL-1793 2018-11-23 12:43:17 -06:00
David Hall
176ef2f2c1 MCOL-1793 Add udafContext to the copy constructor of WindowFunctionColumn. 2018-11-23 12:42:29 -06:00
Roman Nozdrin
6563f48e32 MCOL-1786 Reduce the performance degradation caused by iequals. 2018-11-21 19:43:46 +03:00
Patrick LeBlanc
8dc988d849
Merge pull request #607 from mariadb-corporation/MCOL-520
Mcol 520
2018-11-07 10:37:10 -06:00
Gagan Goel
f8a9ce0fb5 MCOL-1786 Handle "true" keyword for numeric data types in cpimport 2018-10-10 01:13:39 -04:00
david hill
101b36acb6
Merge branch 'develop' into MCOL-520 2018-10-08 14:23:48 -05:00
Andrew Hutchings
f1f13a09d1 Merge branch 'develop-1.1' into 1.1-merge-up-2018-10-05 2018-10-05 18:40:07 +01:00
Patrick LeBlanc
f97dec3406 Merge branch 'fix-skip-oam-init' into MCOL-520 2018-10-04 15:35:32 -05:00
Patrick LeBlanc
3d7f4a3170 Squash commit of fix-skip-oam-init branch.
Squashed commit of the following:

commit faaee9141af019363cbe207e4cdbe01e01493d0f
Author: Patrick LeBlanc <patrick.leblanc@mariadb.com>
Date:   Wed Oct 3 13:03:02 2018 -0500

    Commented a debugging printout.

commit e47e784c53705463696916f5c8dae1c014732f77
Author: Patrick LeBlanc <patrick.leblanc@mariadb.com>
Date:   Wed Oct 3 12:13:23 2018 -0500

    Moved the SKIP_OAM_INIT check for cleanliness, added 'config.h' to
    other places that need it.

commit 662604553538795f9a03e1167c7b44376349a56a
Author: Patrick LeBlanc <patrick.leblanc@mariadb.com>
Date:   Tue Oct 2 16:33:06 2018 -0500

    WIP.  First cut of excising OAM and root access from the dev process.

    This passes most tests; need to make sure that the tests that fail
    have nothing to do with this change.

    DMLProc is doing something that results in a sudo password prompt.
    Will obliterate that next.
2018-10-03 13:04:54 -05:00
Patrick LeBlanc
e47e784c53 Moved the SKIP_OAM_INIT check for cleanliness, added 'config.h' to
other places that need it.
2018-10-03 12:23:35 -05:00
David Hill
f25082bc9a MCOL-520 2018-09-25 17:20:46 -05:00
David Hill
b7b98a3e1a MCOL-520 2018-09-25 11:32:56 -05:00
David Hill
81e35e35eb MCOL-520 2018-09-21 11:23:43 -05:00
David Hill
4e6e5647ef MCOL-520 2018-09-21 10:40:05 -05:00
Andrew Hutchings
24c5e93756 MCOL-1737 Add debug logging options for LRU cache
This adds options which are user enabled to debug the LRU cache inside
ColumnStore. Specifically cache flushing.

It adds the following:
* PrimProc flush information when SIGUSR2 mode is enabled
* cpimport dictionary flush information when -d2 is used
* WriteEngineServer DML flush information to STDERR
2018-09-21 09:50:10 +01:00
Roman Nozdrin
4572c25534 MCOL-1675 When insert record calculate HWM using a column with the smallest width instead of the first column in the same way as in MCOL-984. 2018-08-28 11:29:38 +03:00
Andrew Hutchings
03da6df473 Merge branch 'develop-1.1' into 1.1-merge-up-20180817 2018-08-17 16:17:13 +01:00
Andrew Hutchings
9e3f92b6a3 MCOL-1330 Make debug flag let valgrind work
Add a '-d' flag to WriteEngine, ExeMgr and PrimProc to let valgrind work
with them.
2018-06-25 15:10:28 +01:00
Andrew Hutchings
8c90419852 Fix merge and coding style issues 2018-06-22 15:31:31 +01:00
Andrew Hutchings
7ca289ded9 Merge branch 'develop-1.1' into 1.1-merge-up-20180621 2018-06-22 14:51:20 +01:00
Andrew Hutchings
2bbb70f61b MCOL-1408 Multiple API HWM boundary fixes
Fixes the following:

* Generate error if calculateRowId fails
* No data written when first extent is completely full on a write, all
data going to second extent.
* 0 byte valArray malloc
* valArray free() on no malloc
* Column touched but no data written if all data going to second extent
* Wrong colWidth used on second extent calculateRowId
* Out of bounds memory write (crash) when no data for first extent
* Extent not committed if all data going to second extent
2018-06-06 16:18:54 +01:00
David Hall
6fa7dded6f MCOL-1201 manual rebase with develop. Obsoletes branch MCOL-1201 2018-06-05 13:54:17 -05:00
Andrew Hutchings
4764094e4a Fix merge errors 2018-05-31 15:04:04 +01:00
Andrew Hutchings
1d8964ec0d Fix code style 2018-05-31 14:44:48 +01:00
Andrew Hutchings
53f281933a Merge branch 'develop-1.1' into 1.1-merge-up-20180531 2018-05-31 14:43:52 +01:00
Andrew Hutchings
b6424480c0 MCOL-1408 Fix HWM calculation for DML & API
HWM for DML and API was being calculated using the first column in a
table instead of the smallest column. This shifts the calculation to the
correct column.
2018-05-29 21:21:38 +01:00
Andrew Hutchings
d010397be6 MCOL-1197 Make -c work in cpimport
It turns out -c wasn't actually connected to anything and now with have
BLOB/TEXT it is pretty useful. If -c is set to < 1MB then 1MB is used,
otherwise it will use the selected buffer size.
2018-05-09 14:52:42 +01:00
Andrew Hutchings
1a582eed4a Merge branch 'develop-1.1' into 1.1-merge-up-20180509-a2 2018-05-09 09:20:55 +01:00
Andrew Hutchings
c40903de9b MCOL-392 Apply astyle
Make this branch apply our style guidelines
2018-05-01 09:52:26 +01:00
Andrew Hutchings
bd50bbb8bb MCOL-392 Fix saturation handling 2018-04-30 09:42:41 +01:00
Andrew Hutchings
dba04e8b72 MCOL-392 Fix cpimport and >8bit positive hour 2018-04-30 09:42:41 +01:00