3fef0f21d3
Remove vpj files
...
They shouldn't be here
2019-09-05 17:38:03 +01:00
e2f1b07e70
MCOL-3317 Moved fill-next-block from writeRow() into allocRowId.
...
Intro* INSERT statements could face a non-existant block when MCOL-498 feature
is enabled. writeRow() guard blocks was supposed to proactively create empty
blocks. The pre-patch logic failed when first value in the block has been
removed by DELETE and this overwrites the whole valid block with empty magics.
This patch moves proactive creation logic into allocRowId().
2019-08-16 21:28:07 +03:00
a09a9d5d0f
Mass substitution 'Corporaton' -> 'Corporation'
2019-08-07 14:43:25 -05:00
020b211bb7
Merge branch 'develop-1.2' into develop-merge-up-20190514
2019-05-14 13:58:33 +01:00
9dc33c4e82
Another try to cope with warnings under gcc 8.2.
2019-04-29 11:05:03 +03:00
cbbf267e88
MCOL-537, cleanup compiler warnings. Checkpointing a bunch of fixes.
...
Work in progress...
2019-04-29 10:56:48 +03:00
bc3c780e35
MCOL-498 Revived unit tests for writeengine/shared and add new tests
...
for extent extention.
Added a getter, moved some methods from protected into public to use
with unit tests, e.g createFile, setPreallocSpace. Added code stub in
FileOp::oid2FileName to use with UT.
2019-04-22 20:02:00 +03:00
abf7ef80c2
MCOL-498 Changes made according with review suggestions.
...
Add more comments.
Changed return value for HDFS'es fallocate.
Removed unnecessary code in ColumnBufferCompressed::writeToFile
Replaced Nulls with Empties in variable names.
2019-04-22 20:01:50 +03:00
cbdcdb9f10
MCOL-498 Add DBRootX.PreallocSpace setting in the XML. Dict files extents now contain a correct number of blocks available.
2019-04-22 20:01:43 +03:00
8037af5161
MCOL-498 Fill up next block with empty values if insert values up to the block boundary.
2019-04-22 20:01:26 +03:00
7cf0d55dd0
MCOL-498: Fill up the block with NULLs when CS touches for the first time it with INSERT..VALUES.
2019-04-22 20:01:18 +03:00
d1ada75395
MCOL-270 Add support for MEDIUMINT data type
2018-12-30 19:13:16 -05:00
82bd9e29f5
Merge branch 'develop-1.1' into 1.1-merge-up-2018-12-20b
2018-12-20 20:55:00 +00:00
e4ee1095de
Merge branch 'develop-1.1' into 1.1-merge-up-2018-12-20
2018-12-20 20:37:24 +00:00
d807aaee0a
MCOL-1347 ALTER TABLE ADD COLUMN now creates a column with correct width for a varchar columns.
2018-12-10 10:11:11 -08:00
176ef2f2c1
MCOL-1793 Add udafContext to the copy constructor of WindowFunctionColumn.
2018-11-23 12:42:29 -06:00
f1f13a09d1
Merge branch 'develop-1.1' into 1.1-merge-up-2018-10-05
2018-10-05 18:40:07 +01:00
4572c25534
MCOL-1675 When insert record calculate HWM using a column with the smallest width instead of the first column in the same way as in MCOL-984.
2018-08-28 11:29:38 +03:00
8c90419852
Fix merge and coding style issues
2018-06-22 15:31:31 +01:00
7ca289ded9
Merge branch 'develop-1.1' into 1.1-merge-up-20180621
2018-06-22 14:51:20 +01:00
2bbb70f61b
MCOL-1408 Multiple API HWM boundary fixes
...
Fixes the following:
* Generate error if calculateRowId fails
* No data written when first extent is completely full on a write, all
data going to second extent.
* 0 byte valArray malloc
* valArray free() on no malloc
* Column touched but no data written if all data going to second extent
* Wrong colWidth used on second extent calculateRowId
* Out of bounds memory write (crash) when no data for first extent
* Extent not committed if all data going to second extent
2018-06-06 16:18:54 +01:00
6fa7dded6f
MCOL-1201 manual rebase with develop. Obsoletes branch MCOL-1201
2018-06-05 13:54:17 -05:00
1d8964ec0d
Fix code style
2018-05-31 14:44:48 +01:00
53f281933a
Merge branch 'develop-1.1' into 1.1-merge-up-20180531
2018-05-31 14:43:52 +01:00
b6424480c0
MCOL-1408 Fix HWM calculation for DML & API
...
HWM for DML and API was being calculated using the first column in a
table instead of the smallest column. This shifts the calculation to the
correct column.
2018-05-29 21:21:38 +01:00
3c1ebd8b94
MCOL-392 Add initial TIME datatype support
2018-04-30 09:42:41 +01:00
0d7c0f7ae4
Merge branch 'develop-1.1' into dev-merge-up-20180202
2018-02-02 14:53:36 +00:00
2b944ebe2c
Merge branch 'develop-1.1' into MCOL-1160
2018-01-30 15:32:25 -06:00
63f8e1ce71
MCOL-1176 Fix API extent rollover
...
When the API inserts data into ColumnStore which will roll over into a
new extent that data wasn't being put into the new extent and corruption
occured. This patch now tracks the additional data and inserts it into
the new extent. It also makes sure the LBIDs are stored so that they are
correctly committed.
2018-01-30 11:46:47 +00:00
6211372f61
MCOL-1160 Track and flush dictionary blocks
...
When bulk write API is used dictionary blocks that are written to needs
flushing in PrimProc. This patch tracks the blocks and flushes them.
2018-01-23 21:17:33 +00:00
17f077012d
Merge branch 'develop-1.1' into 1.1-merge-up
2017-12-13 09:09:39 +00:00
8babe4a35d
Merge branch 'develop-1.0' into 1.0-merge-up
2017-12-12 10:01:14 +00:00
34799d8d30
MCOL-994 handle a second abbreviated extent in case it moved dbroots because of redistribute remove.
2017-12-07 10:49:51 -06:00
01446d1e22
Reformat all code to coding standard
2017-10-26 17:18:17 +01:00
7aa588f523
MCOL-984 Fix API bulk insert rowID/HWM calulation
...
The rowID and therefore HWM for an insert was being calculated based on
the first column. If there are smaller columns in the table these will
insert in the middle of blocks instead of creating new blocks. This means
that we would no longer be crash safe and PrimProc gets very confused until
a cache flush.
We now use the smallest column to calculate the rowID and HWM increment
(as cpimport does).
2017-10-26 11:19:41 +01:00
f8f6f8bdde
Fix write API char < 5
...
We need to cast to a 64bit int, not a size based int.
2017-09-13 17:19:00 +01:00
3330495a2e
MCOL-777 Cleanup source
...
Clean out autotools and some other things from the source tree.
2017-08-07 15:59:56 +01:00
17660aaa54
MCOL-769 Fix data casting issues
...
Several typos corrupting data, a cleaner method used now
2017-06-27 16:56:01 +01:00
736826cbdf
MCOL-769 Make sure system catalog is versioned
...
Otherwise bad things can happen
2017-06-21 10:05:14 +01:00
4cca5fa7fa
MCOL-769 Much higher performance bulk insert
...
Use void* pointers instead of boost::any with lots of copies
2017-06-20 19:08:48 +01:00
44977a8c6b
MCOL-769 Add autocommit to condition
2017-06-16 17:55:44 +01:00
e8581e12d3
MCOL-769 Don't use version buffer in I_S mode
...
We don't need the version buffer in bulk write I_S mode since auto
commit will be on and we use the first empty block.
2017-06-16 17:29:08 +01:00
cced9222e1
MCOL-710 Fix ALTER TABLE ADD COLUMN for TEXT/BLOB
...
The column fill didn't detect that this was a TEXT/BLOB column.
2017-05-10 12:03:21 +01:00
e9db44424c
MCOL-642 Separate TEXT from BLOB
...
* TEXT and BLOB now have separate identifiers internally
* TEXT columns are identified as such in system catalog
* cpimport only requires hex input for BLOB, not TEXT
2017-03-27 21:36:27 +01:00
aea729fe7d
MCOL-267 DML support
...
* DML writes for multi-block dictionary (blob) now works
* PrimProc fixed so that the first block in multi-block is read
correctly
* Performance optimisation (removed string copy into stack) for new
dictionary entries
2017-03-18 14:31:29 +00:00
c08d03fba4
MCOL-267 Make BLOB DDL/DML work
...
Currently limited to 8KB inserts.
2017-03-17 12:10:02 +00:00
3d91ac193c
Merge branch 'develop' of git://github.com/mariadb-corporation/mariadb-columnstore-engine into MCOL-97
2016-09-22 18:50:59 -05:00
7d3cd26af9
MCOL-160 MCOL-262 CMake Build Fixes for out-of-tree builds and engine RPMS
2016-09-22 10:14:18 -04:00
b954001fba
Remove net-snmp and use the OS version
...
Also remove a few old binaries from build/
2016-09-13 17:42:57 +01:00
392d6df495
Merge branch 'mcol-159' into develop
...
Conflicts:
1
Makefile.save
autom4te.cache/output.0
autom4te.cache/traces.0
autom4te.cache/traces.1
compile
config.guess
config.sub
configure.save
dbcon/Makefile.in
dbcon/ddlpackage/Makefile.in
dbcon/ddlpackage/ddl-scan.cpp
dbcon/ddlpackageproc/Makefile.in
dbcon/dmlpackage/Makefile.in
dbcon/dmlpackage/dml-scan.cpp
dbcon/dmlpackageproc/Makefile.in
dbcon/execplan/Makefile.in
dbcon/joblist/Makefile.in
dbcon/mysql/Makefile.in
ddlproc/Makefile.in
decomsvr/Makefile.in
depcomp
dmlproc/Makefile.in
exemgr/Makefile.in
install-sh
missing
net-snmp/Makefile.in
net-snmp/net-snmp-5.7.3/agent/mibgroup/mib_module_includes.h
net-snmp/net-snmp-5.7.3/configure-summary
net-snmp/net-snmp-5.7.3/dist/generation-scripts/gen-variables
net-snmp/net-snmp-5.7.3/include/net-snmp/agent/mib_module_config.h
net-snmp/net-snmp-5.7.3/mk/MODULE_LIST.mk
net-snmp/net-snmp-5.7.3/mk/mib_module_list_c.mk
net-snmp/net-snmp-5.7.3/mk/mib_module_list_code.mk
net-snmp/net-snmp-5.7.3/mk/mib_module_list_ft.mk
net-snmp/net-snmp-5.7.3/mk/mib_module_list_lo.mk
net-snmp/net-snmp-5.7.3/mk/mib_module_list_o.mk
net-snmp/net-snmp-5.7.3/mk/mibgroup_list_ft.mk
net-snmp/net-snmp-5.7.3/mk/mibgroup_list_lo.mk
net-snmp/net-snmp-5.7.3/mk/mibgroup_list_o.mk
net-snmp/net-snmp-5.7.3/mk/module_list_c.mk
net-snmp/net-snmp-5.7.3/mk/module_list_code.mk
net-snmp/net-snmp-5.7.3/mk/module_list_ft.mk
net-snmp/net-snmp-5.7.3/mk/module_list_lo.mk
net-snmp/net-snmp-5.7.3/mk/module_list_o.mk
oam/Makefile.in
oam/cloud/Makefile.in
oam/etc/Makefile.in
oam/oamcpp/Makefile.in
oam/post/Makefile.in
oamapps/Makefile.in
oamapps/calpontDB/Makefile.in
oamapps/calpontSupport/Makefile.in
oamapps/columnstoreDB/Makefile.in
oamapps/columnstoreSupport/Makefile.in
oamapps/mcsadmin/Makefile.in
oamapps/postConfigure/Makefile.in
oamapps/sendtrap/Makefile.in
oamapps/serverMonitor/Makefile.in
oamapps/sessionWalker/Makefile.in
oamapps/traphandler/Makefile.in
primitives/Makefile.in
primitives/blockcache/Makefile.in
primitives/linux-port/Makefile.in
primitives/primproc/Makefile.in
procmgr/Makefile.in
procmon/Makefile.in
snmpd/Makefile.in
snmpd/etc/Makefile.in
snmpd/snmpmanager/Makefile.in
tools/Makefile.in
tools/clearShm/Makefile.in
tools/cleartablelock/Makefile.in
tools/configMgt/Makefile.in
tools/cplogger/Makefile.in
tools/dbbuilder/Makefile.in
tools/dbloadxml/Makefile.in
tools/ddlcleanup/Makefile.in
tools/editem/Makefile.in
tools/getConfig/Makefile.in
tools/idbmeminfo/Makefile.in
tools/setConfig/Makefile.in
tools/viewtablelock/Makefile.in
utils/Makefile.in
utils/batchloader/Makefile.in
utils/boost_idb/Makefile.in
utils/cacheutils/Makefile.in
utils/common/Makefile.in
utils/compress/Makefile.in
utils/configcpp/Makefile.in
utils/dataconvert/Makefile.in
utils/ddlcleanup/Makefile.in
utils/funcexp/Makefile.in
utils/idbdatafile/Makefile.in
utils/idbhdfs/Makefile.in
utils/idbhdfs/hdfs-12/Makefile.in
utils/idbhdfs/hdfs-20/Makefile.in
utils/jemalloc/Makefile.in
utils/joiner/Makefile.in
utils/loggingcpp/Makefile.in
utils/messageqcpp/Makefile.in
utils/mysqlcl_idb/Makefile.in
utils/querystats/Makefile.in
utils/querytele/Makefile.in
utils/rowgroup/Makefile.in
utils/rwlock/Makefile.in
utils/startup/Makefile.in
utils/threadpool/Makefile.in
utils/thrift/Makefile.in
utils/udfsdk/Makefile.in
utils/windowfunction/Makefile.in
utils/winport/Makefile.in
versioning/BRM/Makefile.in
versioning/Makefile.in
writeengine/Makefile.in
writeengine/bulk/Makefile.in
writeengine/client/Makefile.in
writeengine/dictionary/Makefile.in
writeengine/index/Makefile.in
writeengine/redistribute/Makefile.in
writeengine/server/Makefile.in
writeengine/shared/Makefile.in
writeengine/splitter/Makefile.in
writeengine/wrapper/Makefile.in
2016-08-10 16:24:51 -05:00