database/mariadb-columnstore-engine
1
0
Fork 0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-11-03 17:13:17 +03:00
Code Activity
6,837 Commits 383 Branches 90 Tags
3d2e61a63721c7497e1959b51c92ea9657c347c5
Commit Graph

414 Commits

Author SHA1 Message Date
Andrew Hutchings
b7a01ce02e MCOL-267 Add blob support for INSERT_SELECT 
* Note there is a 1MB buffer limit, rows longer than 512KB will fail (2x
due to hex of blob data)
* cpimport needs to use hex of blob data
 2017-03-23 14:04:14 +00:00
Andrew Hutchings
1892ac8681 MCOL-267 Bulk write & PrimProc fixes 2017-03-20 21:26:53 +00:00
Andrew Hutchings
093aa377e5 MCOL-267 multi-block support for PrimProc and bulk 
* Adds multi-block bulk write support
* Adds PrimProc multi-block read support
* Allows the functions length() and hex() to work with BLOB columns
 2017-03-20 18:32:24 +00:00
Andrew Hutchings
aea729fe7d MCOL-267 DML support 
* DML writes for multi-block dictionary (blob) now works
* PrimProc fixed so that the first block in multi-block is read
correctly
* Performance optimisation (removed string copy into stack) for new
dictionary entries
 2017-03-18 14:31:29 +00:00
Andrew Hutchings
c08d03fba4 MCOL-267 Make BLOB DDL/DML work 
Currently limited to 8KB inserts.
 2017-03-17 12:10:02 +00:00
Andrew Hutchings
82c383ac20 MCOL-353 Fix lag at end of cpimport 
The end of a cpimport adds a delay which is 1 second multiplied by the
number of PMs. This in-turn is multipled up with the number of
connections/threads causing a long delay when you have several PMs.

The delay is not required as we already have a 20ms delay and we will
re-enter the recv() if there is no data and we are still connected.
 2017-03-07 21:29:39 +00:00
Andrew Hutchings
80b4d7ee36 MCOL-553 Improve error handling for ulimit 
Now sends an error to the error log and aborts postConfigure
 2017-02-21 21:10:57 +00:00
Andrew Hutchings
739f61a1ef MCOL-553 Error if we can't set file limits 
Especially for non-root installs. Otherwise we could be in for some pain
later...
 2017-02-08 17:13:30 +00:00
David Hall
90ba63b929 MCOL-455 spell check 2017-01-20 10:40:58 -06:00
David Hall
d054d0edc7 MCOL-455 spell check 2017-01-20 10:37:43 -06:00
David Hall
72436e1d57 MCOL-455: fix crash caused by rewind of unopened redistribute plan file during display when no partitions have been planned to be moved. 2017-01-20 10:20:09 -06:00
David Hall
faea63b9cb MCOL-455: fix crash caused by rewind of unopened redistribute plan file during display when no partitions have been planned to be moved. 2017-01-20 10:10:24 -06:00
Andrew Hutchings
4163f94976 MCOL-353 Fix lag at end of cpimport 
The end of a cpimport adds a delay which is 1 second multiplied by the
number of PMs. This in-turn is multipled up with the number of
connections/threads causing a long delay when you have several PMs.

The delay is not required as we already have a 20ms delay and we will
re-enter the recv() if there is no data and we are still connected.
 2017-01-17 10:25:59 +00:00
Andrew Hutchings
ffcfc41563 MCOL-507 Further ExeMgr performance improvements 
This does the following:

* Switch resource manager to a singleton which reduces the amount of
times the XML data is scanned and objects allocated.
* Make the I_S tables use the FE implementation of the system catalog
* Make the I_S.columnstore_columns table use the RID list cache
* Make the extentmap pre-allocate a vector instead of many small allocs
 2017-01-16 12:33:27 +00:00
Andrew Hutchings
ae630b3375 Merge pull request #89 from mariadb-corporation/MCOL-455 
MCOL-455 Change resistribute database logic to move all segment files…
 2017-01-09 19:57:04 +00:00
David Hall
600e758539 MCOL-455 Change resistribute database logic to move all segment files from designated dbroots to others in the system. 2017-01-06 13:04:32 -06:00
Andrew Hutchings
bb800e4771 MCOL-477 Change autoincrement on ALTER TABLE 
This patch allows the following syntax to change the current
autoincrement value for the table:

ALTER TABLE table_name COMMENT='autoincrement=value';

Where "value" is the new integer to be used.
 2017-01-05 15:03:54 +00:00
Andrew Hutchings
025838629b MCOL-454 I_S.COLUMNSTORE_FILES multi-node 
I_S.COLUMNSTORE_FILES returned bad filenames and NULL file sizes when
there are multiple nodes in a ColumnStore cluster

It adds an extra message call to the WriteEngine to get the file size
for that file. The I_S function will figure out which WriteEngine to
communicate with and get the file size details from it.
 2016-12-14 16:55:03 +00:00
David Hall
127180220b MCOL-307 merge with develop 2016-12-01 10:06:32 -06:00
Andrew Hutchings
874596c6cd MCOL-309 Implement Information Schema tables 
This patch does the following:

* Fix a year storage issue in the datestamp for the columnstore tables
  metadata table (note that any previous tables will still have the
  incorrect year stored).
* Expose the table creation date in CalpontSystemCatalog::getTables()
* Add an INFORMATION_SCHEMA table listing the tables in ColumnStore
  (similar to systable)
* Add an INFORMATION_SCHEMA table listing the columns in ColumnStore
  (similar to syscolumn)
* Add an INFORMATION_SCHEMA table listing the extents in ColumnStore
  (similar to the editem tool but with additional file information)
* Modifies the build system and scripts to support the new tables
 2016-11-14 15:44:20 +00:00
David Hall
bd17d20710 MCOL-307 Add Redistribute command to mcsadmin 2016-11-08 15:19:31 -06:00
Andrew Hutchings
4fc7fa12cd MCOL-129 INSERT/UPDATE strict mode support 
This changes the warning for truncation to the correct MariaDB error
code (1264).

In addition it passes the strict mode up into the DML class to roll back
correctly.

It also sets the abort_on_warning flag for updates as this isn't set on
the rnd_init phase but is needed for strict mode to work.
 2016-11-04 14:06:00 +00:00
david hill
ed3bc28171 added copyright headers 2016-10-11 10:02:01 -05:00
david hill
897d8d3f3d change snmp to alarm 2016-10-10 17:46:24 -05:00
Andrew Hutchings
3d91ac193c Merge branch 'develop' of git://github.com/mariadb-corporation/mariadb-columnstore-engine into MCOL-97 2016-09-22 18:50:59 -05:00
Ben Thompson
7d3cd26af9 MCOL-160 MCOL-262 CMake Build Fixes for out-of-tree builds and engine RPMS 2016-09-22 10:14:18 -04:00
Andrew Hutchings
d551b7d6e0 MCOL-298 Fix saturated date/datetime handling 
Saturated DML updates would be set to NULL as were saturated cpimport
values. This sets them to the zero date/datetime value.
 2016-09-14 19:58:11 +01:00
Andrew Hutchings
b954001fba Remove net-snmp and use the OS version 
Also remove a few old binaries from build/
 2016-09-13 17:42:57 +01:00
David Hall
33a6102116 Remove SKIP_AUTOI. Not used 2016-09-06 15:42:48 -05:00
David Hall
23cf2e3edc Remove #define SKIP_AUTOI. This is no longer used 2016-09-06 12:04:28 -05:00
dhall-InfiniDB
1a7883f98b Merge pull request #4 from LinuxJedi/MCOL-274 
Make date handling more in-line with MySQL
 2016-09-02 09:15:00 -05:00
Andrew Hutchings
25851df89d Add support for zero date separate to NULL 
NULL is now pushed through the MariaDB storage engine plugin down to the
insert processing. A '0000-00-00' date is now a separate value to NULL.

This is more in-line with MariaDB's handling.
 2016-08-30 16:26:36 +01:00
Andrew Hutchings
0bea3e4ab1 Make date handling more in-line with MySQL 
Date limit of year 1400 was used due to Boost's limits.

This patch strips out the use of Boost for date handling and sets the
lower limit to year 1000.
 2016-08-30 11:25:16 +01:00
Ben Thompson
392d6df495 Merge branch 'mcol-159' into develop 
Conflicts:
	1
	Makefile.save
	autom4te.cache/output.0
	autom4te.cache/traces.0
	autom4te.cache/traces.1
	compile
	config.guess
	config.sub
	configure.save
	dbcon/Makefile.in
	dbcon/ddlpackage/Makefile.in
	dbcon/ddlpackage/ddl-scan.cpp
	dbcon/ddlpackageproc/Makefile.in
	dbcon/dmlpackage/Makefile.in
	dbcon/dmlpackage/dml-scan.cpp
	dbcon/dmlpackageproc/Makefile.in
	dbcon/execplan/Makefile.in
	dbcon/joblist/Makefile.in
	dbcon/mysql/Makefile.in
	ddlproc/Makefile.in
	decomsvr/Makefile.in
	depcomp
	dmlproc/Makefile.in
	exemgr/Makefile.in
	install-sh
	missing
	net-snmp/Makefile.in
	net-snmp/net-snmp-5.7.3/agent/mibgroup/mib_module_includes.h
	net-snmp/net-snmp-5.7.3/configure-summary
	net-snmp/net-snmp-5.7.3/dist/generation-scripts/gen-variables
	net-snmp/net-snmp-5.7.3/include/net-snmp/agent/mib_module_config.h
	net-snmp/net-snmp-5.7.3/mk/MODULE_LIST.mk
	net-snmp/net-snmp-5.7.3/mk/mib_module_list_c.mk
	net-snmp/net-snmp-5.7.3/mk/mib_module_list_code.mk
	net-snmp/net-snmp-5.7.3/mk/mib_module_list_ft.mk
	net-snmp/net-snmp-5.7.3/mk/mib_module_list_lo.mk
	net-snmp/net-snmp-5.7.3/mk/mib_module_list_o.mk
	net-snmp/net-snmp-5.7.3/mk/mibgroup_list_ft.mk
	net-snmp/net-snmp-5.7.3/mk/mibgroup_list_lo.mk
	net-snmp/net-snmp-5.7.3/mk/mibgroup_list_o.mk
	net-snmp/net-snmp-5.7.3/mk/module_list_c.mk
	net-snmp/net-snmp-5.7.3/mk/module_list_code.mk
	net-snmp/net-snmp-5.7.3/mk/module_list_ft.mk
	net-snmp/net-snmp-5.7.3/mk/module_list_lo.mk
	net-snmp/net-snmp-5.7.3/mk/module_list_o.mk
	oam/Makefile.in
	oam/cloud/Makefile.in
	oam/etc/Makefile.in
	oam/oamcpp/Makefile.in
	oam/post/Makefile.in
	oamapps/Makefile.in
	oamapps/calpontDB/Makefile.in
	oamapps/calpontSupport/Makefile.in
	oamapps/columnstoreDB/Makefile.in
	oamapps/columnstoreSupport/Makefile.in
	oamapps/mcsadmin/Makefile.in
	oamapps/postConfigure/Makefile.in
	oamapps/sendtrap/Makefile.in
	oamapps/serverMonitor/Makefile.in
	oamapps/sessionWalker/Makefile.in
	oamapps/traphandler/Makefile.in
	primitives/Makefile.in
	primitives/blockcache/Makefile.in
	primitives/linux-port/Makefile.in
	primitives/primproc/Makefile.in
	procmgr/Makefile.in
	procmon/Makefile.in
	snmpd/Makefile.in
	snmpd/etc/Makefile.in
	snmpd/snmpmanager/Makefile.in
	tools/Makefile.in
	tools/clearShm/Makefile.in
	tools/cleartablelock/Makefile.in
	tools/configMgt/Makefile.in
	tools/cplogger/Makefile.in
	tools/dbbuilder/Makefile.in
	tools/dbloadxml/Makefile.in
	tools/ddlcleanup/Makefile.in
	tools/editem/Makefile.in
	tools/getConfig/Makefile.in
	tools/idbmeminfo/Makefile.in
	tools/setConfig/Makefile.in
	tools/viewtablelock/Makefile.in
	utils/Makefile.in
	utils/batchloader/Makefile.in
	utils/boost_idb/Makefile.in
	utils/cacheutils/Makefile.in
	utils/common/Makefile.in
	utils/compress/Makefile.in
	utils/configcpp/Makefile.in
	utils/dataconvert/Makefile.in
	utils/ddlcleanup/Makefile.in
	utils/funcexp/Makefile.in
	utils/idbdatafile/Makefile.in
	utils/idbhdfs/Makefile.in
	utils/idbhdfs/hdfs-12/Makefile.in
	utils/idbhdfs/hdfs-20/Makefile.in
	utils/jemalloc/Makefile.in
	utils/joiner/Makefile.in
	utils/loggingcpp/Makefile.in
	utils/messageqcpp/Makefile.in
	utils/mysqlcl_idb/Makefile.in
	utils/querystats/Makefile.in
	utils/querytele/Makefile.in
	utils/rowgroup/Makefile.in
	utils/rwlock/Makefile.in
	utils/startup/Makefile.in
	utils/threadpool/Makefile.in
	utils/thrift/Makefile.in
	utils/udfsdk/Makefile.in
	utils/windowfunction/Makefile.in
	utils/winport/Makefile.in
	versioning/BRM/Makefile.in
	versioning/Makefile.in
	writeengine/Makefile.in
	writeengine/bulk/Makefile.in
	writeengine/client/Makefile.in
	writeengine/dictionary/Makefile.in
	writeengine/index/Makefile.in
	writeengine/redistribute/Makefile.in
	writeengine/server/Makefile.in
	writeengine/shared/Makefile.in
	writeengine/splitter/Makefile.in
	writeengine/wrapper/Makefile.in
 2016-08-10 16:24:51 -05:00
Ben Thompson
7766a04de2 Fixes and switch to external boost library 2016-08-10 16:19:27 -05:00
David Hall
8bc7e46905 MCOL-5 Don't send empty strings in cpimport command line. It confuses cpimport. 2016-08-09 11:35:45 -05:00
David Hall
8de8666046 MCOL-5 fill the vector before taking the addresses of the strings. 2016-08-08 16:36:01 -05:00
David Hall
7598e8bc75 MCOL-5 Building the cpimport command line for LDI relied on the addresses of the contents of a std:vector being static during re-allocation. This is an erroneous assumption. Recoded to build the vector completely, then use it. 2016-08-05 14:09:19 -05:00
Ben Thompson
4709c2bece Add dependencies on netsnmp build 2016-07-27 16:00:28 -05:00
david hill
6527f191e1 merged mcol-5 2016-07-21 09:00:25 -05:00
David Hall
6d11ce030d MCOL-66 - Make the DDL and DML parsers re-entrant. 
Serialize all DDL because the VVS can't handle modifying the same block simultaneously
Fix the CTRL+C logic in DML that caused COMMIT issues.
 2016-07-20 11:47:51 -05:00
david hill
edb55cf23a mcol-5 save files 2016-07-19 10:46:58 -05:00
Ben Thompson
424628349b Add CMake build tree files 2016-07-15 10:49:57 -05:00
Ben Thompson
d90af9496e Remove Makefile.in and update gitignore 2016-07-15 10:49:57 -05:00
David Hall
38f1332891 MCOL-66 Make the DDL and DML parsers re-entrant. 2016-07-06 09:05:29 -05:00
david hill
7d8de28b43 MCOL-59, change calpont.xml 2016-06-22 16:00:00 -05:00
justin
22b7b3d1ef [MCOL-69] - autotools bootstrap only needed on new release version 2016-06-15 04:46:10 -04:00
Sergei Golubchik
23f8cb50b9 Builds! 2016-06-03 19:54:24 +03:00
Sergei Golubchik
b1b60065d9 build fails with boost linking errors 2016-06-03 13:55:09 +03:00
Justin Swanhart
16b1264557 Merge pull request #3 from mariadb-corporation/master 
merge upstream
 2016-06-01 23:13:42 -04:00