1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-07 03:22:57 +03:00
Commit Graph

1086 Commits

Author SHA1 Message Date
David Hall
f6caa88703 MCOL-597 merge with 10.2.5 2017-04-25 16:49:32 -05:00
David Hall
b9d06e2bf2 MCOL-597 some clean up and make Release builds work 2017-04-21 10:38:51 -05:00
David Hall
b15f79e8ce MCOL-597 Fix up Windows Functions 2017-04-21 10:38:44 -05:00
David Hall
324a9fd215 MCOL-597 Fix up Windows Functions 2017-04-21 10:38:44 -05:00
David Hall
3055964ddc MCOL-597 stabilization 2017-04-21 10:38:44 -05:00
David Hall
12acd033fb MCOL-597 Take Window Functions just to get a compile. No other changes were needed. 2017-04-21 10:38:44 -05:00
David Hall
b070ef3217 MCOL-597 some clean up and make Release builds work 2017-04-21 09:48:59 -05:00
David Hall
d531796bf2 MCOL-597 Fix up Windows Functions 2017-04-21 09:47:56 -05:00
David Hall
d7da34c249 MCOL-597 Fix up Windows Functions 2017-04-21 09:47:56 -05:00
David Hall
a3c4503bc9 MCOL-597 stabilization 2017-04-21 09:47:56 -05:00
David Hall
f9e5b7b507 MCOL-597 Take Window Functions just to get a compile. No other changes were needed. 2017-04-21 09:47:56 -05:00
Andrew Hutchings
944d76445b MCOL-673 Fix I_S/LDI for larger BLOBs
BLOBs that are longer than half the maximum length of the column would
be turned into a negative length due to signed int casting. This would
cause them to turn into NULL inserts. Unsigned now used.
2017-04-20 19:29:41 +01:00
dhall-InfiniDB
57af5d898f Merge pull request #153 from mariadb-corporation/MCOL-669
MCOL-669 TEXT cpimport fixes
2017-04-19 15:19:09 -05:00
Andrew Hutchings
f251ebccb2 MCOL-669 TEXT cpimport fixes
* 64KB TEXT column had off-by-one length pointer counting
* TEXT I_S/LDI was looping where it shouldn't causing pointer issues
* TEXT data type wasn't fully understood by cpimport
2017-04-19 14:11:21 +01:00
Andrew Hutchings
f64dd0d602 MCOL-529 Pool DBRM connections
DBRM connections are reused so that we don't have a huge amount of
TIME_WAIT sockets when there are large amounts of DML. Also applied to
i_s.columnstore_files
2017-04-14 14:16:25 +01:00
Andrew Hutchings
830b24c1fa MCOL-529 Pool DBRM connections
DBRM connections are reused so that we don't have a huge amount of
TIME_WAIT sockets when there are large amounts of DML. Also applied to
i_s.columnstore_files
2017-04-14 14:13:15 +01:00
Andrew Hutchings
b60c45a968 MCOL-653 Revert SUM(1) behaviour
SUM(1) behaviour was changed as part of MCOL-301. But the original
behaviour was correct.
2017-03-31 21:48:56 +01:00
Andrew Hutchings
8baf0590a4 MCOL-653 Revert SUM(1) behaviour
SUM(1) behaviour was changed as part of MCOL-301. But the original
behaviour was correct.
2017-03-31 21:47:12 +01:00
Andrew Hutchings
e9db44424c MCOL-642 Separate TEXT from BLOB
* TEXT and BLOB now have separate identifiers internally
* TEXT columns are identified as such in system catalog
* cpimport only requires hex input for BLOB, not TEXT
2017-03-27 21:36:27 +01:00
dhall-InfiniDB
99b62cf97b Merge pull request #141 from mariadb-corporation/MCOL-267
MCOL-267 Add BLOB/TEXT support
2017-03-23 12:19:40 -05:00
Andrew Hutchings
b7a01ce02e MCOL-267 Add blob support for INSERT_SELECT
* Note there is a 1MB buffer limit, rows longer than 512KB will fail (2x
due to hex of blob data)
* cpimport needs to use hex of blob data
2017-03-23 14:04:14 +00:00
Andrew Hutchings
6841b261a3 MCOL-605 Fix multi-node "Unkown error"
The string stream which builds up the PM details wasn't cleared on each
run. This moves the creation of the string stream up to where it is
needed so a clean one is used each time.
2017-03-22 17:48:27 +00:00
Andrew Hutchings
6ab434e708 MCOL-605 Fix multi-node "Unkown error"
The string stream which builds up the PM details wasn't cleared on each
run. This moves the creation of the string stream up to where it is
needed so a clean one is used each time.
2017-03-22 17:45:45 +00:00
Andrew Hutchings
27e5995cd3 MCOL-267 Add basic engine support
This patch adds enough support so that cross engines joins with blob
columns in the foreign engines will work. The modifications are as
follows:

* Add CrossEngine support for non-NULL-terminated (binary) data
* Add row data support for blobs (similar to varbinary)
* Add engine support for writing out blob data correctly to the storage
engine API
* Re-enable blob support in the engine plugin
2017-03-17 09:27:50 +00:00
dhall-InfiniDB
c12b587d0d Merge pull request #133 from mariadb-corporation/MCOL-605-1.0
MCOL-605 limit connections for I_S table
2017-03-07 16:01:20 -06:00
Andrew Hutchings
b55c526a5d MCOL-605 limit connections for I_S table
I_S.COLUMNSTORE_FILES now caches a connection per dbroot instead of
using a connection per file.
2017-03-07 21:16:41 +00:00
Andrew Hutchings
052f8d0249 MCOL-533 fix units for table_usage
The fix for MCOL-533 accidentally removed units processing
2017-03-07 21:10:47 +00:00
Andrew Hutchings
e9c5d86c15 MCOL-533 Add lock to table_usage
Calling from multiple connections simultaneously is bad. This adds a
lock preventing that.
2017-03-07 21:10:00 +00:00
Andrew Hutchings
9985bb0647 MCOL-533 fix the table_usage() procedure
The old procedure could be wildly incorrect when there were multiple
extents for a dictionary column.

The new one uses tables so that columnstore_files doesn't get
hammered too hard. They can't be temporary tables due to the reuse
restriction on temporary tables.
2017-03-07 21:09:29 +00:00
Andrew Hutchings
468fc8c260 MCOL-605 limit connections for I_S table
I_S.COLUMNSTORE_FILES now caches a connection per dbroot instead of
using a connection per file.
2017-03-05 09:58:20 +00:00
Andrew Hutchings
c6000d3b7a MCOL-533 fix units for table_usage
The fix for MCOL-533 accidentally removed units processing
2017-03-02 17:56:32 +00:00
David Hill
923e995b29 MCOL-552 - send stdout to null 2017-02-28 11:03:08 -06:00
David Hill
b4061cd4cc MCOL-552 2017-02-28 10:46:13 -06:00
Ben Thompson
4f8e3b0f6e MCOL-468: remove slave-skip-errors=all from default settings 2017-02-17 09:46:42 -06:00
David Hall
c2344accc9 MCOL-513 clean up and test thread pool for ExeMgr 2017-02-09 18:00:00 -06:00
Andrew Hutchings
106a62222c MCOL-533 Add lock to table_usage
Calling from multiple connections simultaneously is bad. This adds a
lock preventing that.
2017-02-09 18:00:00 -06:00
Andrew Hutchings
854a07f7b2 MCOL-533 fix the table_usage() procedure
The old procedure could be wildly incorrect when there were multiple
extents for a dictionary column.

The new one uses tables so that columnstore_files doesn't get
hammered too hard. They can't be temporary tables due to the reuse
restriction on temporary tables.
2017-02-09 18:00:00 -06:00
Andrew Hutchings
a89ab2f2bf MCOL-454 Fix HWM edge case
Sometimes block offset can be > 0 but HWM can be 0 this causes a
calculation error in the DATA_SIZE field of I_S.columnstore_extents
2017-01-19 16:45:10 +00:00
Andrew Hutchings
d26223aa50 MCOL-454 Fix HWM edge case
Sometimes block offset can be > 0 but HWM can be 0 this causes a
calculation error in the DATA_SIZE field of I_S.columnstore_extents
2017-01-19 16:43:27 +00:00
Andrew Hutchings
ffcfc41563 MCOL-507 Further ExeMgr performance improvements
This does the following:

* Switch resource manager to a singleton which reduces the amount of
times the XML data is scanned and objects allocated.
* Make the I_S tables use the FE implementation of the system catalog
* Make the I_S.columnstore_columns table use the RID list cache
* Make the extentmap pre-allocate a vector instead of many small allocs
2017-01-16 12:33:27 +00:00
Andrew Hutchings
641fd2bfe2 MCOL-494 Don't try to process BLOB/TEXT
It is possible for a BLOB/TEXT column to appear in a cross engine join.
This causes an ExeMgr crash later during execution. For now this patch
disable BLOB/TEXT support.
2017-01-10 07:33:00 -06:00
Andrew Hutchings
bb800e4771 MCOL-477 Change autoincrement on ALTER TABLE
This patch allows the following syntax to change the current
autoincrement value for the table:

ALTER TABLE table_name COMMENT='autoincrement=value';

Where "value" is the new integer to be used.
2017-01-05 15:03:54 +00:00
Andrew Hutchings
98f92d53b2 MCOL-301 Fix nested arithmatic in aggregate
Arithmatic on two functions inside an aggregate function caused an error
due to the function not being parsed correctly. This fix parses the
function for the arithmatic.
2016-12-16 21:42:52 +00:00
Andrew Hutchings
5376d4b290 MCOL-301 fix SUM() with constants
If SUM() has constants return the MAX() instead of constant * rows.
2016-12-15 17:13:02 +00:00
Andrew Hutchings
025838629b MCOL-454 I_S.COLUMNSTORE_FILES multi-node
I_S.COLUMNSTORE_FILES returned bad filenames and NULL file sizes when
there are multiple nodes in a ColumnStore cluster

It adds an extra message call to the WriteEngine to get the file size
for that file. The I_S function will figure out which WriteEngine to
communicate with and get the file size details from it.
2016-12-14 16:55:03 +00:00
Andrew Hutchings
5571481957 MCOL-457 Fix insert...select NULL bitmap
When a table has 8 columns that could be NULL and a NOT NULL column
after the NULLable columns the check to see if we have gone over the
NULL bitmap byte limit is run prematurely trigging an error.

This patch moves the check to only run when we are looking at NULLable
columns.
2016-12-09 10:36:42 +00:00
Andrew Hutchings
ef3a655f84 MCOL-406 More fixes to stored procs
* Fix infinite loop problem when there are no ColumnStore tables
* Make table_usage('schema', NULL) work
2016-12-07 09:12:51 +00:00
Andrew Hutchings
6efe906972 MCOL-406 add table_usage() schema input
table_usage() is now called using:

* table_usage(NULL, NULL) - all tables
* table_usage(NULL, 'table') - match tables with the name 'table' in all
schemas
* table_usage('schema', 'table') - match a specific schema and table
combination
2016-12-06 20:10:07 +00:00
dhall-InfiniDB
d4a601b4fb Merge pull request #68 from mariadb-corporation/MCOL-442
MCOL-442 Allow default zero date/datetime
2016-12-06 12:26:09 -06:00
Andrew Hutchings
fe381ab07c MCOL-442 Allow default zero date/datetime
Remove the hard-coded restriction in the DDL code, it isn't needed any
more
2016-12-06 15:47:33 +00:00