1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-07 03:22:57 +03:00
Commit Graph

1706 Commits

Author SHA1 Message Date
Andrew Hutchings
a89ab2f2bf MCOL-454 Fix HWM edge case
Sometimes block offset can be > 0 but HWM can be 0 this causes a
calculation error in the DATA_SIZE field of I_S.columnstore_extents
2017-01-19 16:45:10 +00:00
Andrew Hutchings
d26223aa50 MCOL-454 Fix HWM edge case
Sometimes block offset can be > 0 but HWM can be 0 this causes a
calculation error in the DATA_SIZE field of I_S.columnstore_extents
2017-01-19 16:43:27 +00:00
Andrew Hutchings
271bfb525e Also check for zero
Needed for unsigned int columns
2017-01-18 17:39:37 +00:00
Andrew Hutchings
a64851f56c MCOL-477 Add validation to alter autoincrement
If the data isn't validated and someone gives bad input it could cause
corruption. This validates the input.
2017-01-18 17:39:30 +00:00
Andrew Hutchings
aa2cb8b9ba Also check for zero
Needed for unsigned int columns
2017-01-18 17:35:59 +00:00
Andrew Hutchings
183298ba50 MCOL-477 Add validation to alter autoincrement
If the data isn't validated and someone gives bad input it could cause
corruption. This validates the input.
2017-01-18 17:28:19 +00:00
Andrew Hutchings
ffcfc41563 MCOL-507 Further ExeMgr performance improvements
This does the following:

* Switch resource manager to a singleton which reduces the amount of
times the XML data is scanned and objects allocated.
* Make the I_S tables use the FE implementation of the system catalog
* Make the I_S.columnstore_columns table use the RID list cache
* Make the extentmap pre-allocate a vector instead of many small allocs
2017-01-16 12:33:27 +00:00
Andrew Hutchings
3299a3d57d MCOL-317 Remove libdrizzle
This switches to MariaDB's client library instead of libdrizzle for
Cross Engine and query stats.

It also switches to unbuffered result sets.
2017-01-12 17:12:39 +00:00
Andrew Hutchings
641fd2bfe2 MCOL-494 Don't try to process BLOB/TEXT
It is possible for a BLOB/TEXT column to appear in a cross engine join.
This causes an ExeMgr crash later during execution. For now this patch
disable BLOB/TEXT support.
2017-01-10 07:33:00 -06:00
Andrew Hutchings
de6c933e02 MCOL-163 Add support for DOUBLE PRECISION
Just an alias for DOUBLE
2017-01-06 10:53:11 +00:00
Andrew Hutchings
bb800e4771 MCOL-477 Change autoincrement on ALTER TABLE
This patch allows the following syntax to change the current
autoincrement value for the table:

ALTER TABLE table_name COMMENT='autoincrement=value';

Where "value" is the new integer to be used.
2017-01-05 15:03:54 +00:00
Andrew Hutchings
98f92d53b2 MCOL-301 Fix nested arithmatic in aggregate
Arithmatic on two functions inside an aggregate function caused an error
due to the function not being parsed correctly. This fix parses the
function for the arithmatic.
2016-12-16 21:42:52 +00:00
Andrew Hutchings
5376d4b290 MCOL-301 fix SUM() with constants
If SUM() has constants return the MAX() instead of constant * rows.
2016-12-15 17:13:02 +00:00
Andrew Hutchings
025838629b MCOL-454 I_S.COLUMNSTORE_FILES multi-node
I_S.COLUMNSTORE_FILES returned bad filenames and NULL file sizes when
there are multiple nodes in a ColumnStore cluster

It adds an extra message call to the WriteEngine to get the file size
for that file. The I_S function will figure out which WriteEngine to
communicate with and get the file size details from it.
2016-12-14 16:55:03 +00:00
Andrew Hutchings
5571481957 MCOL-457 Fix insert...select NULL bitmap
When a table has 8 columns that could be NULL and a NOT NULL column
after the NULLable columns the check to see if we have gone over the
NULL bitmap byte limit is run prematurely trigging an error.

This patch moves the check to only run when we are looking at NULLable
columns.
2016-12-09 10:36:42 +00:00
Andrew Hutchings
ef3a655f84 MCOL-406 More fixes to stored procs
* Fix infinite loop problem when there are no ColumnStore tables
* Make table_usage('schema', NULL) work
2016-12-07 09:12:51 +00:00
Andrew Hutchings
6efe906972 MCOL-406 add table_usage() schema input
table_usage() is now called using:

* table_usage(NULL, NULL) - all tables
* table_usage(NULL, 'table') - match tables with the name 'table' in all
schemas
* table_usage('schema', 'table') - match a specific schema and table
combination
2016-12-06 20:10:07 +00:00
dhall-InfiniDB
d4a601b4fb Merge pull request #68 from mariadb-corporation/MCOL-442
MCOL-442 Allow default zero date/datetime
2016-12-06 12:26:09 -06:00
dhall-InfiniDB
cb8ffedf03 Merge pull request #67 from mariadb-corporation/MCOL-406-2
MCOL-406 Add schema to table_usage()
2016-12-06 12:16:48 -06:00
Andrew Hutchings
fe381ab07c MCOL-442 Allow default zero date/datetime
Remove the hard-coded restriction in the DDL code, it isn't needed any
more
2016-12-06 15:47:33 +00:00
Andrew Hutchings
e2771c246b MCOL-406 Add schema to table_usage()
Schema name should be included in results
2016-12-06 12:59:43 +00:00
Andrew Hutchings
52fd60f446 MCOL-430 Fix memory corruption in cross-engine
Cross engine was using fRowGroupDelivered for pulling the rows out of
libdrizzle and passing them on to the next step in the job list
simultaneously on different threads. Sometimes this is OK, but with
larger data sets it leads to data corruption and race conditions.

For pulling the rows out of libdrizzle this patch uses a new RowGroup
object instead to avoid the collision.

In addition this patch makes the DrizzleMySQL class a dynamically
allocated object. A first step into potentially using unbuffered row
results for performance and lower RAM usage at a later date.
2016-12-05 17:35:45 +00:00
Andrew Hutchings
f586f3b46a MCOL-423 Fixes to I_S tables
Fixes the following:

* Compression ratio calculation was incorrect
* Possible issues due to system catalog thread ID usage
* Compressed file size data count was leaking many FDs when the table
  wasn't compressed
* Compressed file size data count was allocating random large amounts
  of RAM and then leaking it when the table wasn't compressed
2016-11-29 10:45:38 +00:00
Andrew Hutchings
3b1de94cd8 MCOL-406 Improved Information Schema
* Add INFORMATION_SCHEMA.COLUMNSTORE_FILES which contains information
  about files
* Remove file information from COLUMNSTORE_EXTENTS (due to above)
* Hide columns with Object ID < 3000 (internal columns)
* Fix bad calculation in data_size columns
* Fix minor memory leak
* Add compressedSize() function to IDBFileSystem to get the used file
  size for a compressed file
* Add columnstore_info schema with utility stored procedures to access
  the information_schema tables
2016-11-23 22:11:26 +00:00
Andrew Hutchings
874596c6cd MCOL-309 Implement Information Schema tables
This patch does the following:

* Fix a year storage issue in the datestamp for the columnstore tables
  metadata table (note that any previous tables will still have the
  incorrect year stored).
* Expose the table creation date in CalpontSystemCatalog::getTables()
* Add an INFORMATION_SCHEMA table listing the tables in ColumnStore
  (similar to systable)
* Add an INFORMATION_SCHEMA table listing the columns in ColumnStore
  (similar to syscolumn)
* Add an INFORMATION_SCHEMA table listing the extents in ColumnStore
  (similar to the editem tool but with additional file information)
* Modifies the build system and scripts to support the new tables
2016-11-14 15:44:20 +00:00
dhall-InfiniDB
15d6cafb53 Merge pull request #52 from mariadb-corporation/MCOL-385
MCOL-385 Fix crash observed with 10.1.19 merge
2016-11-07 15:21:15 -06:00
dhall-InfiniDB
df238a4e0f Merge pull request #50 from mariadb-corporation/MCOL-334
MCOL-334 Give joins in views highest priority
2016-11-07 15:20:21 -06:00
Andrew Hutchings
14a9581bb6 MCOL-385 Fix crash observed with 10.1.19 merge
Appears to be a regression introduced in MCOL-361 which was causing a
segault with bug3670.negative.sql
2016-11-07 21:04:26 +00:00
Andrew Hutchings
4fc7fa12cd MCOL-129 INSERT/UPDATE strict mode support
This changes the warning for truncation to the correct MariaDB error
code (1264).

In addition it passes the strict mode up into the DML class to roll back
correctly.

It also sets the abort_on_warning flag for updates as this isn't set on
the rnd_init phase but is needed for strict mode to work.
2016-11-04 14:06:00 +00:00
Andrew Hutchings
41266b0f23 MCOL-334 Give joins in views highest priority
For "select * from {view} where {col} in ({subquery})" type queries the
join for 'in' was being processed before any joins in the view. This
patch changes the priority so joins in views are processed first.
2016-11-03 17:54:12 +00:00
dhall-InfiniDB
059a158837 Merge pull request #49 from mariadb-corporation/MCOL-263
MCOL-263: throw different error message on load data infile if column…
2016-11-03 09:39:40 -05:00
Ben Thompson
39c3cabb7c MCOL-263: throw different error message on load data infile if columnstore suspendDatabaseWrite is enabled 2016-11-02 17:34:46 -05:00
David Hall
086a98794e MCOL-361 String::c_ptr() can cause a realloc and break things. Remove all uses of c_ptr to String objects from the server. 2016-11-01 16:07:13 -05:00
Andrew Hutchings
c2988cfbf5 Merge pull request #47 from mariadb-corporation/MCOL-121
MCOL-121 reverse the disabling client progress reports.
2016-10-31 19:48:20 +00:00
David Hall
ab5afda7c4 MCOL-121 reverse the disabling client progress reports. 2016-10-31 14:06:10 -05:00
dhall-InfiniDB
96dfb4c294 Merge pull request #46 from mariadb-corporation/MCOL-278
Warning on drop table if exists error
2016-10-31 11:53:55 -05:00
Ben Thompson
c975f00973 Throw warning when table doesn't exist in columnstore so drop table if exists can still remove the front end table. 2016-10-28 15:37:38 -05:00
David Hall
0368dd487a MCOL-153 Add UDF function calgetsqlcount() which will display the number of sql statements active and the number waiting. 2016-10-27 15:49:01 -05:00
dhall-InfiniDB
6694bc3d16 Merge pull request #44 from mariadb-corporation/MCOL-344
Add better cache explanations to debug_walk. This is debug only.
2016-10-27 15:42:00 -05:00
David Hall
331dfd3a4c Add better cache explanations to debug_walk. This is debug only. 2016-10-27 15:39:50 -05:00
Andrew Hutchings
32c76825de Merge pull request #43 from mariadb-corporation/MCOL-218
Mcol 218
2016-10-27 20:21:19 +01:00
dhall-InfiniDB
8f2fca2239 Merge pull request #41 from mariadb-corporation/MCOL-350
MCOL-350 Fix zero date comparison
2016-10-27 10:06:10 -05:00
David Hall
b1a110b830 MCOL-121 client reports "stage 2 - enabling keys" for every query against a CS table.
Add progress_report_time=0 to default my.cnf to disable progress reports
2016-10-24 17:30:05 -05:00
Ben Thompson
fc4cb7ab71 Clean up unneeded objects created in fix. 2016-10-24 11:44:07 -05:00
Andrew Hutchings
877dc201bd MCOL-371 fix mutex free crash
It is possible for an exception to be thrown when a memory limit is hit
whilst a mutex is lock. That mutex is never unlocked and in Ubuntu 16.04
release build it can cause a crash when freed.

This patch catches the exception, releases the lock and then re-throws.
2016-10-23 16:12:38 +01:00
Ben Thompson
87ac01c3d4 MCOL-218: Make drop database work in the columnstore engine. 2016-10-19 15:23:02 -05:00
Andrew Hutchings
08d52d510e MCOL-350 Fix zero date comparison
If a query uses '0000-00-00' the value to compare with is hard-coded to
0. With date types there are 6 unused bits set to 1 so a zero date is
stored as 3F 00 00 00.

This removes the hard-coded setting of '0000-00-00' to 0 and uses the
correct conversion routines instead.
2016-10-19 19:38:53 +01:00
David Hall
7c9e6e84c2 remove debug cout in ddl.l 2016-10-17 13:03:23 -05:00
David Hall
e4f93ea2f2 MCOL-46 subquery sometimes causes unknown error
This was caused by Item_cache::val_str() sometimes causing a full exec of subquery before we're ready
2016-10-12 13:30:35 -05:00
david hill
ed3bc28171 added copyright headers 2016-10-11 10:02:01 -05:00