1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-09 10:41:14 +03:00
Commit Graph

3637 Commits

Author SHA1 Message Date
David Hall
c683b6bfc0 MCOL-3404 Revert experimental changes from MCOL-3343 2019-07-16 18:19:03 -05:00
David Hall
cd79a42ec1 MCOL-3404 Back out experimental changes from MCOL-3343 2019-07-16 17:14:17 -05:00
Patrick LeBlanc
809ff06485 Added an optional prefix for S3 keys to the config file.
Also changed the version of the current code to 0.4.0 from 1.4.0.
Major ver 1 implies this is a release, when in fact it's an alpha
at best.  :D
2019-07-16 15:18:08 -05:00
Patrick LeBlanc
4ec3cdc8b9 Fixed a bug where procmon would have a PID of 0 for StorageManager,
and would end up sending SIGTERM to everything.
2019-07-15 15:15:38 -05:00
Patrick LeBlanc
3f532eb059 Possible fix for OAM madness when SM is killed externally. 2019-07-15 09:48:25 -05:00
Roman Nozdrin
e42fcfa80e Merge pull request #798 from jmrojas2332/MCOL-2224
MCOL-2224
2019-07-15 06:57:18 -05:00
Patrick LeBlanc
8525032db7 Merge branch 'bootstrap-sync' into develop 2019-07-12 15:02:51 -05:00
Patrick LeBlanc
f7014c25e6 Made Cache populate Sync with jobs for the pre-existing stuff in the cache
on startup.
2019-07-12 14:59:23 -05:00
Ben Thompson
87fcfd7924 Fix shutdown code to stop listening for new connections and close all idle connections. 2019-07-12 14:57:05 -05:00
Patrick LeBlanc
b21b41077e Updated storage-manager ref. 2019-07-12 13:48:36 -05:00
Patrick LeBlanc
a84e3a408f Last commit of the initial set of changes. 2019-07-12 10:52:09 -05:00
Patrick LeBlanc
9ced374c81 Another incremental commit. 2019-07-12 10:33:51 -05:00
Patrick LeBlanc
16dc887f20 Incremental commit. Stripping out the OBE fstream IO code. 2019-07-12 10:06:56 -05:00
Patrick LeBlanc
d43f9d855c Merge branch 'cache-accounting' into develop 2019-07-11 12:32:29 -05:00
Patrick LeBlanc
90696b8887 Appears that the U18 version of boost needs an explicit include
of scoped_ptr
2019-07-11 11:46:47 -05:00
Ben Thompson
403942fada Fix for warnings in compiler. 2019-07-11 11:32:12 -05:00
David.Hall
f2c2a3014b Merge pull request #803 from mariadb-corporation/MCOL-3401
Revert "MCOL-2243 Only set length and dec when dec is zero"
2019-07-11 09:09:04 -05:00
Andrew Hutchings
a627611378 Revert "MCOL-2243 Only set length and dec when dec is zero"
This reverts commit b05c4e8df4.
2019-07-11 13:32:44 +01:00
David.Hall
23d6c34e3c Merge pull request #802 from mariadb-corporation/MCOL-3399-1.2
MCOL-3399 Fix VARCHAR LDI length processing
2019-07-11 00:30:54 -05:00
Andrew Hutchings
6219486607 MCOL-3399 Fix VARCHAR LDI length processing
Accidentally passed the wrong number of bytes when processing the row
provided in LDI. Revert the buf increment code.
2019-07-10 11:09:40 +01:00
Patrick LeBlanc
530d9fa5ac Updated a comment re a sneaky bug that means an entry in the LRU
does not exist on the filesystem.  Haven't figured that out yet.
Must be a narrow race b/c it happens rarely.
2019-07-05 16:48:30 -05:00
Patrick LeBlanc
948ee1aa53 Made the log-to-stderr stuff a cmake option. 2019-07-05 16:47:07 -05:00
Patrick LeBlanc
d0c457a068 Parameterized the journal size threshold to trigger a flush. 2019-07-05 14:20:39 -05:00
David Hall
b3df052b9f MCOL-1559 only trim on spaces, not on tabs. Don't ask me why that is. 2019-07-05 12:53:01 -05:00
Patrick LeBlanc
46265585ed Fixed a bug in the new makespace code. toBeDeleted wasn't being updated
during one of the races fixed a couple commits ago.
2019-07-05 11:03:50 -05:00
Patrick LeBlanc
62c853595f Changed the sync trigger to include outstanding journal size.
Right now it's hardcoded at 50MB for testing.  Will parameterize later.
2019-07-05 11:02:55 -05:00
Patrick LeBlanc
aa65090a61 Fixed another race. Also shortened the interval Sync creates new jobs.
In this one, if a read, then a delete happened on an object being flushed
by makeSpace(), it would leave the toBeDeleted struct with an invalid
list iterator.
2019-07-03 17:18:14 -05:00
Patrick LeBlanc
56a51605af Fixed more races and edge cases I found. 2019-07-03 13:31:49 -05:00
David Hall
db597e914b Merge branch 'develop-1.2' into MCOL-1559 2019-07-03 11:20:39 -05:00
David Hall
5993176839 MCOL-1559 add in trim for compare 2019-07-03 11:18:23 -05:00
David.Hall
4e477ab374 Merge pull request #799 from mariadb-corporation/MCOL-3395
MCOL-3395 Always clear dctnry cache on close
2019-07-03 09:33:25 -05:00
Andrew Hutchings
6bee5f9f61 MCOL-3395 Always clear dctnry cache on close
The dictionary cache needs to be cleared every time it is closed so that
on bulk insert we don't mix the cache between columns.
2019-07-03 08:46:43 +01:00
Patrick LeBlanc
2722da0b40 Checkpointing a bunch of edge-case fixes I made and mistakenly mushed
together with the cache size consistency code.
2019-07-02 11:12:29 -05:00
Ben Thompson
4c5866bcca changes for ssize_t messaging 2019-07-01 12:28:11 -05:00
Ben Thompson
dedffcd01e Add logic for graceful shutdown 2019-07-01 11:39:24 -05:00
Ben Thompson
bf18233ce7 Versioning files for StorageManager 2019-07-01 11:34:20 -05:00
Ben Thompson
fc46d1ce7c Modify Write/Read/Append for ssize_t return values. 2019-07-01 11:33:27 -05:00
Patrick LeBlanc
64dd0b720e Fixed a cache accounting error from a previous bug fix. 2019-06-28 14:23:18 -05:00
Patrick LeBlanc
cca5e21c24 Fixed a cache accounting error from a previous bug fix. 2019-06-28 14:22:31 -05:00
Patrick LeBlanc
5789f52420 Updated the libmarias3 ref, brought in Andrew's fixes for Cleversafe. 2019-06-28 13:58:20 -05:00
Patrick LeBlanc
715d041a85 Fixed several bugs exposed by setting the cache size to an
unreasonably small value.  Had to make a compromise to avoid a deadlock
though.  read/write/append/truncate will now be able to exceed the cache size
limit temporarily.  The cache will be reconciled at the end of the respective
operation.

Ex, given a cache of 100MB, and a read() of 500MB, all 500MB
of data being read will stay in the cache until it is read, then
400MB of it will be evicted.  Same on the write side.
2019-06-28 13:20:31 -05:00
Patrick LeBlanc
91585b4c6d Checkpointing some fixes. 2019-06-27 14:58:04 -05:00
jmrojas2332
7aa0643428 MCOL-2224 Trivial Fix. Change help message 2019-06-27 10:43:48 -05:00
David Hall
474039b6cf MCOL-1559 trim strings before compare on equal operator 2019-06-27 10:18:10 -05:00
David.Hall
97243ccf52 Merge pull request #795 from mariadb-corporation/MCOL-2225
MCOL-2225 Make cross-engine step use backticks
2019-06-26 09:11:19 -05:00
Andrew Hutchings
9c4ac78105 MCOL-2225 Make cross-engine step use backticks
If an InnoDB table has spaces in the column names the cross engine step
would fail. This patch wraps quotes around the table and column names to
support this use case.
2019-06-26 07:50:17 +01:00
David.Hall
5bb388842c Merge pull request #794 from mariadb-corporation/MCOL-3391
MCOL-3391 Fix columnstore_upgrade unicode support
2019-06-25 15:40:56 -05:00
David.Hall
206de40664 Merge pull request #788 from mariadb-corporation/develop-1.2-merge-up-20190619
MCOL-3388 Merge develop-1.1 into develop-1.2
2019-06-25 15:31:56 -05:00
Andrew Hutchings
3e77912dcd Merge pull request #793 from pleblanc1976/BRM-save-improvement
Found other places in the BRM code that were using fstreams vs IDB*.
2019-06-25 18:10:54 +01:00
Andrew Hutchings
089ec7d4dc MCOL-3391 Fix columnstore_upgrade unicode support
The columnstore_upgrade() procedure would break on utf8 table names.
This patch fixes that.
2019-06-25 17:15:30 +01:00