1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-21 13:40:58 +03:00
Commit Graph

5453 Commits

Author SHA1 Message Date
Patrick LeBlanc
094e5b554a Changed debugging outputs. 2019-07-22 16:25:31 -05:00
Patrick LeBlanc
45d4a7536b Need to make it eat a trailing \n char. 2019-07-22 14:47:04 -05:00
Patrick LeBlanc
1f09c533d5 more debugging printouts 2019-07-22 14:12:41 -05:00
Patrick LeBlanc
ee81f96f4a More debugging printouts. 2019-07-22 13:31:02 -05:00
Patrick LeBlanc
9f93844772 Still debugging brm transfer stuff. Added some debugging printouts. 2019-07-22 10:39:17 -05:00
Patrick LeBlanc
e8dd6443d6 Replaced some of the shell stuff it was doing with IDB FS fcns.
Still debugging...
2019-07-22 09:58:10 -05:00
Patrick LeBlanc
9daa44efa1 Made procmgr init the IDB* stuff. 2019-07-19 17:08:29 -05:00
Patrick LeBlanc
52bd0ee967 Some logging changes for debugging. 2019-07-19 15:52:01 -05:00
Patrick LeBlanc
be214a6fda Fixed a bug re the previous commit. 2019-07-19 14:54:33 -05:00
Patrick LeBlanc
1a7e733016 Hacked IDB-IO ops into the getDBRMData() stuff procmgr does.
Replaced the fstream stuff it did.
2019-07-19 14:33:29 -05:00
Patrick LeBlanc
d0a576483e Tentative fix for procmon d/ling DBRM files into data1. That screws things
up on shared filesystems, and storagemanager, which has sort-of a shared
filesystem view.
2019-07-19 09:54:54 -05:00
Patrick LeBlanc
3118acc3d4 Made stale sockets reconnect. 2019-07-18 14:56:14 -05:00
Patrick LeBlanc
7d4f406888 Changed the retry behavior in SocketPool to get load_brm to work
when called by proc???.  Also made proc??? start/stop SM around
save_brm runs.  There seems not to be a saner way to do that atm.

So, on stop/restart/shutdown, it will do
1) stop everything
2) restart SM
3) save_brm
4) stop SM again
2019-07-18 11:14:12 -05:00
Patrick LeBlanc
43f7a71bad Disable force-killing of StorageManager. Data corruption is possible
ATM.
2019-07-17 13:07:08 -05:00
Patrick LeBlanc
d30745d37c Merge pull request #805 from pleblanc1976/BRM-IO-cleanup
Brm io cleanup (MCOL-3242)
2019-07-17 07:56:38 -05:00
Andrew Hutchings
106250cbf0 Merge pull request #806 from mariadb-corporation/MCOL-3404
MCOL-3404 Revert experimental changes from MCOL-3343
columnstore-1.2.5
2019-07-17 08:07:08 +01:00
David Hall
c683b6bfc0 MCOL-3404 Revert experimental changes from MCOL-3343 2019-07-16 18:19:03 -05:00
David Hall
cd79a42ec1 MCOL-3404 Back out experimental changes from MCOL-3343 2019-07-16 17:14:17 -05:00
Patrick LeBlanc
809ff06485 Added an optional prefix for S3 keys to the config file.
Also changed the version of the current code to 0.4.0 from 1.4.0.
Major ver 1 implies this is a release, when in fact it's an alpha
at best.  :D
2019-07-16 15:18:08 -05:00
Patrick LeBlanc
4ec3cdc8b9 Fixed a bug where procmon would have a PID of 0 for StorageManager,
and would end up sending SIGTERM to everything.
2019-07-15 15:15:38 -05:00
Patrick LeBlanc
3f532eb059 Possible fix for OAM madness when SM is killed externally. 2019-07-15 09:48:25 -05:00
Roman Nozdrin
e42fcfa80e Merge pull request #798 from jmrojas2332/MCOL-2224
MCOL-2224
2019-07-15 06:57:18 -05:00
Patrick LeBlanc
8525032db7 Merge branch 'bootstrap-sync' into develop 2019-07-12 15:02:51 -05:00
Patrick LeBlanc
f7014c25e6 Made Cache populate Sync with jobs for the pre-existing stuff in the cache
on startup.
2019-07-12 14:59:23 -05:00
Ben Thompson
87fcfd7924 Fix shutdown code to stop listening for new connections and close all idle connections. 2019-07-12 14:57:05 -05:00
Patrick LeBlanc
b21b41077e Updated storage-manager ref. 2019-07-12 13:48:36 -05:00
Patrick LeBlanc
a84e3a408f Last commit of the initial set of changes. 2019-07-12 10:52:09 -05:00
Patrick LeBlanc
9ced374c81 Another incremental commit. 2019-07-12 10:33:51 -05:00
Patrick LeBlanc
16dc887f20 Incremental commit. Stripping out the OBE fstream IO code. 2019-07-12 10:06:56 -05:00
Patrick LeBlanc
d43f9d855c Merge branch 'cache-accounting' into develop 2019-07-11 12:32:29 -05:00
Patrick LeBlanc
90696b8887 Appears that the U18 version of boost needs an explicit include
of scoped_ptr
2019-07-11 11:46:47 -05:00
Ben Thompson
403942fada Fix for warnings in compiler. 2019-07-11 11:32:12 -05:00
David.Hall
f2c2a3014b Merge pull request #803 from mariadb-corporation/MCOL-3401
Revert "MCOL-2243 Only set length and dec when dec is zero"
2019-07-11 09:09:04 -05:00
Andrew Hutchings
a627611378 Revert "MCOL-2243 Only set length and dec when dec is zero"
This reverts commit b05c4e8df4.
2019-07-11 13:32:44 +01:00
David.Hall
23d6c34e3c Merge pull request #802 from mariadb-corporation/MCOL-3399-1.2
MCOL-3399 Fix VARCHAR LDI length processing
2019-07-11 00:30:54 -05:00
Andrew Hutchings
6219486607 MCOL-3399 Fix VARCHAR LDI length processing
Accidentally passed the wrong number of bytes when processing the row
provided in LDI. Revert the buf increment code.
2019-07-10 11:09:40 +01:00
Patrick LeBlanc
530d9fa5ac Updated a comment re a sneaky bug that means an entry in the LRU
does not exist on the filesystem.  Haven't figured that out yet.
Must be a narrow race b/c it happens rarely.
2019-07-05 16:48:30 -05:00
Patrick LeBlanc
948ee1aa53 Made the log-to-stderr stuff a cmake option. 2019-07-05 16:47:07 -05:00
Patrick LeBlanc
d0c457a068 Parameterized the journal size threshold to trigger a flush. 2019-07-05 14:20:39 -05:00
David Hall
b3df052b9f MCOL-1559 only trim on spaces, not on tabs. Don't ask me why that is. 2019-07-05 12:53:01 -05:00
Patrick LeBlanc
46265585ed Fixed a bug in the new makespace code. toBeDeleted wasn't being updated
during one of the races fixed a couple commits ago.
2019-07-05 11:03:50 -05:00
Patrick LeBlanc
62c853595f Changed the sync trigger to include outstanding journal size.
Right now it's hardcoded at 50MB for testing.  Will parameterize later.
2019-07-05 11:02:55 -05:00
Patrick LeBlanc
aa65090a61 Fixed another race. Also shortened the interval Sync creates new jobs.
In this one, if a read, then a delete happened on an object being flushed
by makeSpace(), it would leave the toBeDeleted struct with an invalid
list iterator.
2019-07-03 17:18:14 -05:00
Patrick LeBlanc
56a51605af Fixed more races and edge cases I found. 2019-07-03 13:31:49 -05:00
David Hall
db597e914b Merge branch 'develop-1.2' into MCOL-1559 2019-07-03 11:20:39 -05:00
David Hall
5993176839 MCOL-1559 add in trim for compare 2019-07-03 11:18:23 -05:00
David.Hall
4e477ab374 Merge pull request #799 from mariadb-corporation/MCOL-3395
MCOL-3395 Always clear dctnry cache on close
2019-07-03 09:33:25 -05:00
Andrew Hutchings
6bee5f9f61 MCOL-3395 Always clear dctnry cache on close
The dictionary cache needs to be cleared every time it is closed so that
on bulk insert we don't mix the cache between columns.
2019-07-03 08:46:43 +01:00
Patrick LeBlanc
2722da0b40 Checkpointing a bunch of edge-case fixes I made and mistakenly mushed
together with the cache size consistency code.
2019-07-02 11:12:29 -05:00
Ben Thompson
4c5866bcca changes for ssize_t messaging 2019-07-01 12:28:11 -05:00