1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-04-18 21:44:02 +03:00

19 Commits

Author SHA1 Message Date
benthompson15
dc4f6865d1
MCOL-3983: always set threadpool max threads in storagemanager (#2269) 2022-02-23 12:21:43 -06:00
Leonid Fedorov
04752ec546 clang format apply 2022-01-21 16:43:49 +00:00
Patrick LeBlanc
cd5e872104 Removed unnecessary debugging printouts/logging, fixed a couple add'l bugs. 2020-05-27 16:37:51 -04:00
Patrick LeBlanc
6fd24d2d06 Added code to delete orphaned objects from the cache & from cloud storage. 2020-05-27 16:37:51 -04:00
Patrick LeBlanc
faa35ebeeb Tentative commit, hunting down a source of misbehavior.
Conflicts:
	storage-manager/src/IOCoordinator.cpp
2020-05-27 16:37:46 -04:00
Patrick LeBlanc
359beb9c96 Suppressed logging self-correcting problems.
It will start logging as an err if it does not self-correct after 10 attempts,
and will escalate to crit after 20 attempts.

Also fixed a silly error where it was checking the file size after it
deleted the file.
2020-05-27 16:36:18 -04:00
Patrick LeBlanc
c29050899d Took out the cache repopulate idea. Now we will only have warnings
of problems.

I realized we can't reliably tell how big the cache is while the system
is running.  There's a window where write/append has added / is adding
a journal file but hasn't told Cache about it yet.  This capability will
have to wait for now.

This shouldn't be a problem because in theory, we will no longer have
data whose size is not consistent with metadata stored outside of the file.
If we do, it means there was either a hard failure, or SM was killed.
Either way, SM will be restarted and the cache will populate its meta
fresh then.
2020-05-27 16:36:18 -04:00
Patrick LeBlanc
4b9c1d9169 Cleaned up a little code of previous commit, added retry loops and
a little better error handling to the code that writes journal entries.
2020-05-27 16:36:18 -04:00
Patrick LeBlanc
aeec468814 Fixed a number of bugs in storage manager, and added code to detect
and recover from being killed while writing new objects.

Conflicts:
	storage-manager/src/Synchronizer.cpp
2020-05-27 16:36:08 -04:00
Patrick LeBlanc
635438599c Merge pull request #1042 from benthompson15/MCOL-3736
MCOL-3736: Change AND to OR. Loop could exit with ops still in pendin…
2020-02-28 16:19:41 -05:00
benthompson15
d377defa31 MCOL-3577: update syncNow with prefix
to behave like syncNow no prefix.
This should be corrected eventually but is safer now as
previous implementation would possibly result in deadlock.
2019-11-21 15:19:03 -06:00
benthompson15
18d31fae82 MCOL-3577: cleanup debug logging and comments from copy/paste. 2019-11-21 15:19:03 -06:00
benthompson15
5bbd21b8e0 MCOL-3577: Add functionality to sync S3 storage for suspendDatabaseWrites. 2019-11-21 15:19:03 -06:00
benthompson15
c97e58c9b5 MCOL-3357: reorder this since maxThreads is set by configListener now. 2019-10-08 14:32:52 -05:00
benthompson15
753a77b38c MCOL-3557: add config change listeners. 2019-10-08 13:44:35 -05:00
Andrew Hutchings
4f86b0f909 Fix develop build breakages 2019-08-29 09:44:14 +01:00
Patrick LeBlanc
281443cb0a Wrote a version of mergejournal that uses more mem but reduces the io op
requirement.  Added a safety valve; if the journal file is > 100MB, it
will fall back to the previous IO op heavy but mem friendly version.

This also includes a compiler warning fix for smls & smput.
2019-08-22 16:38:27 -05:00
Patrick LeBlanc
a7fd3bf5d1 A few fixes in Synchronizer. If you have a prefix with a '_'
char, the key breakout wouldn't be correct until this.
2019-08-19 17:02:29 -05:00
Patrick LeBlanc
fba0c1728c Relocating everything in the repo s.t. it can be merged into
the columnstore repo.
2019-08-14 11:07:24 -05:00