aeec468814
Fixed a number of bugs in storage manager, and added code to detect
...
and recover from being killed while writing new objects.
Conflicts:
storage-manager/src/Synchronizer.cpp
2020-05-27 16:36:08 -04:00
75d1dbc592
MCOL-3494: initial commit of test program to verify storagemanager.cnf during postConfigure.
2020-04-30 16:59:56 -05:00
eb52184a5d
Merge pull request #1043 from benthompson15/MCOL-3748
...
MCOL-3748: Modify signal handling for different default actions.
2020-02-28 16:19:48 -05:00
635438599c
Merge pull request #1042 from benthompson15/MCOL-3736
...
MCOL-3736: Change AND to OR. Loop could exit with ops still in pendin…
2020-02-28 16:19:41 -05:00
bf356cdb86
Merge pull request #959 from benthompson15/MCOL-3638
...
MCOL-3638: Fix level of various storagemanager logging items.
2020-01-03 09:42:45 -06:00
586391e1ca
compilation failure
...
error: reference to 'mutex' is ambiguous
note: candidates are: 'class boost::mutex'
note: 'class std::mutex'
2019-12-19 18:13:39 +01:00
207fb3f588
Merge pull request #960 from LinuxJedi/unified_build
...
Unified build for ES and MCS
2019-12-05 01:19:23 +01:00
d56e4bab62
Merge pull request #918 from benthompson15/MCOL-3563
...
MCOL-3563: fix compiler warnings / type errors.
2019-12-04 14:08:43 -06:00
7489d0bfd0
MCOL-3625 Rename packages
...
Rename packages to MariaDB-columnstore-engine, MariaDB-columnstore-libs
and MariaDB-columnstore-platform.
Also add the "columnstore-" prefix the the components so that MariaDB's
packaging system understands then and add a line to include them in
MariaDB's packaging.
In addition
* Fix S3 building for dist source build
* Fix Debian 10 dependency issue
* Fix git handling for dist builds
* Add support for MariaDB's RPM building
* Use MariaDB's PCRE and readline
* Removes a few dead files
* Fix Boost noncopyable includes
2019-12-04 11:04:39 +00:00
a8cd34f86d
Add support for building from server
2019-12-03 21:21:28 +00:00
ce39332e8b
MCOL-3563: Add printouts directing user to check log files.
2019-12-03 13:59:41 -06:00
bdd87284f9
MCOL-3638: Fix level of various storagemanager logging items.
2019-12-03 12:51:48 -06:00
ccfc0dc16d
Merge pull request #948 from LinuxJedi/fix-code-errors
...
MCOL-3621 Fix a few cppcheck issues
2019-11-25 15:04:55 -06:00
0ae4969a4d
MCOL-3563: new SyncTask was added also had this issue.
2019-11-22 18:42:49 -06:00
a0ffc427ec
MCOL-3563: remove the dumb errorHandle test. Misread what this was doing. described the connection test behavior.
2019-11-22 18:36:53 -06:00
3565d237ed
MCOL-3563: Fix OpenTask and PingTask for read returning int to a bool.
2019-11-22 17:05:40 -06:00
8d6c2a33bf
MCOL-3563: Modify all *TASK tests to use processtask and test connection failures and short message error handling on disconnect.
2019-11-22 17:05:40 -06:00
3e3e0ed89b
MCOL-3563: convert some cout to logging messages and default fd for ctrl socket.
2019-11-22 17:05:40 -06:00
3a730a4222
MCOL-3563: fix compiler warnings / type errors.
...
A previous commit made posix::read changed return value
from bool to int. However some callers still expected
bool and compared a bool<0 which is always false.
2019-11-22 17:05:40 -06:00
d377defa31
MCOL-3577: update syncNow with prefix
...
to behave like syncNow no prefix.
This should be corrected eventually but is safer now as
previous implementation would possibly result in deadlock.
2019-11-21 15:19:03 -06:00
18d31fae82
MCOL-3577: cleanup debug logging and comments from copy/paste.
2019-11-21 15:19:03 -06:00
abd7444809
MCOL-3577: Found an issues with the order of dropPrefix Cache before Sync.
2019-11-21 15:19:03 -06:00
5bbd21b8e0
MCOL-3577: Add functionality to sync S3 storage for suspendDatabaseWrites.
2019-11-21 15:19:03 -06:00
dba7220ad3
Fix a few cppcheck issues
...
Found the following:
* Potential stack explosions with alloca() usage on potentially large
strings
* Memory leaks in WriteEngineServer
* Stack usage out of scope in dataconvert
* A typo in an 'if' statement in dataconvert
2019-11-21 13:52:53 +00:00
044ed75176
left out %s in logging message
2019-10-17 15:02:33 -05:00
ab614da63c
MCOL-3499: WriteTask failure was sending 2 responses and fix race between prefixCache::populate and writing new S3 objects.
2019-10-17 14:25:28 -05:00
2b28875698
MCOL-3357: Only call the configListners if the file was updated by reload.
2019-10-09 12:44:25 -05:00
c97e58c9b5
MCOL-3357: reorder this since maxThreads is set by configListener now.
2019-10-08 14:32:52 -05:00
753a77b38c
MCOL-3557: add config change listeners.
2019-10-08 13:44:35 -05:00
3b867e1b1a
Merge pull request #892 from mariadb-corporation/MCOL-3541
...
MCOL-3541: add modtime to smls outputs
2019-10-07 14:12:54 -05:00
1539bfec8d
MCOL-3541: increase buffer for formatted time string.
2019-10-07 13:46:45 -05:00
4a1ce93605
MCOL-3547: cleanup compile warnings from storagemanager.
2019-10-07 13:04:58 -05:00
9225ad9b51
MCOL-3541: add modtime to smls outputs
2019-10-07 10:28:08 -05:00
beedde52d1
Merge pull request #874 from pleblanc1976/partial-msg-tests
...
Partial msg tests
2019-09-25 17:53:14 +01:00
64f3fc950b
Merge pull request #869 from mariadb-corporation/MCOL-3436
...
MCOL-3436: Modify signal handling to not shutdown on non term or core signals.
2019-09-25 17:45:05 +01:00
70f4ffe8c2
MCOL-3436: have sighandler function call crashtrace handler.
2019-09-24 11:16:02 -05:00
90a3a06b0b
fix path in copy test
2019-09-23 15:02:06 -05:00
1809598f03
MCOL-3436: Modify signal handling to not shutdown on non term or core signals.
2019-09-20 16:07:40 -05:00
4c21bb6c44
Should not be checking the COLUMNSTORE_INSTALL_DIR env before looking for the cnf file in MCSSYSCONFDIR.
2019-09-20 15:54:10 -05:00
3b5c7f7ed4
Update unit_tests for testing short messages and connection loss
2019-09-18 11:02:33 -05:00
021009fe99
Change posixtask::read to return int instead of bool and handle when data read is short of expected message length.
2019-09-16 16:26:42 -05:00
97bda78c3b
Move config files
...
This patch:
* Moves config files from /usr/local/mariadb/columnstore/etc to
ENGINE_SYSCONFDIR/columnstore (ENGINE_SYSCONFDIR is /etc by default)
* Sets a define called MCSSYSCONFDIR whic contains the
ENGINE_SYSCONFDIR compile time setting
* Modifies scripts and code to use the new paths
* Removes a whole bunch of files we don't use
2019-09-09 14:13:56 +01:00
0e5f276d12
StorageManager logging should show up with columnstore logging.
2019-09-04 17:21:46 -05:00
ee1537406d
Merge pull request #841 from pleblanc1976/random-mods
...
A couple random SM things
2019-09-03 11:06:03 -05:00
91067f320e
Merge pull request #842 from pleblanc1976/sm-config-documentation
...
MCOL-3467. Documented all of the vars in the SM config file. Also add'l # parsi…
2019-08-29 14:29:30 -05:00
4f86b0f909
Fix develop build breakages
2019-08-29 09:44:14 +01:00
2a78777e06
Documented all of the vars in the SM config file. Also add'l # parsing to Config.
...
Realized our Config class wouldn't handle tera- (T/t) processing but
no reason it shouldn't. Ex, they want a 1TB cache, they can specify
'1t' as the cache_size.
2019-08-28 15:19:03 -05:00
0f065864c4
Started writing unit tests to verify SM does the right thing
...
when given short data (sender crashed).
2019-08-28 12:59:09 -05:00
fc8f68e391
A couple random things
...
- Re-added the StorageManager/Enabled key in the default config file.
Thought I had switched all that stuff to only look at DBRootStorageType
but I was wrong.
- Made the unit_tests bin for SM stay in the SM dir
- Collapsed one level of build dirs for SM. For some reason it was
putting test data in storage-manager/storage-manager/testData
- Limited a single read() call to 100MB as a paranoid safety measure.
Normal usage won't read that much at once anyway.
2019-08-28 12:56:52 -05:00
e203ea262f
Merge pull request #839 from mariadb-corporation/MCOL-3426
...
MCOL-3426: Fix writes that start past current EOF.
2019-08-28 10:55:51 -05:00
