4bddc92092
MCOL-4010 - fixes compilation errors on x64 w/-Werror
...
Merged in Sergei's patch.
2020-06-01 12:52:43 -04:00
2e65619cb1
Fixed an error msg; the function name was wrong.
2020-05-27 16:37:51 -04:00
cd5e872104
Removed unnecessary debugging printouts/logging, fixed a couple add'l bugs.
2020-05-27 16:37:51 -04:00
6fd24d2d06
Added code to delete orphaned objects from the cache & from cloud storage.
2020-05-27 16:37:51 -04:00
33558881ab
Fixed the problem with using the correct length for new objects in copyFile.
...
The metadata should contain the merged length, the object name should
contain the pre-merged length.
2020-05-27 16:37:51 -04:00
c2c23b8098
Snapshotting the changes so far, we'll have to come back to it later.
2020-05-27 16:37:51 -04:00
faa35ebeeb
Tentative commit, hunting down a source of misbehavior.
...
Conflicts:
storage-manager/src/IOCoordinator.cpp
2020-05-27 16:37:46 -04:00
359beb9c96
Suppressed logging self-correcting problems.
...
It will start logging as an err if it does not self-correct after 10 attempts,
and will escalate to crit after 20 attempts.
Also fixed a silly error where it was checking the file size after it
deleted the file.
2020-05-27 16:36:18 -04:00
5d8470b91f
Fixed a length parameter after a partial write.
2020-05-27 16:36:18 -04:00
43585d55cd
Added error detection to the new ::rename calls.
2020-05-27 16:36:18 -04:00
c29050899d
Took out the cache repopulate idea. Now we will only have warnings
...
of problems.
I realized we can't reliably tell how big the cache is while the system
is running. There's a window where write/append has added / is adding
a journal file but hasn't told Cache about it yet. This capability will
have to wait for now.
This shouldn't be a problem because in theory, we will no longer have
data whose size is not consistent with metadata stored outside of the file.
If we do, it means there was either a hard failure, or SM was killed.
Either way, SM will be restarted and the cache will populate its meta
fresh then.
2020-05-27 16:36:18 -04:00
3497191d0c
Fixed a silly error.
2020-05-27 16:36:18 -04:00
31e06e77a2
Fixed the fix.
...
Actually need to rename the file after you pick a new name for it LOL!
2020-05-27 16:36:18 -04:00
4b9c1d9169
Cleaned up a little code of previous commit, added retry loops and
...
a little better error handling to the code that writes journal entries.
2020-05-27 16:36:18 -04:00
aeec468814
Fixed a number of bugs in storage manager, and added code to detect
...
and recover from being killed while writing new objects.
Conflicts:
storage-manager/src/Synchronizer.cpp
2020-05-27 16:36:08 -04:00
b8caaaa760
Rebased MCOL-3836 on top of e7bc7e93.
2020-05-12 15:56:10 +00:00
98abf95eae
MCOL-3991 MCS is now single package and properly uninstalls
2020-05-12 13:36:24 +00:00
49b8a4afea
MCOL-3983 workaround. No time right now for a good fix. For now
...
using a workaround and a note.
2020-05-06 11:28:21 -04:00
6987ac40e1
MCOL-3982 Avoid using autotools for libmarias3 and remove libxml2 from libmarias3 dependencies.
2020-05-06 12:45:34 +00:00
75d1dbc592
MCOL-3494: initial commit of test program to verify storagemanager.cnf during postConfigure.
2020-04-30 16:59:56 -05:00
bb3e76be7b
Accidentally clobbered some documentation with the last commit.
2020-04-22 17:29:12 -04:00
78c53df1b9
MCOL-3889 part 1. Updated the storagemanager.cnf file.
2020-04-22 17:14:41 -04:00
90d4b03fdb
MCOL-3743: cmdline params to postConfig to configure SM
...
Made some changes. It's working the way it should.
2020-03-17 13:55:08 -04:00
eb52184a5d
Merge pull request #1043 from benthompson15/MCOL-3748
...
MCOL-3748: Modify signal handling for different default actions.
2020-02-28 16:19:48 -05:00
635438599c
Merge pull request #1042 from benthompson15/MCOL-3736
...
MCOL-3736: Change AND to OR. Loop could exit with ops still in pendin…
2020-02-28 16:19:41 -05:00
d8f22609b4
MCOL-3745: Investigate slow-ddl problem after restart
...
Found a way to mitigate it through configuration. Only relevant to low
upstream bandwidth envs. Documented it.
2020-01-31 11:35:11 -05:00
bf356cdb86
Merge pull request #959 from benthompson15/MCOL-3638
...
MCOL-3638: Fix level of various storagemanager logging items.
2020-01-03 09:42:45 -06:00
586391e1ca
compilation failure
...
error: reference to 'mutex' is ambiguous
note: candidates are: 'class boost::mutex'
note: 'class std::mutex'
2019-12-19 18:13:39 +01:00
d811697cee
MCOL-3651: Another update to comments since we can't install to users home directory.
2019-12-06 11:28:32 -06:00
99eb56382b
MCOL-3651: Update the comments in the default cnf file to explain common_prefix_depth.
2019-12-06 11:19:26 -06:00
1b56000b7b
MCOL-3651: Change common_prefix_depth default from 4 to 3.
2019-12-06 11:10:32 -06:00
207fb3f588
Merge pull request #960 from LinuxJedi/unified_build
...
Unified build for ES and MCS
2019-12-05 01:19:23 +01:00
d56e4bab62
Merge pull request #918 from benthompson15/MCOL-3563
...
MCOL-3563: fix compiler warnings / type errors.
2019-12-04 14:08:43 -06:00
7489d0bfd0
MCOL-3625 Rename packages
...
Rename packages to MariaDB-columnstore-engine, MariaDB-columnstore-libs
and MariaDB-columnstore-platform.
Also add the "columnstore-" prefix the the components so that MariaDB's
packaging system understands then and add a line to include them in
MariaDB's packaging.
In addition
* Fix S3 building for dist source build
* Fix Debian 10 dependency issue
* Fix git handling for dist builds
* Add support for MariaDB's RPM building
* Use MariaDB's PCRE and readline
* Removes a few dead files
* Fix Boost noncopyable includes
2019-12-04 11:04:39 +00:00
a8cd34f86d
Add support for building from server
2019-12-03 21:21:28 +00:00
efe829784d
MCOL-3624 Move jemalloc to an LD_PRELOAD
...
Linking will become an issue for the unified build and it is an issue
for jemalloc 5.x. Instead we will LD_PRELOAD on the forked ColumnStore
specific processes.
2019-12-03 21:21:28 +00:00
ce39332e8b
MCOL-3563: Add printouts directing user to check log files.
2019-12-03 13:59:41 -06:00
bdd87284f9
MCOL-3638: Fix level of various storagemanager logging items.
2019-12-03 12:51:48 -06:00
ccfc0dc16d
Merge pull request #948 from LinuxJedi/fix-code-errors
...
MCOL-3621 Fix a few cppcheck issues
2019-11-25 15:04:55 -06:00
0ae4969a4d
MCOL-3563: new SyncTask was added also had this issue.
2019-11-22 18:42:49 -06:00
a0ffc427ec
MCOL-3563: remove the dumb errorHandle test. Misread what this was doing. described the connection test behavior.
2019-11-22 18:36:53 -06:00
3565d237ed
MCOL-3563: Fix OpenTask and PingTask for read returning int to a bool.
2019-11-22 17:05:40 -06:00
8d6c2a33bf
MCOL-3563: Modify all *TASK tests to use processtask and test connection failures and short message error handling on disconnect.
2019-11-22 17:05:40 -06:00
3e3e0ed89b
MCOL-3563: convert some cout to logging messages and default fd for ctrl socket.
2019-11-22 17:05:40 -06:00
3a730a4222
MCOL-3563: fix compiler warnings / type errors.
...
A previous commit made posix::read changed return value
from bool to int. However some callers still expected
bool and compared a bool<0 which is always false.
2019-11-22 17:05:40 -06:00
d377defa31
MCOL-3577: update syncNow with prefix
...
to behave like syncNow no prefix.
This should be corrected eventually but is safer now as
previous implementation would possibly result in deadlock.
2019-11-21 15:19:03 -06:00
18d31fae82
MCOL-3577: cleanup debug logging and comments from copy/paste.
2019-11-21 15:19:03 -06:00
abd7444809
MCOL-3577: Found an issues with the order of dropPrefix Cache before Sync.
2019-11-21 15:19:03 -06:00
5bbd21b8e0
MCOL-3577: Add functionality to sync S3 storage for suspendDatabaseWrites.
2019-11-21 15:19:03 -06:00
dba7220ad3
Fix a few cppcheck issues
...
Found the following:
* Potential stack explosions with alloca() usage on potentially large
strings
* Memory leaks in WriteEngineServer
* Stack usage out of scope in dataconvert
* A typo in an 'if' statement in dataconvert
2019-11-21 13:52:53 +00:00
