0b32ad8107
Set errno before returning.
2020-08-26 13:09:06 -05:00
2951dbed39
MCOL-3494: make option for testing configuration to skip retryable errors.
2020-08-26 13:08:51 -05:00
4b46f55d6a
Fixed a race in storagemanager. On startup it would run a connectivity
...
test to verify it can use S3. The key of the object it tests with is
constant, so there can be interference between multiple SM instances that
happen to be doing this at the same time. The fix is to include a
UUID in the key.
2020-08-25 09:59:07 -04:00
eac7dab096
MCOL-4030: first commit of warning removals unneed const and missing virtual dtors.
2020-06-23 13:51:36 -05:00
4bddc92092
MCOL-4010 - fixes compilation errors on x64 w/-Werror
...
Merged in Sergei's patch.
2020-06-01 12:52:43 -04:00
2e65619cb1
Fixed an error msg; the function name was wrong.
2020-05-27 16:37:51 -04:00
cd5e872104
Removed unnecessary debugging printouts/logging, fixed a couple add'l bugs.
2020-05-27 16:37:51 -04:00
6fd24d2d06
Added code to delete orphaned objects from the cache & from cloud storage.
2020-05-27 16:37:51 -04:00
33558881ab
Fixed the problem with using the correct length for new objects in copyFile.
...
The metadata should contain the merged length, the object name should
contain the pre-merged length.
2020-05-27 16:37:51 -04:00
c2c23b8098
Snapshotting the changes so far, we'll have to come back to it later.
2020-05-27 16:37:51 -04:00
faa35ebeeb
Tentative commit, hunting down a source of misbehavior.
...
Conflicts:
storage-manager/src/IOCoordinator.cpp
2020-05-27 16:37:46 -04:00
359beb9c96
Suppressed logging self-correcting problems.
...
It will start logging as an err if it does not self-correct after 10 attempts,
and will escalate to crit after 20 attempts.
Also fixed a silly error where it was checking the file size after it
deleted the file.
2020-05-27 16:36:18 -04:00
5d8470b91f
Fixed a length parameter after a partial write.
2020-05-27 16:36:18 -04:00
43585d55cd
Added error detection to the new ::rename calls.
2020-05-27 16:36:18 -04:00
c29050899d
Took out the cache repopulate idea. Now we will only have warnings
...
of problems.
I realized we can't reliably tell how big the cache is while the system
is running. There's a window where write/append has added / is adding
a journal file but hasn't told Cache about it yet. This capability will
have to wait for now.
This shouldn't be a problem because in theory, we will no longer have
data whose size is not consistent with metadata stored outside of the file.
If we do, it means there was either a hard failure, or SM was killed.
Either way, SM will be restarted and the cache will populate its meta
fresh then.
2020-05-27 16:36:18 -04:00
3497191d0c
Fixed a silly error.
2020-05-27 16:36:18 -04:00
31e06e77a2
Fixed the fix.
...
Actually need to rename the file after you pick a new name for it LOL!
2020-05-27 16:36:18 -04:00
4b9c1d9169
Cleaned up a little code of previous commit, added retry loops and
...
a little better error handling to the code that writes journal entries.
2020-05-27 16:36:18 -04:00
aeec468814
Fixed a number of bugs in storage manager, and added code to detect
...
and recover from being killed while writing new objects.
Conflicts:
storage-manager/src/Synchronizer.cpp
2020-05-27 16:36:08 -04:00
b8caaaa760
Rebased MCOL-3836 on top of e7bc7e93.
2020-05-12 15:56:10 +00:00
98abf95eae
MCOL-3991 MCS is now single package and properly uninstalls
2020-05-12 13:36:24 +00:00
49b8a4afea
MCOL-3983 workaround. No time right now for a good fix. For now
...
using a workaround and a note.
2020-05-06 11:28:21 -04:00
6987ac40e1
MCOL-3982 Avoid using autotools for libmarias3 and remove libxml2 from libmarias3 dependencies.
2020-05-06 12:45:34 +00:00
75d1dbc592
MCOL-3494: initial commit of test program to verify storagemanager.cnf during postConfigure.
2020-04-30 16:59:56 -05:00
bb3e76be7b
Accidentally clobbered some documentation with the last commit.
2020-04-22 17:29:12 -04:00
78c53df1b9
MCOL-3889 part 1. Updated the storagemanager.cnf file.
2020-04-22 17:14:41 -04:00
90d4b03fdb
MCOL-3743: cmdline params to postConfig to configure SM
...
Made some changes. It's working the way it should.
2020-03-17 13:55:08 -04:00
eb52184a5d
Merge pull request #1043 from benthompson15/MCOL-3748
...
MCOL-3748: Modify signal handling for different default actions.
2020-02-28 16:19:48 -05:00
635438599c
Merge pull request #1042 from benthompson15/MCOL-3736
...
MCOL-3736: Change AND to OR. Loop could exit with ops still in pendin…
2020-02-28 16:19:41 -05:00
d8f22609b4
MCOL-3745: Investigate slow-ddl problem after restart
...
Found a way to mitigate it through configuration. Only relevant to low
upstream bandwidth envs. Documented it.
2020-01-31 11:35:11 -05:00
bf356cdb86
Merge pull request #959 from benthompson15/MCOL-3638
...
MCOL-3638: Fix level of various storagemanager logging items.
2020-01-03 09:42:45 -06:00
586391e1ca
compilation failure
...
error: reference to 'mutex' is ambiguous
note: candidates are: 'class boost::mutex'
note: 'class std::mutex'
2019-12-19 18:13:39 +01:00
d811697cee
MCOL-3651: Another update to comments since we can't install to users home directory.
2019-12-06 11:28:32 -06:00
99eb56382b
MCOL-3651: Update the comments in the default cnf file to explain common_prefix_depth.
2019-12-06 11:19:26 -06:00
1b56000b7b
MCOL-3651: Change common_prefix_depth default from 4 to 3.
2019-12-06 11:10:32 -06:00
207fb3f588
Merge pull request #960 from LinuxJedi/unified_build
...
Unified build for ES and MCS
2019-12-05 01:19:23 +01:00
d56e4bab62
Merge pull request #918 from benthompson15/MCOL-3563
...
MCOL-3563: fix compiler warnings / type errors.
2019-12-04 14:08:43 -06:00
7489d0bfd0
MCOL-3625 Rename packages
...
Rename packages to MariaDB-columnstore-engine, MariaDB-columnstore-libs
and MariaDB-columnstore-platform.
Also add the "columnstore-" prefix the the components so that MariaDB's
packaging system understands then and add a line to include them in
MariaDB's packaging.
In addition
* Fix S3 building for dist source build
* Fix Debian 10 dependency issue
* Fix git handling for dist builds
* Add support for MariaDB's RPM building
* Use MariaDB's PCRE and readline
* Removes a few dead files
* Fix Boost noncopyable includes
2019-12-04 11:04:39 +00:00
a8cd34f86d
Add support for building from server
2019-12-03 21:21:28 +00:00
efe829784d
MCOL-3624 Move jemalloc to an LD_PRELOAD
...
Linking will become an issue for the unified build and it is an issue
for jemalloc 5.x. Instead we will LD_PRELOAD on the forked ColumnStore
specific processes.
2019-12-03 21:21:28 +00:00
ce39332e8b
MCOL-3563: Add printouts directing user to check log files.
2019-12-03 13:59:41 -06:00
bdd87284f9
MCOL-3638: Fix level of various storagemanager logging items.
2019-12-03 12:51:48 -06:00
ccfc0dc16d
Merge pull request #948 from LinuxJedi/fix-code-errors
...
MCOL-3621 Fix a few cppcheck issues
2019-11-25 15:04:55 -06:00
0ae4969a4d
MCOL-3563: new SyncTask was added also had this issue.
2019-11-22 18:42:49 -06:00
a0ffc427ec
MCOL-3563: remove the dumb errorHandle test. Misread what this was doing. described the connection test behavior.
2019-11-22 18:36:53 -06:00
3565d237ed
MCOL-3563: Fix OpenTask and PingTask for read returning int to a bool.
2019-11-22 17:05:40 -06:00
8d6c2a33bf
MCOL-3563: Modify all *TASK tests to use processtask and test connection failures and short message error handling on disconnect.
2019-11-22 17:05:40 -06:00
3e3e0ed89b
MCOL-3563: convert some cout to logging messages and default fd for ctrl socket.
2019-11-22 17:05:40 -06:00
3a730a4222
MCOL-3563: fix compiler warnings / type errors.
...
A previous commit made posix::read changed return value
from bool to int. However some callers still expected
bool and compared a bool<0 which is always false.
2019-11-22 17:05:40 -06:00
d377defa31
MCOL-3577: update syncNow with prefix
...
to behave like syncNow no prefix.
This should be corrected eventually but is safer now as
previous implementation would possibly result in deadlock.
2019-11-21 15:19:03 -06:00
