3565d237ed
MCOL-3563: Fix OpenTask and PingTask for read returning int to a bool.
2019-11-22 17:05:40 -06:00
8d6c2a33bf
MCOL-3563: Modify all *TASK tests to use processtask and test connection failures and short message error handling on disconnect.
2019-11-22 17:05:40 -06:00
3e3e0ed89b
MCOL-3563: convert some cout to logging messages and default fd for ctrl socket.
2019-11-22 17:05:40 -06:00
3a730a4222
MCOL-3563: fix compiler warnings / type errors.
...
A previous commit made posix::read changed return value
from bool to int. However some callers still expected
bool and compared a bool<0 which is always false.
2019-11-22 17:05:40 -06:00
d377defa31
MCOL-3577: update syncNow with prefix
...
to behave like syncNow no prefix.
This should be corrected eventually but is safer now as
previous implementation would possibly result in deadlock.
2019-11-21 15:19:03 -06:00
18d31fae82
MCOL-3577: cleanup debug logging and comments from copy/paste.
2019-11-21 15:19:03 -06:00
abd7444809
MCOL-3577: Found an issues with the order of dropPrefix Cache before Sync.
2019-11-21 15:19:03 -06:00
5bbd21b8e0
MCOL-3577: Add functionality to sync S3 storage for suspendDatabaseWrites.
2019-11-21 15:19:03 -06:00
dba7220ad3
Fix a few cppcheck issues
...
Found the following:
* Potential stack explosions with alloca() usage on potentially large
strings
* Memory leaks in WriteEngineServer
* Stack usage out of scope in dataconvert
* A typo in an 'if' statement in dataconvert
2019-11-21 13:52:53 +00:00
b9708530e2
Fix library and storage manager install paths
2019-11-13 23:34:20 +00:00
044ed75176
left out %s in logging message
2019-10-17 15:02:33 -05:00
ab614da63c
MCOL-3499: WriteTask failure was sending 2 responses and fix race between prefixCache::populate and writing new S3 objects.
2019-10-17 14:25:28 -05:00
2b28875698
MCOL-3357: Only call the configListners if the file was updated by reload.
2019-10-09 12:44:25 -05:00
c97e58c9b5
MCOL-3357: reorder this since maxThreads is set by configListener now.
2019-10-08 14:32:52 -05:00
753a77b38c
MCOL-3557: add config change listeners.
2019-10-08 13:44:35 -05:00
3b867e1b1a
Merge pull request #892 from mariadb-corporation/MCOL-3541
...
MCOL-3541: add modtime to smls outputs
2019-10-07 14:12:54 -05:00
1539bfec8d
MCOL-3541: increase buffer for formatted time string.
2019-10-07 13:46:45 -05:00
4a1ce93605
MCOL-3547: cleanup compile warnings from storagemanager.
2019-10-07 13:04:58 -05:00
9225ad9b51
MCOL-3541: add modtime to smls outputs
2019-10-07 10:28:08 -05:00
cbef44a0be
MCOL-3503 add MODA aggregate function
2019-09-27 12:22:44 -05:00
0a175f0052
Merge pull request #871 from mariadb-corporation/cpimport-s3
...
MCOL-3514 Add support for S3 to cpimport
2019-09-25 12:13:47 -05:00
beedde52d1
Merge pull request #874 from pleblanc1976/partial-msg-tests
...
Partial msg tests
2019-09-25 17:53:14 +01:00
64f3fc950b
Merge pull request #869 from mariadb-corporation/MCOL-3436
...
MCOL-3436: Modify signal handling to not shutdown on non term or core signals.
2019-09-25 17:45:05 +01:00
59d1caae02
Fix CMake dependencies
...
Some odd quirks with CMake mean that marias3 has to be in the top level
CMake. Also made submodule checkout happen at cmake time.
2019-09-25 11:30:32 +01:00
70f4ffe8c2
MCOL-3436: have sighandler function call crashtrace handler.
2019-09-24 11:16:02 -05:00
fe8228e50a
Fix build order so ms3 is checked out
2019-09-24 16:47:00 +01:00
8633859dd4
MCOL-3514 Add support for S3 to cpimport
...
cpimport now has the ability to use libmarias3 to read an object from an
S3 bucket instead of a file on local disk.
This also moves libmarias3 to utils/libmarias3.
2019-09-24 10:31:22 +01:00
90a3a06b0b
fix path in copy test
2019-09-23 15:02:06 -05:00
1809598f03
MCOL-3436: Modify signal handling to not shutdown on non term or core signals.
2019-09-20 16:07:40 -05:00
4c21bb6c44
Should not be checking the COLUMNSTORE_INSTALL_DIR env before looking for the cnf file in MCSSYSCONFDIR.
2019-09-20 15:54:10 -05:00
f62ea7e30e
running as root for BB regression requires this to be 1
2019-09-18 11:45:24 -05:00
3b5c7f7ed4
Update unit_tests for testing short messages and connection loss
2019-09-18 11:02:33 -05:00
021009fe99
Change posixtask::read to return int instead of bool and handle when data read is short of expected message length.
2019-09-16 16:26:42 -05:00
99399d289f
change the test cnf file to use 8K objects for unit_test edge cases.
2019-09-16 16:24:28 -05:00
97bda78c3b
Move config files
...
This patch:
* Moves config files from /usr/local/mariadb/columnstore/etc to
ENGINE_SYSCONFDIR/columnstore (ENGINE_SYSCONFDIR is /etc by default)
* Sets a define called MCSSYSCONFDIR whic contains the
ENGINE_SYSCONFDIR compile time setting
* Modifies scripts and code to use the new paths
* Removes a whole bunch of files we don't use
2019-09-09 14:13:56 +01:00
0e5f276d12
StorageManager logging should show up with columnstore logging.
2019-09-04 17:21:46 -05:00
89eff8bc45
MCOL-3455: link to jemalloc. Fix packaging issues for RPMs and other compile issues encounter.
2019-09-03 14:16:34 -05:00
ee1537406d
Merge pull request #841 from pleblanc1976/random-mods
...
A couple random SM things
2019-09-03 11:06:03 -05:00
9e1282e437
put unit_test exe in correct place
2019-08-29 17:35:58 -05:00
91067f320e
Merge pull request #842 from pleblanc1976/sm-config-documentation
...
MCOL-3467. Documented all of the vars in the SM config file. Also add'l # parsi…
2019-08-29 14:29:30 -05:00
4f86b0f909
Fix develop build breakages
2019-08-29 09:44:14 +01:00
1982b38e8a
Added a couple warnings of what values should not be changed after postConfig.
2019-08-28 16:30:35 -05:00
2a78777e06
Documented all of the vars in the SM config file. Also add'l # parsing to Config.
...
Realized our Config class wouldn't handle tera- (T/t) processing but
no reason it shouldn't. Ex, they want a 1TB cache, they can specify
'1t' as the cache_size.
2019-08-28 15:19:03 -05:00
471b00846d
Added the known-good (WIP) config file the unit test will use.
2019-08-28 13:04:59 -05:00
0f065864c4
Started writing unit tests to verify SM does the right thing
...
when given short data (sender crashed).
2019-08-28 12:59:09 -05:00
fc8f68e391
A couple random things
...
- Re-added the StorageManager/Enabled key in the default config file.
Thought I had switched all that stuff to only look at DBRootStorageType
but I was wrong.
- Made the unit_tests bin for SM stay in the SM dir
- Collapsed one level of build dirs for SM. For some reason it was
putting test data in storage-manager/storage-manager/testData
- Limited a single read() call to 100MB as a paranoid safety measure.
Normal usage won't read that much at once anyway.
2019-08-28 12:56:52 -05:00
e203ea262f
Merge pull request #839 from mariadb-corporation/MCOL-3426
...
MCOL-3426: Fix writes that start past current EOF.
2019-08-28 10:55:51 -05:00
bb015a600b
Fix some error case handling to not update counts or write metadata when not required.
2019-08-28 10:48:50 -05:00
fab69d1717
Merge pull request #838 from pleblanc1976/j-merge-opt
...
Wrote a version of mergejournal that uses more mem but reduces the io op requirement.
2019-08-27 14:59:44 -05:00
e5a6e8401e
MCOL-3460. Found that indeed this is a worthwhile optimization.
...
Write and appendtask were breaking the incoming data into 1MB chunks
to call IOC::write/append() with. Keeping the limit for safety,
but bumping it to 100MB.
2019-08-27 14:40:40 -05:00
