c97e58c9b5
MCOL-3357: reorder this since maxThreads is set by configListener now.
2019-10-08 14:32:52 -05:00
753a77b38c
MCOL-3557: add config change listeners.
2019-10-08 13:44:35 -05:00
3b867e1b1a
Merge pull request #892 from mariadb-corporation/MCOL-3541
...
MCOL-3541: add modtime to smls outputs
2019-10-07 14:12:54 -05:00
1539bfec8d
MCOL-3541: increase buffer for formatted time string.
2019-10-07 13:46:45 -05:00
4a1ce93605
MCOL-3547: cleanup compile warnings from storagemanager.
2019-10-07 13:04:58 -05:00
9225ad9b51
MCOL-3541: add modtime to smls outputs
2019-10-07 10:28:08 -05:00
cbef44a0be
MCOL-3503 add MODA aggregate function
2019-09-27 12:22:44 -05:00
0a175f0052
Merge pull request #871 from mariadb-corporation/cpimport-s3
...
MCOL-3514 Add support for S3 to cpimport
2019-09-25 12:13:47 -05:00
beedde52d1
Merge pull request #874 from pleblanc1976/partial-msg-tests
...
Partial msg tests
2019-09-25 17:53:14 +01:00
64f3fc950b
Merge pull request #869 from mariadb-corporation/MCOL-3436
...
MCOL-3436: Modify signal handling to not shutdown on non term or core signals.
2019-09-25 17:45:05 +01:00
59d1caae02
Fix CMake dependencies
...
Some odd quirks with CMake mean that marias3 has to be in the top level
CMake. Also made submodule checkout happen at cmake time.
2019-09-25 11:30:32 +01:00
70f4ffe8c2
MCOL-3436: have sighandler function call crashtrace handler.
2019-09-24 11:16:02 -05:00
fe8228e50a
Fix build order so ms3 is checked out
2019-09-24 16:47:00 +01:00
8633859dd4
MCOL-3514 Add support for S3 to cpimport
...
cpimport now has the ability to use libmarias3 to read an object from an
S3 bucket instead of a file on local disk.
This also moves libmarias3 to utils/libmarias3.
2019-09-24 10:31:22 +01:00
90a3a06b0b
fix path in copy test
2019-09-23 15:02:06 -05:00
1809598f03
MCOL-3436: Modify signal handling to not shutdown on non term or core signals.
2019-09-20 16:07:40 -05:00
4c21bb6c44
Should not be checking the COLUMNSTORE_INSTALL_DIR env before looking for the cnf file in MCSSYSCONFDIR.
2019-09-20 15:54:10 -05:00
f62ea7e30e
running as root for BB regression requires this to be 1
2019-09-18 11:45:24 -05:00
3b5c7f7ed4
Update unit_tests for testing short messages and connection loss
2019-09-18 11:02:33 -05:00
021009fe99
Change posixtask::read to return int instead of bool and handle when data read is short of expected message length.
2019-09-16 16:26:42 -05:00
99399d289f
change the test cnf file to use 8K objects for unit_test edge cases.
2019-09-16 16:24:28 -05:00
97bda78c3b
Move config files
...
This patch:
* Moves config files from /usr/local/mariadb/columnstore/etc to
ENGINE_SYSCONFDIR/columnstore (ENGINE_SYSCONFDIR is /etc by default)
* Sets a define called MCSSYSCONFDIR whic contains the
ENGINE_SYSCONFDIR compile time setting
* Modifies scripts and code to use the new paths
* Removes a whole bunch of files we don't use
2019-09-09 14:13:56 +01:00
0e5f276d12
StorageManager logging should show up with columnstore logging.
2019-09-04 17:21:46 -05:00
89eff8bc45
MCOL-3455: link to jemalloc. Fix packaging issues for RPMs and other compile issues encounter.
2019-09-03 14:16:34 -05:00
ee1537406d
Merge pull request #841 from pleblanc1976/random-mods
...
A couple random SM things
2019-09-03 11:06:03 -05:00
9e1282e437
put unit_test exe in correct place
2019-08-29 17:35:58 -05:00
91067f320e
Merge pull request #842 from pleblanc1976/sm-config-documentation
...
MCOL-3467. Documented all of the vars in the SM config file. Also add'l # parsi…
2019-08-29 14:29:30 -05:00
4f86b0f909
Fix develop build breakages
2019-08-29 09:44:14 +01:00
1982b38e8a
Added a couple warnings of what values should not be changed after postConfig.
2019-08-28 16:30:35 -05:00
2a78777e06
Documented all of the vars in the SM config file. Also add'l # parsing to Config.
...
Realized our Config class wouldn't handle tera- (T/t) processing but
no reason it shouldn't. Ex, they want a 1TB cache, they can specify
'1t' as the cache_size.
2019-08-28 15:19:03 -05:00
471b00846d
Added the known-good (WIP) config file the unit test will use.
2019-08-28 13:04:59 -05:00
0f065864c4
Started writing unit tests to verify SM does the right thing
...
when given short data (sender crashed).
2019-08-28 12:59:09 -05:00
fc8f68e391
A couple random things
...
- Re-added the StorageManager/Enabled key in the default config file.
Thought I had switched all that stuff to only look at DBRootStorageType
but I was wrong.
- Made the unit_tests bin for SM stay in the SM dir
- Collapsed one level of build dirs for SM. For some reason it was
putting test data in storage-manager/storage-manager/testData
- Limited a single read() call to 100MB as a paranoid safety measure.
Normal usage won't read that much at once anyway.
2019-08-28 12:56:52 -05:00
e203ea262f
Merge pull request #839 from mariadb-corporation/MCOL-3426
...
MCOL-3426: Fix writes that start past current EOF.
2019-08-28 10:55:51 -05:00
bb015a600b
Fix some error case handling to not update counts or write metadata when not required.
2019-08-28 10:48:50 -05:00
fab69d1717
Merge pull request #838 from pleblanc1976/j-merge-opt
...
Wrote a version of mergejournal that uses more mem but reduces the io op requirement.
2019-08-27 14:59:44 -05:00
e5a6e8401e
MCOL-3460. Found that indeed this is a worthwhile optimization.
...
Write and appendtask were breaking the incoming data into 1MB chunks
to call IOC::write/append() with. Keeping the limit for safety,
but bumping it to 100MB.
2019-08-27 14:40:40 -05:00
4d8523cf86
MCOL-3426: Fix writes that start past current EOF.
2019-08-26 13:52:51 -05:00
281443cb0a
Wrote a version of mergejournal that uses more mem but reduces the io op
...
requirement. Added a safety valve; if the journal file is > 100MB, it
will fall back to the previous IO op heavy but mem friendly version.
This also includes a compiler warning fix for smls & smput.
2019-08-22 16:38:27 -05:00
b9dbc079ac
Cleanup changes and make more flexible to run
2019-08-22 13:18:28 -05:00
5249066ada
Checkout unit_test fixes.
2019-08-21 16:04:09 -05:00
77f311c086
Handle if you set common_prefix_depth to -1 as described in .cnf file
2019-08-21 16:03:47 -05:00
050f8c0be5
Lock condition possible exposed by unit_test.
2019-08-21 16:00:57 -05:00
83789d7180
iocBytesRead was not getting set in ctor
2019-08-21 16:00:13 -05:00
6454b53572
Fix SM_TRACE flag.
2019-08-21 15:59:29 -05:00
fa0da4b9bb
Merge pull request #834 from pleblanc1976/develop
...
Bring in the fixes to make S3 lib work with google cloud storage.
2019-08-21 15:50:27 -05:00
ea1cf03e5f
Merge pull request #833 from pleblanc1976/toolkit-useability
...
MCOL-3438. SM Toolkit usability
2019-08-21 15:49:28 -05:00
d36d8b6831
Bring in the fixes to make S3 lib work with google cloud storage.
2019-08-20 15:52:40 -05:00
47a662b231
MCOL-3438. Made it more sensible. Ownership is still confusing even to
...
me, the author, but this makes the view of the SM-managed files consistent
for the sm* toolkit.
2019-08-20 15:06:21 -05:00
94e77a33c5
MCOL-3441 Fix in-tree builds
...
A copy command was failing for in-tree builds.
2019-08-20 11:15:54 +01:00
