database/mariadb-columnstore-engine
1
0
Fork 0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-05 16:15:50 +03:00
Code Activity
6,463 Commits 350 Branches 89 Tags
fix/json_depth
Commit Graph

182 Commits

Author SHA1 Message Date
benthompson15
bdd87284f9 MCOL-3638: Fix level of various storagemanager logging items. 2019-12-03 12:51:48 -06:00
David.Hall
ccfc0dc16d Merge pull request #948 from LinuxJedi/fix-code-errors 
MCOL-3621 Fix a few cppcheck issues
 2019-11-25 15:04:55 -06:00
benthompson15
0ae4969a4d MCOL-3563: new SyncTask was added also had this issue. 2019-11-22 18:42:49 -06:00
benthompson15
a0ffc427ec MCOL-3563: remove the dumb errorHandle test. Misread what this was doing. described the connection test behavior. 2019-11-22 18:36:53 -06:00
benthompson15
3565d237ed MCOL-3563: Fix OpenTask and PingTask for read returning int to a bool. 2019-11-22 17:05:40 -06:00
benthompson15
8d6c2a33bf MCOL-3563: Modify all *TASK tests to use processtask and test connection failures and short message error handling on disconnect. 2019-11-22 17:05:40 -06:00
benthompson15
3e3e0ed89b MCOL-3563: convert some cout to logging messages and default fd for ctrl socket. 2019-11-22 17:05:40 -06:00
benthompson15
3a730a4222 MCOL-3563: fix compiler warnings / type errors. 
A previous commit made posix::read changed return value
from bool to int. However some callers still expected
bool and compared a bool<0 which is always false.
 2019-11-22 17:05:40 -06:00
benthompson15
d377defa31 MCOL-3577: update syncNow with prefix 
to behave like syncNow no prefix.
This should be corrected eventually but is safer now as
previous implementation would possibly result in deadlock.
 2019-11-21 15:19:03 -06:00
benthompson15
18d31fae82 MCOL-3577: cleanup debug logging and comments from copy/paste. 2019-11-21 15:19:03 -06:00
benthompson15
abd7444809 MCOL-3577: Found an issues with the order of dropPrefix Cache before Sync. 2019-11-21 15:19:03 -06:00
benthompson15
5bbd21b8e0 MCOL-3577: Add functionality to sync S3 storage for suspendDatabaseWrites. 2019-11-21 15:19:03 -06:00
Andrew Hutchings
dba7220ad3 Fix a few cppcheck issues 
Found the following:

* Potential stack explosions with alloca() usage on potentially large
strings
* Memory leaks in WriteEngineServer
* Stack usage out of scope in dataconvert
* A typo in an 'if' statement in dataconvert
 2019-11-21 13:52:53 +00:00
Andrew Hutchings
b9708530e2 Fix library and storage manager install paths 2019-11-13 23:34:20 +00:00
benthompson15
044ed75176 left out %s in logging message 2019-10-17 15:02:33 -05:00
benthompson15
ab614da63c MCOL-3499: WriteTask failure was sending 2 responses and fix race between prefixCache::populate and writing new S3 objects. 2019-10-17 14:25:28 -05:00
benthompson15
2b28875698 MCOL-3357: Only call the configListners if the file was updated by reload. 2019-10-09 12:44:25 -05:00
benthompson15
c97e58c9b5 MCOL-3357: reorder this since maxThreads is set by configListener now. 2019-10-08 14:32:52 -05:00
benthompson15
753a77b38c MCOL-3557: add config change listeners. 2019-10-08 13:44:35 -05:00
Patrick LeBlanc
3b867e1b1a Merge pull request #892 from mariadb-corporation/MCOL-3541 
MCOL-3541: add modtime to smls outputs
 2019-10-07 14:12:54 -05:00
benthompson15
1539bfec8d MCOL-3541: increase buffer for formatted time string. 2019-10-07 13:46:45 -05:00
benthompson15
4a1ce93605 MCOL-3547: cleanup compile warnings from storagemanager. 2019-10-07 13:04:58 -05:00
benthompson15
9225ad9b51 MCOL-3541: add modtime to smls outputs 2019-10-07 10:28:08 -05:00
David Hall
cbef44a0be MCOL-3503 add MODA aggregate function 2019-09-27 12:22:44 -05:00
benthompson15
0a175f0052 Merge pull request #871 from mariadb-corporation/cpimport-s3 
MCOL-3514 Add support for S3 to cpimport
 2019-09-25 12:13:47 -05:00
Andrew Hutchings
beedde52d1 Merge pull request #874 from pleblanc1976/partial-msg-tests 
Partial msg tests
 2019-09-25 17:53:14 +01:00
Andrew Hutchings
64f3fc950b Merge pull request #869 from mariadb-corporation/MCOL-3436 
MCOL-3436: Modify signal handling to not shutdown on non term or core signals.
 2019-09-25 17:45:05 +01:00
Andrew Hutchings
59d1caae02 Fix CMake dependencies 
Some odd quirks with CMake mean that marias3 has to be in the top level
CMake. Also made submodule checkout happen at cmake time.
 2019-09-25 11:30:32 +01:00
benthompson15
70f4ffe8c2 MCOL-3436: have sighandler function call crashtrace handler. 2019-09-24 11:16:02 -05:00
Andrew Hutchings
fe8228e50a Fix build order so ms3 is checked out 2019-09-24 16:47:00 +01:00
Andrew Hutchings
8633859dd4 MCOL-3514 Add support for S3 to cpimport 
cpimport now has the ability to use libmarias3 to read an object from an
S3 bucket instead of a file on local disk.

This also moves libmarias3 to utils/libmarias3.
 2019-09-24 10:31:22 +01:00
benthompson15
90a3a06b0b fix path in copy test 2019-09-23 15:02:06 -05:00
benthompson15
1809598f03 MCOL-3436: Modify signal handling to not shutdown on non term or core signals. 2019-09-20 16:07:40 -05:00
benthompson15
4c21bb6c44 Should not be checking the COLUMNSTORE_INSTALL_DIR env before looking for the cnf file in MCSSYSCONFDIR. 2019-09-20 15:54:10 -05:00
benthompson15
f62ea7e30e running as root for BB regression requires this to be 1 2019-09-18 11:45:24 -05:00
benthompson15
3b5c7f7ed4 Update unit_tests for testing short messages and connection loss 2019-09-18 11:02:33 -05:00
benthompson15
021009fe99 Change posixtask::read to return int instead of bool and handle when data read is short of expected message length. 2019-09-16 16:26:42 -05:00
benthompson15
99399d289f change the test cnf file to use 8K objects for unit_test edge cases. 2019-09-16 16:24:28 -05:00
Andrew Hutchings
97bda78c3b Move config files 
This patch:

* Moves config files from /usr/local/mariadb/columnstore/etc to
ENGINE_SYSCONFDIR/columnstore (ENGINE_SYSCONFDIR is /etc by default)
* Sets a define called MCSSYSCONFDIR whic contains the
ENGINE_SYSCONFDIR compile time setting
* Modifies scripts and code to use the new paths
* Removes a whole bunch of files we don't use
 2019-09-09 14:13:56 +01:00
benthompson15
0e5f276d12 StorageManager logging should show up with columnstore logging. 2019-09-04 17:21:46 -05:00
benthompson15
89eff8bc45 MCOL-3455: link to jemalloc. Fix packaging issues for RPMs and other compile issues encounter. 2019-09-03 14:16:34 -05:00
Patrick LeBlanc
ee1537406d Merge pull request #841 from pleblanc1976/random-mods 
A couple random SM things
 2019-09-03 11:06:03 -05:00
benthompson15
9e1282e437 put unit_test exe in correct place 2019-08-29 17:35:58 -05:00
benthompson15
91067f320e Merge pull request #842 from pleblanc1976/sm-config-documentation 
MCOL-3467. Documented all of the vars in the SM config file.  Also add'l # parsi…
 2019-08-29 14:29:30 -05:00
Andrew Hutchings
4f86b0f909 Fix develop build breakages 2019-08-29 09:44:14 +01:00
Patrick LeBlanc
1982b38e8a Added a couple warnings of what values should not be changed after postConfig. 2019-08-28 16:30:35 -05:00
Patrick LeBlanc
2a78777e06 Documented all of the vars in the SM config file. Also add'l # parsing to Config. 
Realized our Config class wouldn't handle tera- (T/t) processing but
no reason it shouldn't.  Ex, they want a 1TB cache, they can specify
'1t' as the cache_size.
 2019-08-28 15:19:03 -05:00
Patrick LeBlanc
471b00846d Added the known-good (WIP) config file the unit test will use. 2019-08-28 13:04:59 -05:00
Patrick LeBlanc
0f065864c4 Started writing unit tests to verify SM does the right thing 
when given short data (sender crashed).
 2019-08-28 12:59:09 -05:00
Patrick LeBlanc
fc8f68e391 A couple random things 
- Re-added the StorageManager/Enabled key in the default config file.
  Thought I had switched all that stuff to only look at DBRootStorageType
  but I was wrong.
- Made the unit_tests bin for SM stay in the SM dir
- Collapsed one level of build dirs for SM.  For some reason it was
  putting test data in storage-manager/storage-manager/testData
- Limited a single read() call to 100MB as a paranoid safety measure.
  Normal usage won't read that much at once anyway.
 2019-08-28 12:56:52 -05:00