database/mariadb-columnstore-engine
1
0
Fork 0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-13 23:02:14 +03:00
Code Activity
249 Commits 374 Branches 90 Tags
d43f9d855cb81d67782a58cf1972d810d11afca2
Commit Graph

50 Commits

Author SHA1 Message Date
Patrick LeBlanc
62c853595f Changed the sync trigger to include outstanding journal size. 
Right now it's hardcoded at 50MB for testing.  Will parameterize later.
 2019-07-05 11:02:55 -05:00
Patrick LeBlanc
715d041a85 Fixed several bugs exposed by setting the cache size to an 
unreasonably small value.  Had to make a compromise to avoid a deadlock
though.  read/write/append/truncate will now be able to exceed the cache size
limit temporarily.  The cache will be reconciled at the end of the respective
operation.

Ex, given a cache of 100MB, and a read() of 500MB, all 500MB
of data being read will stay in the cache until it is read, then
400MB of it will be evicted.  Same on the write side.
 2019-06-28 13:20:31 -05:00
Ben Thompson
9351962942 Add sync forceFlush and modified unit_test to be in working state again. 2019-05-28 15:18:19 -05:00
Patrick LeBlanc
19859de510 Added a test to the s3 module, attempt to copy a non-existant file. 2019-05-13 12:10:48 -05:00
Patrick LeBlanc
5ad6246575 Debugged mergeJournal() using some data that failed to merge in a 
'real' run.  Added the files that failed to merge, & added to the unit test.
 2019-04-23 10:37:54 -05:00
Patrick LeBlanc
e51bb230ed Changed the mergeJournal* usage under the assumption that the 
metadata contains the merged length, not the object's unmerged
length.
 2019-04-12 17:23:59 -05:00
Patrick LeBlanc
5443f8662c Checkpointing some paranoid assertions & some fixes I noticed. 2019-04-12 15:08:01 -05:00
Ben Thompson
cf678170ca fixes for write and finish append. add append unit_test cases. 2019-04-08 16:34:48 -05:00
Patrick LeBlanc
6f234f45c0 More fixes around sync, error handling, and logging. 2019-04-05 16:38:37 -05:00
Patrick LeBlanc
1879499ad3 Fixed a few random things. 2019-04-05 14:10:59 -05:00
Ben Thompson
7d3924a31a cleanup warning unit_test 2019-04-04 18:18:13 -05:00
Ben Thompson
729953c273 Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop 2019-04-04 17:03:09 -05:00
Ben Thompson
4ec8e12266 Added more complete IOC::write logic fixed metadata bug started IOC::append. 2019-04-04 16:53:11 -05:00
Patrick LeBlanc
d5dfe5ee67 Fixed all compiler warnings. For debugging builds, also made 
the compiler treat warnings as errors.
 2019-04-04 16:52:47 -05:00
Patrick LeBlanc
c4ebe6958e Reversed some changes I made for debugging. 2019-04-04 12:59:27 -05:00
Patrick LeBlanc
a3789bbe5c Added add'l copyFile tests, fixed a bug. 2019-04-04 12:43:59 -05:00
Patrick LeBlanc
fe2c5b64d0 Added a couple assertions in Cache to keep us honest during testing. 
Added a 'real' test for IOC::copyFile().  Looks good, will merge it.
 2019-04-04 11:06:17 -05:00
Patrick LeBlanc
67ad5f445e Updated the unit test for copytask, fixed up IOC::copyFile(). 2019-04-04 10:22:22 -05:00
Patrick LeBlanc
e84a88b7a8 Made the new IOC unlink test work. Hopefully, finally, 
resolved the path & extension confusion.
 2019-04-03 14:10:04 -05:00
Patrick LeBlanc
91c05d1000 Fixed up existing unit test for unlinktask & simplified IOC::unlink(). 2019-04-03 10:50:50 -05:00
Patrick LeBlanc
34cd6595de Fixed something I noticed in IOC::list_directory() 2019-04-02 13:39:09 -05:00
Patrick LeBlanc
7ebab52e8e Finished the new truncate unit test, fixed a couple things 
in IOC::read()
 2019-04-02 11:52:13 -05:00
Patrick LeBlanc
b4ebf7c3c0 First cut of IOC::truncate(). Got some of the unit test 
written.  Fixed some bugs.  Commented out the old truncate test
for now; depends on IOC::write() to extend a file.
 2019-04-01 16:23:35 -05:00
Patrick LeBlanc
8e5519ec47 Updated IOC::listdirectory & its unit test. 2019-03-29 10:16:11 -05:00
Patrick LeBlanc
e1f2fcdfaa Updated IOC::stat, updated its test. 2019-03-29 09:05:37 -05:00
Patrick LeBlanc
9be168eb64 Implemented IOC::open() + updated unit test 2019-03-28 16:05:18 -05:00
Patrick LeBlanc
e164cbc364 Got a basic unit test to work for IOC::read() 2019-03-28 14:13:21 -05:00
Ben Thompson
c1a33111f6 Update Metadata and Replicator to use configure file paths. Update unit_tests to work and cleanup as expected. 2019-03-26 17:24:03 -05:00
Patrick LeBlanc
c6648ce91e Added a pre-test check for AWS creds, will fail gracefully 
if there are none.
 2019-03-26 16:03:18 -05:00
Patrick LeBlanc
ed6caeb830 Fixed up the Sync unit test, fixed a couple things in S3Storage, 
it's working now.
 2019-03-26 15:58:22 -05:00
Ben Thompson
e87e9fd5ae Changes to MetadataFile for updating entries. changes references to metadata object name to key. enhanced the metadataJournal file unit_test. 2019-03-25 17:23:22 -05:00
Patrick LeBlanc
e27f91e59e A couple minor changes to the unit tests. Not sure why the compiler 
wasn't complaining.
 2019-03-25 09:39:12 -05:00
Patrick LeBlanc
4ff769ab24 Got a pretty decent unit test for Sync working. 2019-03-22 12:04:36 -05:00
Patrick LeBlanc
323fd18953 Fixed some stuff, got a basic unit test for sync to work. 2019-03-21 15:23:23 -05:00
Patrick LeBlanc
07b4bdd19c Got the synchronizer stuff to build. 2019-03-21 12:42:10 -05:00
Patrick LeBlanc
c674a2921f Merge branch 'develop' into synchronizer 2019-03-20 13:48:31 -05:00
Patrick LeBlanc
2990d320aa Checkpointing some unit test stuff, won't build yet. 2019-03-20 13:17:16 -05:00
Ben Thompson
0b4cbad829 Add MetadataFile / Replicator class and initial IOC-write logic. 2019-03-20 11:44:43 -05:00
Patrick LeBlanc
208e3c300d First cut of the journal-merging code + the unit test for it. 
Looks like it's working.
 2019-03-12 11:51:47 -05:00
Patrick LeBlanc
13ade9e724 Added more Cache tests, fixed a couple bugs. 2019-03-08 10:35:36 -06:00
Patrick LeBlanc
9bd6ddac1b Fixed up some sync stuff. 2019-03-07 08:47:39 -06:00
Patrick LeBlanc
c386881f40 Simple unit test for Cache::read(), and corresponding fixes. 2019-03-06 14:41:30 -06:00
Patrick LeBlanc
2619aa8983 Added to the unit test 
Effectively this is just a test of Config, to make sure it's
doing envvar substitutions & number suffix expansions right.
 2019-02-21 16:27:22 -06:00
Patrick LeBlanc
b78cac755b Phase 1 of trying to clean up some messaging code. 2019-02-11 18:08:18 -06:00
Patrick LeBlanc
4f47ee1f96 Implemented the SM-side copy op & a couple minor changes. 2019-02-01 13:05:29 -06:00
Patrick LeBlanc
ce8398876a Made IOCoordinator a singleton vs a global. 2019-02-01 09:48:25 -06:00
Patrick LeBlanc
07cc7f9d0e Made the list-dir test clean up after itself. 2019-02-01 08:43:07 -06:00
Patrick LeBlanc
443c4dfdf3 Finished the unit tests & they pass. 2019-01-31 16:23:07 -06:00
Patrick LeBlanc
13af644425 Working on defining message structures and unit tests for 
the PosixTask subclasses.
 2019-01-31 14:43:32 -06:00
Patrick LeBlanc
76fe86a0f7 Important fix in IOCoordinator. Added the start of some 
unit tests.
 2019-01-30 18:29:17 -06:00