Patrick LeBlanc
2722da0b40
Checkpointing a bunch of edge-case fixes I made and mistakenly mushed
...
together with the cache size consistency code.
2019-07-02 11:12:29 -05:00
Patrick LeBlanc
80cd06909d
Minor optimization I came across.
2019-05-30 17:01:16 -05:00
Patrick LeBlanc
d3be498e03
Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop
2019-05-30 10:58:27 -05:00
Patrick LeBlanc
3fe2a4859c
Several fixes / improvements....
...
- normalized pathnames passed to IOC functions
- fixed a race that could leave files orphaned in cloud storage
- fixed a couple small things in Metadatafile
- added metadata sanity checks to Sync fcns to detect truncation &
deletion before they do work
2019-05-30 10:56:45 -05:00
Ben Thompson
a817b170d3
Modify write to correctly set length on new object creation.
2019-05-29 10:01:20 -05:00
Patrick LeBlanc
39b93dac2d
In boost < 1.65 +/-, the RNG for uuids isn't threadsafe. Put a lock around it.
2019-04-22 11:46:53 -05:00
Ben Thompson
1ccc876fec
Fix for older boost versions that makes read json not crash and burn.
2019-04-22 10:13:00 -05:00
Patrick LeBlanc
e51bb230ed
Changed the mergeJournal* usage under the assumption that the
...
metadata contains the merged length, not the object's unmerged
length.
2019-04-12 17:23:59 -05:00
Patrick LeBlanc
c9d6730639
Had to replace boost::split wrt key manipulation.
2019-04-10 16:43:18 -05:00
Patrick LeBlanc
06fe98c1a7
Fixed a boundary condition in metadatafile.
2019-04-08 13:52:21 -05:00
Ben Thompson
729953c273
Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop
2019-04-04 17:03:09 -05:00
Ben Thompson
4ec8e12266
Added more complete IOC::write logic fixed metadata bug started IOC::append.
2019-04-04 16:53:11 -05:00
Patrick LeBlanc
d5dfe5ee67
Fixed all compiler warnings. For debugging builds, also made
...
the compiler treat warnings as errors.
2019-04-04 16:52:47 -05:00
Patrick LeBlanc
e84a88b7a8
Made the new IOC unlink test work. Hopefully, finally,
...
resolved the path & extension confusion.
2019-04-03 14:10:04 -05:00
Patrick LeBlanc
fc0321b036
First cut of IOC::unlink()
2019-04-02 15:22:11 -05:00
Patrick LeBlanc
b4ebf7c3c0
First cut of IOC::truncate(). Got some of the unit test
...
written. Fixed some bugs. Commented out the old truncate test
for now; depends on IOC::write() to extend a file.
2019-04-01 16:23:35 -05:00
Patrick LeBlanc
d0aeffca07
Moved the metadata config stuff to a singleton for performance reasons.
2019-03-29 13:40:43 -05:00
Patrick LeBlanc
52560a72dd
Simlified IOC::open, removed a couple debugging printouts.
2019-03-29 08:18:36 -05:00
Patrick LeBlanc
9be168eb64
Implemented IOC::open() + updated unit test
2019-03-28 16:05:18 -05:00
Patrick LeBlanc
e164cbc364
Got a basic unit test to work for IOC::read()
2019-03-28 14:13:21 -05:00
Patrick LeBlanc
6bd4b60a7b
Checkpointing mods for IOC::read(). Doesn't build yet.
2019-03-27 16:27:15 -05:00
Ben Thompson
c1a33111f6
Update Metadata and Replicator to use configure file paths. Update unit_tests to work and cleanup as expected.
2019-03-26 17:24:03 -05:00
Patrick LeBlanc
ed6caeb830
Fixed up the Sync unit test, fixed a couple things in S3Storage,
...
it's working now.
2019-03-26 15:58:22 -05:00
Ben Thompson
e87e9fd5ae
Changes to MetadataFile for updating entries. changes references to metadata object name to key. enhanced the metadataJournal file unit_test.
2019-03-25 17:23:22 -05:00
Patrick LeBlanc
323fd18953
Fixed some stuff, got a basic unit test for sync to work.
2019-03-21 15:23:23 -05:00
Patrick LeBlanc
719cf3f2fa
Filled in some key manipulation stubs.
2019-03-21 14:45:51 -05:00
Patrick LeBlanc
fe66382580
Added some add'l stubs for key manipulation
2019-03-20 14:23:43 -05:00
Ben Thompson
0b4cbad829
Add MetadataFile / Replicator class and initial IOC-write logic.
2019-03-20 11:44:43 -05:00
