Patrick LeBlanc
42b79bd5e7
Added a couple config params for storagemanager.
2019-06-03 09:43:05 -05:00
David Mott
fff18e0dd4
fix to possible memory corruption
2019-06-03 03:36:48 -05:00
Patrick LeBlanc
b1e788732e
Forgot to add the ls and rm source files.
2019-05-31 14:40:19 -05:00
Patrick LeBlanc
fb669ca5b5
Added an 'rm' tool. This one might orphan files in cloud storage
...
until there is a graceful shutdown mechanism.
2019-05-31 14:38:30 -05:00
Patrick LeBlanc
6d6b27dd1e
Added an 'ls' type tool, and fixed a couple things in IOC
...
around handling things that aren't .meta files.
2019-05-31 14:30:48 -05:00
Patrick LeBlanc
4772af7038
Added a blurb of description to the usage output of smcat & smput.
2019-05-31 13:38:20 -05:00
Patrick LeBlanc
f31659f7f7
Fixed an error code returned by IOC::write(). Added a 'put' tool.
2019-05-31 13:23:54 -05:00
Patrick LeBlanc
72038645f5
Added a cat utility & made linkage dynamic.
2019-05-31 13:00:12 -05:00
Patrick LeBlanc
7a11a44f80
Made main() init all objects on start to verify config settings.
...
Also added a connectivity & perms check to S3Storage ctor, and
added optional config settings for the AWS keys.
2019-05-31 09:59:58 -05:00
Andrew Hutchings
dd3df5328c
Merge pull request #776 from mariadb-corporation/MCOL-3239
...
MCOL-3239 CS pushes relevant filter predicates into derived tables.
2019-05-31 11:29:58 +01:00
Andrew Hutchings
5d96b1d8ba
Merge pull request #775 from mariadb-corporation/MCOL-3314
...
MCOL-3314 Use something useful for stats functions oid and key during…
2019-05-31 11:28:33 +01:00
Patrick LeBlanc
193c95f043
Sync::deleteObjects() was not always processing the whole list it
...
was given.
2019-05-30 17:01:32 -05:00
Patrick LeBlanc
80cd06909d
Minor optimization I came across.
2019-05-30 17:01:16 -05:00
Patrick LeBlanc
d3be498e03
Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop
2019-05-30 10:58:27 -05:00
Patrick LeBlanc
3fe2a4859c
Several fixes / improvements....
...
- normalized pathnames passed to IOC functions
- fixed a race that could leave files orphaned in cloud storage
- fixed a couple small things in Metadatafile
- added metadata sanity checks to Sync fcns to detect truncation &
deletion before they do work
2019-05-30 10:56:45 -05:00
Ben Thompson
a817b170d3
Modify write to correctly set length on new object creation.
2019-05-29 10:01:20 -05:00
Patrick LeBlanc
b85030b164
Added a python version check to the metadata verify script.
2019-05-28 17:16:49 -05:00
Patrick LeBlanc
68849fc506
Added a tool to verify metadata contents against actual storage.
2019-05-28 17:11:35 -05:00
David Hall
23b594eb28
MCOL-3304 During prepAggregate, if you set type to LONGDOUBLE, set scale to 0
2019-05-28 15:56:30 -05:00
Ben Thompson
9351962942
Add sync forceFlush and modified unit_test to be in working state again.
2019-05-28 15:18:19 -05:00
Patrick LeBlanc
b9d7a2e4c4
Fixed the deadlock in our sanity check code in synchronizer.
2019-05-28 10:51:15 -05:00
Patrick LeBlanc
9a1dc8a4c5
Removed some redundant assertions around deleting files,
...
commented the one in replicator::remove() to get ready for milestone-2,
and to make the unit test work.
2019-05-28 09:57:26 -05:00
Patrick LeBlanc
be01adb150
Added some debugging lines to track down spurious threads. Looks like
...
they're created by the s3 lib. The lines are commented but left in
it we need them later.
2019-05-24 15:52:24 -05:00
Patrick LeBlanc
0cad8308f1
Untangled cache flushing behavior s.t. it should no longer deadlock.
...
Now, something that grabs the sync or cache locks should never block
while holding the lock. Need to review the code to make sure of that.
Also made the recursive mutexes non-recursive again.
2019-05-24 13:02:09 -05:00
Roman Nozdrin
42f29096f0
MCOL-3239 CS pushes relevant filter predicates into derived tables.
...
This change disables predicate push for function column that
contains both derived table column and non-derived table column.
2019-05-23 22:22:55 +03:00
David Hall
6b2f67a237
MCOL-3314 Use something useful for stats functions oid and key during prep1PhaseAggregate
2019-05-23 14:15:58 -05:00
Patrick LeBlanc
b7b9ce9f93
Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop
2019-05-23 13:46:38 -05:00
Patrick LeBlanc
8e4f8db2a2
Changed the lock scope in IOC::read() to make sure journal files
...
can't be written to while they're being read.
2019-05-23 13:43:51 -05:00
Patrick LeBlanc
e4f5d30ffa
Added assertion around deleteing a failed download.
2019-05-23 13:43:16 -05:00
Patrick LeBlanc
6bd44eae5a
Added printing the element count with the cache size on SIGUSR1.
...
Not atomic, but good enough for debugging purposes.
2019-05-23 13:42:31 -05:00
Patrick LeBlanc
a32e6c7bb4
Fixed a possible size mismatch in Sync, which could be caused
...
by a truncated logical file.
2019-05-23 13:41:24 -05:00
Patrick LeBlanc
51d06f1d93
Fixed the reason cache size was blowing up using S3.
2019-05-23 13:38:58 -05:00
David Hall
57152cf881
MCOL-1559 experimental
2019-05-23 10:42:25 -05:00
Roman Nozdrin
8eaf3dd4ae
Merge pull request #774 from mariadb-corporation/perf-fix
...
Revert MCOL-1559
columnstore-1.2.4
2019-05-23 15:56:09 +03:00
Andrew Hutchings
9390ee05fb
Revert "MCOL-1559 Some string trailing blank stuff"
...
This reverts commit e5d76e142b .
2019-05-23 13:49:08 +01:00
Andrew Hutchings
922e828d6c
Revert "MCOL-1559 trailing white space comparison"
...
This reverts commit aa802f44c5 .
2019-05-23 13:48:56 +01:00
Andrew Hutchings
e7a331f3f8
Revert "MCOL-1559 trim spaces before compare"
...
This reverts commit 8d553ae9fb .
2019-05-23 13:48:43 +01:00
Andrew Hutchings
f3449fe2f4
Revert "MCOL-1559 trailing space compare"
...
This reverts commit 5b581f53cb .
2019-05-23 13:48:31 +01:00
Andrew Hutchings
73f7307ca2
Revert "MCOL-1559 trailing space compare"
...
This reverts commit e2cb644484 .
2019-05-23 13:48:18 +01:00
Andrew Hutchings
8b1c0f6101
Revert "MCOL-1559 trim constant varchar string before adding filter"
...
This reverts commit b6484dda4a .
2019-05-23 13:48:00 +01:00
Andrew Hutchings
182e31e282
Revert "MCOL-1559 backout trim before setting compare. Shouldn't do this in all cases."
...
This reverts commit d78944d9ff .
2019-05-23 13:47:42 +01:00
Andrew Hutchings
fa0947caaa
Revert "MCOL-1559 remove unused boost/trim header"
...
This reverts commit 28e743bf38 .
2019-05-23 13:47:20 +01:00
Ben Thompson
6d6c51cdd6
Remove assertions that are bad.
2019-05-22 15:05:03 -05:00
Patrick LeBlanc
4f20e2cb80
Merge pull request #772 from drrtuy/MCOL-537_3
...
MCOL-537 Regression test doesn't tolerate 'failed' in stderr, stdout.
2019-05-22 09:50:28 -05:00
Patrick LeBlanc
05e98265a8
Updated libmarias3
2019-05-22 08:50:37 -05:00
Patrick LeBlanc
0c4e549b7a
Fixed a couple compiler warnings/errors.
2019-05-22 08:50:19 -05:00
Patrick LeBlanc
68ffceaa68
Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop
2019-05-21 16:06:08 -05:00
Patrick LeBlanc
0dcbc10b5e
Added assertions around the file deletes in syncwithjournal.
2019-05-21 16:05:27 -05:00
Patrick LeBlanc
88de938913
Added logging to an error path in the s3 lib that looked like it should
...
have one.
2019-05-21 16:04:33 -05:00
Patrick LeBlanc
1e1fa5dbd5
Added a sigusr1 handler that prints current cache size.
2019-05-21 16:03:56 -05:00