1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-09 10:41:14 +03:00
Commit Graph

3637 Commits

Author SHA1 Message Date
Patrick LeBlanc
42b79bd5e7 Added a couple config params for storagemanager. 2019-06-03 09:43:05 -05:00
David Mott
fff18e0dd4 fix to possible memory corruption 2019-06-03 03:36:48 -05:00
Patrick LeBlanc
b1e788732e Forgot to add the ls and rm source files. 2019-05-31 14:40:19 -05:00
Patrick LeBlanc
fb669ca5b5 Added an 'rm' tool. This one might orphan files in cloud storage
until there is a graceful shutdown mechanism.
2019-05-31 14:38:30 -05:00
Patrick LeBlanc
6d6b27dd1e Added an 'ls' type tool, and fixed a couple things in IOC
around handling things that aren't .meta files.
2019-05-31 14:30:48 -05:00
Patrick LeBlanc
4772af7038 Added a blurb of description to the usage output of smcat & smput. 2019-05-31 13:38:20 -05:00
Patrick LeBlanc
f31659f7f7 Fixed an error code returned by IOC::write(). Added a 'put' tool. 2019-05-31 13:23:54 -05:00
Patrick LeBlanc
72038645f5 Added a cat utility & made linkage dynamic. 2019-05-31 13:00:12 -05:00
Patrick LeBlanc
7a11a44f80 Made main() init all objects on start to verify config settings.
Also added a connectivity & perms check to S3Storage ctor, and
added optional config settings for the AWS keys.
2019-05-31 09:59:58 -05:00
Andrew Hutchings
dd3df5328c Merge pull request #776 from mariadb-corporation/MCOL-3239
MCOL-3239 CS pushes relevant filter predicates into derived tables.
2019-05-31 11:29:58 +01:00
Andrew Hutchings
5d96b1d8ba Merge pull request #775 from mariadb-corporation/MCOL-3314
MCOL-3314 Use something useful for stats functions oid and key during…
2019-05-31 11:28:33 +01:00
Patrick LeBlanc
193c95f043 Sync::deleteObjects() was not always processing the whole list it
was given.
2019-05-30 17:01:32 -05:00
Patrick LeBlanc
80cd06909d Minor optimization I came across. 2019-05-30 17:01:16 -05:00
Patrick LeBlanc
d3be498e03 Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop 2019-05-30 10:58:27 -05:00
Patrick LeBlanc
3fe2a4859c Several fixes / improvements....
- normalized pathnames passed to IOC functions
 - fixed a race that could leave files orphaned in cloud storage
 - fixed a couple small things in Metadatafile
 - added metadata sanity checks to Sync fcns to detect truncation &
   deletion before they do work
2019-05-30 10:56:45 -05:00
Ben Thompson
a817b170d3 Modify write to correctly set length on new object creation. 2019-05-29 10:01:20 -05:00
Patrick LeBlanc
b85030b164 Added a python version check to the metadata verify script. 2019-05-28 17:16:49 -05:00
Patrick LeBlanc
68849fc506 Added a tool to verify metadata contents against actual storage. 2019-05-28 17:11:35 -05:00
David Hall
23b594eb28 MCOL-3304 During prepAggregate, if you set type to LONGDOUBLE, set scale to 0 2019-05-28 15:56:30 -05:00
Ben Thompson
9351962942 Add sync forceFlush and modified unit_test to be in working state again. 2019-05-28 15:18:19 -05:00
Patrick LeBlanc
b9d7a2e4c4 Fixed the deadlock in our sanity check code in synchronizer. 2019-05-28 10:51:15 -05:00
Patrick LeBlanc
9a1dc8a4c5 Removed some redundant assertions around deleting files,
commented the one in replicator::remove() to get ready for milestone-2,
and to make the unit test work.
2019-05-28 09:57:26 -05:00
Patrick LeBlanc
be01adb150 Added some debugging lines to track down spurious threads. Looks like
they're created by the s3 lib.  The lines are commented but left in
it we need them later.
2019-05-24 15:52:24 -05:00
Patrick LeBlanc
0cad8308f1 Untangled cache flushing behavior s.t. it should no longer deadlock.
Now, something that grabs the sync or cache locks should never block
while holding the lock.  Need to review the code to make sure of that.

Also made the recursive mutexes non-recursive again.
2019-05-24 13:02:09 -05:00
Roman Nozdrin
42f29096f0 MCOL-3239 CS pushes relevant filter predicates into derived tables.
This change disables predicate push for function column that
    contains both derived table column and non-derived table column.
2019-05-23 22:22:55 +03:00
David Hall
6b2f67a237 MCOL-3314 Use something useful for stats functions oid and key during prep1PhaseAggregate 2019-05-23 14:15:58 -05:00
Patrick LeBlanc
b7b9ce9f93 Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop 2019-05-23 13:46:38 -05:00
Patrick LeBlanc
8e4f8db2a2 Changed the lock scope in IOC::read() to make sure journal files
can't be written to while they're being read.
2019-05-23 13:43:51 -05:00
Patrick LeBlanc
e4f5d30ffa Added assertion around deleteing a failed download. 2019-05-23 13:43:16 -05:00
Patrick LeBlanc
6bd44eae5a Added printing the element count with the cache size on SIGUSR1.
Not atomic, but good enough for debugging purposes.
2019-05-23 13:42:31 -05:00
Patrick LeBlanc
a32e6c7bb4 Fixed a possible size mismatch in Sync, which could be caused
by a truncated logical file.
2019-05-23 13:41:24 -05:00
Patrick LeBlanc
51d06f1d93 Fixed the reason cache size was blowing up using S3. 2019-05-23 13:38:58 -05:00
David Hall
57152cf881 MCOL-1559 experimental 2019-05-23 10:42:25 -05:00
Roman Nozdrin
8eaf3dd4ae Merge pull request #774 from mariadb-corporation/perf-fix
Revert MCOL-1559
columnstore-1.2.4
2019-05-23 15:56:09 +03:00
Andrew Hutchings
9390ee05fb Revert "MCOL-1559 Some string trailing blank stuff"
This reverts commit e5d76e142b.
2019-05-23 13:49:08 +01:00
Andrew Hutchings
922e828d6c Revert "MCOL-1559 trailing white space comparison"
This reverts commit aa802f44c5.
2019-05-23 13:48:56 +01:00
Andrew Hutchings
e7a331f3f8 Revert "MCOL-1559 trim spaces before compare"
This reverts commit 8d553ae9fb.
2019-05-23 13:48:43 +01:00
Andrew Hutchings
f3449fe2f4 Revert "MCOL-1559 trailing space compare"
This reverts commit 5b581f53cb.
2019-05-23 13:48:31 +01:00
Andrew Hutchings
73f7307ca2 Revert "MCOL-1559 trailing space compare"
This reverts commit e2cb644484.
2019-05-23 13:48:18 +01:00
Andrew Hutchings
8b1c0f6101 Revert "MCOL-1559 trim constant varchar string before adding filter"
This reverts commit b6484dda4a.
2019-05-23 13:48:00 +01:00
Andrew Hutchings
182e31e282 Revert "MCOL-1559 backout trim before setting compare. Shouldn't do this in all cases."
This reverts commit d78944d9ff.
2019-05-23 13:47:42 +01:00
Andrew Hutchings
fa0947caaa Revert "MCOL-1559 remove unused boost/trim header"
This reverts commit 28e743bf38.
2019-05-23 13:47:20 +01:00
Ben Thompson
6d6c51cdd6 Remove assertions that are bad. 2019-05-22 15:05:03 -05:00
Patrick LeBlanc
4f20e2cb80 Merge pull request #772 from drrtuy/MCOL-537_3
MCOL-537 Regression test doesn't tolerate 'failed' in stderr, stdout.
2019-05-22 09:50:28 -05:00
Patrick LeBlanc
05e98265a8 Updated libmarias3 2019-05-22 08:50:37 -05:00
Patrick LeBlanc
0c4e549b7a Fixed a couple compiler warnings/errors. 2019-05-22 08:50:19 -05:00
Patrick LeBlanc
68ffceaa68 Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop 2019-05-21 16:06:08 -05:00
Patrick LeBlanc
0dcbc10b5e Added assertions around the file deletes in syncwithjournal. 2019-05-21 16:05:27 -05:00
Patrick LeBlanc
88de938913 Added logging to an error path in the s3 lib that looked like it should
have one.
2019-05-21 16:04:33 -05:00
Patrick LeBlanc
1e1fa5dbd5 Added a sigusr1 handler that prints current cache size. 2019-05-21 16:03:56 -05:00