database/mariadb-columnstore-engine
1
0
Fork 0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-12-21 13:40:58 +03:00
Code Activity
5,453 Commits 372 Branches 90 Tags
29679e91ecefc22a45372fac159b48f0c3a2a10c
Commit Graph

5453 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Patrick LeBlanc
21a937472f Fixed the config file search path for columnstore. 2019-06-11 10:36:19 -05:00
David.Hall
0ddcb3c39c Merge pull request #782 from mariadb-corporation/MCOL-1968 
MCOL-1968 Fix UTF char/varchar min/max handling
 2019-06-11 09:30:47 -05:00
Andrew Hutchings
e3cd205388 MCOL-1968 Fix UTF char/varchar min/max handling 
If the first byte of a char/varchar was > 0x80 then it will break the
min/max values for an extent during cpimport. This patch makes the
min/max compare unsigned and only switches to signed when storing.

In addition send all the LDI / INSERT...SELECT data to cpimport, not
truncated. Let cpimport figure out the truncation point.
 2019-06-11 10:37:04 +01:00
Patrick LeBlanc
0ae0761e1a Removed the Location config value for SM; redundant with ProcessConfig.xml 2019-06-10 13:11:04 -05:00
Patrick LeBlanc
f34f785f8a Made OAM suppress its knowledge of StorageManager if it is disabled. 2019-06-10 13:02:56 -05:00
David.Hall
992b696a66 Merge pull request #781 from mariadb-corporation/MCOL-2230 
MCOL-2230 Fix TIMEDIFF() handling
 2019-06-10 12:36:38 -05:00
Andrew Hutchings
0983c1becf MCOL-2230 Fix TIMEDIFF() handling 
TIMEDIFF would not compare datetime with string correctly, causing a
NULL saturation.
 2019-06-10 16:46:24 +01:00
Patrick LeBlanc
d454f84b82 Cleaned up the hacks made so far. 2019-06-10 09:41:03 -05:00
Patrick LeBlanc
6193d2cda2 Made mcsadmin and postConfigure print a warning if SKIP_OAM_INIT is set. 2019-06-10 08:10:10 -05:00
Andrew Hutchings
f8b834c8ec Merge pull request #777 from mariadb-corporation/MCOL-3304 
MCOL-3304 During prepAggregate, if you set type to LONGDOUBLE, set sc…
 2019-06-10 14:02:09 +01:00
Andrew Hutchings
d6cdef3d86 Merge pull request #739 from tntnatbry/MCOL-265 
MCOL-265 Add support for TIMESTAMP data type
 2019-06-10 13:58:41 +01:00
Andrew Hutchings
5e4f1b9933 Merge branch 'develop' into MCOL-265 2019-06-10 13:58:03 +01:00
Patrick LeBlanc
15c256b011 Checkpointing some stuff. Doesn't work yet. 2019-06-06 15:47:15 -05:00
Patrick LeBlanc
98c9cd7b22 Checkpointing some experimental changes to get storagemanager running. 2019-06-06 08:36:40 -05:00
Patrick LeBlanc
6ad4faf7e6 The extern "C" stuff around the s3 lib header is no longer necessary. 2019-06-05 13:10:53 -05:00
Patrick LeBlanc
e800a61459 Got everything to install in the right place & linked correctly. 2019-06-05 13:10:04 -05:00
Patrick LeBlanc
42b79bd5e7 Added a couple config params for storagemanager. 2019-06-03 09:43:05 -05:00
David Mott
fff18e0dd4 fix to possible memory corruption 2019-06-03 03:36:48 -05:00
Patrick LeBlanc
b1e788732e Forgot to add the ls and rm source files. 2019-05-31 14:40:19 -05:00
Patrick LeBlanc
fb669ca5b5 Added an 'rm' tool. This one might orphan files in cloud storage 
until there is a graceful shutdown mechanism.
 2019-05-31 14:38:30 -05:00
Patrick LeBlanc
6d6b27dd1e Added an 'ls' type tool, and fixed a couple things in IOC 
around handling things that aren't .meta files.
 2019-05-31 14:30:48 -05:00
Patrick LeBlanc
4772af7038 Added a blurb of description to the usage output of smcat & smput. 2019-05-31 13:38:20 -05:00
Patrick LeBlanc
f31659f7f7 Fixed an error code returned by IOC::write(). Added a 'put' tool. 2019-05-31 13:23:54 -05:00
Patrick LeBlanc
72038645f5 Added a cat utility & made linkage dynamic. 2019-05-31 13:00:12 -05:00
Patrick LeBlanc
7a11a44f80 Made main() init all objects on start to verify config settings. 
Also added a connectivity & perms check to S3Storage ctor, and
added optional config settings for the AWS keys.
 2019-05-31 09:59:58 -05:00
Andrew Hutchings
dd3df5328c Merge pull request #776 from mariadb-corporation/MCOL-3239 
MCOL-3239 CS pushes relevant filter predicates into derived tables.
 2019-05-31 11:29:58 +01:00
Andrew Hutchings
5d96b1d8ba Merge pull request #775 from mariadb-corporation/MCOL-3314 
MCOL-3314 Use something useful for stats functions oid and key during…
 2019-05-31 11:28:33 +01:00
Patrick LeBlanc
193c95f043 Sync::deleteObjects() was not always processing the whole list it 
was given.
 2019-05-30 17:01:32 -05:00
Patrick LeBlanc
80cd06909d Minor optimization I came across. 2019-05-30 17:01:16 -05:00
Patrick LeBlanc
d3be498e03 Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop 2019-05-30 10:58:27 -05:00
Patrick LeBlanc
3fe2a4859c Several fixes / improvements.... 
- normalized pathnames passed to IOC functions
 - fixed a race that could leave files orphaned in cloud storage
 - fixed a couple small things in Metadatafile
 - added metadata sanity checks to Sync fcns to detect truncation &
   deletion before they do work
 2019-05-30 10:56:45 -05:00
Ben Thompson
a817b170d3 Modify write to correctly set length on new object creation. 2019-05-29 10:01:20 -05:00
Patrick LeBlanc
b85030b164 Added a python version check to the metadata verify script. 2019-05-28 17:16:49 -05:00
Patrick LeBlanc
68849fc506 Added a tool to verify metadata contents against actual storage. 2019-05-28 17:11:35 -05:00
David Hall
23b594eb28 MCOL-3304 During prepAggregate, if you set type to LONGDOUBLE, set scale to 0 2019-05-28 15:56:30 -05:00
Ben Thompson
9351962942 Add sync forceFlush and modified unit_test to be in working state again. 2019-05-28 15:18:19 -05:00
Patrick LeBlanc
b9d7a2e4c4 Fixed the deadlock in our sanity check code in synchronizer. 2019-05-28 10:51:15 -05:00
Patrick LeBlanc
9a1dc8a4c5 Removed some redundant assertions around deleting files, 
commented the one in replicator::remove() to get ready for milestone-2,
and to make the unit test work.
 2019-05-28 09:57:26 -05:00
Patrick LeBlanc
be01adb150 Added some debugging lines to track down spurious threads. Looks like 
they're created by the s3 lib.  The lines are commented but left in
it we need them later.
 2019-05-24 15:52:24 -05:00
Patrick LeBlanc
0cad8308f1 Untangled cache flushing behavior s.t. it should no longer deadlock. 
Now, something that grabs the sync or cache locks should never block
while holding the lock.  Need to review the code to make sure of that.

Also made the recursive mutexes non-recursive again.
 2019-05-24 13:02:09 -05:00
Roman Nozdrin
42f29096f0 MCOL-3239 CS pushes relevant filter predicates into derived tables. 
This change disables predicate push for function column that
    contains both derived table column and non-derived table column.
 2019-05-23 22:22:55 +03:00
David Hall
6b2f67a237 MCOL-3314 Use something useful for stats functions oid and key during prep1PhaseAggregate 2019-05-23 14:15:58 -05:00
Patrick LeBlanc
b7b9ce9f93 Merge branch 'develop' of github.com:pleblanc1976/storage-manager into develop 2019-05-23 13:46:38 -05:00
Patrick LeBlanc
8e4f8db2a2 Changed the lock scope in IOC::read() to make sure journal files 
can't be written to while they're being read.
 2019-05-23 13:43:51 -05:00
Patrick LeBlanc
e4f5d30ffa Added assertion around deleteing a failed download. 2019-05-23 13:43:16 -05:00
Patrick LeBlanc
6bd44eae5a Added printing the element count with the cache size on SIGUSR1. 
Not atomic, but good enough for debugging purposes.
 2019-05-23 13:42:31 -05:00
Patrick LeBlanc
a32e6c7bb4 Fixed a possible size mismatch in Sync, which could be caused 
by a truncated logical file.
 2019-05-23 13:41:24 -05:00
Patrick LeBlanc
51d06f1d93 Fixed the reason cache size was blowing up using S3. 2019-05-23 13:38:58 -05:00
David Hall
57152cf881 MCOL-1559 experimental 2019-05-23 10:42:25 -05:00
Roman Nozdrin
8eaf3dd4ae Merge pull request #774 from mariadb-corporation/perf-fix 
Revert MCOL-1559
columnstore-1.2.4 		2019-05-23 15:56:09 +03:00