1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-07 03:22:57 +03:00
Commit Graph

178 Commits

Author SHA1 Message Date
Patrick LeBlanc
9ced374c81 Another incremental commit. 2019-07-12 10:33:51 -05:00
Patrick LeBlanc
16dc887f20 Incremental commit. Stripping out the OBE fstream IO code. 2019-07-12 10:06:56 -05:00
Patrick LeBlanc
7dca5365b6 Found other places in the BRM code that were using fstreams vs IDB*. 2019-06-24 16:42:28 -05:00
Patrick LeBlanc
b30ee07318 Merge remote-tracking branch 'upstream/develop' into S3-project 2019-06-24 15:41:10 -05:00
Patrick LeBlanc
157d1ef667 Made the BRM not save a snapshot after every transaction. 2019-06-14 12:33:12 -05:00
Patrick LeBlanc
bcdd76adc0 Fixed a bug in the new extentmap saving code. 2019-06-14 11:50:47 -05:00
Patrick LeBlanc
029b4a61a8 Made oidserver use the IDB* path, made it write the initial
bitmap in one swipe vs small bits at a time.
2019-06-14 10:09:17 -05:00
Patrick LeBlanc
603cbc9314 First cut of improving IO behavior for BRM load/save 2019-06-13 16:14:00 -05:00
Patrick LeBlanc
3d67df18bf Merge branch 'develop' of github.com:mariadb-corporation/mariadb-columnstore-engine into S3-project 2019-05-17 13:24:09 -05:00
Andrew Hutchings
020b211bb7 Merge branch 'develop-1.2' into develop-merge-up-20190514 2019-05-14 13:58:33 +01:00
Roman Nozdrin
7e2cb05624 MCOL-537 There are no CS-specific warnings building with gcc 8.2. 2019-05-07 16:00:05 +03:00
Roman Nozdrin
9dc33c4e82 Another try to cope with warnings under gcc 8.2. 2019-04-29 11:05:03 +03:00
David Mott
515b93cc3d remove faulty test code 2019-04-29 01:28:54 -05:00
David Mott
4b9d046c6e Fully resolve potentially ambiguous symbols by removing using namespace statements from headers which have a cascading effect. This causes potential behavior changes when switching to c++11 since symbols can be exported from std and boost while both have been imported into the global namespace. 2019-04-29 01:21:15 -05:00
David Mott
e65f80f493 delete visual c++ project files. cmake can generate these if needed 2019-04-25 23:35:03 -05:00
Patrick LeBlanc
46163c129a Neutered all of the excessive snapshotting that was going on. 2019-04-10 17:53:05 -05:00
Patrick LeBlanc
dfc29fa833 Eventually found the problem with rename(). Was calling
::unlink() instead of our unlink/remove.
2019-04-10 15:01:29 -05:00
Patrick LeBlanc
c0f93d904a Fixed a bug where the BRM would open the journal for reading when
it should be have open for writing.  Not sure how that ever worked.
2019-04-09 17:34:30 -05:00
Patrick LeBlanc
6e6cfdb59b The BRM structs aren't using IDBDataFile consistently.
Testing whether forcing them to use IDBDataFiles breaks anything.
2019-04-09 15:07:00 -05:00
Andrew Hutchings
82bd9e29f5 Merge branch 'develop-1.1' into 1.1-merge-up-2018-12-20b 2018-12-20 20:55:00 +00:00
Roman Nozdrin
3fc1893ce9 MCOL-1347 BRM_INFO is fixed and could be used for BRM debugging. 2018-12-05 13:39:21 -08:00
David Hall
176ef2f2c1 MCOL-1793 Add udafContext to the copy constructor of WindowFunctionColumn. 2018-11-23 12:42:29 -06:00
Patrick LeBlanc
5559674208 MCOL-1558. Got it working.
Fixed a couple off-by-one type errors constructing the new paths.
2018-11-15 16:50:45 -06:00
Patrick LeBlanc
86c64d6dc0 MCOL-1558. This likely covers it. First cut. 2018-11-15 15:33:50 -06:00
Patrick LeBlanc
6a353b40b5 MCOL-520, missed a line to log an error in the new shm error handling. 2018-10-10 14:58:18 -05:00
Patrick LeBlanc
4215a47b5c MCOL-520. More untested changes.
Went down the list in shmkeys.h, added sane error msgs on perms
errors accessing rest of the shmsegs there.
Realized we probably do need 666 to the shmsegs.
Also deleted a little dead code that was copy-pasted everywhere.
2018-10-04 14:25:01 -05:00
Patrick LeBlanc
a35009c8ee MCOL-520. Removed chmod stuff from MST and did a little cleaning. 2018-10-04 11:27:08 -05:00
Patrick LeBlanc
f514ed6775 MCOL-520. Got rid of the chmods on shmsegs & added
better error msgs.  Untested.
2018-10-04 11:13:19 -05:00
David Hill
7aff68969e MCOL-520 - back out nonroot shm changes 2018-10-03 14:09:48 -05:00
David Hill
8d3ce9757f MCOL-520 - initial changes for /dev/shm 2018-10-01 14:39:17 -05:00
David Hill
b7b98a3e1a MCOL-520 2018-09-25 11:32:56 -05:00
Andrew Hutchings
0d7c0f7ae4 Merge branch 'develop-1.1' into dev-merge-up-20180202 2018-02-02 14:53:36 +00:00
Andrew Hutchings
5d9f9c819b Merge branch 'develop-1.0' into 1.1-merge-up-20180118 2018-01-18 16:28:08 +00:00
Andrew Hutchings
c31c836352 MCOL-1085 Add crash dump to daemons
This patch adds an automated crash dump which logs in
/var/log/mariadb/columnstore/trace/ when one of the ColumnStore daemons
crashes.
2018-01-03 09:20:09 +00:00
Andrew Hutchings
17f077012d Merge branch 'develop-1.1' into 1.1-merge-up 2017-12-13 09:09:39 +00:00
Andrew Hutchings
8babe4a35d Merge branch 'develop-1.0' into 1.0-merge-up 2017-12-12 10:01:14 +00:00
David Hall
34799d8d30 MCOL-994 handle a second abbreviated extent in case it moved dbroots because of redistribute remove. 2017-12-07 10:49:51 -06:00
Andrew Hutchings
01446d1e22 Reformat all code to coding standard 2017-10-26 17:18:17 +01:00
Andrew Hutchings
401e257df3 MCOL-879 Fix QueryStats linking issues
With 1.1 we have removed libdrizzle and used MariaDB's client library
instead for both CrossEngine and QueryStats. Unfortunately MariaDB 10.2
has two client libraries which have different structs with the same
name. When QueryStats was running inside the ColumnStore plugin this
symbol conflict was causing a crash.

The server's built-in client API has several different and several
missing functions so some additions to sm.cpp were made to fill the
gaps.

This patch does the following:

* Make sure that libmariadb is only linked to executables, not the
ColumnStore Plugin (to avoid symbol conflicts). Note that all
executables that link to CrossEngine and/or QueryStats need to link to
libmariadb to avoid missing symbol issues.
* Use the server's built-in client API for QueryStats when run in the
plugin
* Replace missing server built-in client API calls in sm.cpp (this is
for QueryStats and CrossEngine to keep the dynamic linker happy)
* Fixes issue where using 'localhost' as the MariaDB Server hostname
would fail in QueryStats.
2017-08-18 10:16:52 +01:00
Andrew Hutchings
3330495a2e MCOL-777 Cleanup source
Clean out autotools and some other things from the source tree.
2017-08-07 15:59:56 +01:00
David.Hall
e87c519f0a Merge pull request #196 from mariadb-corporation/MCOL-769
MCOL-769
2017-07-05 11:56:51 -05:00
Andrew Hutchings
7501cfc1f0 MCOL-769 Add command to get the uncommitted lbids
We need this to be able to commit them
2017-06-16 12:22:53 +01:00
Andrew Hutchings
850d773a78 MCOL-739 Use catalog_tables.size()
Suggested by David Hall. Just in case getTables() is messed up.
2017-06-06 16:30:41 +01:00
Andrew Hutchings
ab9e0a509d MCOL-739 Add command to get the system catalog
Added to DBRM master for use with the the new API so that it can get the
system catalog via the wire protocol.
2017-06-06 14:17:23 +01:00
David Hall
d531796bf2 MCOL-597 Fix up Windows Functions 2017-04-21 09:47:56 -05:00
Andrew Hutchings
f64dd0d602 MCOL-529 Pool DBRM connections
DBRM connections are reused so that we don't have a huge amount of
TIME_WAIT sockets when there are large amounts of DML. Also applied to
i_s.columnstore_files
2017-04-14 14:16:25 +01:00
Andrew Hutchings
830b24c1fa MCOL-529 Pool DBRM connections
DBRM connections are reused so that we don't have a huge amount of
TIME_WAIT sockets when there are large amounts of DML. Also applied to
i_s.columnstore_files
2017-04-14 14:13:15 +01:00
Andrew Hutchings
ffcfc41563 MCOL-507 Further ExeMgr performance improvements
This does the following:

* Switch resource manager to a singleton which reduces the amount of
times the XML data is scanned and objects allocated.
* Make the I_S tables use the FE implementation of the system catalog
* Make the I_S.columnstore_columns table use the RID list cache
* Make the extentmap pre-allocate a vector instead of many small allocs
2017-01-16 12:33:27 +00:00
david hill
ed3bc28171 added copyright headers 2016-10-11 10:02:01 -05:00
david hill
897d8d3f3d change snmp to alarm 2016-10-10 17:46:24 -05:00