1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-08-07 03:22:57 +03:00
Commit Graph

189 Commits

Author SHA1 Message Date
Andrew Hutchings
a8cd34f86d Add support for building from server 2019-12-03 21:21:28 +00:00
Andrew Hutchings
8ab9ebb0f4 MCOL-3606 Make ColumnStore use generic paths
ColumnStore now uses standard bin/lib paths for pretty much everything.
Data path is now hard-coded to /var/lib/columnstore.

This patch also:

* Removes v1 decompression
* Removes a bunch of unneeded files
* Removes COLUMNSTORE_INSTALL_DIR / $INSTALLDIR
* Makes my.cnf.d work for all platforms (MCOL-3558)
* Changes configcpp to use recursive mutex (fixes possible config write deadlock)
* Fixes MCOL-3599 Fix regr functions, The library was installed in the wrong location
* Fixes a bunch of Ubuntu packaging issues
* Changes the binary names of several of the executables so as not to
clash with potential executables from other packages
2019-11-09 16:53:05 +00:00
Andrew Hutchings
3fef0f21d3 Remove vpj files
They shouldn't be here
2019-09-05 17:38:03 +01:00
Patrick LeBlanc
fbdf1a5308 Merge branch 'develop' into S3-project 2019-08-14 15:37:14 -05:00
Roman Nozdrin
b1bc995420 Merge branch 'develop' into remove-infinidb 2019-08-13 12:32:01 +03:00
Andrew Hutchings
9d83b49fca MCOL-104 First pass of InfiniDB rename in code 2019-08-12 09:41:28 +01:00
Patrick LeBlanc
a09a9d5d0f Mass substitution 'Corporaton' -> 'Corporation' 2019-08-07 14:43:25 -05:00
Patrick LeBlanc
62c7ab6480 Fixed a merge error. 2019-08-05 16:35:59 -05:00
Patrick LeBlanc
295c638c18 Merge branch 'develop' into S3-project 2019-08-05 16:34:45 -05:00
Patrick LeBlanc
8190e44d1f Fixed an old bug in the HDFS code in the BRM. Journal file supposed
to be opened for appending.
2019-07-29 14:26:13 -05:00
Patrick LeBlanc
a84e3a408f Last commit of the initial set of changes. 2019-07-12 10:52:09 -05:00
Patrick LeBlanc
9ced374c81 Another incremental commit. 2019-07-12 10:33:51 -05:00
Patrick LeBlanc
16dc887f20 Incremental commit. Stripping out the OBE fstream IO code. 2019-07-12 10:06:56 -05:00
Patrick LeBlanc
7dca5365b6 Found other places in the BRM code that were using fstreams vs IDB*. 2019-06-24 16:42:28 -05:00
Patrick LeBlanc
b30ee07318 Merge remote-tracking branch 'upstream/develop' into S3-project 2019-06-24 15:41:10 -05:00
Patrick LeBlanc
157d1ef667 Made the BRM not save a snapshot after every transaction. 2019-06-14 12:33:12 -05:00
Patrick LeBlanc
bcdd76adc0 Fixed a bug in the new extentmap saving code. 2019-06-14 11:50:47 -05:00
Patrick LeBlanc
029b4a61a8 Made oidserver use the IDB* path, made it write the initial
bitmap in one swipe vs small bits at a time.
2019-06-14 10:09:17 -05:00
Patrick LeBlanc
603cbc9314 First cut of improving IO behavior for BRM load/save 2019-06-13 16:14:00 -05:00
Patrick LeBlanc
3d67df18bf Merge branch 'develop' of github.com:mariadb-corporation/mariadb-columnstore-engine into S3-project 2019-05-17 13:24:09 -05:00
Andrew Hutchings
020b211bb7 Merge branch 'develop-1.2' into develop-merge-up-20190514 2019-05-14 13:58:33 +01:00
Roman Nozdrin
7e2cb05624 MCOL-537 There are no CS-specific warnings building with gcc 8.2. 2019-05-07 16:00:05 +03:00
Roman Nozdrin
9dc33c4e82 Another try to cope with warnings under gcc 8.2. 2019-04-29 11:05:03 +03:00
David Mott
515b93cc3d remove faulty test code 2019-04-29 01:28:54 -05:00
David Mott
4b9d046c6e Fully resolve potentially ambiguous symbols by removing using namespace statements from headers which have a cascading effect. This causes potential behavior changes when switching to c++11 since symbols can be exported from std and boost while both have been imported into the global namespace. 2019-04-29 01:21:15 -05:00
David Mott
e65f80f493 delete visual c++ project files. cmake can generate these if needed 2019-04-25 23:35:03 -05:00
Patrick LeBlanc
46163c129a Neutered all of the excessive snapshotting that was going on. 2019-04-10 17:53:05 -05:00
Patrick LeBlanc
dfc29fa833 Eventually found the problem with rename(). Was calling
::unlink() instead of our unlink/remove.
2019-04-10 15:01:29 -05:00
Patrick LeBlanc
c0f93d904a Fixed a bug where the BRM would open the journal for reading when
it should be have open for writing.  Not sure how that ever worked.
2019-04-09 17:34:30 -05:00
Patrick LeBlanc
6e6cfdb59b The BRM structs aren't using IDBDataFile consistently.
Testing whether forcing them to use IDBDataFiles breaks anything.
2019-04-09 15:07:00 -05:00
Andrew Hutchings
82bd9e29f5 Merge branch 'develop-1.1' into 1.1-merge-up-2018-12-20b 2018-12-20 20:55:00 +00:00
Roman Nozdrin
3fc1893ce9 MCOL-1347 BRM_INFO is fixed and could be used for BRM debugging. 2018-12-05 13:39:21 -08:00
David Hall
176ef2f2c1 MCOL-1793 Add udafContext to the copy constructor of WindowFunctionColumn. 2018-11-23 12:42:29 -06:00
Patrick LeBlanc
5559674208 MCOL-1558. Got it working.
Fixed a couple off-by-one type errors constructing the new paths.
2018-11-15 16:50:45 -06:00
Patrick LeBlanc
86c64d6dc0 MCOL-1558. This likely covers it. First cut. 2018-11-15 15:33:50 -06:00
Patrick LeBlanc
6a353b40b5 MCOL-520, missed a line to log an error in the new shm error handling. 2018-10-10 14:58:18 -05:00
Patrick LeBlanc
4215a47b5c MCOL-520. More untested changes.
Went down the list in shmkeys.h, added sane error msgs on perms
errors accessing rest of the shmsegs there.
Realized we probably do need 666 to the shmsegs.
Also deleted a little dead code that was copy-pasted everywhere.
2018-10-04 14:25:01 -05:00
Patrick LeBlanc
a35009c8ee MCOL-520. Removed chmod stuff from MST and did a little cleaning. 2018-10-04 11:27:08 -05:00
Patrick LeBlanc
f514ed6775 MCOL-520. Got rid of the chmods on shmsegs & added
better error msgs.  Untested.
2018-10-04 11:13:19 -05:00
David Hill
7aff68969e MCOL-520 - back out nonroot shm changes 2018-10-03 14:09:48 -05:00
David Hill
8d3ce9757f MCOL-520 - initial changes for /dev/shm 2018-10-01 14:39:17 -05:00
David Hill
b7b98a3e1a MCOL-520 2018-09-25 11:32:56 -05:00
Andrew Hutchings
0d7c0f7ae4 Merge branch 'develop-1.1' into dev-merge-up-20180202 2018-02-02 14:53:36 +00:00
Andrew Hutchings
5d9f9c819b Merge branch 'develop-1.0' into 1.1-merge-up-20180118 2018-01-18 16:28:08 +00:00
Andrew Hutchings
c31c836352 MCOL-1085 Add crash dump to daemons
This patch adds an automated crash dump which logs in
/var/log/mariadb/columnstore/trace/ when one of the ColumnStore daemons
crashes.
2018-01-03 09:20:09 +00:00
Andrew Hutchings
17f077012d Merge branch 'develop-1.1' into 1.1-merge-up 2017-12-13 09:09:39 +00:00
Andrew Hutchings
8babe4a35d Merge branch 'develop-1.0' into 1.0-merge-up 2017-12-12 10:01:14 +00:00
David Hall
34799d8d30 MCOL-994 handle a second abbreviated extent in case it moved dbroots because of redistribute remove. 2017-12-07 10:49:51 -06:00
Andrew Hutchings
01446d1e22 Reformat all code to coding standard 2017-10-26 17:18:17 +01:00
Andrew Hutchings
401e257df3 MCOL-879 Fix QueryStats linking issues
With 1.1 we have removed libdrizzle and used MariaDB's client library
instead for both CrossEngine and QueryStats. Unfortunately MariaDB 10.2
has two client libraries which have different structs with the same
name. When QueryStats was running inside the ColumnStore plugin this
symbol conflict was causing a crash.

The server's built-in client API has several different and several
missing functions so some additions to sm.cpp were made to fill the
gaps.

This patch does the following:

* Make sure that libmariadb is only linked to executables, not the
ColumnStore Plugin (to avoid symbol conflicts). Note that all
executables that link to CrossEngine and/or QueryStats need to link to
libmariadb to avoid missing symbol issues.
* Use the server's built-in client API for QueryStats when run in the
plugin
* Replace missing server built-in client API calls in sm.cpp (this is
for QueryStats and CrossEngine to keep the dynamic linker happy)
* Fixes issue where using 'localhost' as the MariaDB Server hostname
would fail in QueryStats.
2017-08-18 10:16:52 +01:00