1
0
mirror of https://github.com/mariadb-corporation/mariadb-columnstore-engine.git synced 2025-09-15 08:41:09 +03:00
Commit Graph

978 Commits

Author SHA1 Message Date
Andrew Hutchings
f9e5bdbc8d Fix restart hang
mcsadmin restart will do a status call. Before this would log status
output to a file which would be checked. If that file check failed a PID
check would be made.

We do not log the status to a file any more since it could have multiple
different outputs. The PID check could hit a race condition where it is
being checked before the process is up. This would mean there is no
module state change causing a hang.

This fix does the following:

1. Remove the file status check completely
2. Loop the PID check to give it time to come up
3. If the PID check fails drop to a DEGRADED state

This makes mcsadmin restart work correctly again.
2020-02-12 09:57:22 +00:00
Gagan Goel
9b01b0ac61 MCOL-2101 Set up proper permissions for /tmp/columnstore_tmp_files to
allow non-root users to write to it.
2020-02-10 22:39:21 +00:00
Gagan Goel
7656a1ead3 MCOL-2101 Set up proper permissions for /tmp/columnstore_tmp_files to
allow non-root users to write to it.
2020-02-10 22:16:03 +00:00
Andrew Hutchings
7df731a3a6 Make mysqld work without systemd
ColumnStore should now start/stop mysqld where the systemd service is
not available.
2020-02-06 09:40:36 +00:00
Andrew Hutchings
6cf6519019 MCOL-3718 Use systemd instead of mysql-Columnstore
MariaDB server is now managed using systemd instead of our own
mysql-Columnstore script. This means that MariaDB server can be stopped
/ started independently of ColumnStore
2020-02-06 07:47:44 +00:00
Patrick LeBlanc
d01df95144 Made the SKIP_OAM_INIT checks happen at run time vs build time. 2020-01-15 16:31:07 -05:00
Patrick LeBlanc
81017e2ec0 Merge pull request #993 from toddstoffel/spelling
Spelling
2020-01-03 09:42:11 -06:00
Andrew Hutchings
de4ab3e294 MCOL-3702 Fix replication config file changes
log_bin is missing from columnstore.cnf. This causes a search for the
master log file to fail and replication doesn't apply.

This patch adds a commented out log_bin which is enabled as needed.

It also fixes an error message.
2020-01-03 10:08:52 +00:00
Patrick LeBlanc
347c3d2261 MCOL-3702: postConfig replication error
Todd & Andrew ID'd the problem as being that the libjemalloc.so ->
(real lib) link doesn't always exist for whatever reason.  I hacked our
run script to try the 3 possibilities mentioned in the ticket in this order
1) libjemalloc.so
2) libjemalloc.so.1
3) libjemalloc.so.2

Failing that, it will fall back to an empty LD_PRELOAD, so libc
would be used for the allocator.

Fixes the immediate problem.  The lib_bin and server_id vars mentioned
in the ticket are untouched by this commit.
2020-01-02 19:29:49 -05:00
Todd Stoffel
63a963b206 Fix typo 2019-12-23 10:55:59 -08:00
Sergei Golubchik
586391e1ca compilation failure
error: reference to 'mutex' is ambiguous
note: candidates are: 'class boost::mutex'
note:                 'class std::mutex'
2019-12-19 18:13:39 +01:00
Andrew Hutchings
63af0e8034 MCOL-3630 Remove "columnstore start" instruction
Don't tell the user to do this as ColumnStore already does it.
2019-12-05 16:50:02 +00:00
jmrojas2332
e3a8c273c0 Merge branch 'MCOL-3585' of https://github.com/jmrojas2332/mariadb-columnstore-engine into MCOL-3585 2019-12-05 16:16:41 +00:00
jmrojas2332
3502871d2e MCOL 3585 Remove possibly confusing comment 2019-12-05 16:15:47 +00:00
Jose Rojas
e9ee385a11 Merge branch 'develop' into MCOL-3585 2019-12-05 10:03:40 -06:00
jmrojas2332
608d61feb5 MCOL 3585 Minor update to Default for MaxOutstandingRequests 2019-12-05 15:54:00 +00:00
jmrojas2332
c0319a5438 MCOL 3585 Related. Updated Comment in config file 2019-12-04 23:20:01 +00:00
Andrew Hutchings
7489d0bfd0 MCOL-3625 Rename packages
Rename packages to MariaDB-columnstore-engine, MariaDB-columnstore-libs
and MariaDB-columnstore-platform.

Also add the "columnstore-" prefix the the components so that MariaDB's
packaging system understands then and add a line to include them in
MariaDB's packaging.

In addition
* Fix S3 building for dist source build
* Fix Debian 10 dependency issue
* Fix git handling for dist builds
* Add support for MariaDB's RPM building
* Use MariaDB's PCRE and readline
* Removes a few dead files
* Fix Boost noncopyable includes
2019-12-04 11:04:39 +00:00
Andrew Hutchings
a8cd34f86d Add support for building from server 2019-12-03 21:21:28 +00:00
Andrew Hutchings
efe829784d MCOL-3624 Move jemalloc to an LD_PRELOAD
Linking will become an issue for the unified build and it is an issue
for jemalloc 5.x. Instead we will LD_PRELOAD on the forked ColumnStore
specific processes.
2019-12-03 21:21:28 +00:00
Andrew Hutchings
b3c22c8f9a MCOL-3626 Remove mcsmysql alias 2019-12-03 21:21:28 +00:00
benthompson15
6b916675d5 Merge pull request #952 from LinuxJedi/MCOL-3564
MCOL-3564 Don't double-execute ProcMon
2019-11-22 23:06:56 +01:00
Andrew Hutchings
627f8345ad MCOL-3564 Don't double-execute ProcMon
It is possible for ProcMon can be left behind during a node shutdown.
This patch makes sure it is killed and makes sure it is killed before a new
one starts.
2019-11-22 20:19:56 +00:00
Patrick LeBlanc
947e0f6543 Merge pull request #946 from benthompson15/MCOL-3577
MCOL-3577
2019-11-22 13:45:35 -06:00
Patrick LeBlanc
935826a4fb Merge pull request #950 from pleblanc1976/threadedUMjoin-squashed
Threaded um join squashed
2019-11-22 12:01:20 -06:00
benthompson15
830490c846 MCOL-3577: Make this run syncFS for storagemanager on all nodes when suspend writes is done from mcsadmin. 2019-11-21 15:19:03 -06:00
Patrick LeBlanc
c866715efe Removed CalpontHome config param. 2019-11-21 14:51:46 -05:00
Patrick LeBlanc
0d26dc447c Squash merge of the threaded UM hash table construction feature.
Conflicts:
	oam/etc/Columnstore.xml.singleserver
2019-11-21 14:41:00 -05:00
jmrojas2332
e712df5d0b MCOL 3585 update some defaults in config file 2019-11-21 06:08:49 +00:00
Andrew Hutchings
2275f4fd26 MCOL-3619 Fix multinode initial start on PM > 1
The new "columnstore stop" command doesn't work well if the cluster is
already down. Instead we need to use the older method to stop
ProcMon/ProcMgr on the node before starting it.
2019-11-19 15:14:16 +00:00
benthompson15
f291d88979 Merge pull request #940 from LinuxJedi/fix-rep-password
MCOL-3553 Use a rep password MENT will accept
2019-11-15 21:13:48 +01:00
Andrew Hutchings
ac093eacee Merge pull request #939 from LinuxJedi/fix-post-mysql
Fix post-mysql-install
2019-11-15 17:10:25 +00:00
Andrew Hutchings
d432a0ac7a MCOL-3553 Use a rep password MENT will accept
MariaDB Enterprise won't accept our canned replication passed. This
patch updates it to a stronger one it will accept.
2019-11-15 16:59:03 +00:00
Andrew Hutchings
45f3dd294f Fix post-mysql-install
It was executing based on a condition that will never be true
2019-11-15 15:30:04 +00:00
benthompson15
5ad303e52b MCOL-3589: Add mcsadmin stopmodule command and modify columnstore stop to use it. 2019-11-14 16:01:17 -06:00
Andrew Hutchings
25d22381c6 MCOL-3608 Add module installer file copy
Adds back some stuff that was remove distributed that didn't work
properly for non-distributed. Also use /var/lib/columnstore/local
for module file as OAM intended.
2019-11-14 14:40:28 +00:00
Andrew Hutchings
8ab9ebb0f4 MCOL-3606 Make ColumnStore use generic paths
ColumnStore now uses standard bin/lib paths for pretty much everything.
Data path is now hard-coded to /var/lib/columnstore.

This patch also:

* Removes v1 decompression
* Removes a bunch of unneeded files
* Removes COLUMNSTORE_INSTALL_DIR / $INSTALLDIR
* Makes my.cnf.d work for all platforms (MCOL-3558)
* Changes configcpp to use recursive mutex (fixes possible config write deadlock)
* Fixes MCOL-3599 Fix regr functions, The library was installed in the wrong location
* Fixes a bunch of Ubuntu packaging issues
* Changes the binary names of several of the executables so as not to
clash with potential executables from other packages
2019-11-09 16:53:05 +00:00
Andrew Hutchings
85f25278a2 Don't use calpontsys as default db before creation
We don't need to use calpontsys as the default DB for SHOW ENGINES, it
likely isn't created yet so don't do it.
2019-11-05 14:03:43 +00:00
Andrew Hutchings
ebb22a96a3 MCOL-3551 Use generic MariaDB Server paths
This branch enforces the use of generic MariaDB server paths for their
binaries and data rather than custom paths.

/usr/local/mariadb/columnstore is now only for columnstore with this
patch.

It should be noted that this removes the auto-mounting of external
MariaDB UM data storage for AWS.

This is also a fix for MCOL-3510 after buildbot changes are made.

Also... MCOL-3552 Use columnstore.cnf to load plugins

The ColumnStore plugins now load using a columnstore.cnf instead of a
SQL sequence to be more in-line with MariaDB's methods.
2019-10-13 09:34:37 +01:00
Gagan Goel
c8df46ed26 Replace ha_calpont with ha_mcs in the source code and filenames in the plugin code. 2019-10-11 17:33:43 +00:00
Andrew Hutchings
deac0471bb Merge pull request #887 from mariadb-corporation/MCOL-3498
MCOL-3498: only update bashrc if DataFileEnvFile is set.
2019-10-07 19:27:16 +01:00
benthompson15
4fc711da06 MCOL-3498: when datafileplugin is set only update bashrc if DataFileEnvFile is set. 2019-10-03 14:04:43 -05:00
Jose Rojas
9b99660f84 MCOL-3537 Reworded Post Installation Instruction in post-install script 2019-10-03 17:58:49 +00:00
Andrew Hutchings
8c207bf412 MCOL-3515 Remove distributed install
Non-distributed is now the only install method.
2019-09-24 12:02:10 +01:00
benthompson15
24e1c3ff2d Merge pull request #855 from mariadb-corporation/move-etc
Move config files
2019-09-09 15:54:30 -05:00
Andrew Hutchings
97bda78c3b Move config files
This patch:

* Moves config files from /usr/local/mariadb/columnstore/etc to
ENGINE_SYSCONFDIR/columnstore (ENGINE_SYSCONFDIR is /etc by default)
* Sets a define called MCSSYSCONFDIR whic contains the
ENGINE_SYSCONFDIR compile time setting
* Modifies scripts and code to use the new paths
* Removes a whole bunch of files we don't use
2019-09-09 14:13:56 +01:00
benthompson15
b658080f06 Merge pull request #854 from mariadb-corporation/remove-vpj
Remove vpj files
2019-09-06 10:01:52 -05:00
benthompson15
016523ef47 Merge pull request #851 from mariadb-corporation/fix-packaging
Fix my.cnf clash
2019-09-05 18:27:45 -05:00
Andrew Hutchings
3fef0f21d3 Remove vpj files
They shouldn't be here
2019-09-05 17:38:03 +01:00
Andrew Hutchings
74d68b4db3 Fix my.cnf clash
This patch:

* Moves ColumnStore my.cnf to /etc/my.cnf.d/columnstore.cnf
* Removes unneeded entries from columnstore.cnf
* Removes some things that used my.cnf and are now dead
* Also removes utils/scenarios
* Modifies things that use extra defaults file to use the standard one
* Makes sure that C++11 standard is used for older CMake versions

With this patch we no longer need to set -DINSTALL_SYSCONF2DIR and
-DINSTALL_SYSCONFDIR when building MariaDB server.
2019-09-04 18:51:02 +01:00