I thought I would ask on here as a final option before rebuilding my VPS server. Long story short, my server was operating fine for years and all of a sudden a recent CentOS upgrade crashed my server and the only option I had at the time (Based on feedback I received from the company who provides the VPS) advised to restore my WHM/cPanel VPS server from a snapshot backup (From an earlier date where the VPS was operational and working perfectly fine)
After the VPS snapshot backup was restored, everything was reinstated from an earlier date this month, including cPanel accounts, files/data and WHM settings which was great.
After checking on my Service Status page, I noticed "MariaDB" was identified as being down.
I've tried so many different solutions throughout stackoverflow and through various bits of research online, and I've not managed to get this service back up and running.
According to my VPS provider, during the time of when the snapshot backup was created, the backup process at their side had glitched causing a "rare" database corruption.
MariaDB won't start at all on the server. I can see all of the databases on my server inside of /var/lib/mysql, but there aren't any SQL files present - Only myd, frm, ibd and myi files.
Startup log when running service mysql start
-- The result is failed.
Jan 25 14:20:39 serverhostname systemd[1]: Unit mariadb.service entered failed state.
Jan 25 14:20:39 serverhostname systemd[1]: mariadb.service failed.
Jan 25 14:20:39 serverhostname polkitd[608]: Unregistered Authentication Agent for unix-process:1053813:4592511 (system bu
Jan 25 14:20:42 serverhostname kernel: IPDB Blocked: IN=eth0 OUT= MAC=52:54:00:b3:54:91:fc:33:42:f2:d7:81:08:00 SRC=45.227
Jan 25 14:20:44 serverhostname systemd[1]: mariadb.service holdoff time over, scheduling restart.
Jan 25 14:20:44 serverhostname systemd[1]: Stopped MariaDB 10.3.34 database server.
-- Subject: Unit mariadb.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit mariadb.service has finished shutting down.
Jan 25 14:20:44 serverhostname systemd[1]: Starting MariaDB 10.3.34 database server...
-- Subject: Unit mariadb.service has begun start-up
Mysqld.log and Messages.log
See output here: https://justpaste.it/bla5n
From the error log located in /var/lib/mysql
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/
InnoDB: about forcing recovery.
230125 6:38:49 [ERROR] mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.
Server version: 10.3.34-MariaDB
key_buffer_size=134217728
read_buffer_size=131072
max_used_connections=0
I'm a little challenged by what to do for the best at the moment as I can't perform a dump on any of the databases as I can't get this service running and the snapshot backup which I thought may of been a reliable option hasn't worked out to plan.
I do have a few SQL backups for a few of my websites, but I'm missing SQL files for a few other websites I am running on this server.
As a last resort, I am considering rebuilding the VPS from ground up and to import the data that I have saved but I thought i would ask on here first to see if anyone may have any suggestions with being able to assist me with getting MariaDB up and running again. :-)
I've also tried setting InnoDB recovery mode to 1 within /etc/my.cnf and restarting the MySQL service but this hasn't brought the service back running again.
Whilst trying to access any MySQL services in my WHM, I am receiving this error (Which I am guessing is because MySQL isn't actively running on the server)
Failed to “validate” Remote MySQL profile. 1 error occurred.
Unable to connect to the MySQL host “localhost”. Connection failed with error: Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (111)
P.S I've renamed my server hostname whilst posting results on here :)
I am currently using MariaDB 10.3 with cPanel/WHM on CloudLinux OS.
Thank you in advance!
