#maria Log v0.1

logs Catalogue

This page loads from the db, refresh as and when. It displays 24 hrs
For older data http://marialog.archivist.info/previous.php, logs go back to 2009-01-18
Some user stats
Table logs
date_time
user
message
2016-12-10 06:50:44
MariaDBstaff
<guillaume> Sibiria, there are log files both on the joiner and donor. Check log files in the hidden .sst directory under /var/lib/mysql/
2016-12-10 06:51:17
MariaDBstaff
<guillaume> Your problem is probably xtrabackup not being able to copy back the data
2016-12-10 08:44:15
qwebirc25136
hello all!
2016-12-10 08:46:23
qwebirc25136
i have a question regarding the licencing... I provide a commercial webpage and users (customers) can register and pay for the function. I will use mariaDB as database. The database is connected via java (hibernate, jdbc). Is it okay to use mariaDB or it is necessary to pay for it?
2016-12-10 08:46:56
qwebirc25136
I only want to be 100% save before starting...
2016-12-10 08:50:21
salle
qwebirc25136: It is OK according to GPL
2016-12-10 08:50:34
qwebirc25136
perfect
2016-12-10 08:50:41
qwebirc25136
thanks for the hep
2016-12-10 08:50:44
qwebirc25136
help
2016-12-10 08:51:01
salle
qwebirc25136: GPL says as long as you do not distribute the product you can use it any way for free
2016-12-10 08:51:21
qwebirc25136
no, the database runs only on my server
2016-12-10 08:52:58
salle
qwebirc25136: Even if you distribute GPL you don't have to pay anything if the entire "package" is under GPL or compatible license
2016-12-10 08:53:49
qwebirc25136
okay
2016-12-10 08:53:51
salle
qwebirc25136: And even if you want to pay license for MariaDB server you can not do it, but that's another story :)
2016-12-10 08:54:00
tilt
:D haha
2016-12-10 08:54:13
qwebirc25136
nono.. is okay ;)
2016-12-10 08:55:58
salle
qwebirc25136: Of course if you want access to https://support.mariadb.com we will gladly take your money :)
2016-12-10 08:58:23
tilt
we are very content with mariadb btw - it's a great db system that does everything short of making coffee :)
2016-12-10 08:59:36
salle
tilt: I am not sure my espresso machine doesn't have embedded Linux with mariadb in it. You never know with today's appliances
2016-12-10 09:03:37
tilt
today i buy a replacement mainboard for my SoHo fileserver
2016-12-10 09:03:47
tilt
i think i'll go low power
2016-12-10 09:04:23
tilt
salle: you think mariadb can reasonably be run on embedded systems?
2016-12-10 09:04:48
salle
tilt: People run lot of things on embedded systems with aparent reason
2016-12-10 09:05:33
tilt
salle: arm 32bit 2gb ram? hmmm :)
2016-12-10 09:05:50
tilt
well, depends on the data load i suppose
2016-12-10 09:39:24
jamieshepherd
Hey guys. I used to be able to run this query really fast but it's gotten super slow now https://gist.github.com/jamieshepherd/7a46388e9288c908b619070ab6823d2e on Amazon RDS - wondering if there's anything obvious.. Table size is only about 1 million
2016-12-10 09:43:43
salle
jamieshepherd: There is no query there
2016-12-10 09:44:26
jamieshepherd
Ok, updated :)
2016-12-10 09:50:00
tilt
jamieshepherd: primary key on varchar is not a good idea imho
2016-12-10 09:50:28
tilt
jamieshepherd: not with records in the millions at least
2016-12-10 13:09:05
sibiria
guillame, the log files say nothing that indicates WHAT the problem is
2016-12-10 13:09:11
sibiria
neither on donor nor joiner
2016-12-10 13:09:18
sibiria
the only info there is what i put in the pastebin
2016-12-10 14:24:37
MariaDBstaff
<svar> sibiria: xtarbackup log files are in /tmp or /datadir
2016-12-10 14:25:17
MariaDBstaff
<svar> i remember something about node names that was breaking SST
2016-12-10 14:26:45
MariaDBstaff
<svar> Hopefully this all nightmare will disappear in 10.2 that comes with xtrabackup bundle
2016-12-10 14:35:23
sibiria
svar, i believe i figured the problem out
2016-12-10 14:35:43
sibiria
... i think
2016-12-10 14:35:55
MariaDBstaff
<svar> sibiria :slightly_smiling_face:
2016-12-10 14:36:14
sibiria
because now IST works out of nowhere - after i had set up nodes as sst/rsync AND populated them with some new db + table data
2016-12-10 14:36:36
sibiria
when fresh, just after galera_new_cluster had been run, xtrabackup-v2 refused to work
2016-12-10 14:39:14
MariaDBstaff
<svar> Have you change the systemd timeout , that's a commun issue when xtrabackup takes long time
2016-12-10 14:39:51
sibiria
yeah i increased it just in case, but mariadb always exited with error long before the timeout
2016-12-10 14:40:58
sibiria
it seems i simply have to enforce SST when first building the cluster, create data, THEN i can switch to xtrabackup-v2 to achieve IST
2016-12-10 14:41:19
sibiria
i have now taken nodes offline, created more data, changed the node to xtrabackup-v2, and they start up correct and sync
2016-12-10 14:41:40
sibiria
it finally works
2016-12-10 14:45:42
MariaDBstaff
<svar> IST does not use xtabackup but gcache
2016-12-10 14:46:19
MariaDBstaff
<svar> so that the node can sync by delta catch
2016-12-10 14:46:19
sibiria
i could be wrong, but i read a tutorial on severalnine.com hinting that IST can only be achieved by switching from rsync to xtrabackup-v2?
2016-12-10 14:46:30
sibiria
(and tuning gcache)
2016-12-10 14:46:49
MariaDBstaff
<svar> full node copy is call SST
2016-12-10 14:47:00
MariaDBstaff
<svar> IST is delta copy
2016-12-10 14:47:04
sibiria
with rsync, i always get a full node copy, right?
2016-12-10 14:47:07
sibiria
always SST
2016-12-10 14:47:12
sibiria
when a node leaves/joins
2016-12-10 14:47:15
MariaDBstaff
<svar> with xtrabackup as well
2016-12-10 14:47:29
MariaDBstaff
<svar> it's just that rsync lock the donor
2016-12-10 14:48:01
MariaDBstaff
<svar> with xtrabackup you can still write to the donor
2016-12-10 14:48:13
sibiria
is IST then enabled by setting the gcache size?
2016-12-10 14:49:19
MariaDBstaff
<svar> gcache size influence when you need to do SST , it cache events changes ( writeset) so if over loaded it need full copy
2016-12-10 14:50:12
sibiria
hm. i had it set to 1G since start but xtrabackup-v2 method consistently failed until i had some actual data in tables synced across the three nodes
2016-12-10 14:50:13
MariaDBstaff
<svar> if you write very few per second gcache does not need to be increase , well i could in case of big transaction
2016-12-10 14:51:14
MariaDBstaff
<svar> i guess you need to understand why it failed , as a fresh cluster , it works later because it's based on IST and not SST
2016-12-10 14:51:48
sibiria
the logs really did not say much more than that it appeared to be a permission error
2016-12-10 14:51:57
sibiria
("operation not permitted")
2016-12-10 14:52:08
MariaDBstaff
<svar> SST logs our outside of mariadb logs
2016-12-10 14:52:26
MariaDBstaff
<svar> they are staying in stange places like /tmp
2016-12-10 14:52:37
MariaDBstaff
<svar> on donner and receiver
2016-12-10 14:52:46
sibiria
it's empty everywhere here. nothing in /tmp, nothing in .sst/
2016-12-10 14:52:56
MariaDBstaff
<svar> you should first be sure that no firewall in place
2016-12-10 14:52:58
sibiria
searching the filesystems yields nothing
2016-12-10 14:53:12
sibiria
there is a firewall but it allows traffic freely between the three nodes, so that is not the problem
2016-12-10 14:53:27
MariaDBstaff
<svar> have you disable selinux as well
2016-12-10 14:53:46
MariaDBstaff
<svar> and to be sure disable the iptables
2016-12-10 14:53:53
MariaDBstaff
<svar> temporary
2016-12-10 14:54:01
sibiria
the only thing i changed was that i created a new database, put a table in it, and created some rows
2016-12-10 14:54:17
MariaDBstaff
<svar> that should not matter
2016-12-10 14:54:23
sibiria
after that, after the nodes were synced in rsync method, i could shut them down and switch to xtrabackup-v2
2016-12-10 14:54:36
MariaDBstaff
<svar> you can start a cluster on any node with existing data
2016-12-10 14:54:54
sibiria
when only mysql, performance_schema and information_schema existed, it failed
2016-12-10 14:54:59
sibiria
i do not understand why
2016-12-10 14:55:40
MariaDBstaff
<svar> so now you can shutdown all nodes
2016-12-10 14:55:53
MariaDBstaff
<svar> start a new cluster on one
2016-12-10 14:55:58
sibiria
i should try. at least one by one finally works using xtrabackup-v2 :)
2016-12-10 14:56:00
MariaDBstaff
<svar> and start remaining node ?
2016-12-10 14:56:08
sibiria
1 min, will try
2016-12-10 14:56:13
MariaDBstaff
<svar> one by one is nt using SST
2016-12-10 14:56:31
MariaDBstaff
<svar> so using gcache instead of xtrabackup
2016-12-10 14:56:50
MariaDBstaff
<svar> so i would not trust such instable system
2016-12-10 14:57:09
sibiria
well the point is that i need to be able to lose one node (or take it offline manually for updates)
2016-12-10 14:57:16
sibiria
so that it can join again safely
2016-12-10 14:57:37
MariaDBstaff
<svar> ok if to complex than keep rsync with 3 nodes
2016-12-10 14:58:07
MariaDBstaff
<svar> you will alway be able to write on one node
2016-12-10 14:58:24
sibiria
i have now shut off all three nodes. they have one new database with a table containing lots of stuff (not just mysql/performance_schema/information_schema), and all three nodes are configured to use xtrabackup-v2
2016-12-10 14:58:34
sibiria
do i now start up normally, or with "galera_new_cluster"?
2016-12-10 14:58:50
MariaDBstaff
<svar> galera_new_cluster
2016-12-10 14:59:09
MariaDBstaff
<svar> preferably on the last node that you shutdown
2016-12-10 14:59:18
sibiria
i actually took a random node, the second one
2016-12-10 14:59:39
MariaDBstaff
<svar> or you may have risk of bootstrap unsync data
2016-12-10 15:00:01
sibiria
ah, risky
2016-12-10 15:00:21
MariaDBstaff
<svar> galera_new_cluster , is you choice to restart a cluster , so it's up to you to get the must up to date
2016-12-10 15:00:57
MariaDBstaff
<svar> you can found from comparing gtid
2016-12-10 15:01:09
sibiria
ok, that script will define the cluster from the current local data
2016-12-10 15:01:18
MariaDBstaff
<svar> yes
2016-12-10 15:01:22
sibiria
good to know, thanks
2016-12-10 15:01:39
MariaDBstaff
<svar> GTID can be found in each node from .DAT file something like that
2016-12-10 15:02:12
MariaDBstaff
<svar> i can't remenber the exact name of the file sorry
2016-12-10 15:02:18
sibiria
all three nodes can start up again, and the uuid state matches
2016-12-10 15:02:21
sibiria
this seems to have worked
2016-12-10 15:02:35
sibiria
so glad it finally runs
2016-12-10 15:02:38
MariaDBstaff
<svar> can you tell from the log if that was SST
2016-12-10 15:02:42
sibiria
hold on
2016-12-10 15:02:58
sibiria
i know it was IST earlier, after i switched to xtrabackup-v2 after having created the big table
2016-12-10 15:03:44
sibiria
[Note] WSREP: IST received: <some uuid>
2016-12-10 15:04:55
MariaDBstaff
<svar> oups
2016-12-10 15:08:14
MariaDBstaff
<svar> is that still IST
2016-12-10 15:08:32
sibiria
it's IST still
2016-12-10 15:12:59
MariaDBstaff
<svar> Yep new feature
2016-12-10 15:13:11
sibiria
thanks for the explanations and info
2016-12-10 15:13:17
sibiria
i'll do some deeper tests of this later
2016-12-10 15:13:37
MariaDBstaff
<svar> yes you may have to kill -9 to force SST
2016-12-10 15:13:51
MariaDBstaff
<svar> good luck
2016-12-10 17:00:51
sibiria
is there a simple way of summing up several rows from a union?
2016-12-10 17:01:33
sibiria
f.e.... select distinct name, count(1) as count from tbl_a union <select same for tbl_b>
2016-12-10 17:01:45
sibiria
without getting duplicate names
2016-12-10 17:07:01
sibiria
looks like a subquery is the only way?
2016-12-10 17:07:17
MariaDBstaff
<svar> select name , sum(count) FROM ( select distinct name, count(1) as count from tbl_a union select distinct name, count(1) as count from tbl_b ) A
2016-12-10 17:07:30
sibiria
mm yeah what i thought
2016-12-10 17:07:31
sibiria
thanks, svar
2016-12-10 17:08:30
jiffe
so I've got mariadb auth running pam authentication, is there a way to have a set of privileges assigned to groups instead of users?
2016-12-10 18:27:04
MariaDBstaff
<svar> https://mariadb.com/resources/blog/configuring-pam-group-mapping-mariadb
2016-12-10 19:37:05
galera_noob
Hi guys - can I ask a question about Galera cluster here or is there another channel that should go in?
2016-12-10 20:03:48
Jers1
can someone here help me out with a problem regarding PHP and MariaDB?
2016-12-10 20:10:15
treehug88
Jers1 just ask the question
2016-12-10 20:11:07
Jers1
how exactly do I connect PHP and MariaDB? I've tried MySQLi and PDO and both result in a blank page
2016-12-10 20:34:03
Jers1
... restarting apache2 solved everything
2016-12-10 20:34:15
Jers1
i'm going to go cry in a corner now