{"action":"created","issue":{"url":"https://api.github.com/repos/codership/galera/issues/342","labels_url":"https://api.github.com/repos/codership/galera/issues/342/labels{/name}","comments_url":"https://api.github.com/repos/codership/galera/issues/342/comments","events_url":"https://api.github.com/repos/codership/galera/issues/342/events","html_url":"https://github.com/codership/galera/issues/342","id":105408774,"number":342,"title":"Reducing wsrep_slave_threads leads to crash/unavailability","user":{"login":"joffrey92","id":7384759,"avatar_url":"https://avatars.githubusercontent.com/u/7384759?v=3","gravatar_id":"","url":"https://api.github.com/users/joffrey92","html_url":"https://github.com/joffrey92","followers_url":"https://api.github.com/users/joffrey92/followers","following_url":"https://api.github.com/users/joffrey92/following{/other_user}","gists_url":"https://api.github.com/users/joffrey92/gists{/gist_id}","starred_url":"https://api.github.com/users/joffrey92/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joffrey92/subscriptions","organizations_url":"https://api.github.com/users/joffrey92/orgs","repos_url":"https://api.github.com/users/joffrey92/repos","events_url":"https://api.github.com/users/joffrey92/events{/privacy}","received_events_url":"https://api.github.com/users/joffrey92/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/codership/galera/labels/duplicate","name":"duplicate","color":"cccccc"}],"state":"closed","locked":false,"assignee":{"login":"philip-galera","id":8738032,"avatar_url":"https://avatars.githubusercontent.com/u/8738032?v=3","gravatar_id":"","url":"https://api.github.com/users/philip-galera","html_url":"https://github.com/philip-galera","followers_url":"https://api.github.com/users/philip-galera/followers","following_url":"https://api.github.com/users/philip-galera/following{/other_user}","gists_url":"https://api.github.com/users/philip-galera/gists{/gist_id}","starred_url":"https://api.github.com/users/philip-galera/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/philip-galera/subscriptions","organizations_url":"https://api.github.com/users/philip-galera/orgs","repos_url":"https://api.github.com/users/philip-galera/repos","events_url":"https://api.github.com/users/philip-galera/events{/privacy}","received_events_url":"https://api.github.com/users/philip-galera/received_events","type":"User","site_admin":false},"milestone":null,"comments":4,"created_at":"2015-09-08T15:42:26Z","updated_at":"2015-09-14T21:52:15Z","closed_at":"2015-09-09T10:32:22Z","body":"Hi,\r\n\r\nBrand new cluster MariaDB Galera 10.0.21 (wsrep_25.10.r4144) with 3 nodes and default settings except:\r\nwsrep_cluster_address=\"gcomm://node1,node2,node3\"\r\nwsrep_provider=/path/to/lib\r\nbinlog_format=ROW\r\nwsrep_slave_threads=1 (default)\r\n\r\nnode2:\r\nMariaDB [test]> CREATE TABLE test_table (a int primary key);\r\nMariaDB [test]> SET GLOBAL wsrep_slave_threads = 32;\r\nMariaDB [test]> SET GLOBAL wsrep_slave_threads = 1;\r\n\r\nnode1:\r\nMariaDB [test]> INSERT INTO test_table values (1);\r\nnode2: open new session in MySQL (success)\r\nnode1:\r\nMariaDB [test]> INSERT INTO test_table values (2);\r\nnode2: open new session in MySQL (fail)\r\n\r\nThe node still participates in cluster replication.\r\nWhen gently killed, it doesn't stop correctly, or stops with a crash, one example:\r\n\r\nSep  8 16:56:03 sd-68422 mysqld: 150908 16:56:03 [Note] WSREP: applier thread exiting (code:6)\r\nSep  8 16:56:03 sd-68422 mysqld: 150908 16:56:03 [Note] WSREP: applier thread exiting (code:6)\r\nSep  8 16:56:03 sd-68422 mysqld: 150908 16:56:03 [Note] WSREP: applier thread exiting (code:6)\r\nSep  8 16:56:03 sd-68422 mysqld: 150908 16:56:03 [Note] WSREP: applier thread exiting (code:6)\r\nSep  8 16:56:05 sd-68422 mysqld: 150908 16:56:05 [Note] WSREP: rollbacker thread exiting\r\nSep  8 16:56:05 sd-68422 mysqld: 150908 16:56:05 [ERROR] mysqld got signal 11 ;\r\nSep  8 16:56:05 sd-68422 mysqld: This could be because you hit a bug. It is also possible that this binary\r\nSep  8 16:56:05 sd-68422 mysqld: or one of the libraries it was linked against is corrupt, improperly built,\r\nSep  8 16:56:05 sd-68422 mysqld: or misconfigured. This error can also be caused by malfunctioning hardware.\r\nSep  8 16:56:05 sd-68422 mysqld:\r\nSep  8 16:56:05 sd-68422 mysqld: To report this bug, see http://kb.askmonty.org/en/reporting-bugs\r\nSep  8 16:56:05 sd-68422 mysqld:\r\nSep  8 16:56:05 sd-68422 mysqld: We will try our best to scrape up some info that will hopefully help\r\nSep  8 16:56:05 sd-68422 mysqld: diagnose the problem, but since we have already crashed,\r\nSep  8 16:56:05 sd-68422 mysqld: something is definitely wrong and this may fail.\r\nSep  8 16:56:05 sd-68422 mysqld:\r\nSep  8 16:56:05 sd-68422 mysqld: Server version: 10.0.21-MariaDB-1~jessie-wsrep-log\r\nSep  8 16:56:05 sd-68422 mysqld: key_buffer_size=134217728\r\nSep  8 16:56:05 sd-68422 mysqld: read_buffer_size=2097152\r\nSep  8 16:56:05 sd-68422 mysqld: max_used_connections=6\r\nSep  8 16:56:05 sd-68422 mysqld: max_threads=102\r\nSep  8 16:56:05 sd-68422 mysqld: thread_count=5\r\nSep  8 16:56:05 sd-68422 mysqld: It is possible that mysqld could use up to\r\nSep  8 16:56:05 sd-68422 mysqld: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 759797 K  bytes of memory\r\nSep  8 16:56:05 sd-68422 mysqld: Hope that's ok; if not, decrease some variables in the equation.\r\nSep  8 16:56:05 sd-68422 mysqld:\r\nSep  8 16:56:05 sd-68422 mysqld: Thread pointer: 0x0x0\r\nSep  8 16:56:05 sd-68422 mysqld: Attempting backtrace. You can use the following information to find out\r\nSep  8 16:56:05 sd-68422 mysqld: where mysqld died. If you see no messages after this, something went\r\nSep  8 16:56:05 sd-68422 mysqld: terribly wrong...\r\nSep  8 16:56:05 sd-68422 mysqld: stack_bottom = 0x0 thread_stack 0x48000\r\nSep  8 16:56:05 sd-68422 mysqld: /usr/sbin/mysqld(my_print_stacktrace+0x3d)[0x7f9e487c8b1d]\r\nSep  8 16:56:05 sd-68422 mysqld: /usr/sbin/mysqld(handle_fatal_signal+0x31a)[0x7f9e482fcf9a]\r\nSep  8 16:56:05 sd-68422 mysqld: /lib/x86_64-linux-gnu/libpthread.so.0(+0xf8d0)[0x7f9e479448d0]\r\nSep  8 16:56:05 sd-68422 mysqld: /usr/sbin/mysqld(+0x34ea4f)[0x7f9e480c3a4f]\r\nSep  8 16:56:05 sd-68422 mysqld: /usr/sbin/mysqld(kill_server_thread+0xe)[0x7f9e480c41be]\r\nSep  8 16:56:05 sd-68422 mysqld: /lib/x86_64-linux-gnu/libpthread.so.0(+0x80a4)[0x7f9e4793d0a4]\r\nSep  8 16:56:05 sd-68422 mysqld: /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f9e45f4504d]\r\nSep  8 16:56:05 sd-68422 mysqld: The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains\r\nSep  8 16:56:05 sd-68422 mysqld: information that should help you find out what is causing the crash.\r\nSep  8 16:56:06 sd-68422 mysqld_safe: Number of processes running now: 0\r\nSep  8 16:56:06 sd-68422 mysqld_safe: WSREP: not restarting wsrep node automatically\r\nSep  8 16:56:06 sd-68422 mysqld_safe: mysqld from pid file /var/run/mysqld/mysqld.pid ended\r\n\r\nI didn't find an issue reporting same behavior,\r\n\r\nRegards,\r\nJoffrey"},"comment":{"url":"https://api.github.com/repos/codership/galera/issues/comments/140215650","html_url":"https://github.com/codership/galera/issues/342#issuecomment-140215650","issue_url":"https://api.github.com/repos/codership/galera/issues/342","id":140215650,"user":{"login":"nirbhayc","id":7414429,"avatar_url":"https://avatars.githubusercontent.com/u/7414429?v=3","gravatar_id":"","url":"https://api.github.com/users/nirbhayc","html_url":"https://github.com/nirbhayc","followers_url":"https://api.github.com/users/nirbhayc/followers","following_url":"https://api.github.com/users/nirbhayc/following{/other_user}","gists_url":"https://api.github.com/users/nirbhayc/gists{/gist_id}","starred_url":"https://api.github.com/users/nirbhayc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nirbhayc/subscriptions","organizations_url":"https://api.github.com/users/nirbhayc/orgs","repos_url":"https://api.github.com/users/nirbhayc/repos","events_url":"https://api.github.com/users/nirbhayc/events{/privacy}","received_events_url":"https://api.github.com/users/nirbhayc/received_events","type":"User","site_admin":false},"created_at":"2015-09-14T21:52:14Z","updated_at":"2015-09-14T21:52:14Z","body":"https://github.com/MariaDB/server/commit/eac8e43541afdbc60b7e6c954d310db9b37db2d5.patch"}}