{"action":"created","issue":{"url":"https://api.github.com/repos/NagiosEnterprises/nagioscore/issues/84","labels_url":"https://api.github.com/repos/NagiosEnterprises/nagioscore/issues/84/labels{/name}","comments_url":"https://api.github.com/repos/NagiosEnterprises/nagioscore/issues/84/comments","events_url":"https://api.github.com/repos/NagiosEnterprises/nagioscore/issues/84/events","html_url":"https://github.com/NagiosEnterprises/nagioscore/issues/84","id":112964437,"number":84,"title":"Nagios Core 4.1.1 - workers seemingly dont notice check completion","user":{"login":"iscb2015","id":15259804,"avatar_url":"https://avatars.githubusercontent.com/u/15259804?v=3","gravatar_id":"","url":"https://api.github.com/users/iscb2015","html_url":"https://github.com/iscb2015","followers_url":"https://api.github.com/users/iscb2015/followers","following_url":"https://api.github.com/users/iscb2015/following{/other_user}","gists_url":"https://api.github.com/users/iscb2015/gists{/gist_id}","starred_url":"https://api.github.com/users/iscb2015/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/iscb2015/subscriptions","organizations_url":"https://api.github.com/users/iscb2015/orgs","repos_url":"https://api.github.com/users/iscb2015/repos","events_url":"https://api.github.com/users/iscb2015/events{/privacy}","received_events_url":"https://api.github.com/users/iscb2015/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/NagiosEnterprises/nagioscore/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-10-23T06:55:41Z","updated_at":"2015-11-05T13:36:22Z","closed_at":null,"body":"Nagios Core 4.1.1 built from source on Solaris 11.2 (SPARC).\r\nNo options supplied to configure script.\r\nConfiguration following sample, only real change is the directory with configuration information.\r\n\r\nWhen running the following style messages are logged (repeatedly) to the nagios.log (in a 60 second period there are between 500 and 900 messages logged depending on check activity)\r\n\r\n[1445582254] wproc: Core Worker 14747: job 49765 (pid=21636) timed out. Killing it\r\n[1445582254] wproc: Core Worker 14747: job 49765 with pid 21636 reaped at timeout. timeouts=49747; started=49789\r\n\r\nLarge number (averages around 400) of defunct processes which are children of the nagios and nagios worker processes.\r\n\r\nWeb interface reports that the run time for all (all the ones I've looked at - see also nagiostat output below) service and host checks are just over 60 and 30 seconds respectively which matches the maximum times for the checks defined in the nagios configuration.\r\n\r\nChecks seem to be working - although they're taking longer to report the information.\r\n\r\n# /usr/local/nagios/bin/nagiostats\r\n\r\nNagios Stats 4.1.1\r\nCopyright (c) 2003-2008 Ethan Galstad (www.nagios.org)\r\nLast Modified: 08-19-2015\r\nLicense: GPL\r\n\r\nCURRENT STATUS DATA\r\n------------------------------------------------------\r\nStatus File:                            /usr/local/nagios/var/status.dat\r\nStatus File Age:                        0d 0h 0m 8s\r\nStatus File Version:                    4.1.1\r\n\r\nProgram Running Time:                   0d 22h 37m 20s\r\nNagios PID:                             14744\r\n\r\nTotal Services:                         1427\r\nServices Checked:                       1424\r\nServices Scheduled:                     1394\r\nServices Actively Checked:              1427\r\nServices Passively Checked:             0\r\nTotal Service State Change:             0.000 / 6.120 / 0.004 %\r\nActive Service Latency:                 0.000 / 30.377 / 0.078 sec\r\nActive Service Execution Time:          0.000 / 60.093 / 58.653 sec\r\nActive Service State Change:            0.000 / 6.120 / 0.004 %\r\nActive Services Last 1/5/15/60 min:     0 / 1020 / 1392 / 1392\r\nPassive Service Latency:                0.000 / 0.000 / 0.000 sec\r\nPassive Service State Change:           0.000 / 0.000 / 0.000 %\r\nPassive Services Last 1/5/15/60 min:    0 / 0 / 0 / 0\r\nServices Ok/Warn/Unk/Crit:              1398 / 8 / 4 / 17\r\nServices Flapping:                      0\r\nServices In Downtime:                   0\r\n\r\nTotal Hosts:                            302\r\nHosts Checked:                          302\r\nHosts Scheduled:                        294\r\nHosts Actively Checked:                 302\r\nHost Passively Checked:                 0\r\nTotal Host State Change:                0.000 / 0.000 / 0.000 %\r\nActive Host Latency:                    0.000 / 2025.389 / 20.777 sec\r\nActive Host Execution Time:             4.056 / 30.089 / 29.323 sec\r\nActive Host State Change:               0.000 / 0.000 / 0.000 %\r\nActive Hosts Last 1/5/15/60 min:        11 / 227 / 294 / 294\r\nPassive Host Latency:                   0.000 / 0.000 / 0.000 sec\r\nPassive Host State Change:              0.000 / 0.000 / 0.000 %\r\nPassive Hosts Last 1/5/15/60 min:       0 / 0 / 0 / 0\r\nHosts Up/Down/Unreach:                  301 / 1 / 0\r\nHosts Flapping:                         0\r\nHosts In Downtime:                      1\r\n\r\nActive Host Checks Last 1/5/15 min:     45 / 277 / 834\r\n   Scheduled:                           45 / 277 / 834\r\n   On-demand:                           0 / 0 / 0\r\n   Parallel:                            45 / 277 / 834\r\n   Serial:                              0 / 0 / 0\r\n   Cached:                              0 / 0 / 0\r\nPassive Host Checks Last 1/5/15 min:    0 / 0 / 0\r\nActive Service Checks Last 1/5/15 min:  305 / 1374 / 4158\r\n   Scheduled:                           305 / 1374 / 4158\r\n   On-demand:                           0 / 0 / 0\r\n   Cached:                              0 / 0 / 0\r\nPassive Service Checks Last 1/5/15 min: 0 / 0 / 0\r\n\r\nExternal Commands Last 1/5/15 min:      0 / 0 / 0\r\n\r\n\r\n\r\nI found the bug documented at https://tracker.nagios.org/view.php?id=498 which reports the same error messages and I tried to recompile using the io-broker option that was documented as fixing the issue there - however the configure option --with-ibroker=epoll is reported as not available.\r\n\r\nI have tried rebuilding using configure --with-iobroker=select which gets rid of the timeout messages, but results in the following style messages \r\n\r\n[1445496380] wproc: 'Core Worker 14436' seems to be choked. ret = -1; bufsize = 142: errno = 11 (Resource temporarily unavailable)\r\n[1445496380] Unable to run check for service 'service name' on host 'hostname'\r\n\r\nand no checks seem to work.\r\n\r\n\r\nWhen attempting to compile after using configure --disable-event-broker the compile fails - last few lines of compilation shown below;\r\n\r\ngmake[2]: Leaving directory `/var/tmp/ian/nagios-4.1.1/lib'\r\ngcc -Wall -I.. -I /usr/include -I /usr/include/gd2 -DHAVE_CONFIG_H -DNSCORE -o nagios nagios.o  ../common/shared.o nerd.o query-handler.o workers.o checks.o config.o commands.o events.o flapping.o logging.o macros-base.o netutils.o notifications.o sehandlers.o utils.o retention-base.o xretention-base.o comments-base.o xcomments-base.o objects-base.o xobjects-base.o statusdata-base.o xstatusdata-base.o perfdata-base.o xperfdata-base.o downtime-base.o    -lm -lsocket  -lsocket  ../lib/libnagios.a\r\nUndefined                       first referenced\r\n symbol                             in file\r\nneb_free_module_list                nagios.o\r\nneb_register_callback               nerd.o\r\nneb_deregister_callback             nerd.o\r\nneb_add_core_module                 nerd.o\r\nld: fatal: symbol referencing errors\r\ncollect2: error: ld returned 1 exit status\r\ngmake[1]: *** [nagios] Error 1\r\ngmake[1]: Leaving directory `/var/tmp/ian/nagios-4.1.1/base'\r\ngmake: *** [all] Error 2\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/NagiosEnterprises/nagioscore/issues/comments/154060295","html_url":"https://github.com/NagiosEnterprises/nagioscore/issues/84#issuecomment-154060295","issue_url":"https://api.github.com/repos/NagiosEnterprises/nagioscore/issues/84","id":154060295,"user":{"login":"giteric","id":2440508,"avatar_url":"https://avatars.githubusercontent.com/u/2440508?v=3","gravatar_id":"","url":"https://api.github.com/users/giteric","html_url":"https://github.com/giteric","followers_url":"https://api.github.com/users/giteric/followers","following_url":"https://api.github.com/users/giteric/following{/other_user}","gists_url":"https://api.github.com/users/giteric/gists{/gist_id}","starred_url":"https://api.github.com/users/giteric/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/giteric/subscriptions","organizations_url":"https://api.github.com/users/giteric/orgs","repos_url":"https://api.github.com/users/giteric/repos","events_url":"https://api.github.com/users/giteric/events{/privacy}","received_events_url":"https://api.github.com/users/giteric/received_events","type":"User","site_admin":false},"created_at":"2015-11-05T13:36:22Z","updated_at":"2015-11-05T13:36:22Z","body":"I'm guessing @tmcnag missed that.  I'm guessing the next question will be \"can you post the contents of your configure.log\" file.\r\n"}}