{"action":"created","issue":{"url":"https://api.github.com/repos/papertrail/remote_syslog2/issues/4","labels_url":"https://api.github.com/repos/papertrail/remote_syslog2/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/papertrail/remote_syslog2/issues/4/comments","events_url":"https://api.github.com/repos/papertrail/remote_syslog2/issues/4/events","html_url":"https://github.com/papertrail/remote_syslog2/issues/4","id":33482904,"number":4,"title":"remote_syslog exits with \"too many open files\"","user":{"login":"unwiredlabs","id":5090515,"avatar_url":"https://avatars.githubusercontent.com/u/5090515?v=3","gravatar_id":"","url":"https://api.github.com/users/unwiredlabs","html_url":"https://github.com/unwiredlabs","followers_url":"https://api.github.com/users/unwiredlabs/followers","following_url":"https://api.github.com/users/unwiredlabs/following{/other_user}","gists_url":"https://api.github.com/users/unwiredlabs/gists{/gist_id}","starred_url":"https://api.github.com/users/unwiredlabs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/unwiredlabs/subscriptions","organizations_url":"https://api.github.com/users/unwiredlabs/orgs","repos_url":"https://api.github.com/users/unwiredlabs/repos","events_url":"https://api.github.com/users/unwiredlabs/events{/privacy}","received_events_url":"https://api.github.com/users/unwiredlabs/received_events","type":"Organization","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"leonsodhi","id":2627536,"avatar_url":"https://avatars.githubusercontent.com/u/2627536?v=3","gravatar_id":"","url":"https://api.github.com/users/leonsodhi","html_url":"https://github.com/leonsodhi","followers_url":"https://api.github.com/users/leonsodhi/followers","following_url":"https://api.github.com/users/leonsodhi/following{/other_user}","gists_url":"https://api.github.com/users/leonsodhi/gists{/gist_id}","starred_url":"https://api.github.com/users/leonsodhi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/leonsodhi/subscriptions","organizations_url":"https://api.github.com/users/leonsodhi/orgs","repos_url":"https://api.github.com/users/leonsodhi/repos","events_url":"https://api.github.com/users/leonsodhi/events{/privacy}","received_events_url":"https://api.github.com/users/leonsodhi/received_events","type":"User","site_admin":false},"milestone":null,"comments":18,"created_at":"2014-05-14T11:20:35Z","updated_at":"2015-05-31T16:23:43Z","closed_at":null,"body":"On Ubuntu 12.04, the remote_syslog2 wouldn't start with the following .yml file. I started it with -D option and this is what I got towards the end:\r\n\r\nfiles: \r\n  - /var/log/apache2/access.log\r\n  - /var/log/apache2/error.log\r\n  - /opt/misc/*.log\r\n  - /var/log/mysql/error.log\r\n  - /var/www/weblogs/*.log\r\n  - /var/log/Xorg.x.log\r\n  - /var/log/alternatives.log\r\n  - /var/log/mail.log\r\n  - /var/log/messages\r\n  - /var/log/dmesg\r\n  - /var/log/wtmp\r\n  - /var/log/daemon.log\r\n  - /var/log/btmp\r\n  - /var/log/secure\r\n  - /var/log/auth.log\r\n  - /var/log/lastlog\r\n  - /var/log/boot.log\r\n  - /var/log/faillog\r\n  - /var/log/anaconda.log\r\n  - /var/log/user.log\r\n  - /var/log/dkpg.log\r\n  - /var/log/cups\r\n  - /var/log/kern.log\r\ndestination:\r\n  host: logs.papertrailapp.com\r\n  port: <port>\r\n\r\n\r\nremote_syslog error output:\r\n\r\n2014-05-14 10:48:40 ERROR  remote_syslog.go:76 Cannot forward /var/log/cups, it may not exist\r\n2014-05-14 10:48:40 INFO  remote_syslog.go:86 Forwarding /var/log/kern.log\r\n2014/05/14 16:18:40 FATAL -- Error creating fsnotify watcher: inotify_init: too many open files\r\n\r\n\r\nI removed the *.log wildcards and the error isn't there anymore.. but what limit is this? And is there a way for the daemon to notify the admin by email instead of quitting silently?"},"comment":{"url":"https://api.github.com/repos/papertrail/remote_syslog2/issues/comments/107216762","html_url":"https://github.com/papertrail/remote_syslog2/issues/4#issuecomment-107216762","issue_url":"https://api.github.com/repos/papertrail/remote_syslog2/issues/4","id":107216762,"user":{"login":"troy","id":9222,"avatar_url":"https://avatars.githubusercontent.com/u/9222?v=3","gravatar_id":"","url":"https://api.github.com/users/troy","html_url":"https://github.com/troy","followers_url":"https://api.github.com/users/troy/followers","following_url":"https://api.github.com/users/troy/following{/other_user}","gists_url":"https://api.github.com/users/troy/gists{/gist_id}","starred_url":"https://api.github.com/users/troy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/troy/subscriptions","organizations_url":"https://api.github.com/users/troy/orgs","repos_url":"https://api.github.com/users/troy/repos","events_url":"https://api.github.com/users/troy/events{/privacy}","received_events_url":"https://api.github.com/users/troy/received_events","type":"User","site_admin":false},"created_at":"2015-05-31T16:23:43Z","updated_at":"2015-05-31T16:23:43Z","body":"@deltamualpha If you're seeing anything unexpected, the most useful thing for debugging and troubleshooting is an `strace -f -s 500 -p 12345` (where 12345 is remote_syslog2's PID) while it's happening. Try to get at least 10 seconds before it happens (or before you make it happen, like by creating or writing to tons of files) and at least 10 seconds after. That at least gives us a fighting chance at seeing what's happening :)"}}