{"action":"created","issue":{"url":"https://api.github.com/repos/meetecho/janus-gateway/issues/316","labels_url":"https://api.github.com/repos/meetecho/janus-gateway/issues/316/labels{/name}","comments_url":"https://api.github.com/repos/meetecho/janus-gateway/issues/316/comments","events_url":"https://api.github.com/repos/meetecho/janus-gateway/issues/316/events","html_url":"https://github.com/meetecho/janus-gateway/issues/316","id":103695890,"number":316,"title":"double free or corruption (fasttop)","user":{"login":"ancorgs","id":3638289,"avatar_url":"https://avatars.githubusercontent.com/u/3638289?v=3","gravatar_id":"","url":"https://api.github.com/users/ancorgs","html_url":"https://github.com/ancorgs","followers_url":"https://api.github.com/users/ancorgs/followers","following_url":"https://api.github.com/users/ancorgs/following{/other_user}","gists_url":"https://api.github.com/users/ancorgs/gists{/gist_id}","starred_url":"https://api.github.com/users/ancorgs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ancorgs/subscriptions","organizations_url":"https://api.github.com/users/ancorgs/orgs","repos_url":"https://api.github.com/users/ancorgs/repos","events_url":"https://api.github.com/users/ancorgs/events{/privacy}","received_events_url":"https://api.github.com/users/ancorgs/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":25,"created_at":"2015-08-28T10:43:01Z","updated_at":"2015-09-15T10:05:06Z","closed_at":null,"body":"We have been experiencing several (apparently different) stability problems and very high CPU usage issues in Janus lately. For many of them, I don't have further information, but the latest crash left this on the logs.\r\n\r\n```\r\n*** Error in `/usr/bin/janus': double free or corruption (fasttop): 0x00007f6ea8d37e70 ***\r\n======= Backtrace: =========\r\n/lib64/libc.so.6(+0x7283f)[0x7f6ebe3f883f]\r\n/lib64/libc.so.6(+0x780ae)[0x7f6ebe3fe0ae]\r\n/lib64/libc.so.6(+0x78db6)[0x7f6ebe3fedb6]\r\n/usr/bin/janus(janus_sdp_parse+0x6e8)[0x453a58]\r\n/usr/bin/janus(janus_process_incoming_request+0x3fb0)[0x43ddf0]\r\n/usr/bin/janus(janus_wss_task+0x32e)[0x441c0e]\r\n/usr/lib64/libglib-2.0.so.0(+0x707cc)[0x7f6ec07167cc]\r\n/usr/lib64/libglib-2.0.so.0(+0x6fe15)[0x7f6ec0715e15]\r\n/lib64/libpthread.so.0(+0x80a4)[0x7f6ebe7360a4]\r\n/lib64/libc.so.6(clone+0x6d)[0x7f6ebe46b08d]\r\n======= Memory map: ========\r\n00400000-0046c000 r-xp 00000000 fe:01 5681                               /usr/bin/janus\r\n0066b000-0066c000 r--p 0006b000 fe:01 5681                               /usr/bin/janus\r\n0066c000-0066e000 rw-p 0006c000 fe:01 5681                               /usr/bin/janus\r\n01390000-014d8000 rw-p 00000000 00:00 0                                  [heap]\r\n7f6de66f5000-7f6de66f6000 ---p 00000000 00:00 0\r\n7f6de66f6000-7f6de6ef6000 rw-p 00000000 00:00 0                          [stack:3923]\r\n7f6de6ef6000-7f6de6ef7000 ---p 00000000 00:00 0\r\n7f6de6ef7000-7f6de76f7000 rw-p 00000000 00:00 0                          [stack:3922]\r\n7f6de76f7000-7f6de76f8000 ---p 00000000 00:00 0\r\n7f6de76f8000-7f6de7ef8000 rw-p 00000000 00:00 0                          [stack:3921]\r\n7f6de7ef8000-7f6de7ef9000 ---p 00000000 00:00 0\r\n7f6de7ef9000-7f6de86f9000 rw-p 00000000 00:00 0                          [stack:3920]\r\n7f6de86f9000-7f6de86fa000 ---p 00000000 00:00 0\r\n7f6de86fa000-7f6de8efa000 rw-p 00000000 00:00 0                          [stack:3919]\r\n7f6de8efa000-7f6de8efb000 ---p 00000000 00:00 0\r\n7f6de8efb000-7f6de96fb000 rw-p 00000000 00:00 0                          [stack:3918]\r\n7f6de96fb000-7f6de96fc000 ---p 00000000 00:00 0\r\n7f6de96fc000-7f6de9efc000 rw-p 00000000 00:00 0                          [stack:3898]\r\n7f6de9efc000-7f6de9efd000 ---p 00000000 00:00 0\r\n7f6de9efd000-7f6dea6fd000 rw-p 00000000 00:00 0                          [stack:3862]\r\n```\r\n\r\nWe use a rather old version of systemd (SLE12) and it seems it is not generating a core dump for us. If it's needed for debugging process, I can try to generate it. But it's not that easy as I need enough people (even the right people) on the room to generate the crash.\r\n\r\nUsing the videoroom plugin, btw."},"comment":{"url":"https://api.github.com/repos/meetecho/janus-gateway/issues/comments/140343276","html_url":"https://github.com/meetecho/janus-gateway/issues/316#issuecomment-140343276","issue_url":"https://api.github.com/repos/meetecho/janus-gateway/issues/316","id":140343276,"user":{"login":"ancorgs","id":3638289,"avatar_url":"https://avatars.githubusercontent.com/u/3638289?v=3","gravatar_id":"","url":"https://api.github.com/users/ancorgs","html_url":"https://github.com/ancorgs","followers_url":"https://api.github.com/users/ancorgs/followers","following_url":"https://api.github.com/users/ancorgs/following{/other_user}","gists_url":"https://api.github.com/users/ancorgs/gists{/gist_id}","starred_url":"https://api.github.com/users/ancorgs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ancorgs/subscriptions","organizations_url":"https://api.github.com/users/ancorgs/orgs","repos_url":"https://api.github.com/users/ancorgs/repos","events_url":"https://api.github.com/users/ancorgs/events{/privacy}","received_events_url":"https://api.github.com/users/ancorgs/received_events","type":"User","site_admin":false},"created_at":"2015-09-15T10:05:06Z","updated_at":"2015-09-15T10:05:06Z","body":"As soon as we enable libasan we are able to make it crash almost constantly. But the asan output is not consistent. Three examples.\r\n\r\nhttp://paste.opensuse.org/86236827\r\nhttp://paste.opensuse.org/92017366\r\nhttp://paste.opensuse.org/84609500\r\n\r\nI also have dozens of crashes without the line numbers (I forgot to enable the llvm symbolizer trick at the beginning of the crashing session). Pasting some of them:\r\nhttp://paste.opensuse.org/77475797\r\nhttp://paste.opensuse.org/86290181\r\n\r\nIn many (most) crashes, the error is simply that janus couldn't allocate memory (a machine with 1GB), but a clean shutdown doesn't seem to display any information about leaks."}}