{"action":"created","issue":{"url":"https://api.github.com/repos/multipath-tcp/mptcp/issues/99","labels_url":"https://api.github.com/repos/multipath-tcp/mptcp/issues/99/labels{/name}","comments_url":"https://api.github.com/repos/multipath-tcp/mptcp/issues/99/comments","events_url":"https://api.github.com/repos/multipath-tcp/mptcp/issues/99/events","html_url":"https://github.com/multipath-tcp/mptcp/issues/99","id":117026809,"number":99,"title":"BUG: soft lockup at _raw_spin_lock_bh","user":{"login":"shimlee","id":15278921,"avatar_url":"https://avatars.githubusercontent.com/u/15278921?v=3","gravatar_id":"","url":"https://api.github.com/users/shimlee","html_url":"https://github.com/shimlee","followers_url":"https://api.github.com/users/shimlee/followers","following_url":"https://api.github.com/users/shimlee/following{/other_user}","gists_url":"https://api.github.com/users/shimlee/gists{/gist_id}","starred_url":"https://api.github.com/users/shimlee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shimlee/subscriptions","organizations_url":"https://api.github.com/users/shimlee/orgs","repos_url":"https://api.github.com/users/shimlee/repos","events_url":"https://api.github.com/users/shimlee/events{/privacy}","received_events_url":"https://api.github.com/users/shimlee/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":7,"created_at":"2015-11-15T23:32:49Z","updated_at":"2015-11-17T06:54:07Z","closed_at":"2015-11-17T00:21:19Z","body":"Happens two times.\r\n//==============================================================================\r\n[1795863.315125] BUG: soft lockup - CPU#19 stuck for 23s! [kworker/u290:7:61545]\r\n[1795863.315130] Modules linked in: binfmt_misc iptable_mangle ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack tun bridge stp llc bonding dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt iTCO_vendor_support x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd serio_raw pcspkr sb_edac hpilo hpwdt edac_core ioatdma lpc_ich mfd_core shpchp wmi ipmi_si ipmi_msghandler acpi_power_meter uinput xfs libcrc32c mgag200 syscopyarea sysfillrect sysimgblt i2c_algo_bit drm_kms_helper ttm ixgbe drm tg3 mdio dca ptp i2c_core pps_core mptcp_sm_nl(OF)\r\n[1795863.315248] CPU: 19 PID: 61545 Comm: kworker/u290:7 Tainted: GF       W  O 3.14.33-el-magw-v02+ #1\r\n[1795863.315250] Hardware name: HP ProLiant DL580 Gen8, BIOS P79 11/26/2014\r\n[1795863.315261] Workqueue: mptcp_wq mptcp_sub_close_wq\r\n[1795863.315263] task: ffff8819f3970000 ti: ffff8819e9e6e000 task.ti: ffff8819e9e6e000\r\n[1795863.315264] RIP: 0010:[<ffffffff8165e812>]  [<ffffffff8165e812>] _raw_spin_lock_bh+0x42/0x60\r\n[1795863.315270] RSP: 0018:ffff8819e9e6fdd8  EFLAGS: 00000202\r\n[1795863.315271] RAX: 000000000000678e RBX: ffff88203f853700 RCX: 00000000000014f6\r\n[1795863.315272] RDX: 00000000000014f8 RSI: 00000000000014f8 RDI: ffff88137228e530\r\n[1795863.315273] RBP: ffff8819e9e6fdd8 R08: ffff881a260dbeb0 R09: df96efe32b6dbea8\r\n[1795863.315274] R10: df96efe32b6dbea8 R11: 00000000000002eb R12: ffff8819f3970068\r\n[1795863.315275] R13: 000000010010000e R14: ffffffff8115df72 R15: ffff8819e9e6fd40\r\n[1795863.315276] FS:  0000000000000000(0000) GS:ffff88203f8e0000(0000) knlGS:0000000000000000\r\n[1795863.315278] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\r\n[1795863.315278] CR2: 00007fd36beb0000 CR3: 000000000196e000 CR4: 00000000001407e0\r\n[1795863.315284] Stack:\r\n[1795863.315292]  ffff8819e9e6fdf8 ffffffff81515db0 ffff881afc5907c0 ffff88137228e4c0\r\n[1795863.315313]  ffff8819e9e6fe18 ffffffff8161c46a ffff881a260dbea8 ffff88201ec4a700\r\n[1795863.315316]  ffff8819e9e6fe60 ffffffff8108ceeb 000000002975f018 0000000000000000\r\n[1795863.315318] Call Trace:\r\n[1795863.315332]  [<ffffffff81515db0>] lock_sock_nested+0x20/0x60\r\n[1795863.315334]  [<ffffffff8161c46a>] mptcp_sub_close_wq+0x3a/0x110\r\n[1795863.315339]  [<ffffffff8108ceeb>] process_one_work+0x17b/0x460\r\n[1795863.315341]  [<ffffffff8108dcfb>] worker_thread+0x11b/0x400\r\n[1795863.315346]  [<ffffffff8108dbe0>] ? rescuer_thread+0x450/0x450\r\n[1795863.315370]  [<ffffffff81094db8>] kthread+0xd8/0xf0\r\n[1795863.315372]  [<ffffffff81094ce0>] ? kthread_create_on_node+0x1a0/0x1a0\r\n[1795863.315377]  [<ffffffff81667e7c>] ret_from_fork+0x7c/0xb0\r\n[1795863.315379]  [<ffffffff81094ce0>] ? kthread_create_on_node+0x1a0/0x1a0\r\n[1795863.315380] Code: 00 02 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 10 66 0f 1f 84 00 00 00 00 00 f3 90 <83> e8 01 74 0a 0f b7 0f 66 39 ca 75 f1 5d c3 0f 1f 80 00 00 00\r\n\r\n//////=============================\r\n[2405031.939643] BUG: soft lockup - CPU#1 stuck for 22s! [kworker/u289:1:84019]\r\n[2405031.939648] Modules linked in: binfmt_misc iptable_mangle ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack tun bridge stp llc bonding dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt x86_pkg_temp_thermal iTCO_vendor_support intel_powerclamp coretemp kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd serio_raw pcspkr sb_edac edac_core ioatdma hpilo hpwdt lpc_ich mfd_core shpchp wmi ipmi_si ipmi_msghandler acpi_power_meter uinput xfs mgag200 syscopyarea sysfillrect sysimgblt i2c_algo_bit drm_kms_helper ttm ixgbe drm libcrc32c tg3 mdio dca ptp i2c_core pps_core mptcp_sm_nl(OF)\r\n[2405031.939699] CPU: 1 PID: 84019 Comm: kworker/u289:1 Tainted: GF       W  O 3.14.33-el-magw-v02+ #1\r\n[2405031.939700] Hardware name: HP ProLiant DL580 Gen8, BIOS P79 11/26/2014\r\n[2405031.939705] Workqueue: mptcp_wq mptcp_sub_close_wq\r\n[2405031.939707] task: ffff8803fcbc2880 ti: ffff88057c8bc000 task.ti: ffff88057c8bc000\r\n[2405031.939708] RIP: 0010:[<ffffffff8165e817>]  [<ffffffff8165e817>] _raw_spin_lock_bh+0x47/0x60\r\n[2405031.939713] RSP: 0018:ffff88057c8bddd8  EFLAGS: 00000202\r\n[2405031.939714] RAX: 0000000000004808 RBX: ffff88103f813700 RCX: 0000000000000066\r\n[2405031.939715] RDX: 0000000000000068 RSI: 0000000000000068 RDI: ffff88287c888830\r\n[2405031.939716] RBP: ffff88057c8bddd8 R08: ffff880957fc08b0 R09: dfda2819355c08a8\r\n[2405031.939717] R10: dfda2819355c08a8 R11: 0000000000000146 R12: ffff8803fcbc28e8\r\n[2405031.939718] R13: ffff88102773c064 R14: ffff88103f833700 R15: ffff88103f833700\r\n[2405031.939719] FS:  0000000000000000(0000) GS:ffff88103f820000(0000) knlGS:0000000000000000\r\n[2405031.939720] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033\r\n[2405031.939721] CR2: 00007f47f8d1707c CR3: 000000000196e000 CR4: 00000000001407e0\r\n[2405031.939722] Stack:\r\n[2405031.939723]  ffff88057c8bddf8 ffffffff81515db0 ffff88030dc65d00 ffff88287c8887c0\r\n[2405031.939729]  ffff88057c8bde18 ffffffff8161c46a ffff880957fc08a8 ffff881025e25180\r\n[2405031.939731]  ffff88057c8bde60 ffffffff8108ceeb 000000002971b018 0000000000000000\r\n[2405031.939734] Call Trace:\r\n[2405031.939740]  [<ffffffff81515db0>] lock_sock_nested+0x20/0x60\r\n[2405031.939742]  [<ffffffff8161c46a>] mptcp_sub_close_wq+0x3a/0x110\r\n[2405031.939747]  [<ffffffff8108ceeb>] process_one_work+0x17b/0x460\r\n[2405031.939749]  [<ffffffff8108dcfb>] worker_thread+0x11b/0x400\r\n[2405031.939751]  [<ffffffff8108dbe0>] ? rescuer_thread+0x450/0x450\r\n[2405031.939755]  [<ffffffff81094db8>] kthread+0xd8/0xf0\r\n[2405031.939758]  [<ffffffff81094ce0>] ? kthread_create_on_node+0x1a0/0x1a0\r\n[2405031.939762]  [<ffffffff81667e7c>] ret_from_fork+0x7c/0xb0\r\n[2405031.939765]  [<ffffffff81094ce0>] ? kthread_create_on_node+0x1a0/0x1a0\r\n[2405031.939765] Code: c1 07 89 c2 c1 ea 10 66 39 c2 75 02 5d c3 83 e2 fe 0f b7 f2 b8 00 80 00 00 eb 10 66 0f 1f 84 00 00 00 00 00 f3 90 83 e8 01 74 0a <0f> b7 0f 66 39 ca 75 f1 5d c3 0f 1f 80 00 00 00 00 eb d6 66 0f"},"comment":{"url":"https://api.github.com/repos/multipath-tcp/mptcp/issues/comments/157289256","html_url":"https://github.com/multipath-tcp/mptcp/issues/99#issuecomment-157289256","issue_url":"https://api.github.com/repos/multipath-tcp/mptcp/issues/99","id":157289256,"user":{"login":"shimlee","id":15278921,"avatar_url":"https://avatars.githubusercontent.com/u/15278921?v=3","gravatar_id":"","url":"https://api.github.com/users/shimlee","html_url":"https://github.com/shimlee","followers_url":"https://api.github.com/users/shimlee/followers","following_url":"https://api.github.com/users/shimlee/following{/other_user}","gists_url":"https://api.github.com/users/shimlee/gists{/gist_id}","starred_url":"https://api.github.com/users/shimlee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shimlee/subscriptions","organizations_url":"https://api.github.com/users/shimlee/orgs","repos_url":"https://api.github.com/users/shimlee/repos","events_url":"https://api.github.com/users/shimlee/events{/privacy}","received_events_url":"https://api.github.com/users/shimlee/received_events","type":"User","site_admin":false},"created_at":"2015-11-17T06:54:07Z","updated_at":"2015-11-17T06:54:07Z","body":"It is now on service, so it is difficult to reproduce freely.  sorry. \r\nIt was just happening two times and it has not happened in our test bed on heavy load. \r\nOk. I'll try with CONFIG_LOCKDEP.\r\nthanks,\r\nShim\r\n\r\n\r\n"}}