{"action":"created","issue":{"url":"https://api.github.com/repos/influxdb/influxdb/issues/4655","labels_url":"https://api.github.com/repos/influxdb/influxdb/issues/4655/labels{/name}","comments_url":"https://api.github.com/repos/influxdb/influxdb/issues/4655/comments","events_url":"https://api.github.com/repos/influxdb/influxdb/issues/4655/events","html_url":"https://github.com/influxdb/influxdb/issues/4655","id":115008289,"number":4655,"title":"[0.9.4.2] - Crash / Panic : Span weird","user":{"login":"JulienChampseix","id":3264366,"avatar_url":"https://avatars.githubusercontent.com/u/3264366?v=3","gravatar_id":"","url":"https://api.github.com/users/JulienChampseix","html_url":"https://github.com/JulienChampseix","followers_url":"https://api.github.com/users/JulienChampseix/followers","following_url":"https://api.github.com/users/JulienChampseix/following{/other_user}","gists_url":"https://api.github.com/users/JulienChampseix/gists{/gist_id}","starred_url":"https://api.github.com/users/JulienChampseix/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JulienChampseix/subscriptions","organizations_url":"https://api.github.com/users/JulienChampseix/orgs","repos_url":"https://api.github.com/users/JulienChampseix/repos","events_url":"https://api.github.com/users/JulienChampseix/events{/privacy}","received_events_url":"https://api.github.com/users/JulienChampseix/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/influxdb/influxdb/labels/panic","name":"panic","color":"cc0000"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":7,"created_at":"2015-11-04T09:24:06Z","updated_at":"2015-11-12T18:57:30Z","closed_at":null,"body":"Hi Team,\r\n\r\nVersion infos : \r\nInfluxDB v0.9.4.2 (git: 0.9.4 da1b59e7d7764d36786253b2db13b97f42ed4e1d)\r\n\r\nServer 0.9.4.2 crashed suddently, stack log crash:\r\n```\r\nruntime:objectstart Span weird: p=[http] 2015/11/04 02:00:58 10.13.1.9 - brain [04/Nov/2015:02:00:58 +0000] POST /write?db=brain.applications&p=%5BREDACTED%5D&u=brain HTTP/1.1 204 0 - - e42b53cb-8297-11e5-8f7e-000000000000 615.073µs\r\n0xc900000000 k=0x6480000 s.start=0xc900000000 s.limit=0xc900005a00 s.state=2\r\nfatal error: objectstart: bad pointer in unexpected span\r\n\r\ngoroutine 54 [running]:\r\nruntime.throw(0xcb2580, 0x2b)\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/panic.go:527 +0x90 fp=0xc820596610 sp=0xc8205965f8\r\nruntime.heapBitsForObject(0xc900000000, 0x0, 0x0, 0xc800000000, 0x7fd4cdcacb90)\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/mbitmap.go:217 +0x287 fp=0xc820596648 sp=0xc820596610\r\nruntime.scanobject(0xc96578bd70, 0xc82002dc20)\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/mgcmark.go:863 +0x239 fp=0xc820596718 sp=0xc820596648\r\nruntime.gcDrainUntilPreempt(0xc82002dc20, 0x7d0)\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/mgcmark.go:726 +0x152 fp=0xc820596750 sp=0xc820596718\r\nruntime.gcBgMarkWorker(0xc82002ca00)\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/mgc.go:1328 +0x474 fp=0xc8205967b8 sp=0xc820596750\r\nruntime.goexit()\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/asm_amd64.s:1696 +0x1 fp=0xc8205967c0 sp=0xc8205967b8\r\ncreated by runtime.gcBgMarkStartWorkers\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/mgc.go:1238 +0x93\r\n\r\ngoroutine 1 [chan receive, 8016 minutes]:\r\nmain.(*Main).Run(0xc8ab433f10, 0xc82000a0b0, 0x4, 0x4, 0x0, 0x0)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/cmd/influxd/main.go:91 +0xa16\r\nmain.main()\r\n\t/tmp/build/src/github.com/influxdb/influxdb/cmd/influxd/main.go:42 +0x29b\r\n\r\ngoroutine 17 [syscall, 8017 minutes, locked to thread]:\r\nruntime.goexit()\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/asm_amd64.s:1696 +0x1\r\n\r\ngoroutine 5 [syscall, 8017 minutes]:\r\nos/signal.loop()\r\n\t/home/philip/.gvm/gos/go1.5/src/os/signal/signal_unix.go:22 +0x18\r\ncreated by os/signal.init.1\r\n\t/home/philip/.gvm/gos/go1.5/src/os/signal/signal_unix.go:28 +0x37\r\n\r\ngoroutine 19 [IO wait, 8017 minutes]:\r\nnet.runtime_pollWait(0x7fd4f4a2c380, 0x72, 0xc8200101a0)\r\n\t/home/philip/.gvm/gos/go1.5/src/runtime/netpoll.go:157 +0x60\r\nnet.(*pollDesc).Wait(0xc8201204c0, 0x72, 0x0, 0x0)\r\n\t/home/philip/.gvm/gos/go1.5/src/net/fd_poll_runtime.go:73 +0x3a\r\nnet.(*pollDesc).WaitRead(0xc8201204c0, 0x0, 0x0)\r\n\t/home/philip/.gvm/gos/go1.5/src/net/fd_poll_runtime.go:78 +0x36\r\nnet.(*netFD).accept(0xc820120460, 0x0, 0x7fd4f6271788, 0xc820984000)\r\n\t/home/philip/.gvm/gos/go1.5/src/net/fd_unix.go:408 +0x27c\r\nnet.(*TCPListener).AcceptTCP(0xc82010e0a8, 0xc8201c6ec8, 0x0, 0x0)\r\n\t/home/philip/.gvm/gos/go1.5/src/net/tcpsock_posix.go:254 +0x4d\r\nnet.(*TCPListener).Accept(0xc82010e0a8, 0x0, 0x0, 0x0, 0x0)\r\n\t/home/philip/.gvm/gos/go1.5/src/net/tcpsock_posix.go:264 +0x3d\r\ngithub.com/influxdb/influxdb/tcp.(*Mux).Serve(0xc82010b3c0, 0x7fd4f4a2b400, 0xc82010e0a8, 0x0, 0x0)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tcp/mux.go:48 +0x4b\r\ncreated by github.com/influxdb/influxdb/cmd/influxd/run.(*Server).Open.func1\r\n\t/tmp/build/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:346 +0xae9\r\n\r\ngoroutine 20 [chan receive, 8017 minutes]:\r\ngithub.com/influxdb/influxdb/tcp.(*listener).Accept(0xc82010e0b0, 0x0, 0x0, 0x0, 0x0)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f\r\ngithub.com/influxdb/influxdb/meta.(*raftLayer).Accept(0xc820188540, 0x0, 0x0, 0x0, 0x0)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/meta/store.go:2059 +0x51\r\ngithub.com/hashicorp/raft.(*NetworkTransport).listen(0xc8201204d0)\r\n\t/tmp/build/src/github.com/hashicorp/raft/net_transport.go:346 +0x79\r\ncreated by github.com/hashicorp/raft.NewNetworkTransport\r\n\t/tmp/build/src/github.com/hashicorp/raft/net_transport.go:138 +0x284\r\n\r\ngoroutine 21 [select, 2 minutes]:\r\ngithub.com/hashicorp/raft.(*Raft).leaderLoop(0xc82019a000)\r\n\t/tmp/build/src/github.com/hashicorp/raft/raft.go:849 +0xcce\r\ngithub.com/hashicorp/raft.(*Raft).runLeader(0xc82019a000)\r\n\t/tmp/build/src/github.com/hashicorp/raft/raft.go:821 +0x936\r\ngithub.com/hashicorp/raft.(*Raft).run(0xc82019a000)\r\n\t/tmp/build/src/github.com/hashicorp/raft/raft.go:602 +0xbb\r\ngithub.com/hashicorp/raft.(*Raft).(github.com/hashicorp/raft.run)-fm()\r\n\t/tmp/build/src/github.com/hashicorp/raft/raft.go:252 +0x20\r\ngithub.com/hashicorp/raft.(*raftState).goFunc.func1(0xc82019a000, 0xc82018c540)\r\n\t/tmp/build/src/github.com/hashicorp/raft/state.go:152 +0x44\r\ncreated by github.com/hashicorp/raft.(*raftState).goFunc\r\n\t/tmp/build/src/github.com/hashicorp/raft/state.go:153 +0x4d\r\n\r\ngoroutine 22 [select, 147 minutes]:\r\ngithub.com/hashicorp/raft.(*Raft).runFSM(0xc82019a000)\r\n\t/tmp/build/src/github.com/hashicorp/raft/raft.go:509 +0x10eb\r\ngithub.com/hashicorp/raft.(*Raft).(github.com/hashicorp/raft.runFSM)-fm()\r\n\t/tmp/build/src/github.com/hashicorp/raft/raft.go:253 +0x20\r\ngithub.com/hashicorp/raft.(*raftState).goFunc.func1(0xc82019a000, 0xc82018c550)\r\n\t/tmp/build/src/github.com/hashicorp/raft/state.go:152 +0x44\r\ncreated by github.com/hashicorp/raft.(*raftState).goFunc\r\n\t/tmp/build/src/github.com/hashicorp/raft/state.go:153 +0x4d\r\n\r\ngoroutine 23 [select, 2 minutes]:\r\ngithub.com/hashicorp/raft.(*Raft).runSnapshots(0xc82019a000)\r\n\t/tmp/build/src/github.com/hashicorp/raft/raft.go:1636 +0x493\r\ngithub.com/hashicorp/raft.(*Raft).(github.com/hashicorp/raft.runSnapshots)-fm()\r\n\t/tmp/build/src/github.com/hashicorp/raft/raft.go:254 +0x20\r\ngithub.com/hashicorp/raft.(*raftState).goFunc.func1(0xc82019a000, 0xc82018c560)\r\n\t/tmp/build/src/github.com/hashicorp/raft/state.go:152 +0x44\r\ncreated by github.com/hashicorp/raft.(*raftState).goFunc\r\n\t/tmp/build/src/github.com/hashicorp/raft/state.go:153 +0x4d\r\n\r\ngoroutine 24 [select, 8017 minutes]:\r\ngithub.com/influxdb/influxdb/meta.(*localRaft).logLeaderChanges(0xc820107130)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/meta/state.go:187 +0x4f5\r\ncreated by github.com/influxdb/influxdb/meta.(*localRaft).open\r\n\t/tmp/build/src/github.com/influxdb/influxdb/meta/state.go:177 +0x1344\r\n\r\ngoroutine 25 [chan receive, 8017 minutes]:\r\ngithub.com/influxdb/influxdb/tcp.(*listener).Accept(0xc82010e0b8, 0x0, 0x0, 0x0, 0x0)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f\r\ngithub.com/influxdb/influxdb/meta.(*Store).serveExecListener(0xc820124280)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/meta/store.go:622 +0xa2\r\ncreated by github.com/influxdb/influxdb/meta.(*Store).Open\r\n\t/tmp/build/src/github.com/influxdb/influxdb/meta/store.go:239 +0x364\r\n\r\ngoroutine 26 [chan receive, 8017 minutes]:\r\ngithub.com/influxdb/influxdb/tcp.(*listener).Accept(0xc82010e0c0, 0x0, 0x0, 0x0, 0x0)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tcp/mux.go:129 +0x6f\r\ngithub.com/influxdb/influxdb/meta.(*Store).serveRPCListener(0xc820124280)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/meta/store.go:726 +0xa2\r\ncreated by github.com/influxdb/influxdb/meta.(*Store).Open\r\n\t/tmp/build/src/github.com/influxdb/influxdb/meta/store.go:242 +0x3b6\r\n\r\ngoroutine 30 [select, 2 minutes]:\r\ngithub.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc870602000, 0xc8488c81e0)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567\r\ncreated by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:240 +0x627\r\n\r\ngoroutine 39 [select, 8017 minutes]:\r\ngithub.com/influxdb/influxdb/cmd/influxd/run.(*Server).monitorErrorChan(0xc82011db00, 0xc8201166c0)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:492 +0x145\r\ncreated by github.com/influxdb/influxdb/cmd/influxd/run.(*Server).Open.func1\r\n\t/tmp/build/src/github.com/influxdb/influxdb/cmd/influxd/run/server.go:352 +0xc67\r\n\r\ngoroutine 68 [select]:\r\ngithub.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc86d7ca2a0, 0xc867b8c060)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567\r\ncreated by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:240 +0x627\r\n\r\ngoroutine 16 [select]:\r\ngithub.com/influxdb/influxdb/tsdb/engine/wal.(*Log).autoflusher(0xc8201268c0, 0xc821512660)\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:604 +0x567\r\ncreated by github.com/influxdb/influxdb/tsdb/engine/wal.(*Log).Open\r\n\t/tmp/build/src/github.com/influxdb/influxdb/tsdb/engine/wal/wal.go:240 +0x627\r\n```"},"comment":{"url":"https://api.github.com/repos/influxdb/influxdb/issues/comments/156201400","html_url":"https://github.com/influxdb/influxdb/issues/4655#issuecomment-156201400","issue_url":"https://api.github.com/repos/influxdb/influxdb/issues/4655","id":156201400,"user":{"login":"JulienChampseix","id":3264366,"avatar_url":"https://avatars.githubusercontent.com/u/3264366?v=3","gravatar_id":"","url":"https://api.github.com/users/JulienChampseix","html_url":"https://github.com/JulienChampseix","followers_url":"https://api.github.com/users/JulienChampseix/followers","following_url":"https://api.github.com/users/JulienChampseix/following{/other_user}","gists_url":"https://api.github.com/users/JulienChampseix/gists{/gist_id}","starred_url":"https://api.github.com/users/JulienChampseix/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JulienChampseix/subscriptions","organizations_url":"https://api.github.com/users/JulienChampseix/orgs","repos_url":"https://api.github.com/users/JulienChampseix/repos","events_url":"https://api.github.com/users/JulienChampseix/events{/privacy}","received_events_url":"https://api.github.com/users/JulienChampseix/received_events","type":"User","site_admin":false},"created_at":"2015-11-12T18:57:30Z","updated_at":"2015-11-12T18:57:30Z","body":"@otoolep 1.5.2 released regarding the go issue about it"}}