{"action":"created","issue":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/3407","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/3407/labels{/name}","comments_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/3407/comments","events_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/3407/events","html_url":"https://github.com/cockroachdb/cockroach/issues/3407","id":121773716,"number":3407,"title":"Test failure in CI build 10091","user":{"login":"tschottdorf","id":5076964,"avatar_url":"https://avatars.githubusercontent.com/u/5076964?v=3","gravatar_id":"","url":"https://api.github.com/users/tschottdorf","html_url":"https://github.com/tschottdorf","followers_url":"https://api.github.com/users/tschottdorf/followers","following_url":"https://api.github.com/users/tschottdorf/following{/other_user}","gists_url":"https://api.github.com/users/tschottdorf/gists{/gist_id}","starred_url":"https://api.github.com/users/tschottdorf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tschottdorf/subscriptions","organizations_url":"https://api.github.com/users/tschottdorf/orgs","repos_url":"https://api.github.com/users/tschottdorf/repos","events_url":"https://api.github.com/users/tschottdorf/events{/privacy}","received_events_url":"https://api.github.com/users/tschottdorf/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/cockroachdb/cockroach/labels/test-failure","name":"test-failure","color":"fbca04"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-12-11T19:15:58Z","updated_at":"2015-12-13T11:23:45Z","closed_at":"2015-12-13T11:23:45Z","body":"The following test appears to have failed:\n\n[#10091](https://circleci.com/gh/cockroachdb/cockroach/10091):\n\n```\nE1211 19:15:33.470184 1087 storage/replica.go:968  error executing raft command: replica corruption (processed=true): storage/replica.go:987: applied index moved backwards: 28 >= 28\nW1211 19:15:33.470260 1087 multiraft/multiraft.go:1233  aborting configuration change: replica corruption (processed=true): storage/replica.go:987: applied index moved backwards: 28 >= 27\nW1211 19:15:33.470306 1087 multiraft/multiraft.go:1233  aborting configuration change: replica corruption (processed=true): storage/replica.go:987: applied index moved backwards: 28 >= 28\nI1211 19:15:33.587620 1087 multiraft/multiraft.go:849  node 3: got message for group 1 with newer replica ID (12 vs 11), recreating group\nE1211 19:15:33.587957 1087 raft/log.go:205  [group 1] applied(28) is out of range [prevApplied(0), committed(0)]\npanic: [group 1] applied(28) is out of range [prevApplied(0), committed(0)]\n\ngoroutine 6101 [running]:\ngithub.com/cockroachdb/cockroach/multiraft.(*raftLogger).Panicf(0xc8202c8df0, 0x158a960, 0x3c, 0xc8203db080, 0x3, 0x3)\n\t/go/src/github.com/cockroachdb/cockroach/multiraft/raft.go:121 +0x1a2\ngithub.com/coreos/etcd/raft.(*raftLog).appliedTo(0xc8203bcaf0, 0x1c)\n\t/go/src/github.com/coreos/etcd/raft/log.go:205 +0x1f7\ngithub.com/coreos/etcd/raft.newRaft(0xc8204651a0, 0x597f92)\n\t/go/src/github.com/coreos/etcd/raft/raft.go:224 +0x939\ngithub.com/coreos/etcd/raft.NewRawNode(0xc8204651a0, 0x0, 0x0, 0x0, 0xc8205df960, 0x0, 0x0)\n\t/go/src/github.com/coreos/etcd/raft/rawnode.go:76 +0xba\n--\n\t/go/src/github.com/cockroachdb/cockroach/storage/queue.go:287 +0x329\ngithub.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc8202184e0, 0xc8202e6540)\n\t/go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:88 +0x52\ncreated by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:89 +0x62\nFAIL\tgithub.com/cockroachdb/cockroach/storage\t11.340s\n=== RUN   TestBatchBasics\nI1211 19:15:18.032638 1066 storage/engine/rocksdb.go:138  closing in-memory rocksdb instance\n--- PASS: TestBatchBasics (0.00s)\n=== RUN   TestBatchGet\nI1211 19:15:18.033643 1066 storage/engine/rocksdb.go:138  closing in-memory rocksdb instance\n--- PASS: TestBatchGet (0.00s)\n=== RUN   TestBatchMerge\nI1211 19:15:18.036443 1066 storage/engine/rocksdb.go:138  closing in-memory rocksdb instance\n--- PASS: TestBatchMerge (0.00s)\n=== RUN   TestBatchProto\n\n```\nPlease assign, take a look and update the issue accordingly."},"comment":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/comments/164248459","html_url":"https://github.com/cockroachdb/cockroach/issues/3407#issuecomment-164248459","issue_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/3407","id":164248459,"user":{"login":"tschottdorf","id":5076964,"avatar_url":"https://avatars.githubusercontent.com/u/5076964?v=3","gravatar_id":"","url":"https://api.github.com/users/tschottdorf","html_url":"https://github.com/tschottdorf","followers_url":"https://api.github.com/users/tschottdorf/followers","following_url":"https://api.github.com/users/tschottdorf/following{/other_user}","gists_url":"https://api.github.com/users/tschottdorf/gists{/gist_id}","starred_url":"https://api.github.com/users/tschottdorf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tschottdorf/subscriptions","organizations_url":"https://api.github.com/users/tschottdorf/orgs","repos_url":"https://api.github.com/users/tschottdorf/repos","events_url":"https://api.github.com/users/tschottdorf/events{/privacy}","received_events_url":"https://api.github.com/users/tschottdorf/received_events","type":"User","site_admin":false},"created_at":"2015-12-13T11:23:45Z","updated_at":"2015-12-13T11:23:45Z","body":"#3297"}}