{"action":"created","issue":{"url":"https://api.github.com/repos/spotify/folsom/issues/47","labels_url":"https://api.github.com/repos/spotify/folsom/issues/47/labels{/name}","comments_url":"https://api.github.com/repos/spotify/folsom/issues/47/comments","events_url":"https://api.github.com/repos/spotify/folsom/issues/47/events","html_url":"https://github.com/spotify/folsom/issues/47","id":65844524,"number":47,"title":"IntegrationTest#testPartitionMultiget is flaky","user":{"login":"danielnorberg","id":393289,"avatar_url":"https://avatars.githubusercontent.com/u/393289?v=3","gravatar_id":"","url":"https://api.github.com/users/danielnorberg","html_url":"https://github.com/danielnorberg","followers_url":"https://api.github.com/users/danielnorberg/followers","following_url":"https://api.github.com/users/danielnorberg/following{/other_user}","gists_url":"https://api.github.com/users/danielnorberg/gists{/gist_id}","starred_url":"https://api.github.com/users/danielnorberg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/danielnorberg/subscriptions","organizations_url":"https://api.github.com/users/danielnorberg/orgs","repos_url":"https://api.github.com/users/danielnorberg/repos","events_url":"https://api.github.com/users/danielnorberg/events{/privacy}","received_events_url":"https://api.github.com/users/danielnorberg/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-04-02T05:44:11Z","updated_at":"2015-04-07T07:31:57Z","closed_at":null,"body":"Seems like jmemcached might be flaky. Most test runs complete successfully but when it fails, the root cause seems to be an `IndexOutOfBoundsException` in jmemcached.\r\n\r\n```\r\n14:37:24.635 [New I/O server worker #1-1] ERROR c.t.j.p.t.MemcachedResponseEncoder - error\r\njava.lang.IndexOutOfBoundsException: null\r\n\tat org.jboss.netty.buffer.SlicedChannelBuffer.checkIndex(SlicedChannelBuffer.java:222) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.buffer.SlicedChannelBuffer.getByte(SlicedChannelBuffer.java:93) ~[netty-3.2.3.Final.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.text.MemcachedCommandDecoder.eol(MemcachedCommandDecoder.java:53) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.text.MemcachedCommandDecoder.decode(MemcachedCommandDecoder.java:68) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:282) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:214) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:274) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:261) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:350) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.processSelectedKeys(NioWorker.java:281) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:201) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:46) [netty-3.2.3.Final.jar:na]\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_40]\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_40]\r\n\tat java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]\r\n14:37:24.638 [New I/O server worker #1-1] ERROR c.t.j.p.t.MemcachedResponseEncoder - error\r\njava.io.IOException: Broken pipe\r\n\tat sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_40]\r\n\tat sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) ~[na:1.8.0_40]\r\n\tat sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) ~[na:1.8.0_40]\r\n\tat sun.nio.ch.IOUtil.write(IOUtil.java:51) ~[na:1.8.0_40]\r\n\tat sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) ~[na:1.8.0_40]\r\n\tat org.jboss.netty.channel.socket.nio.SocketSendBufferPool$PooledSendBuffer.transferTo(SocketSendBufferPool.java:239) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.write0(NioWorker.java:470) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.writeFromUserCode(NioWorker.java:388) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:137) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:76) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.write(Channels.java:611) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.write(Channels.java:578) ~[netty-3.2.3.Final.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.text.MemcachedResponseEncoder.messageReceived(MemcachedResponseEncoder.java:103) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:302) ~[netty-3.2.3.Final.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.MemcachedCommandHandler.handleSet(MemcachedCommandHandler.java:290) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.MemcachedCommandHandler.messageReceived(MemcachedCommandHandler.java:186) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:302) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:317) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:299) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:214) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:274) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:261) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:350) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.processSelectedKeys(NioWorker.java:281) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:201) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:46) [netty-3.2.3.Final.jar:na]\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_40]\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_40]\r\n\tat java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]\r\n14:37:24.639 [New I/O server worker #1-1] ERROR c.t.j.p.t.MemcachedResponseEncoder - error\r\njava.nio.channels.ClosedChannelException: null\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.cleanUpWriteBuffer(NioWorker.java:637) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.writeFromUserCode(NioWorker.java:370) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:137) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:76) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.write(Channels.java:611) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.write(Channels.java:578) ~[netty-3.2.3.Final.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.text.MemcachedResponseEncoder.messageReceived(MemcachedResponseEncoder.java:103) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:302) ~[netty-3.2.3.Final.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.MemcachedCommandHandler.handleSet(MemcachedCommandHandler.java:290) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.MemcachedCommandHandler.messageReceived(MemcachedCommandHandler.java:186) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:302) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:317) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:299) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.cleanup(FrameDecoder.java:333) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.channelDisconnected(FrameDecoder.java:226) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireChannelDisconnected(Channels.java:360) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.close(NioWorker.java:587) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.write0(NioWorker.java:513) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.writeFromUserCode(NioWorker.java:388) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.handleAcceptedSocket(NioServerSocketPipelineSink.java:137) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:76) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.write(Channels.java:611) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.write(Channels.java:578) ~[netty-3.2.3.Final.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.text.MemcachedResponseEncoder.messageReceived(MemcachedResponseEncoder.java:103) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:302) ~[netty-3.2.3.Final.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.MemcachedCommandHandler.handleSet(MemcachedCommandHandler.java:290) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat com.thimbleware.jmemcached.protocol.MemcachedCommandHandler.messageReceived(MemcachedCommandHandler.java:186) ~[jmemcached-core-1.0.0.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:302) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:317) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:299) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:214) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:274) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:261) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:350) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.processSelectedKeys(NioWorker.java:281) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:201) ~[netty-3.2.3.Final.jar:na]\r\n\tat org.jboss.netty.util.internal.IoWorkerRunnable.run(IoWorkerRunnable.java:46) [netty-3.2.3.Final.jar:na]\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_40]\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_40]\r\n\tat java.lang.Thread.run(Thread.java:745) [na:1.8.0_40]\r\n```"},"comment":{"url":"https://api.github.com/repos/spotify/folsom/issues/comments/90421359","html_url":"https://github.com/spotify/folsom/issues/47#issuecomment-90421359","issue_url":"https://api.github.com/repos/spotify/folsom/issues/47","id":90421359,"user":{"login":"spkrka","id":5349266,"avatar_url":"https://avatars.githubusercontent.com/u/5349266?v=3","gravatar_id":"","url":"https://api.github.com/users/spkrka","html_url":"https://github.com/spkrka","followers_url":"https://api.github.com/users/spkrka/followers","following_url":"https://api.github.com/users/spkrka/following{/other_user}","gists_url":"https://api.github.com/users/spkrka/gists{/gist_id}","starred_url":"https://api.github.com/users/spkrka/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/spkrka/subscriptions","organizations_url":"https://api.github.com/users/spkrka/orgs","repos_url":"https://api.github.com/users/spkrka/repos","events_url":"https://api.github.com/users/spkrka/events{/privacy}","received_events_url":"https://api.github.com/users/spkrka/received_events","type":"User","site_admin":false},"created_at":"2015-04-07T07:31:57Z","updated_at":"2015-04-07T07:31:57Z","body":"Can we consider this fixed now with the monkey patch in place?\r\nI also exported jmemcached here: https://github.com/krka/jmemcache-daemon/ - maybe can clean up the monkey patch at least by changing the package names and making a release."}}