{"action":"created","issue":{"url":"https://api.github.com/repos/chrislusf/weed-fs/issues/93","labels_url":"https://api.github.com/repos/chrislusf/weed-fs/issues/93/labels{/name}","comments_url":"https://api.github.com/repos/chrislusf/weed-fs/issues/93/comments","events_url":"https://api.github.com/repos/chrislusf/weed-fs/issues/93/events","html_url":"https://github.com/chrislusf/weed-fs/issues/93","id":59613948,"number":93,"title":"Lots of \"volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\" errors in our production server log files","user":{"login":"yourchanges","id":492946,"avatar_url":"https://avatars.githubusercontent.com/u/492946?v=3","gravatar_id":"","url":"https://api.github.com/users/yourchanges","html_url":"https://github.com/yourchanges","followers_url":"https://api.github.com/users/yourchanges/followers","following_url":"https://api.github.com/users/yourchanges/following{/other_user}","gists_url":"https://api.github.com/users/yourchanges/gists{/gist_id}","starred_url":"https://api.github.com/users/yourchanges/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yourchanges/subscriptions","organizations_url":"https://api.github.com/users/yourchanges/orgs","repos_url":"https://api.github.com/users/yourchanges/repos","events_url":"https://api.github.com/users/yourchanges/events{/privacy}","received_events_url":"https://api.github.com/users/yourchanges/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-03-03T09:11:19Z","updated_at":"2015-03-04T16:44:43Z","closed_at":null,"body":"Here is the\r\n\r\n### Deploy structure\r\n\r\n    10.252.130.159:9333(master)         10.252.130.159:5088(haproxy)\r\n                                       /                                      \\ \r\n                        10.252.133.22:5083 (volume1)               10.252.135.207:5084(volume2)  \r\n\r\n    Replication Stratage: 001\r\n\r\nSo, it always gets the content via haproxy from the volume server.\r\n\r\nBut after running few days, we get a 404 error sometimes from the 10.252.130.159:5088 for a special fid such as :5,1001e1b02c1b01.\r\n\r\nAnd we did a check and found that one of volume server(different fid on the random different server) always output the following logs:\r\n\r\n    I0303 15:44:23 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n    I0303 15:45:14 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n    I0303 15:52:52 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n    I0303 15:52:52 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n    I0303 15:53:05 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n    I0303 15:53:06 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n    I0303 15:53:07 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n    I0303 15:53:07 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n    I0303 15:53:18 21828 volume_server_handlers.go:75] read error: <nil> /5,1001e1b02c1b01\r\n\r\nIt means that the file for [fid:5,1001e1b02c1b01] has be damaged?\r\n\r\nAnd how to fix this?\r\n\r\nHow could be happened? any suggestions?\r\n"},"comment":{"url":"https://api.github.com/repos/chrislusf/weed-fs/issues/comments/77194570","html_url":"https://github.com/chrislusf/weed-fs/issues/93#issuecomment-77194570","issue_url":"https://api.github.com/repos/chrislusf/weed-fs/issues/93","id":77194570,"user":{"login":"chrislusf","id":1543151,"avatar_url":"https://avatars.githubusercontent.com/u/1543151?v=3","gravatar_id":"","url":"https://api.github.com/users/chrislusf","html_url":"https://github.com/chrislusf","followers_url":"https://api.github.com/users/chrislusf/followers","following_url":"https://api.github.com/users/chrislusf/following{/other_user}","gists_url":"https://api.github.com/users/chrislusf/gists{/gist_id}","starred_url":"https://api.github.com/users/chrislusf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chrislusf/subscriptions","organizations_url":"https://api.github.com/users/chrislusf/orgs","repos_url":"https://api.github.com/users/chrislusf/repos","events_url":"https://api.github.com/users/chrislusf/events{/privacy}","received_events_url":"https://api.github.com/users/chrislusf/received_events","type":"User","site_admin":false},"created_at":"2015-03-04T16:44:43Z","updated_at":"2015-03-04T16:44:43Z","body":"Is it possible to share the 5.dat file?"}}