{"action":"created","issue":{"url":"https://api.github.com/repos/zfsonlinux/zfs/issues/3114","labels_url":"https://api.github.com/repos/zfsonlinux/zfs/issues/3114/labels{/name}","comments_url":"https://api.github.com/repos/zfsonlinux/zfs/issues/3114/comments","events_url":"https://api.github.com/repos/zfsonlinux/zfs/issues/3114/events","html_url":"https://github.com/zfsonlinux/zfs/issues/3114","id":57968344,"number":3114,"title":"Broken L2ARC space accounting: 16.0E cache device","user":{"login":"jflandry","id":11034767,"avatar_url":"https://avatars.githubusercontent.com/u/11034767?v=3","gravatar_id":"","url":"https://api.github.com/users/jflandry","html_url":"https://github.com/jflandry","followers_url":"https://api.github.com/users/jflandry/followers","following_url":"https://api.github.com/users/jflandry/following{/other_user}","gists_url":"https://api.github.com/users/jflandry/gists{/gist_id}","starred_url":"https://api.github.com/users/jflandry/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jflandry/subscriptions","organizations_url":"https://api.github.com/users/jflandry/orgs","repos_url":"https://api.github.com/users/jflandry/repos","events_url":"https://api.github.com/users/jflandry/events{/privacy}","received_events_url":"https://api.github.com/users/jflandry/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/zfsonlinux/zfs/labels/Bug%20-%20Minor","name":"Bug - Minor","color":"e11d21"},{"url":"https://api.github.com/repos/zfsonlinux/zfs/labels/Difficulty%20-%20Medium","name":"Difficulty - Medium","color":"207de5"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2015-02-17T19:18:01Z","updated_at":"2015-06-26T22:45:03Z","closed_at":"2015-06-25T16:25:58Z","body":"I'm having an issue with some NFS servers, after the cache device fills up the reported size jumps up to 16 Exabytes. If the cache device is removed and re-added the correct size is shown.\r\n\r\n```\r\nlogs                                                 -      -      -      -      -      -\r\n  scsi-SATA_Crucial_CT240M5_1347095ABE09-part4    140K   160G      0      0    276    106\r\ncache                                                -      -      -      -      -      -\r\n  scsi-SATA_Crucial_CT240M5_1347095ABE0D-part4   2.41T   16.0E      0      9     28   237K\r\n-----------------------------------------------  -----  -----  -----  -----  -----  -----\r\n```\r\n\r\nRunning on 2.6.32-431.23.3.el6.x86_64 , spl-0.6.3-53_ga3c1eb7 , zfs-0.6.3-163_g9063f65\r\n\r\nThese have 90 drives hanging off two Supermicro JBODs, 2x Xeon E5-2620, 64GB ram, exporting nfs on IPoIB on QDR Mellanox InfiniBand.\r\n\r\nFor what it's worth we also have  a couple of OpenVZ hosts with zfs and cache devices on partitions or whole SSDs, only the nfs servers get weird 16E cache devices, but they do get hammered a lot more.\r\n\r\nI have found some references from the zfs-discuss and just this morning OmniOS-discuss mailing lists, there seems to be an issue with the upstream ZFS code, the problem is also present on FreeNAS.\r\n\r\nHere are the mailing list posts:\r\n\r\nhttps://groups.google.com/a/zfsonlinux.org/forum/#!topic/zfs-discuss/aMwHZrZa5J4/discussion\r\nhttps://www.mail-archive.com/omnios-discuss@lists.omniti.com/msg03820.html\r\n\r\nAnd a FreeNAS bug report and fix:\r\n\r\nhttps://bugs.freenas.org/issues/6239\r\nhttps://bugs.freenas.org/projects/freenas/repository/trueos/revisions/6ec48ebf5a1596ec7d2732e891fce3f116105ae5/diff/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c\r\n\r\nOne of the NFS servers is for internal use, I could easily test a patch if needed."},"comment":{"url":"https://api.github.com/repos/zfsonlinux/zfs/issues/comments/115910459","html_url":"https://github.com/zfsonlinux/zfs/issues/3114#issuecomment-115910459","issue_url":"https://api.github.com/repos/zfsonlinux/zfs/issues/3114","id":115910459,"user":{"login":"odoucet","id":199838,"avatar_url":"https://avatars.githubusercontent.com/u/199838?v=3","gravatar_id":"","url":"https://api.github.com/users/odoucet","html_url":"https://github.com/odoucet","followers_url":"https://api.github.com/users/odoucet/followers","following_url":"https://api.github.com/users/odoucet/following{/other_user}","gists_url":"https://api.github.com/users/odoucet/gists{/gist_id}","starred_url":"https://api.github.com/users/odoucet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/odoucet/subscriptions","organizations_url":"https://api.github.com/users/odoucet/orgs","repos_url":"https://api.github.com/users/odoucet/repos","events_url":"https://api.github.com/users/odoucet/events{/privacy}","received_events_url":"https://api.github.com/users/odoucet/received_events","type":"User","site_admin":false},"created_at":"2015-06-26T22:45:03Z","updated_at":"2015-06-26T22:45:03Z","body":"These two fixes were not merged in 0.6.4.2 ; was it expected ?"}}