{"action":"created","issue":{"url":"https://api.github.com/repos/swcarpentry/good-enough-practices-in-scientific-computing/issues/24","labels_url":"https://api.github.com/repos/swcarpentry/good-enough-practices-in-scientific-computing/issues/24/labels{/name}","comments_url":"https://api.github.com/repos/swcarpentry/good-enough-practices-in-scientific-computing/issues/24/comments","events_url":"https://api.github.com/repos/swcarpentry/good-enough-practices-in-scientific-computing/issues/24/events","html_url":"https://github.com/swcarpentry/good-enough-practices-in-scientific-computing/issues/24","id":117440262,"number":24,"title":"Number of files","user":{"login":"mboisson","id":7515242,"avatar_url":"https://avatars.githubusercontent.com/u/7515242?v=3","gravatar_id":"","url":"https://api.github.com/users/mboisson","html_url":"https://github.com/mboisson","followers_url":"https://api.github.com/users/mboisson/followers","following_url":"https://api.github.com/users/mboisson/following{/other_user}","gists_url":"https://api.github.com/users/mboisson/gists{/gist_id}","starred_url":"https://api.github.com/users/mboisson/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mboisson/subscriptions","organizations_url":"https://api.github.com/users/mboisson/orgs","repos_url":"https://api.github.com/users/mboisson/repos","events_url":"https://api.github.com/users/mboisson/events{/privacy}","received_events_url":"https://api.github.com/users/mboisson/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-11-17T20:14:44Z","updated_at":"2015-11-19T08:51:59Z","closed_at":null,"body":"- If you have tens of thousands of files (or more), you are probably doing it wrong. Look for archiving those files in chunks, or combining them in some way.\r\n\r\nOn a cluster, having tens of thousands of files will be a killer, but even on a personnal computer, it will make your data management a nightmare.\r\nI have seen users who think that having 2.5M files in a directory is \"ok\"...\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/swcarpentry/good-enough-practices-in-scientific-computing/issues/comments/157992365","html_url":"https://github.com/swcarpentry/good-enough-practices-in-scientific-computing/issues/24#issuecomment-157992365","issue_url":"https://api.github.com/repos/swcarpentry/good-enough-practices-in-scientific-computing/issues/24","id":157992365,"user":{"login":"gvwilson","id":911566,"avatar_url":"https://avatars.githubusercontent.com/u/911566?v=3","gravatar_id":"","url":"https://api.github.com/users/gvwilson","html_url":"https://github.com/gvwilson","followers_url":"https://api.github.com/users/gvwilson/followers","following_url":"https://api.github.com/users/gvwilson/following{/other_user}","gists_url":"https://api.github.com/users/gvwilson/gists{/gist_id}","starred_url":"https://api.github.com/users/gvwilson/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gvwilson/subscriptions","organizations_url":"https://api.github.com/users/gvwilson/orgs","repos_url":"https://api.github.com/users/gvwilson/repos","events_url":"https://api.github.com/users/gvwilson/events{/privacy}","received_events_url":"https://api.github.com/users/gvwilson/received_events","type":"User","site_admin":false},"created_at":"2015-11-19T08:51:59Z","updated_at":"2015-11-19T08:51:59Z","body":"Karin Lagesen replies:\r\n\r\n~~~\r\nMore importantly, it is quite likely to kill any backup systems that you have running. \r\n~~~"}}