{"action":"created","issue":{"url":"https://api.github.com/repos/dmwm/WMCore/issues/6297","labels_url":"https://api.github.com/repos/dmwm/WMCore/issues/6297/labels{/name}","comments_url":"https://api.github.com/repos/dmwm/WMCore/issues/6297/comments","events_url":"https://api.github.com/repos/dmwm/WMCore/issues/6297/events","html_url":"https://github.com/dmwm/WMCore/pull/6297","id":109197791,"number":6297,"title":"do the phedex file injection in chunks","user":{"login":"hufnagel","id":1798355,"avatar_url":"https://avatars.githubusercontent.com/u/1798355?v=3","gravatar_id":"","url":"https://api.github.com/users/hufnagel","html_url":"https://github.com/hufnagel","followers_url":"https://api.github.com/users/hufnagel/followers","following_url":"https://api.github.com/users/hufnagel/following{/other_user}","gists_url":"https://api.github.com/users/hufnagel/gists{/gist_id}","starred_url":"https://api.github.com/users/hufnagel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hufnagel/subscriptions","organizations_url":"https://api.github.com/users/hufnagel/orgs","repos_url":"https://api.github.com/users/hufnagel/repos","events_url":"https://api.github.com/users/hufnagel/events{/privacy}","received_events_url":"https://api.github.com/users/hufnagel/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2015-09-30T23:00:23Z","updated_at":"2015-10-09T11:44:13Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/dmwm/WMCore/pulls/6297","html_url":"https://github.com/dmwm/WMCore/pull/6297","diff_url":"https://github.com/dmwm/WMCore/pull/6297.diff","patch_url":"https://github.com/dmwm/WMCore/pull/6297.patch"},"body":"Tier0 had a huge backlog of 150k uninjected files, which the PhEDExInjector tried to inject in a single data service call. Obviously that didn't succeed. Broke this up into chunks. Limits are 20 datasets, 50 blocks or 5000 files. Whenever we go over this (in units of all files for a dataset), we inject."},"comment":{"url":"https://api.github.com/repos/dmwm/WMCore/issues/comments/146840956","html_url":"https://github.com/dmwm/WMCore/pull/6297#issuecomment-146840956","issue_url":"https://api.github.com/repos/dmwm/WMCore/issues/6297","id":146840956,"user":{"login":"DMWMBot","id":1124170,"avatar_url":"https://avatars.githubusercontent.com/u/1124170?v=3","gravatar_id":"","url":"https://api.github.com/users/DMWMBot","html_url":"https://github.com/DMWMBot","followers_url":"https://api.github.com/users/DMWMBot/followers","following_url":"https://api.github.com/users/DMWMBot/following{/other_user}","gists_url":"https://api.github.com/users/DMWMBot/gists{/gist_id}","starred_url":"https://api.github.com/users/DMWMBot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/DMWMBot/subscriptions","organizations_url":"https://api.github.com/users/DMWMBot/orgs","repos_url":"https://api.github.com/users/DMWMBot/repos","events_url":"https://api.github.com/users/DMWMBot/events{/privacy}","received_events_url":"https://api.github.com/users/DMWMBot/received_events","type":"User","site_admin":false},"created_at":"2015-10-09T11:44:13Z","updated_at":"2015-10-09T11:44:13Z","body":"Summary of pylint changes for pull request 6297:\n* Score for src/python/WMComponent/PhEDExInjector/PhEDExInjectorPoller.py changed from 9.27 to 9.30 with 0 (15) total errors (warnings)\n\nsrc/python/WMComponent/PhEDExInjector/PhEDExInjectorPoller.py got worse in pylint. Report follows:\n* Line 34 in PhEDExInjectorPoller R0902 Too many instance attributes (12/7)\n* Line 94 in PhEDExInjectorPoller.setup W1201 Specify string format arguments as logging function parameters\n* Line 132 in PhEDExInjectorPoller.createRecoveryFileFormat R0201 Method could be a function\n* Line 169 in PhEDExInjectorPoller.injectFiles W0612 Unused variable 'myThread'\n* Line 163 in PhEDExInjectorPoller.injectFiles R0912 Too many branches (15/12)\n* Line 270 in PhEDExInjectorPoller.injectFilesPhEDExCall W1201 Specify string format arguments as logging function parameters\n* Line 273 in PhEDExInjectorPoller.injectFilesPhEDExCall W1201 Specify string format arguments as logging function parameters\n* Line 327 in PhEDExInjectorPoller.closeBlocks W1201 Specify string format arguments as logging function parameters\n* Line 334 in PhEDExInjectorPoller.closeBlocks W1201 Specify string format arguments as logging function parameters\n* Line 335 in PhEDExInjectorPoller.closeBlocks W1201 Specify string format arguments as logging function parameters\n* Line 341 in PhEDExInjectorPoller.closeBlocks W1201 Specify string format arguments as logging function parameters\n* Line 349 in PhEDExInjectorPoller.closeBlocks W1201 Specify string format arguments as logging function parameters\n* Line 355 in PhEDExInjectorPoller.closeBlocks W1201 Specify string format arguments as logging function parameters\n* Line 289 in PhEDExInjectorPoller.closeBlocks R0912 Too many branches (14/12)\n* Line 392 in PhEDExInjectorPoller.recoverInjectedFiles W1201 Specify string format arguments as logging function parameters\n* Line 86 in PhEDExInjectorPoller.setup W0201 Attribute 'setStatus' defined outside __init__\n* Line 87 in PhEDExInjectorPoller.setup W0201 Attribute 'setBlockClosed' defined outside __init__\n* Line 80 in PhEDExInjectorPoller.setup W0201 Attribute 'getUninjected' defined outside __init__\n* Line 81 in PhEDExInjectorPoller.setup W0201 Attribute 'getMigrated' defined outside __init__\n* plus 35 comments on code style\n"}}