{"action":"created","issue":{"url":"https://api.github.com/repos/dmwm/CRABServer/issues/4658","labels_url":"https://api.github.com/repos/dmwm/CRABServer/issues/4658/labels{/name}","comments_url":"https://api.github.com/repos/dmwm/CRABServer/issues/4658/comments","events_url":"https://api.github.com/repos/dmwm/CRABServer/issues/4658/events","html_url":"https://github.com/dmwm/CRABServer/issues/4658","id":56826211,"number":4658,"title":"Additions to the monitor for CSP shifters","user":{"login":"mmascher","id":1586246,"avatar_url":"https://avatars.githubusercontent.com/u/1586246?v=3","gravatar_id":"","url":"https://api.github.com/users/mmascher","html_url":"https://github.com/mmascher","followers_url":"https://api.github.com/users/mmascher/followers","following_url":"https://api.github.com/users/mmascher/following{/other_user}","gists_url":"https://api.github.com/users/mmascher/gists{/gist_id}","starred_url":"https://api.github.com/users/mmascher/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mmascher/subscriptions","organizations_url":"https://api.github.com/users/mmascher/orgs","repos_url":"https://api.github.com/users/mmascher/repos","events_url":"https://api.github.com/users/mmascher/events{/privacy}","received_events_url":"https://api.github.com/users/mmascher/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/dmwm/CRABServer/labels/Support","name":"Support","color":"5319e7"}],"state":"open","locked":false,"assignee":{"login":"jmarra13","id":8515981,"avatar_url":"https://avatars.githubusercontent.com/u/8515981?v=3","gravatar_id":"","url":"https://api.github.com/users/jmarra13","html_url":"https://github.com/jmarra13","followers_url":"https://api.github.com/users/jmarra13/followers","following_url":"https://api.github.com/users/jmarra13/following{/other_user}","gists_url":"https://api.github.com/users/jmarra13/gists{/gist_id}","starred_url":"https://api.github.com/users/jmarra13/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jmarra13/subscriptions","organizations_url":"https://api.github.com/users/jmarra13/orgs","repos_url":"https://api.github.com/users/jmarra13/repos","events_url":"https://api.github.com/users/jmarra13/events{/privacy}","received_events_url":"https://api.github.com/users/jmarra13/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/dmwm/CRABServer/milestones/71","html_url":"https://github.com/dmwm/CRABServer/milestones/CRAB3%20May%202015","labels_url":"https://api.github.com/repos/dmwm/CRABServer/milestones/71/labels","id":1044712,"number":71,"title":"CRAB3 May 2015","description":"","creator":{"login":"mmascher","id":1586246,"avatar_url":"https://avatars.githubusercontent.com/u/1586246?v=3","gravatar_id":"","url":"https://api.github.com/users/mmascher","html_url":"https://github.com/mmascher","followers_url":"https://api.github.com/users/mmascher/followers","following_url":"https://api.github.com/users/mmascher/following{/other_user}","gists_url":"https://api.github.com/users/mmascher/gists{/gist_id}","starred_url":"https://api.github.com/users/mmascher/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mmascher/subscriptions","organizations_url":"https://api.github.com/users/mmascher/orgs","repos_url":"https://api.github.com/users/mmascher/repos","events_url":"https://api.github.com/users/mmascher/events{/privacy}","received_events_url":"https://api.github.com/users/mmascher/received_events","type":"User","site_admin":false},"open_issues":8,"closed_issues":27,"state":"open","created_at":"2015-03-30T13:21:52Z","updated_at":"2015-05-06T07:34:08Z","due_on":null,"closed_at":null},"comments":34,"created_at":"2015-02-06T15:32:46Z","updated_at":"2015-05-08T13:40:16Z","closed_at":null,"body":"Before we lost them, here there are some ideas Jadir can look into for the kibana monitor page\r\n\r\n1) # of idle old jobs per site: See https://hypernews.cern.ch/HyperNews/CMS/get/crabDevelopment/2262/1.html\r\nWe can query each CRAB3 schedd and filter on (1) Payload jobs with time()-QDate > 86400 and (2) JobStatus == 1\r\nThen, look at DESIRED_Sites and increase the count for each possible site.\r\nThis way we can spot jobs that are idle at a site for a long time.\r\n\r\n2) # of task per state in the CRABServer oracle database.\r\nWe can implement an API in the server that returns something like \"SELECT count(*), tm_task_status from TASKS group by tm_task_status\". That way we can spot tasks that either gets stuck in a state (HOLDING/NEW/QUEUED), or overloads of the taskworker that cannot keep up with the submission load.\r\n\r\nFor reference, here is the current kibana page: https://meter.cern.ch/public/_plugin/kibana/#/dashboard/temp/97o-BAAkSPaJq8QA-no2HA"},"comment":{"url":"https://api.github.com/repos/dmwm/CRABServer/issues/comments/100236958","html_url":"https://github.com/dmwm/CRABServer/issues/4658#issuecomment-100236958","issue_url":"https://api.github.com/repos/dmwm/CRABServer/issues/4658","id":100236958,"user":{"login":"belforte","id":1837785,"avatar_url":"https://avatars.githubusercontent.com/u/1837785?v=3","gravatar_id":"","url":"https://api.github.com/users/belforte","html_url":"https://github.com/belforte","followers_url":"https://api.github.com/users/belforte/followers","following_url":"https://api.github.com/users/belforte/following{/other_user}","gists_url":"https://api.github.com/users/belforte/gists{/gist_id}","starred_url":"https://api.github.com/users/belforte/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/belforte/subscriptions","organizations_url":"https://api.github.com/users/belforte/orgs","repos_url":"https://api.github.com/users/belforte/repos","events_url":"https://api.github.com/users/belforte/events{/privacy}","received_events_url":"https://api.github.com/users/belforte/received_events","type":"User","site_admin":false},"created_at":"2015-05-08T13:40:16Z","updated_at":"2015-05-08T13:40:16Z","body":"I really like 3. the way it is now. When Jadir adds a plot with #tasks in a given\nstatus, rather then rate of change, we can try linear and log scale and see how\nit looks.\n\n"}}