{"action":"created","issue":{"url":"https://api.github.com/repos/sul-dlss/argo/issues/250","labels_url":"https://api.github.com/repos/sul-dlss/argo/issues/250/labels{/name}","comments_url":"https://api.github.com/repos/sul-dlss/argo/issues/250/comments","events_url":"https://api.github.com/repos/sul-dlss/argo/issues/250/events","html_url":"https://github.com/sul-dlss/argo/issues/250","id":118449680,"number":250,"title":"Analysis of profiling data","user":{"login":"mejackreed","id":1656824,"avatar_url":"https://avatars.githubusercontent.com/u/1656824?v=3","gravatar_id":"","url":"https://api.github.com/users/mejackreed","html_url":"https://github.com/mejackreed","followers_url":"https://api.github.com/users/mejackreed/followers","following_url":"https://api.github.com/users/mejackreed/following{/other_user}","gists_url":"https://api.github.com/users/mejackreed/gists{/gist_id}","starred_url":"https://api.github.com/users/mejackreed/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mejackreed/subscriptions","organizations_url":"https://api.github.com/users/mejackreed/orgs","repos_url":"https://api.github.com/users/mejackreed/repos","events_url":"https://api.github.com/users/mejackreed/events{/privacy}","received_events_url":"https://api.github.com/users/mejackreed/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"drh-stanford","id":1861171,"avatar_url":"https://avatars.githubusercontent.com/u/1861171?v=3","gravatar_id":"","url":"https://api.github.com/users/drh-stanford","html_url":"https://github.com/drh-stanford","followers_url":"https://api.github.com/users/drh-stanford/followers","following_url":"https://api.github.com/users/drh-stanford/following{/other_user}","gists_url":"https://api.github.com/users/drh-stanford/gists{/gist_id}","starred_url":"https://api.github.com/users/drh-stanford/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/drh-stanford/subscriptions","organizations_url":"https://api.github.com/users/drh-stanford/orgs","repos_url":"https://api.github.com/users/drh-stanford/repos","events_url":"https://api.github.com/users/drh-stanford/events{/privacy}","received_events_url":"https://api.github.com/users/drh-stanford/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/sul-dlss/argo/milestones/5","html_url":"https://github.com/sul-dlss/argo/milestones/Sprint%204","labels_url":"https://api.github.com/repos/sul-dlss/argo/milestones/5/labels","id":1425816,"number":5,"title":"Sprint 4","description":"","creator":{"login":"mejackreed","id":1656824,"avatar_url":"https://avatars.githubusercontent.com/u/1656824?v=3","gravatar_id":"","url":"https://api.github.com/users/mejackreed","html_url":"https://github.com/mejackreed","followers_url":"https://api.github.com/users/mejackreed/followers","following_url":"https://api.github.com/users/mejackreed/following{/other_user}","gists_url":"https://api.github.com/users/mejackreed/gists{/gist_id}","starred_url":"https://api.github.com/users/mejackreed/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mejackreed/subscriptions","organizations_url":"https://api.github.com/users/mejackreed/orgs","repos_url":"https://api.github.com/users/mejackreed/repos","events_url":"https://api.github.com/users/mejackreed/events{/privacy}","received_events_url":"https://api.github.com/users/mejackreed/received_events","type":"User","site_admin":false},"open_issues":15,"closed_issues":9,"state":"open","created_at":"2015-11-23T18:58:52Z","updated_at":"2015-11-25T21:01:31Z","due_on":"2015-12-07T05:00:00Z","closed_at":null},"comments":24,"created_at":"2015-11-23T19:09:33Z","updated_at":"2015-11-26T02:01:11Z","closed_at":null,"body":""},"comment":{"url":"https://api.github.com/repos/sul-dlss/argo/issues/comments/159780114","html_url":"https://github.com/sul-dlss/argo/issues/250#issuecomment-159780114","issue_url":"https://api.github.com/repos/sul-dlss/argo/issues/250","id":159780114,"user":{"login":"jmartin-sul","id":7741604,"avatar_url":"https://avatars.githubusercontent.com/u/7741604?v=3","gravatar_id":"","url":"https://api.github.com/users/jmartin-sul","html_url":"https://github.com/jmartin-sul","followers_url":"https://api.github.com/users/jmartin-sul/followers","following_url":"https://api.github.com/users/jmartin-sul/following{/other_user}","gists_url":"https://api.github.com/users/jmartin-sul/gists{/gist_id}","starred_url":"https://api.github.com/users/jmartin-sul/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jmartin-sul/subscriptions","organizations_url":"https://api.github.com/users/jmartin-sul/orgs","repos_url":"https://api.github.com/users/jmartin-sul/repos","events_url":"https://api.github.com/users/jmartin-sul/events{/privacy}","received_events_url":"https://api.github.com/users/jmartin-sul/received_events","type":"User","site_admin":false},"created_at":"2015-11-26T02:01:11Z","updated_at":"2015-11-26T02:01:11Z","body":"@drh-stanford (and a bit later @mejackreed) also noticed that argo-prod-b and argo-stage-b have the same resource allocation as argo-dev (8 CPU/4 GB, vs. 12 CPU/16 GB for real prod).  @drh-stanford filed a SAR ticket to get argo-stage-b and argo-prod-b the same resource allocation as argo-prod.\r\n\r\nthe resource allocation might help explain the ridiculous increase in indexing time when testing was first done back in may (5 weeks, vs. last september's full reindexing in 2.5ish days).   i guess some of us assumed that a \"clone\" of production would be a clone in resource allocation also (i didn't even think to ask about that).  but i can see how if someone thought the setup was just for initial functional testing of the schema against good fedora data, it'd make a lot of sense to not waste a bunch of excess resources on it.  so... i'm pretty excited to see what indexing on argo-stage-b and argo-prod-b look like with argo-prod levels of memory and processor allocation.  we've indexed just over 5000 objects in the last 2 hrs, so if we round down to 2500/hr, that's 300 hrs to do 750k objects, which means 12.5 days to do all of dor-prod (and that's with the computing resources of argo-dev).  that was the same rate i estimated an hr ago, which makes me optimistic about it staying consistent.  and it does seem plausible to me that the delayed job approach could better than halve the time for a full reindex, since it doesn't do the whole roundabout (and even more fragile) thing of giving pid lists to karaf, so that karaf can queue requests to the /dor/reindex URL on argo.\r\n\r\nas a side note, i think it's as funny as it is frustrating that we might've been worried about a performance problem that was a result of our investigating a performance problem that we might've just been able to chalk up to mismatched expectations re: how much computing power a VM should've had."}}