{"action":"created","issue":{"url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/issues/141","labels_url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/issues/141/labels{/name}","comments_url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/issues/141/comments","events_url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/issues/141/events","html_url":"https://github.com/TYPO3-Solr/ext-solr/issues/141","id":118761580,"number":141,"title":"Evaluate use of curl_multi_getcontent() to index pages","user":{"login":"irnnr","id":320915,"avatar_url":"https://avatars.githubusercontent.com/u/320915?v=3","gravatar_id":"","url":"https://api.github.com/users/irnnr","html_url":"https://github.com/irnnr","followers_url":"https://api.github.com/users/irnnr/followers","following_url":"https://api.github.com/users/irnnr/following{/other_user}","gists_url":"https://api.github.com/users/irnnr/gists{/gist_id}","starred_url":"https://api.github.com/users/irnnr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/irnnr/subscriptions","organizations_url":"https://api.github.com/users/irnnr/orgs","repos_url":"https://api.github.com/users/irnnr/repos","events_url":"https://api.github.com/users/irnnr/events{/privacy}","received_events_url":"https://api.github.com/users/irnnr/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/labels/enhancement","name":"enhancement","color":"84b6eb"},{"url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/labels/needs%20feedback","name":"needs feedback","color":"eb6420"},{"url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/labels/task","name":"task","color":"84b6eb"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-11-25T05:01:16Z","updated_at":"2015-11-25T10:45:41Z","closed_at":null,"body":"Right now when indexing pages one page is indexed after the other. The process is slow for multiple reasons. We should check however, whether it is possible to use curl_multi_*() to index multiple pages at the same time. \r\n\r\nWhether we can use multi curl also depends on whether that feature is available on common hosting packages.\r\n\r\nhttp://php.net/manual/en/function.curl-multi-getcontent.php"},"comment":{"url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/issues/comments/159568772","html_url":"https://github.com/TYPO3-Solr/ext-solr/issues/141#issuecomment-159568772","issue_url":"https://api.github.com/repos/TYPO3-Solr/ext-solr/issues/141","id":159568772,"user":{"login":"timoschmidt","id":964675,"avatar_url":"https://avatars.githubusercontent.com/u/964675?v=3","gravatar_id":"","url":"https://api.github.com/users/timoschmidt","html_url":"https://github.com/timoschmidt","followers_url":"https://api.github.com/users/timoschmidt/followers","following_url":"https://api.github.com/users/timoschmidt/following{/other_user}","gists_url":"https://api.github.com/users/timoschmidt/gists{/gist_id}","starred_url":"https://api.github.com/users/timoschmidt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/timoschmidt/subscriptions","organizations_url":"https://api.github.com/users/timoschmidt/orgs","repos_url":"https://api.github.com/users/timoschmidt/repos","events_url":"https://api.github.com/users/timoschmidt/events{/privacy}","received_events_url":"https://api.github.com/users/timoschmidt/received_events","type":"User","site_admin":false},"created_at":"2015-11-25T10:45:41Z","updated_at":"2015-11-25T10:45:41Z","body":"I like both ideas maybe we do a profiling and check where most of the performance is lost. Reusing curl handles is definitly a good idea."}}