{"action":"created","issue":{"url":"https://api.github.com/repos/alexfernandez/loadtest/issues/47","labels_url":"https://api.github.com/repos/alexfernandez/loadtest/issues/47/labels{/name}","comments_url":"https://api.github.com/repos/alexfernandez/loadtest/issues/47/comments","events_url":"https://api.github.com/repos/alexfernandez/loadtest/issues/47/events","html_url":"https://github.com/alexfernandez/loadtest/issues/47","id":59272816,"number":47,"title":"Worst performance results than ab","user":{"login":"jgato","id":3435696,"avatar_url":"https://avatars.githubusercontent.com/u/3435696?v=3","gravatar_id":"","url":"https://api.github.com/users/jgato","html_url":"https://github.com/jgato","followers_url":"https://api.github.com/users/jgato/followers","following_url":"https://api.github.com/users/jgato/following{/other_user}","gists_url":"https://api.github.com/users/jgato/gists{/gist_id}","starred_url":"https://api.github.com/users/jgato/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jgato/subscriptions","organizations_url":"https://api.github.com/users/jgato/orgs","repos_url":"https://api.github.com/users/jgato/repos","events_url":"https://api.github.com/users/jgato/events{/privacy}","received_events_url":"https://api.github.com/users/jgato/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-02-27T18:09:47Z","updated_at":"2015-02-27T18:37:18Z","closed_at":null,"body":"Hi there,\r\n\r\nI need to make really hard performance test against a node with express services. Doing an initial test against a hello world service I have very significant differences between using loadtest and the traditional ab:\r\n\r\nWith loadtest:\r\n\r\n```\r\n>loadtest -n 50000 -c 1000 http://localhost:3000/version\r\n\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO \r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Target URL:          http://localhost:3000/version\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Max requests:        50000\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Concurrency level:   1000\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Agent:               none\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO \r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Completed requests:  50000\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Total errors:        0\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Total time:          43.307403647 s\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Requests per second: 1155\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Total time:          43.307403647 s\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO \r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO Percentage of the requests served within a certain time\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO   50%      538 ms\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO   90%      1373 ms\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO   95%      1527 ms\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO   99%      7267 ms\r\n[Fri Feb 27 2015 19:00:53 GMT+0100 (CET)] INFO  100%      31354 ms (longest request)\r\n\r\n```\r\nThe same test but using ab:\r\n\r\n ```\r\n)>ab -n 50000 -c 1000 -k http://localhost:3000/version\r\nThis is ApacheBench, Version 2.3 <$Revision: 1528965 $>\r\nCopyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/\r\nLicensed to The Apache Software Foundation, http://www.apache.org/\r\nConcurrency Level:      1000\r\nTime taken for tests:   22.181 seconds\r\nComplete requests:      50000\r\nFailed requests:        0\r\nKeep-Alive requests:    0\r\nTotal transferred:      25450000 bytes\r\nHTML transferred:       3650000 bytes\r\nRequests per second:    2254.14 [#/sec] (mean)\r\nTime per request:       443.629 [ms] (mean)\r\nTime per request:       0.444 [ms] (mean, across all concurrent requests)\r\nTransfer rate:          1120.46 [Kbytes/sec] received\r\n\r\n\r\nPercentage of the requests served within a certain time (ms)\r\n  50%    119\r\n  66%    138\r\n  75%    158\r\n  80%    180\r\n  90%   1127\r\n  95%   1164\r\n  98%   3133\r\n  99%   3322\r\n 100%  15219 (longest request)\r\n```\r\n\r\nIs it normal so big differences for the same test?\r\n"},"comment":{"url":"https://api.github.com/repos/alexfernandez/loadtest/issues/comments/76447361","html_url":"https://github.com/alexfernandez/loadtest/issues/47#issuecomment-76447361","issue_url":"https://api.github.com/repos/alexfernandez/loadtest/issues/47","id":76447361,"user":{"login":"jgato","id":3435696,"avatar_url":"https://avatars.githubusercontent.com/u/3435696?v=3","gravatar_id":"","url":"https://api.github.com/users/jgato","html_url":"https://github.com/jgato","followers_url":"https://api.github.com/users/jgato/followers","following_url":"https://api.github.com/users/jgato/following{/other_user}","gists_url":"https://api.github.com/users/jgato/gists{/gist_id}","starred_url":"https://api.github.com/users/jgato/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jgato/subscriptions","organizations_url":"https://api.github.com/users/jgato/orgs","repos_url":"https://api.github.com/users/jgato/repos","events_url":"https://api.github.com/users/jgato/events{/privacy}","received_events_url":"https://api.github.com/users/jgato/received_events","type":"User","site_admin":false},"created_at":"2015-02-27T18:37:18Z","updated_at":"2015-02-27T18:37:18Z","body":"It is taking almost 100% of CPU. My hardware is i5 6GB RAM and unbutu 14.04."}}