Progammatic browsing performance issues
<p>I'm using <a href="http://docs.seleniumhq.org/" rel="nofollow">Selenium</a> (in Java) to do programmatic browsing (Firefox) and, to speed up page loading, I'm going through a programmatic Java proxy running in the same application (<a href="https://bmp.lightbody.net/" rel="nofollow">Browsermob</a>) to prevent the loading of external content (ads, etc) as I only need website's hosted content.</p>

<p>The application is browsing through hundreds of thousands of pages but unfortunately, after a few hours, speed is reducing significantly (from ~5s/page to ~30s/page).</p>

<p>Can it be related to browser cache size? Proxy cache? How to check?
Any pointer or hint would be more than welcome!</p>

<p>Many thanks,
Tom</p>