Is it able to retrieve website content by Crawler4j?
<p>I m very new to Java.</p>

<p>Now , I want to retrieve the news article contents using Google news search -keyword: "toy" from page 1 to page 10.</p>

<p><a href="https://www.google.com/search?q=toy&amp;biw=1366&amp;bih=645&amp;tbm=nws&amp;source=lnms&amp;sa=X&amp;ved=0ahUKEwiTp82syoXPAhUMkpQKHawZBOoQ_AUICygE" rel="nofollow noreferrer">https://www.google.com/search?q=toy&amp;biw=1366&amp;bih=645&amp;tbm=nws&amp;source=lnms&amp;sa=X&amp;ved=0ahUKEwiTp82syoXPAhUMkpQKHawZBOoQ_AUICygE</a></p>

<p>That is retrieving 100 news content from page 1 - page 10. (assuming 10 news article in every pages)</p>

<p>After I read this 
<a href="https://stackoverflow.com/questions/34888510/crawler4j-vs-jsoup-for-the-pages-crawling-and-parsing-in-java/34892537#34892537">Crawler4j vs. Jsoup for the pages crawling and parsing in Java</a></p>

<p>I decide to use Crawler4j as it can </p>

<blockquote>
  <blockquote>
    <p>Give base URI (home page) </p>
    
    <p>Take all the URIs from each page and retrieve the contents of those
    too.  </p>
    
    <p>Move recursively for every URI you  retrieve.  </p>
    
    <p>Retrieve the contents only of URIs that are inside this website (there
    could be
    external URIs referencing another website, we  don't need those).</p>
  </blockquote>
</blockquote>

<p>In my case , I can give the google search page from p1 to p10 .And it returns the 100 news article if I set <code>intnumberOfCrawlers=1</code></p>

<hr>

<p>However , when i try the Quickstart of Crawler4j <a href="https://github.com/yasserg/crawler4j" rel="nofollow noreferrer">example</a></p>

<p>It only returns the external links found from the orginal link .
Like these:</p>

<pre><code>    URL: http://www.ics.uci.edu/~lopes/
Text length: 2619
Html length: 11656
Number of outgoing links: 38
URL: http://www.ics.uci.edu/~welling/
Text length: 4503
Html length: 23713
Number of outgoing links: 24
URL: http://www.ics.uci.edu/~welling/teaching/courses.html
Text length: 2222
Html length: 15138
Number of outgoing links: 33
URL: http://www.ics.uci.edu/
Text length: 3661
Html length: 51628
Number of outgoing links: 86
</code></pre>

<hr>

<p><strong>Hence , I wonder can <code>crawler4j</code> perform the function I raised . Or should I use <code>crawler4j</code> +<code>JSoup</code>together ?</strong></p>