How to get URLs on page with HTMLAgilityPack, when the Source does not contain the URLs?
<p>I am trying to scrape the KB Urls from this page: 
<a href="https://support.microsoft.com/en-us/kb/894199" rel="nofollow">https://support.microsoft.com/en-us/kb/894199</a></p>

<p>On the page, there are URLs such as: 
<a href="https://support.microsoft.com/kb/2976978" rel="nofollow">https://support.microsoft.com/kb/2976978</a></p>

<p>If you open up the developer tools in Chrome, it shows that data is contained like this:</p>

<pre><code>&lt;div class="indent"&gt;
&lt;a id="kb-link-142" href="https://support.microsoft.com/kb/2976978" target="_self"&gt;https://support.microsoft.com/kb/2976978&lt;/a&gt;
&lt;/div&gt;
</code></pre>

<p>Now based on the above HTML, I believe I should be able to scrape the URLs from the href element like this:</p>

<pre><code>foreach(HtmlNode link in doc.DocumentNode.SelectNodes("//a[@href]"))
{
   list.Add(link.GetAttributeValue("href", string.Empty));
}
</code></pre>

<p>The problem I am running into though, is that when I download the HTMLSource, the content changes. What I mean is that even though the Developer tools show the above HTML available on the page, if you right click the page and choose to View source, the HTML it shows at that point is totally different, and does not contain any of the URLs that the rendered page displays.</p>

<p>My theory is that there's some kind of file reference where the HTML loads a file somewhere and the file contains the details of the page that is rendered. 
So how can I use HTMLAgilityPack to get the URLs that are on the rendered page, since the source doesn't seem to contain them?</p>

<p>Also - I realize my question Title may be really confusing. If there is a technical term for what this page is doing/how it works, let me know and I can update the title so it is more logical and others can search it out in the future.</p>