Reading (even joining) a very large (1.1bn row) table in Enterprise Guide from Teradata
<p>Hopefully you guys can help with what I'm hoping is quite a simple question for those in the know!</p>

<p>I live (well, work) in SAS Enterprise Guide and am trying to perform a simple left join against a table in Teradata.</p>

<p>The table is extremely large (700+ columns, 1.1bn rows) and so far I have been connecting via a LIBNAME statement at the top of my program, followed by the usual PROC SQL to read the data.</p>

<p>The issue I am having is its is extremely slow. I performed the join successfully using 90 rows on the left table and it took 3 hours to complete. The real table I want to use has something like 15,000 rows.</p>

<p>I have tried to connect via the SQL Pass-Through method, but this throws a hosts file error, which I can't fix due to corporate security limitations.</p>

<p>Has anyone had any experience performing this kind of task?</p>

<p>I should mention that I can run a simple select * query in Teradata SQL Assistant is just over 1 minute (16,666,666 obs/s!) so the limitation must be somewhere between SAS/Teradata, or even SAS itself.</p>

<p>I'm sorry I haven't posted actual code snippets as they're on my work machine but this has been bugging me for ages so thought I'd see if I'm missing any tricks.</p>

<p>Thanks in advance for your help.</p>