hive difference between insert and load data
<p>I am new to <strong>Hadoop</strong> and <strong>Hive</strong>, and I am confused about hive's <code>insert into</code> and <code>load data</code> statements.</p>
<p>When I execute <code>INSERT INTO TABLE_NAME (field1, field2) VALUES(value1, value2);</code>, hiveserver will execute mapReduce task.</p>
<p>When I execute <code>LOAD DATA LOCAL INPATH PATH_TO_MY_DATA INTO TABLE TABLE_NAME;</code>, it only loads data from the file and does nothing else.</p>
<p>I wrote a program with Python, here is my problem, if I use pyhs2 and use the <code>insert</code> statement to save data records, each record will execute a MapReduce task, and it is very slow.
Should I first save my data somewhere, and later use the <code>load data</code> statement to load it?</p>