how do you perform hadoop fs -getmerge on dataproc from google storage
<p>How do you use getmerge on dataproc for part files which are dumped to the google storage bucket.
If I try this <code>hadoop fs -getmerge  gs://my-bucket/temp/part-* gs://my-bucket/temp_merged</code>
I get an error
<code>getmerge: /temp_merged (Permission denied)</code></p>

<p>It works fine for <code>hadoop fs -getmerge  gs://my-bucket/temp/part-* temp_merged</code> but that of course writes the merged file on the cluster machine and not in GS.</p>