 He was elected as a Democrat to the 81st United States Congress, to fill the vacancy caused by the death of John J. Delaney, and was re-elected to the 82nd and 83rd United States Congresses, holding office from February 15, 1949, until his resignation on July 21, 1954.Heller resigned from Congress to become a Judge of New York City's Special Sessions Court, where he served until 1958.In December 1958 he was elected Justice of New York City's City Court, and he served until August 1966.