Carmeli was born in Baghdad, Iraq in 1933. However, he spent the majority of his life and career in Israel and the United States of America. In 1960, he received his Masters of Science from The Hebrew University of Jerusalem under the supervision of N. Zeldes. In 1964, he received his Doctor of Science from the Technion-Israel Institute of Technology in Haifa, Israel under the supervision of Nathan Rosen.