Mohammad Ataul Karim was born on 4 May 1953 in Barlekha, a border town in South Sylhet. He attended Shatma Primary for his elementary education and Patharia Chotolekha High for a year after which he left home to be schooled at Faujdarhat Cadet College (1965–1969), Sylhet MC College (1969–1972), and the University of Dacca (1972–1976) wherefrom he received his bachelor's honors degree in physics. Ataul Karim earned his master's degrees in physics (1978) and electrical engineering (1979), and a doctor of philosophy degree in electrical engineering (1982) from the University of Alabama.