In 1951–53, Ruderman worked at Berkeley's Radiation Laboratory. He became an assistant professor at UC Berkeley in 1953, rising by 1964 to the rank of full professor. He moved to New York University in 1964, and to Columbia University in 1969, becoming Centennial Professor in 1980. Ruderman served as chair of the Department of Physics at Columbia in 1973–75.