Varsavsky was born in Buenos Aires in 1933. After completing secondary studies in the Colegio Nacional de Buenos Aires, he settled in the United States. In the US, Varsavsky graduated in physical engineering, in which he also obtained a master's degree from the University of Colorado. In 1959 he did his doctorate in astronomy at Harvard University. He was the younger brother of Argentinian mathematician and social scientist Oscar Varsavsky.