 Koller was born Noemie Benczer in Vienna, Austria on born August 21, 1933.Her father was a Ph.D. chemist and her mother worked as a bookbinder.The family moved frequently in her early childhood due to the turbulence of World War II.