 Her first marriage was to actor and dancer Poul Christian Guldager (1926–1931), then to Danish film director Emanuel Gregers (1932–1938).In 1938, Viby married businessman Knud Wold with whom she had her only child, the actress Susse Wold.During the early 1940s, Viby was linked with Prince Bertil of Sweden.