 However, by 1939, Diego Rivera and Leon Trotsky had a falling-out.Some stories state that it was over ideology and Diego's criticism of Trotsky's writing and others state that Trotsky had had an affair with Frida, or a combination of both.The Trotskys then moved to the house on Viena Street in the same borough in April 1939, not far from The Blue House.