 Disappointed, they severed their ties with the two and moved to Idaho Springs, while Baby Doe followed Harvey to Denver despite wishing for a divorce from him.In Denver, Harvey frequented saloons and brothels.After witnessing him with a prostitute, Baby Doe filed for divorce on the grounds of adultery.