 He married three times.After graduating from law school, Fields married his college sweetheart, Amy Markson, with whom he had one son, James Elder Fields (born 1955).In 1960, he married fashion model Lydia Menovich whose divorce he had handled two years prior.