 He then became a member of Bethlehem Asylum, a fusion band with two recordings on Ampex records, "Commit Yourself" and "Bethlehem Asylum" in 1970 and 1971.In 1971, Finley moved to Nashville, Tennessee.While there, he became Billy Joe Shaver's guitar player.. Finley co-wrote with Shaver the song "Bottom Dollar" and appeared on Shaver's record "Old Five and Dimers".