 Smith was born to sportswriter Red Smith, and later earned a Bachelor of Arts degree from the University of Notre Dame in 1960.Smith is married and has two grown children and three grandchildren.He lives in the Eastport neighborhood in Annapolis, Maryland, on the shore of the Chesapeake Bay.