 Clarke also took interest in various forms of sport, his yacht, the "Janet", won several races, but he was not very successful on the turf; the most important race he won being the V.R.C.Oaks.He was the inaugural president of the Victorian Football Association, presiding from 1877 until 1882.