 Castle was the captain of the British épée and sabre teams at the 1908 Summer Olympics.He was born in London into a wealthy family; his maternal grandfather was the publishing magnate and philanthropist Egerton Smith.He was a lieutenant in the Second West India Regiment and afterwards a captain in the Royal Engineers Militia.