 Rumley was also colonel of the 27th (Inniskilling) Regiment of Foot from 1870 until its amalgamation into the Royal Inniskilling Fusiliers in 1881, after which he was Colonel of the 1st Battalion of the new regiment until 1884.He was then made Colonel of the 1st Battalion, 60th Regiment of Foot from April 1884 until his death in September 1884.On 30 September 1838, Rumley married Caroline Mary Berkeley, daughter of Sir George Henry Frederick Berkeley, grandson of Augustus Berkeley, 4th Earl of Berkeley.