 In 1785 Bayly was made head-master of the Royal Academy at Portsmouth, an office he continued to hold until the establishment of the Royal Naval College in 1807, when he retired on a sufficient pension.The organ in the parish church of his native village is his gift.He died at Portsea, Portsmouth towards the end of 1810.