 Bridge was born in Oldbury, then in Worcestershire, in central England, the eldest son of John Bridge and his wife, Rebecca "née" Cox.In 1850, his father was appointed a vicar-choral of Rochester Cathedral.Young Bridge was admitted to the cathedral choir as a "practising boy" (that is, a probationer).