 Throughout his career he was known as "Digger" Brown.Brown was born in Spon End, Coventry, the elder brother of Albert Arthur Brown who would also go on to have a career as a footballer with Aston Villa.Arthur began his career playing for local junior sides including Aston Cross, Aston Unity and Aston Comrades before joining the most senior club in the area, Aston Villa in 1878.