 He also held the honorary post of Lord Lieutenant of Caernarvonshire.In 1866 he was raised to the peerage as Baron Penrhyn, of Llandegai in the County of Carnarvon.In 1868, he sacked 80 workers from Penrhyn Quarry for failing to vote for his son, George Douglas-Pennant, in the general election.