 In 1537 Thomas Howard, the second Duke of Norfolk made repairs to the castle but, following the Council's relocation to York in the mid sixteenth century, the castle went into decline.A further campaign of repairs was undertaken by Henry, Earl of Huntingdon in 1572.The Earl hoped the President of the Council would use the castle as a residence, and he described it as an 'olde Castell aamoste ruinated.'