In a recent column, the former Conservative leader, Iain Duncan Smith, an influential and passionate Brexiter, asks why “unelected judges have the right to supersede the wishes of the elected members of parliament, and through them the government”.