 James Fleming was an English prisoner by May 1549, and was released by exchange with the English prisoner James Wilford.In 1550 James accompanied the queen dowager Mary of Guise into France .On 21 December 1553, James was confirmed as Great Chamberlain of Scotland for life.