From St. Andrew's Square, it is only a short walk north to Queen Street, where you will find the Scottish National Portrait Gallery on the corner.
The Scottish National Portrait Gallery has pictures of all the kings.  