And, to return to Mr. Delaney, swimmingly is associated with aquatic   with a smooth gliding movement  says OED .  No confusion there, I would suggest.
Swimmingly has both a literal and figurative meaning.