 As the infantrymen were largely convalescences and stragglers not fit to make the trek into Maryland and their force being greatly outnumbered, Gibson began to retreat from town.White, however, not wanting to give up his hometown without a fight, persuaded Gibson to resist the Federals as long as possible.A skirmish broke out between the Federal advance guard and the ragtag Confederate force near the courthouse square.