some were leaving to try their hand in kansas , and a sprinkling of others ( `` panicky sheep , '' william had called them ) were being frightened off by the threat of violence over the slavery issue .