Mark Potok, a senior fellow with the liberal Southern Poverty Law Center in Montgomery, Alabama, said it's hard to determine exact numbers, but around 100,000 people might be members in hate groups and several hundred thousand could be linked informally.