There is no official measure of how many immigrants in the town are there illegally, and interviews with more than two dozen local officials, employers, longtime residents and immigrants suggest the numbers today are off their peak.