The Department of Homeland Security declined to comment, though people briefed on the matter said there was fierce resistance inside the department to making changes to the program that could further alienate Muslim communities assisting antiterrorism efforts.