But Ellison has come under heavy fire for remarks he has made in the past and for his associations with controversial figures and groups, such as the Nation of Islam and members of the Muslim Brotherhood.