A more compelling explanation is that Ellison wanted to write a second novel that would meet the standard of Invisible Man while being an entirely different kind of book.
Ellison was unaware of a novel titled Invisible Man.