zahemen9900's picture
Refactor inference script to streamline usage; remove unnecessary classes and integrate threading for response generation
0f6159c