transformers
torch
fastapi
uvicorn
accelerate>=0.26.0
bitsandbytes