chillies

/

mistral-7b-ielts-evaluator-q4

like 11

usage example code can't load gguf file from aututokenizor and automodel， I change to use llamacpp to load gguf file, but it only generate essay string and happen error in 'score = outputs.logits.argmax(dim=-1).item()'