gguf model not loading properly in ollama
#1
by
xldistance
- opened
H:\Desktop>ollama run llama3.1cn:70b
Error: llama runner process has terminated: error loading model: done_getting_tensors: wrong number of tensors; expected 724, got 723
You need a version of ollama with llama-3.1 support.
mradermacher
changed discussion status to
closed
You need a version of ollama with llama-3.1 support.
My version of ollama is 0.3.0, latest
You can start by using LM Studio 0.2.29, and then switch to ollama once it's upgraded.