It seems like not runnable on ollama...

#7
by DXBTR74 - opened

As I tried many quants of this model and it popped error like this:

Error: error reading llm response: read tcp 127.0.0.1:52284->127.0.0.1:52281: wsarecv: An existing connection was forcibly closed by the remote host.

This only happened on this model including 0.15b, 0.4b and 1.7b. no matter what quants.

So is there any feasible way to run it?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment