Inference server recommandation

by DeltaWhiplash - opened Sep 11, 2024

Sep 11, 2024

Hello I have an amd APU with ubuntu 24.04LTS
What inference software do you recommands for Q8 ?

Arcee AI org Sep 11, 2024

People like using ollama: https://ollama.com/

Sep 19, 2024

Oh I didn't see it's avaiable
Thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment