FP8 or GGUF version to run on consumer GPU

by ryg81 - opened Mar 25

ryg81

Mar 25

Hey, please release small fp8 or gguf models too.
Thanks in advance

Mar 27

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment