IQ4_XS is optimal 4Bits model for me
#5 opened 1 day ago
by
jweb

What tool/framework to test .gguf models?
#4 opened 19 days ago
by
bobchenyx
671B params vs 685B params?
5
#3 opened 29 days ago
by
masel99

Any plan for IQS_XS or IQS_XXS ?
2
#2 opened about 1 month ago
by
bobchenyx
Non split version for ollama?
2
#1 opened about 1 month ago
by
Martinotu