Warning: llm_load_vocab: missing pre-tokenizer type, using: 'default'
1
1
#4 opened about 1 year ago
by
supercharge19
The f16 with 32k ctx fits nicely in 24GB VRAM
2
5
#3 opened about 1 year ago
by
ubergarm