Rombos-LLM-70b-Llama-3.3 AWQ 4-Bit Quantized

This repository provides the AWQ 4-bit quantized version of rombodawg/Rombos-LLM-70b-Llama-3.3, originally developed by Meta AI and finetuned by rombodawg.

Downloads last month
2
Safetensors
Model size
11.3B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kosbu/Rombos-LLM-70b-Llama-3.3-AWQ