This is a MLC converted weight from Dolphin3.0-Llama3.2-3B model in MLC format q4f16_1.

The model can be used for projects MLC-LLM and WebLLM.

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for huggingkot/Dolphin3.0-Llama3.2-3B-q4f16_1-MLC

Base model

Finetuned

Quantized

(27)

this model

Collection including huggingkot/Dolphin3.0-Llama3.2-3B-q4f16_1-MLC