This is a MLC converted weight from Gemmasutra-Small-4B-v1 model in MLC format q4f16_1.

The model can be used for projects MLC-LLM and WebLLM.

Downloads last month
7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for huggingkot/Gemmasutra-Small-4B-v1-q4f16_1-MLC

Quantized
(17)
this model

Collection including huggingkot/Gemmasutra-Small-4B-v1-q4f16_1-MLC