GGUF quants of nvidia/Llama-3.1-Nemotron-Nano-8B-v1
Using llama.cpp b4920 (commit d84635b1b085d54d6a21924e6171688d6e3dfb46)
The importance matrix was generated with calibration_datav3.txt.
All quants were generated/calibrated with the imatrix, including the K quants.
Quantized from BF16.
- Downloads last month
- 271
Hardware compatibility
Log In
to view the estimation
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for redponike/Llama-3.1-Nemotron-Nano-8B-v1-GGUF
Base model
nvidia/Llama-3.1-Nemotron-Nano-8B-v1