Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
like
3
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
2
Use this model
refs/pr/1
Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
14 commits
MaziyarPanahi
98ab1ed42594aa48136a38d9498040da1a0cb88c1b5952a8a54770658bb1a4e3
79dd5e5
verified
7 months ago
.gitattributes
2.59 kB
98ab1ed42594aa48136a38d9498040da1a0cb88c1b5952a8a54770658bb1a4e3
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ1_M.gguf
Safe
16.8 GB
LFS
31df1e70e8b3ec8d2c555e7897589623835f42f45edfcbd7cb8cd61668ba65ca
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ1_S.gguf
Safe
15.3 GB
LFS
70e8dede3e457b0c6ab9ebb4e06206acbbda6abe492655819086aedea2cbdff3
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ2_XS.gguf
Safe
21.1 GB
LFS
616e029fae21693286630bb7c2cdb0037f73323e24b3f9496a4bd086a4dcdfd3
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ3_XS.gguf
Safe
29.3 GB
LFS
8290aa30e76af0d4174280b7d3520af3099ba0a28d95fb7c8b93833e6552b137
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.IQ4_XS.gguf
Safe
37.9 GB
LFS
21da02abc81f265543ba44473e0ac170ef09f32f42223d687c05a173479e75a7
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q2_K.gguf
Safe
26.4 GB
LFS
27c7b996af33056814f4a78a3dfa9e67128a59f843ce143b25838a4aa1ff1c3c
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_L.gguf
Safe
37.1 GB
LFS
b390ecc0fe1a037cc50060fa6b6a64311aacd9e38bc77af8d5011e0b4592b3aa
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_M.gguf
Safe
34.3 GB
LFS
c179022cea4fc66159a52f5d463883294249f1d47445692694d2fe2c085462d7
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q3_K_S.gguf
Safe
30.9 GB
LFS
4d843059094646bdc77808db3de051817d8a9e0131f09865755a18fd4c3f53a3
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q4_K_M.gguf
Safe
42.5 GB
LFS
22fb865225f82796e3157b5349bbea1ce72172aba0f8569b54c99fa4017c0612
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q4_K_S.gguf
Safe
40.3 GB
LFS
f6dd2c9859d0406b5b4be97cee80dd864f0a654fa305fb317fd6667323bad5f9
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q5_K_M.gguf
Safe
49.9 GB
LFS
b9d8faba3ae4dfc5ef6fec7b8e485b95f7b65da2092405ef60b47e4f86b0720e
7 months ago
Llama-3.1-Nemotron-70B-Instruct-HF.Q5_K_S.gguf
Safe
48.7 GB
LFS
98ab1ed42594aa48136a38d9498040da1a0cb88c1b5952a8a54770658bb1a4e3
7 months ago
