Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

LWDCLS
/
Meta-Llama-3-8B-Instruct-GGUF-Imatrix-Request

GGUF
conversational
Model card Files Files and versions Community
1
Meta-Llama-3-8B-Instruct-GGUF-Imatrix-Request
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
Lewdiculous's picture
Lewdiculous
IQ4_XS
c72921d verified 10 months ago
  • .gitattributes
    2.25 kB
    IQ4_XS 10 months ago
  • Meta-Llama-3-8B-Instruct-BF16.gguf
    16.1 GB
    LFS
    quants 10 months ago
  • Meta-Llama-3-8B-Instruct-F16.gguf
    16.1 GB
    LFS
    quants 10 months ago
  • Meta-Llama-3-8B-Instruct-IQ4_XS-imat.gguf
    4.45 GB
    LFS
    IQ4_XS 10 months ago
  • Meta-Llama-3-8B-Instruct-Q4_K_M-imat.gguf
    4.92 GB
    LFS
    Q4_K_M 10 months ago
  • Meta-Llama-3-8B-Instruct-Q4_K_S-imat.gguf
    4.69 GB
    LFS
    Q4_K_S 10 months ago
  • Meta-Llama-3-8B-Instruct-Q5_K_M-imat.gguf
    5.73 GB
    LFS
    Q5_K_M-imat and imatrix data 10 months ago
  • Meta-Llama-3-8B-Instruct-Q5_K_S-imat.gguf
    5.6 GB
    LFS
    quants 10 months ago
  • Meta-Llama-3-8B-Instruct-Q6_K-imat.gguf
    6.6 GB
    LFS
    quants 10 months ago
  • Meta-Llama-3-8B-Instruct-Q8_0-imat.gguf
    8.54 GB
    LFS
    quants 10 months ago
  • README.md
    339 Bytes
    Update README.md 10 months ago
  • UNLICENSE
    1.24 kB
    Q5_K_M-imat and imatrix data 10 months ago
  • imatrix-with-rp-ex.txt
    228 kB
    Q5_K_M-imat and imatrix data 10 months ago
  • imatrix.dat
    4.99 MB
    LFS
    Q5_K_M-imat and imatrix data 10 months ago