Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

afrideva
/
Llama-68M-Chat-v1-GGUF

Text Generation
GGUF
English
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
conversational
Model card Files Files and versions Community
Llama-68M-Chat-v1-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
afrideva's picture
afrideva
Upload llama-68m-chat-v1.q6_k.gguf with huggingface_hub
5094f4f verified over 1 year ago
  • .gitattributes
    1.91 kB
    Upload llama-68m-chat-v1.q6_k.gguf with huggingface_hub over 1 year ago
  • llama-68m-chat-v1.fp16.gguf
    137 MB
    LFS
    Upload llama-68m-chat-v1.fp16.gguf with huggingface_hub over 1 year ago
  • llama-68m-chat-v1.q2_k.gguf
    35.9 MB
    LFS
    Upload llama-68m-chat-v1.q2_k.gguf with huggingface_hub over 1 year ago
  • llama-68m-chat-v1.q3_k_m.gguf
    40.7 MB
    LFS
    Upload llama-68m-chat-v1.q3_k_m.gguf with huggingface_hub over 1 year ago
  • llama-68m-chat-v1.q4_k_m.gguf
    46.1 MB
    LFS
    Upload llama-68m-chat-v1.q4_k_m.gguf with huggingface_hub over 1 year ago
  • llama-68m-chat-v1.q5_k_m.gguf
    51.2 MB
    LFS
    Upload llama-68m-chat-v1.q5_k_m.gguf with huggingface_hub over 1 year ago
  • llama-68m-chat-v1.q6_k.gguf
    56.5 MB
    LFS
    Upload llama-68m-chat-v1.q6_k.gguf with huggingface_hub over 1 year ago