Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

jukofyork
/
DeepSeek-V3-0324-DRAFT-0.5B-v1.0-GGUF

GGUF
draft
speculative-decoding
conversational
Model card Files Files and versions Community
1
DeepSeek-V3-0324-DRAFT-0.5B-v1.0-GGUF / with-imatrix
Ctrl+K
Ctrl+K
  • 2 contributors
History: 2 commits
jukofyork's picture
jukofyork
Upload 10 files
d7f727b verified about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iIQ4_NL.gguf
    313 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iIQ4_XS.gguf
    300 MB
    LFS
    Rename DeepSeek-V3-0324-DRAFT-0.5B-iIQ4_XS.gguf to with-imatrix/DeepSeek-V3-0324-DRAFT-0.5B-iIQ4_XS.gguf about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ4_0.gguf
    313 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ4_1.gguf
    338 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ4_K_M.gguf
    325 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ4_K_S.gguf
    314 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ5_0.gguf
    364 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ5_1.gguf
    388 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ5_K_M.gguf
    369 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ5_K_S.gguf
    363 MB
    LFS
    Upload 10 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-iQ6_K.gguf
    416 MB
    LFS
    Upload 10 files about 1 month ago