Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

jukofyork
/
DeepSeek-V3-0324-DRAFT-0.5B-v1.0-GGUF

GGUF
draft
speculative-decoding
conversational
Model card Files Files and versions Community
1
DeepSeek-V3-0324-DRAFT-0.5B-v1.0-GGUF / no-imatrix
Ctrl+K
Ctrl+K
  • 2 contributors
History: 2 commits
jukofyork's picture
jukofyork
Upload 13 files
61a1863 verified about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-BF16.gguf
    1.01 GB
    LFS
    Rename DeepSeek-V3-0324-DRAFT-0.5B-BF16.gguf to no-imatrix/DeepSeek-V3-0324-DRAFT-0.5B-BF16.gguf about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-F16.gguf
    1.01 GB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-IQ4_NL.gguf
    314 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-IQ4_XS.gguf
    302 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q4_0.gguf
    313 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q4_1.gguf
    338 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q4_K_M.gguf
    325 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q4_K_S.gguf
    314 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q5_0.gguf
    363 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q5_1.gguf
    388 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q5_K_M.gguf
    369 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q5_K_S.gguf
    363 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q6_K.gguf
    416 MB
    LFS
    Upload 13 files about 1 month ago
  • DeepSeek-V3-0324-DRAFT-0.5B-Q8_0.gguf
    537 MB
    LFS
    Upload 13 files about 1 month ago