Hugging Face's logo
Xuan-Son Nguyen's picture
51 56 32

Xuan-Son Nguyen

ngxson
analytics206's profile picture MLDataScientist's profile picture shotvpro's profile picture
·
https://blog.ngxson.com

AI & ML interests

Doing AI for fun, not for profit

Recent Activity

updated a model 2 days ago
ngxson/gemma-3-4b-pt-Q4_0-GGUF
published a model 2 days ago
ngxson/gemma-3-4b-pt-Q4_0-GGUF
new activity 3 days ago
ggml-org/gguf-my-repo:URGENT: CVE's/vulns Present, Update Dependencies
View all activity

Organizations

Hugging Face's profile picture Blog-explorers's profile picture Hugging Face TB Research's profile picture ggml.ai's profile picture Hugging Face Discord Community's profile picture Consumer AI Edge Hackathon (Meta, Hugging Face, Pytorch, Scaleway & Unaite)'s profile picture Mistral AI Game Jam's profile picture gg-hf-g's profile picture

Posts 4

view post
Post
3042
A comprehensive matrix for which format should you use.

Read more on my blog post: https://huggingface.co/blog/ngxson/common-ai-model-formats

| Hardware        | GGUF      | PyTorch                | Safetensors              | ONNX  |
|-----------------|-----------|------------------------|--------------------------|-------|
| CPU             | ✅ (best) | 🟡                      | 🟡                       | ✅    |
| GPU             | ✅        | ✅                      | ✅                       | ✅    |
| Mobile          | ✅        | 🟡 (via executorch)     | ❌                       | ✅    |
| Apple silicon   | ✅        | 🟡                      | ✅ (via MLX framework)   | ✅    |
View all Posts

Articles 4

Article
31

Common AI Model Formats

View all Articles

Collections 3

Papers 1