Xuan-Son Nguyen's picture

Xuan-Son Nguyen

ngxson

AI & ML interests

Doing AI for fun, not for profit

Recent Activity

Organizations

Hugging Face's profile picture Blog-explorers's profile picture Hugging Face TB Research's profile picture ggml.ai's profile picture Hugging Face Discord Community's profile picture Consumer AI Edge Hackathon (Meta, Hugging Face, Pytorch, Scaleway & Unaite)'s profile picture Mistral AI Game Jam's profile picture gg-hf-g's profile picture

Posts 4

view post
Post
3044
A comprehensive matrix for which format should you use.

Read more on my blog post: https://huggingface.co/blog/ngxson/common-ai-model-formats

| Hardware        | GGUF      | PyTorch                | Safetensors              | ONNX  |
|-----------------|-----------|------------------------|--------------------------|-------|
| CPU             | ✅ (best) | 🟡                      | 🟡                       ||
| GPU             |||||
| Mobile          || 🟡 (via executorch)     |||
| Apple silicon   || 🟡                      | ✅ (via MLX framework)   ||

Articles 4

Article
31

Common AI Model Formats