Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,974

Full-text search

Active filters: 8-bit

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 80 • 2

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 100 • 4

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 359 • 10

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 1.07k • 51

MaziyarPanahi/gemma-2b-it-GGUF

Text Generation • Updated Feb 27, 2024 • 560 • 10

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 282 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 208 • 8

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 87 • 7

MaziyarPanahi/ChatMusician-GGUF

Text Generation • Updated Mar 2, 2024 • 494 • 14

MaziyarPanahi/Yi-9B-GGUF

Text Generation • Updated Mar 14, 2024 • 408 • 15

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 331 • 8

Vision-CAIR/MiniGPT4-Video

Updated Jul 24, 2024 • 16 • 32

FriendliAI/Mistral-7B-Instruct-v0.2-fp8

Text Generation • Updated Apr 18, 2024 • 47 • 12

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 228k • 74

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.98k • 29

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.75k • 127

FriendliAI/c4ai-command-r-plus-fp8

Text Generation • Updated Apr 19, 2024 • 40 • 4

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 18.9k • 168

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 350k • 89

FriendliAI/Meta-Llama-3-70B-fp8

Text Generation • Updated Aug 1, 2024 • 43 • 5

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Jun 28, 2024 • 283k • 57

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25, 2024 • 259k • 13

Kameshr/LLAMA-3-Quantized

Text Generation • Updated May 3, 2024 • 23 • 9

nassersala/axolotl-olama3b-gpt4-cleaned

Updated May 24, 2024 • 2 • 1

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 13 • 2

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29, 2024 • 46 • 7

cortecs/Mistral-7B-Instruct-v0.3-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 29 • 1

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 58 • 15

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 201 • 4

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 250 • 17