Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

287

Full-text search

Active filters: ggml

Arjay87/bloomz_7b1.cpp

Updated Apr 21, 2023

nicholascao/chatbloom-1b7-sft

Text Generation • Updated Aug 12, 2023 • 5 • 6

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2

ravenscroftj/CodeGen-6B-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 9

rozek/OpenLLaMA_7B_300BT_q4

Text Generation • Updated May 5, 2023 • 1

mverrilli/dolly-v2-3b-ggml

Updated May 17, 2023 • 2

mverrilli/dolly-v2-12b-ggml

Updated May 8, 2023 • 1

mverrilli/dolly-v2-7b-ggml

Updated May 18, 2023 • 1

Green-Sky/ggml-mpt-7b-storywriter

Updated May 20, 2023 • 14

farmer00317558/quantized_whisper_model

Updated May 11, 2023 • 1

ShadowPower/ggml-alpaca-chatgpt-new

Text Generation • Updated May 27, 2023 • 7

rustformers/mpt-7b-ggml

Text Generation • Updated Jun 9, 2023 • 28 • 46

Crataco/Pygmalion-1.3B-GGML

Updated Sep 24, 2023 • 7

Crataco/RWKV-4-PilePlus-Series-GGML

Text Generation • Updated Oct 1, 2023 • 3

digitous/13B-HyperMantis_GGML

Updated May 24, 2023 • 1

rustformers/redpajama-3b-ggml

Text Generation • Updated Jun 9, 2023 • 7 • 8

rustformers/pythia-ggml

Text Generation • Updated Jun 9, 2023 • 10 • 5

rustformers/bloom-ggml

Text Generation • Updated Jun 9, 2023 • 19 • 8

CalderaAI/30B-Lazarus-GGMLv5_1

Updated May 27, 2023 • 7

rustformers/bloomz-ggml

Text Generation • Updated Jun 9, 2023 • 7 • 6

rustformers/gpt-j-ggml

Text Generation • Updated Jun 9, 2023 • 13 • 2

rustformers/stablelm-ggml

Text Generation • Updated Jun 9, 2023 • 6 • 3

rustformers/dolly-v2-ggml

Text Generation • Updated Oct 19, 2023 • 6 • 2

rustformers/gpt4all-j-ggml

Text Generation • Updated Jun 9, 2023 • 10 • 11

rustformers/redpajama-7b-ggml

Text Generation • Updated Jun 9, 2023 • 5 • 3

rustformers/open-llama-ggml

Text Generation • Updated Jun 11, 2023 • 6 • 9

phi0112358/Zicklein-7B-german_Alpaca-ggml

Updated Jun 19, 2023 • 4

phi0112358/PMC_LLaMA-7B-ggml

Updated Jun 19, 2023 • 3

Green-Sky/ggml_openai_clip-vit-base-patch32

Updated Jun 25, 2023