This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-8b-base

Downloads last month: 336

GGUF

Model size

8.17B params

Architecture

granite

Hardware compatibility

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ibm-granite/granite-3.3-8b-base-GGUF

Base model

ibm-granite/granite-3.3-8b-base

Quantized

(5)

this model

Collection including ibm-granite/granite-3.3-8b-base-GGUF

Granite GGUF Models

Collection

GGUF-formatted, versions of IBM Granite models. Licensed under the Apache 2.0 license. • 9 items • Updated 7 days ago • 1