Meta LLaMA-3-8B-Instruct GGUF Models
These are quantized versions of Meta's LLaMA-3-8B-Instruct model using IPEX and converted to GGUF format. Supported Formats: f32.gguf, f16.gguf, q8_0.gguf
Usage
from llama_cpp import Llama
llm = Llama(model_path="q8_0.gguf")
response = llm("What is AI?")
print(response)
- Downloads last month
- 47
Hardware compatibility
Log In
to view the estimation
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for ilayaraja3/llama-3-8b-instruct-gguf
Base model
meta-llama/Llama-3.1-8B
Finetuned
meta-llama/Llama-3.1-8B-Instruct