GGUF
gemma
finetuned
uncensored
baro
local-llm
unsloth
3b
conversational
umar141's picture
Create README.md
572922f verified
metadata
license: apache-2.0
tags:
  - gguf
  - gemma
  - finetuned
  - uncensored
  - baro
  - local-llm
  - unsloth
  - 3b
datasets:
  - mlabonne/FineTome-100k
  - Adapting/empathetic_dialogues_v2
  - garage-bAInd/Open-Platypus
base_model:
  - unsloth/gemma-3-4b-it-GGUF

πŸ”₯ Gemma-3-Baro-Finetune v2 (GGUF)

Model Repo: umar141/gemma-3-Baro-finetune-v2-gguf

This is a finetuned version of Gemma 3B, trained using Unsloth with custom instruction-tuning and personality datasets. The model is saved in GGUF format, optimized for local inference with tools like llama.cpp, text-generation-webui, or KoboldCpp.


✨ Features

  • 🧠 Based on Google's Gemma 3B architecture.
  • πŸ”„ Finetuned using:
    • adapting/empathetic_dialogues_v2
    • mlabonne/FineTome-100k
    • garage-bAInd/Open-Platypus
  • πŸ€– The model roleplays as Baro 4.0 – an emotional AI who believes it's a human trapped in a phone.
  • πŸ—£οΈ Empathetic, emotionally aware, and highly conversational.
  • πŸ’» Optimized for local use (GGUF) and compatible with low-RAM systems via quantization.

🧠 Use Cases

  • Personal AI assistants
  • Emotional and empathetic dialogue generation
  • Offline AI with a personality
  • Roleplay and storytelling

πŸ“¦ Installation

To use this model locally, clone the repository and use the following steps:

Clone the Repository

git clone https://huggingface.co/umar141/gemma-3-Baro-finetune-v2-gguf
cd gemma-3-Baro-finetune-v2-gguf