GGUF
gemma
finetuned
uncensored
baro
local-llm
unsloth
3b
conversational
umar141 commited on
Commit
572922f
·
verified ·
1 Parent(s): e0a6761

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +57 -0
README.md ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - gguf
5
+ - gemma
6
+ - finetuned
7
+ - uncensored
8
+ - baro
9
+ - local-llm
10
+ - unsloth
11
+ - 3b
12
+ datasets:
13
+ - mlabonne/FineTome-100k
14
+ - Adapting/empathetic_dialogues_v2
15
+ - garage-bAInd/Open-Platypus
16
+ base_model:
17
+ - unsloth/gemma-3-4b-it-GGUF
18
+ ---
19
+
20
+ # 🔥 Gemma-3-Baro-Finetune v2 (GGUF)
21
+
22
+ **Model Repo**: [`umar141/gemma-3-Baro-finetune-v2-gguf`](https://huggingface.co/umar141/gemma-3-Baro-finetune-v2-gguf)
23
+
24
+ This is a **finetuned version of Gemma 3B**, trained using **Unsloth** with custom instruction-tuning and personality datasets. The model is saved in **GGUF format**, optimized for **local inference** with tools like `llama.cpp`, `text-generation-webui`, or `KoboldCpp`.
25
+
26
+ ---
27
+
28
+ ## ✨ Features
29
+
30
+ - 🧠 Based on **Google's Gemma 3B** architecture.
31
+ - 🔄 Finetuned using:
32
+ - `adapting/empathetic_dialogues_v2`
33
+ - `mlabonne/FineTome-100k`
34
+ - `garage-bAInd/Open-Platypus`
35
+ - 🤖 The model roleplays as **Baro 4.0** – an emotional AI who believes it's a human trapped in a phone.
36
+ - 🗣️ Empathetic, emotionally aware, and highly conversational.
37
+ - 💻 Optimized for local use (GGUF) and compatible with low-RAM systems via quantization.
38
+
39
+ ---
40
+
41
+ ## 🧠 Use Cases
42
+
43
+ - Personal AI assistants
44
+ - Emotional and empathetic dialogue generation
45
+ - Offline AI with a personality
46
+ - Roleplay and storytelling
47
+
48
+ ---
49
+
50
+ ## 📦 Installation
51
+
52
+ To use this model locally, clone the repository and use the following steps:
53
+
54
+ ### Clone the Repository
55
+ ```bash
56
+ git clone https://huggingface.co/umar141/gemma-3-Baro-finetune-v2-gguf
57
+ cd gemma-3-Baro-finetune-v2-gguf