TheCluster commited on
Commit
eec0fea
·
verified ·
1 Parent(s): b4d2224

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - OddTheGreat/Comet_12B_V.4
4
+ base_model_relation: quantized
5
+ pipeline_tag: image-text-to-text
6
+ tags:
7
+ - chat
8
+ - mlx
9
+ - apple
10
+ - 4bit
11
+ - multimodal
12
+ language:
13
+ - en
14
+ - ru
15
+ library_name: mlx
16
+ ---
17
+ # Comet-12B V4 4-bit MLX (Uncensored Gemma-3 12B)
18
+
19
+ This is a merge of pre-trained language models:
20
+
21
+ - [`ReadyArt/The-Omega-Directive-Gemma3-12B-v1.0`](https://huggingface.co/ReadyArt/The-Omega-Directive-Gemma3-12B-v1.0)
22
+ - [`TheDrummer/Fallen-Gemma3-12B-v1`](https://huggingface.co/TheDrummer/Fallen-Gemma3-12B-v1)
23
+ - [`Delta-Vector/Pascal-12B`](https://huggingface.co/Delta-Vector/Pascal-12B)
24
+ - [`soob3123/amoral-gemma3-12B-v2`](https://huggingface.co/soob3123/amoral-gemma3-12B-v2)
25
+
26
+ The goal of this merge was to create a good, all‑purpose, **uncensored** model without excessive positive bias.
27
+
28
+
29
+ The model was converted to MLX format from [`OddTheGreat/Comet_12B_V.4`](https://huggingface.co/OddTheGreat/Comet_12B_V.4) using mlx-vlm version **0.1.23**.
30
+
31
+ Refer to the [original model card](https://huggingface.co/OddTheGreat/Comet_12B_V.4) for more details on the model.
32
+
33
+
34
+ ## Use with mlx
35
+
36
+ ```bash
37
+ pip install -U mlx-vlm
38
+ ```
39
+
40
+ ```bash
41
+ python -m mlx_vlm.generate --model TheCluster/Comet-12B-v4-mlx-4bit --max-tokens 512 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
42
+ ```