Moraliane commited on
Commit
5ab71fa
·
verified ·
1 Parent(s): 421b34d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +86 -56
README.md CHANGED
@@ -1,56 +1,86 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # SAINEMO2.1
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the della_linear merge method using E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * E:\Programs\TextGen\text-generation-webui\models\elinas_Chronos-Gold-12B-1.0
22
- * E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
23
- * E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
24
-
25
- ### Configuration
26
-
27
- The following YAML configuration was used to produce this model:
28
-
29
- ```yaml
30
- models:
31
- - model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
32
- parameters:
33
- weight: 0.55 # Основной акцент на русском языке
34
- density: 0.4
35
- - model: E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
36
- parameters:
37
- weight: 0.2 # РП модель, чуть меньший вес из-за ориентации на английский
38
- density: 0.4
39
- - model: E:\Programs\TextGen\text-generation-webui\models\elinas_Chronos-Gold-12B-1.0
40
- parameters:
41
- weight: 0.15 # Вторая РП модель
42
- density: 0.4
43
- - model: E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
44
- parameters:
45
- weight: 0.25 # Русскоязычная поддержка и баланс
46
- density: 0.4
47
-
48
- merge_method: della_linear
49
- base_model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
50
- parameters:
51
- epsilon: 0.05
52
- lambda: 1
53
- dtype: float16
54
- tokenizer_source: base
55
-
56
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - IlyaGusev/saiga_nemo_12b
4
+ - elinas/Chronos-Gold-12B-1.0
5
+ - Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24
6
+ library_name: transformers
7
+ tags:
8
+ - mergekit
9
+ - merge
10
+ language:
11
+ - ru
12
+ - en
13
+ ---
14
+ # SAINEMO-reMIX
15
+ ![SAINEMO-reMIX](./remixwife.webp)
16
+
17
+ GGUF: Soon...
18
+
19
+ # Presets
20
+ The given presets are quite suitable for this model. https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main/Customized/Mistral%20Improved
21
+ # Sampler
22
+
23
+
24
+ ```
25
+ Temp - 0,7 - 1,2 ~
26
+ TopA - 0,1
27
+ DRY - 0,8 1,75 2 0
28
+
29
+ ```
30
+
31
+
32
+
33
+
34
+
35
+
36
+
37
+
38
+
39
+
40
+
41
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
42
+
43
+ ## Merge Details
44
+ ### Merge Method
45
+
46
+ This model was merged using the della_linear merge method using E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b as a base.
47
+
48
+ ### Models Merged
49
+
50
+ The following models were included in the merge:
51
+ * E:\Programs\TextGen\text-generation-webui\models\elinas_Chronos-Gold-12B-1.0
52
+ * E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
53
+ * E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
54
+
55
+ ### Configuration
56
+
57
+ The following YAML configuration was used to produce this model:
58
+
59
+ ```yaml
60
+ models:
61
+ - model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
62
+ parameters:
63
+ weight: 0.55 # Основной акцент на русском языке
64
+ density: 0.4
65
+ - model: E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
66
+ parameters:
67
+ weight: 0.2 # РП модель, чуть меньший вес из-за ориентации на английский
68
+ density: 0.4
69
+ - model: E:\Programs\TextGen\text-generation-webui\models\elinas_Chronos-Gold-12B-1.0
70
+ parameters:
71
+ weight: 0.15 # Вторая РП модель
72
+ density: 0.4
73
+ - model: E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
74
+ parameters:
75
+ weight: 0.25 # Русскоязычная поддержка и баланс
76
+ density: 0.4
77
+
78
+ merge_method: della_linear
79
+ base_model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
80
+ parameters:
81
+ epsilon: 0.05
82
+ lambda: 1
83
+ dtype: float16
84
+ tokenizer_source: base
85
+
86
+ ```