Hugging Face's logo

AmberYifan
/
Qwen2.5-7B-spin-2k-hhrlhf

Safetensors
qwen2
Generated from Trainer
Model card Files Community
1
lbourdois commited on
Commit
2834c84
·
verified ·
1 Parent(s): 72f7e1a

Improve language tag

Browse files

Hi! As the model is multilingual, this is a PR to add other languages than English to the language tag to improve the referencing. Note that 29 languages are announced in the README, but only 13 are explicitly listed. I was therefore only able to add these 13 languages.

Files changed (1) hide show
  1. README.md +85 -71
README.md CHANGED
@@ -1,71 +1,85 @@
1
- ---
2
- license: apache-2.0
3
- base_model: Qwen/Qwen2.5-7B
4
- tags:
5
- - generated_from_trainer
6
- model-index:
7
- - name: Qwen2.5-7B-spin-2k-hhrlhf
8
- results: []
9
- ---
10
-
11
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
- should probably proofread and complete it, then remove this comment. -->
13
-
14
- # Qwen2.5-7B-spin-2k-hhrlhf
15
-
16
- This model is a fine-tuned version of [Qwen/Qwen2.5-7B](https://huggingface.co/Qwen/Qwen2.5-7B) on an unknown dataset.
17
- It achieves the following results on the evaluation set:
18
- - Loss: 0.1118
19
- - Rewards/real: 7.4786
20
- - Rewards/generated: -3.0273
21
- - Rewards/accuracies: 1.0
22
- - Rewards/margins: 10.5060
23
- - Logps/generated: -309.5072
24
- - Logps/real: -106.0837
25
- - Logits/generated: -0.7103
26
- - Logits/real: -1.2792
27
-
28
- ## Model description
29
-
30
- More information needed
31
-
32
- ## Intended uses & limitations
33
-
34
- More information needed
35
-
36
- ## Training and evaluation data
37
-
38
- More information needed
39
-
40
- ## Training procedure
41
-
42
- ### Training hyperparameters
43
-
44
- The following hyperparameters were used during training:
45
- - learning_rate: 5e-07
46
- - train_batch_size: 4
47
- - eval_batch_size: 4
48
- - seed: 42
49
- - distributed_type: multi-GPU
50
- - num_devices: 4
51
- - gradient_accumulation_steps: 2
52
- - total_train_batch_size: 32
53
- - total_eval_batch_size: 16
54
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
55
- - lr_scheduler_type: linear
56
- - lr_scheduler_warmup_ratio: 0.1
57
- - num_epochs: 1
58
-
59
- ### Training results
60
-
61
- | Training Loss | Epoch | Step | Validation Loss | Rewards/real | Rewards/generated | Rewards/accuracies | Rewards/margins | Logps/generated | Logps/real | Logits/generated | Logits/real |
62
- |:-------------:|:-----:|:----:|:---------------:|:------------:|:-----------------:|:------------------:|:---------------:|:---------------:|:----------:|:----------------:|:-----------:|
63
- | 0.1077 | 0.8 | 50 | 0.1118 | 7.4786 | -3.0273 | 1.0 | 10.5060 | -309.5072 | -106.0837 | -0.7103 | -1.2792 |
64
-
65
-
66
- ### Framework versions
67
-
68
- - Transformers 4.43.3
69
- - Pytorch 2.2.2+cu121
70
- - Datasets 2.20.0
71
- - Tokenizers 0.19.1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen2.5-7B
4
+ tags:
5
+ - generated_from_trainer
6
+ language:
7
+ - zho
8
+ - eng
9
+ - fra
10
+ - spa
11
+ - por
12
+ - deu
13
+ - ita
14
+ - rus
15
+ - jpn
16
+ - kor
17
+ - vie
18
+ - tha
19
+ - ara
20
+ model-index:
21
+ - name: Qwen2.5-7B-spin-2k-hhrlhf
22
+ results: []
23
+ ---
24
+
25
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
26
+ should probably proofread and complete it, then remove this comment. -->
27
+
28
+ # Qwen2.5-7B-spin-2k-hhrlhf
29
+
30
+ This model is a fine-tuned version of [Qwen/Qwen2.5-7B](https://huggingface.co/Qwen/Qwen2.5-7B) on an unknown dataset.
31
+ It achieves the following results on the evaluation set:
32
+ - Loss: 0.1118
33
+ - Rewards/real: 7.4786
34
+ - Rewards/generated: -3.0273
35
+ - Rewards/accuracies: 1.0
36
+ - Rewards/margins: 10.5060
37
+ - Logps/generated: -309.5072
38
+ - Logps/real: -106.0837
39
+ - Logits/generated: -0.7103
40
+ - Logits/real: -1.2792
41
+
42
+ ## Model description
43
+
44
+ More information needed
45
+
46
+ ## Intended uses & limitations
47
+
48
+ More information needed
49
+
50
+ ## Training and evaluation data
51
+
52
+ More information needed
53
+
54
+ ## Training procedure
55
+
56
+ ### Training hyperparameters
57
+
58
+ The following hyperparameters were used during training:
59
+ - learning_rate: 5e-07
60
+ - train_batch_size: 4
61
+ - eval_batch_size: 4
62
+ - seed: 42
63
+ - distributed_type: multi-GPU
64
+ - num_devices: 4
65
+ - gradient_accumulation_steps: 2
66
+ - total_train_batch_size: 32
67
+ - total_eval_batch_size: 16
68
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
69
+ - lr_scheduler_type: linear
70
+ - lr_scheduler_warmup_ratio: 0.1
71
+ - num_epochs: 1
72
+
73
+ ### Training results
74
+
75
+ | Training Loss | Epoch | Step | Validation Loss | Rewards/real | Rewards/generated | Rewards/accuracies | Rewards/margins | Logps/generated | Logps/real | Logits/generated | Logits/real |
76
+ |:-------------:|:-----:|:----:|:---------------:|:------------:|:-----------------:|:------------------:|:---------------:|:---------------:|:----------:|:----------------:|:-----------:|
77
+ | 0.1077 | 0.8 | 50 | 0.1118 | 7.4786 | -3.0273 | 1.0 | 10.5060 | -309.5072 | -106.0837 | -0.7103 | -1.2792 |
78
+
79
+
80
+ ### Framework versions
81
+
82
+ - Transformers 4.43.3
83
+ - Pytorch 2.2.2+cu121
84
+ - Datasets 2.20.0
85
+ - Tokenizers 0.19.1