Hugging Face's logo

htlou
/
backup_0202_llamafactory_RLAIF-V-Dataset-llava-mistral

Image-Text-to-Text
Transformers
Safetensors
llava_next
llama-factory
full
Generated from Trainer
conversational
text-generation-inference
Model card Files Community
htlou commited on
Commit
79117ff
·
verified ·
1 Parent(s): 83dcf8f

Upload folder using huggingface_hub

Browse files
Files changed (23) hide show
  1. README.md +94 -0
  2. added_tokens.json +4 -0
  3. all_results.json +20 -0
  4. config.json +68 -0
  5. eval_results.json +15 -0
  6. generation_config.json +6 -0
  7. model-00001-of-00004.safetensors +3 -0
  8. model-00002-of-00004.safetensors +3 -0
  9. model-00003-of-00004.safetensors +3 -0
  10. model-00004-of-00004.safetensors +3 -0
  11. model.safetensors.index.json +694 -0
  12. preprocessor_config.json +52 -0
  13. special_tokens_map.json +30 -0
  14. tokenizer.json +0 -0
  15. tokenizer.model +3 -0
  16. tokenizer_config.json +70 -0
  17. train_results.json +8 -0
  18. trainer_log.jsonl +197 -0
  19. trainer_state.json +0 -0
  20. training_args.bin +3 -0
  21. training_eval_loss.png +0 -0
  22. training_loss.png +0 -0
  23. training_rewards_accuracies.png +0 -0
README.md ADDED
@@ -0,0 +1,94 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: other
4
+ base_model: llava-hf/llava-v1.6-mistral-7b-hf
5
+ tags:
6
+ - llama-factory
7
+ - full
8
+ - generated_from_trainer
9
+ model-index:
10
+ - name: RLAIF-V-Dataset
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # RLAIF-V-Dataset
18
+
19
+ This model is a fine-tuned version of [llava-hf/llava-v1.6-mistral-7b-hf](https://huggingface.co/llava-hf/llava-v1.6-mistral-7b-hf) on the RLAIF-V-Dataset dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.4513
22
+ - Rewards/chosen: -3.2808
23
+ - Rewards/rejected: -6.0928
24
+ - Rewards/accuracies: 0.8212
25
+ - Rewards/margins: 2.8121
26
+ - Logps/rejected: -219.8085
27
+ - Logps/chosen: -191.2850
28
+ - Logits/rejected: -2.2605
29
+ - Logits/chosen: -2.2964
30
+
31
+ ## Model description
32
+
33
+ More information needed
34
+
35
+ ## Intended uses & limitations
36
+
37
+ More information needed
38
+
39
+ ## Training and evaluation data
40
+
41
+ More information needed
42
+
43
+ ## Training procedure
44
+
45
+ ### Training hyperparameters
46
+
47
+ The following hyperparameters were used during training:
48
+ - learning_rate: 1e-06
49
+ - train_batch_size: 8
50
+ - eval_batch_size: 8
51
+ - seed: 42
52
+ - distributed_type: multi-GPU
53
+ - num_devices: 8
54
+ - gradient_accumulation_steps: 4
55
+ - total_train_batch_size: 256
56
+ - total_eval_batch_size: 64
57
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
58
+ - lr_scheduler_type: cosine
59
+ - lr_scheduler_warmup_steps: 10
60
+ - num_epochs: 3.0
61
+
62
+ ### Training results
63
+
64
+ | Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Rewards/rejected | Rewards/accuracies | Rewards/margins | Logps/rejected | Logps/chosen | Logits/rejected | Logits/chosen |
65
+ |:-------------:|:------:|:----:|:---------------:|:--------------:|:----------------:|:------------------:|:---------------:|:--------------:|:------------:|:---------------:|:-------------:|
66
+ | 0.5989 | 0.1368 | 40 | 0.6069 | -0.3887 | -0.8615 | 0.6365 | 0.4728 | -167.4954 | -162.3644 | -2.4012 | -2.4102 |
67
+ | 0.5452 | 0.2735 | 80 | 0.5331 | -0.8812 | -1.8338 | 0.7135 | 0.9526 | -177.2182 | -167.2896 | -2.5177 | -2.5334 |
68
+ | 0.5026 | 0.4103 | 120 | 0.4925 | -1.4411 | -2.6703 | 0.7442 | 1.2292 | -185.5836 | -172.8887 | -1.9765 | -2.0268 |
69
+ | 0.4511 | 0.5470 | 160 | 0.4683 | -1.3283 | -3.0284 | 0.7625 | 1.7001 | -189.1644 | -171.7603 | -2.0280 | -2.0709 |
70
+ | 0.4562 | 0.6838 | 200 | 0.4528 | -1.4943 | -3.2675 | 0.7567 | 1.7732 | -191.5553 | -173.4200 | -2.1029 | -2.1462 |
71
+ | 0.4189 | 0.8205 | 240 | 0.4494 | -1.9309 | -3.8899 | 0.7663 | 1.9589 | -197.7792 | -177.7867 | -2.4165 | -2.4472 |
72
+ | 0.4484 | 0.9573 | 280 | 0.4432 | -1.7397 | -3.8238 | 0.7635 | 2.0841 | -197.1187 | -175.8746 | -2.1586 | -2.2000 |
73
+ | 0.222 | 1.0940 | 320 | 0.4504 | -1.2207 | -2.9698 | 0.7760 | 1.7491 | -188.5780 | -170.6839 | -2.4060 | -2.4397 |
74
+ | 0.2018 | 1.2308 | 360 | 0.4438 | -2.0855 | -4.4746 | 0.7885 | 2.3891 | -203.6262 | -179.3325 | -2.3445 | -2.3790 |
75
+ | 0.2017 | 1.3675 | 400 | 0.4350 | -1.9109 | -4.1414 | 0.7981 | 2.2305 | -200.2943 | -177.5862 | -2.3022 | -2.3351 |
76
+ | 0.1999 | 1.5043 | 440 | 0.4288 | -2.1056 | -4.4641 | 0.8048 | 2.3585 | -203.5214 | -179.5331 | -2.1361 | -2.1716 |
77
+ | 0.1837 | 1.6410 | 480 | 0.4262 | -2.2318 | -4.7056 | 0.8125 | 2.4738 | -205.9359 | -180.7949 | -2.2127 | -2.2452 |
78
+ | 0.1942 | 1.7778 | 520 | 0.4163 | -2.3806 | -5.0283 | 0.8115 | 2.6478 | -209.1637 | -182.2829 | -2.3333 | -2.3675 |
79
+ | 0.1821 | 1.9145 | 560 | 0.4165 | -2.2038 | -4.6709 | 0.8173 | 2.4671 | -205.5893 | -180.5155 | -2.3238 | -2.3543 |
80
+ | 0.0858 | 2.0513 | 600 | 0.4415 | -2.7029 | -5.1979 | 0.8144 | 2.4950 | -210.8597 | -185.5066 | -2.2872 | -2.3220 |
81
+ | 0.0832 | 2.1880 | 640 | 0.4414 | -2.8951 | -5.6554 | 0.8173 | 2.7603 | -215.4344 | -187.4282 | -2.2892 | -2.3247 |
82
+ | 0.0817 | 2.3248 | 680 | 0.4521 | -3.2403 | -6.0014 | 0.8154 | 2.7611 | -218.8945 | -190.8804 | -2.2697 | -2.3056 |
83
+ | 0.0858 | 2.4615 | 720 | 0.4479 | -3.3847 | -6.3012 | 0.8221 | 2.9165 | -221.8926 | -192.3248 | -2.2708 | -2.3072 |
84
+ | 0.0723 | 2.5983 | 760 | 0.4574 | -3.3436 | -6.1113 | 0.8173 | 2.7677 | -219.9932 | -191.9133 | -2.2754 | -2.3103 |
85
+ | 0.0717 | 2.7350 | 800 | 0.4532 | -3.3171 | -6.1289 | 0.8192 | 2.8118 | -220.1688 | -191.6483 | -2.2610 | -2.2973 |
86
+ | 0.0691 | 2.8718 | 840 | 0.4514 | -3.2739 | -6.0855 | 0.8212 | 2.8116 | -219.7354 | -191.2166 | -2.2604 | -2.2964 |
87
+
88
+
89
+ ### Framework versions
90
+
91
+ - Transformers 4.45.2
92
+ - Pytorch 2.4.0+cu121
93
+ - Datasets 2.21.0
94
+ - Tokenizers 0.20.3
added_tokens.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "<image>": 32000,
3
+ "<pad>": 32001
4
+ }
all_results.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 2.994871794871795,
3
+ "eval_logits/chosen": -2.296416759490967,
4
+ "eval_logits/rejected": -2.2604804039001465,
5
+ "eval_logps/chosen": -191.28500366210938,
6
+ "eval_logps/rejected": -219.8085479736328,
7
+ "eval_loss": 0.4512675702571869,
8
+ "eval_rewards/accuracies": 0.8211538195610046,
9
+ "eval_rewards/chosen": -3.2807652950286865,
10
+ "eval_rewards/margins": 2.812060594558716,
11
+ "eval_rewards/rejected": -6.092825889587402,
12
+ "eval_runtime": 509.575,
13
+ "eval_samples_per_second": 16.316,
14
+ "eval_steps_per_second": 0.255,
15
+ "total_flos": 1.0330118169821184e+16,
16
+ "train_loss": 0.2632859356310134,
17
+ "train_runtime": 40450.3897,
18
+ "train_samples_per_second": 5.549,
19
+ "train_steps_per_second": 0.022
20
+ }
config.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "/data/align-anything/hantao/models/llava-v1.6-mistral-7b-hf",
3
+ "architectures": [
4
+ "LlavaNextForConditionalGeneration"
5
+ ],
6
+ "hidden_size": 4096,
7
+ "ignore_index": -100,
8
+ "image_grid_pinpoints": [
9
+ [
10
+ 336,
11
+ 672
12
+ ],
13
+ [
14
+ 672,
15
+ 336
16
+ ],
17
+ [
18
+ 672,
19
+ 672
20
+ ],
21
+ [
22
+ 1008,
23
+ 336
24
+ ],
25
+ [
26
+ 336,
27
+ 1008
28
+ ]
29
+ ],
30
+ "image_seq_length": 576,
31
+ "image_token_index": 32000,
32
+ "model_type": "llava_next",
33
+ "projector_hidden_act": "gelu",
34
+ "text_config": {
35
+ "_name_or_path": "mistralai/Mistral-7B-Instruct-v0.2",
36
+ "architectures": [
37
+ "MistralForCausalLM"
38
+ ],
39
+ "intermediate_size": 14336,
40
+ "max_position_embeddings": 32768,
41
+ "model_type": "mistral",
42
+ "num_key_value_heads": 8,
43
+ "rms_norm_eps": 1e-05,
44
+ "rope_theta": 1000000.0,
45
+ "sliding_window": null,
46
+ "torch_dtype": "bfloat16",
47
+ "vocab_size": 32064
48
+ },
49
+ "tie_word_embeddings": false,
50
+ "torch_dtype": "bfloat16",
51
+ "transformers_version": "4.45.2",
52
+ "use_cache": false,
53
+ "use_image_newline_parameter": true,
54
+ "vision_config": {
55
+ "hidden_size": 1024,
56
+ "image_size": 336,
57
+ "intermediate_size": 4096,
58
+ "model_type": "clip_vision_model",
59
+ "num_attention_heads": 16,
60
+ "num_hidden_layers": 24,
61
+ "patch_size": 14,
62
+ "projection_dim": 768,
63
+ "vocab_size": 32000
64
+ },
65
+ "vision_feature_layer": -2,
66
+ "vision_feature_select_strategy": "default",
67
+ "vocab_size": 32064
68
+ }
eval_results.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 2.994871794871795,
3
+ "eval_logits/chosen": -2.296416759490967,
4
+ "eval_logits/rejected": -2.2604804039001465,
5
+ "eval_logps/chosen": -191.28500366210938,
6
+ "eval_logps/rejected": -219.8085479736328,
7
+ "eval_loss": 0.4512675702571869,
8
+ "eval_rewards/accuracies": 0.8211538195610046,
9
+ "eval_rewards/chosen": -3.2807652950286865,
10
+ "eval_rewards/margins": 2.812060594558716,
11
+ "eval_rewards/rejected": -6.092825889587402,
12
+ "eval_runtime": 509.575,
13
+ "eval_samples_per_second": 16.316,
14
+ "eval_steps_per_second": 0.255
15
+ }
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 1,
4
+ "eos_token_id": 2,
5
+ "transformers_version": "4.45.2"
6
+ }
model-00001-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32be2aab4c2465e8b8a98ca540626ffd7dd235a695f9556b7767c0e17059ceb2
3
+ size 4921618624
model-00002-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6114d676f0194c0f3c3106c5bcc0f049e4c0a655ce9f8e5004e39a0ddc14ed29
3
+ size 4915917672
model-00003-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35ce0c0a1b108af110f6970398fd421f25dc7e336003826663cf9f1ea658e961
3
+ size 4915917680
model-00004-of-00004.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c73e805c7ed1d38dd743ddfaa9a4bb46e790cc994664cb2686c3d7b99a90e9f
3
+ size 380134008
model.safetensors.index.json ADDED
@@ -0,0 +1,694 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 15133495296
4
+ },
5
+ "weight_map": {
6
+ "image_newline": "model-00001-of-00004.safetensors",
7
+ "language_model.lm_head.weight": "model-00004-of-00004.safetensors",
8
+ "language_model.model.embed_tokens.weight": "model-00001-of-00004.safetensors",
9
+ "language_model.model.layers.0.input_layernorm.weight": "model-00001-of-00004.safetensors",
10
+ "language_model.model.layers.0.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
11
+ "language_model.model.layers.0.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
12
+ "language_model.model.layers.0.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
13
+ "language_model.model.layers.0.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
14
+ "language_model.model.layers.0.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
15
+ "language_model.model.layers.0.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
16
+ "language_model.model.layers.0.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
17
+ "language_model.model.layers.0.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
18
+ "language_model.model.layers.1.input_layernorm.weight": "model-00001-of-00004.safetensors",
19
+ "language_model.model.layers.1.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
20
+ "language_model.model.layers.1.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
21
+ "language_model.model.layers.1.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
22
+ "language_model.model.layers.1.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
23
+ "language_model.model.layers.1.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
24
+ "language_model.model.layers.1.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
25
+ "language_model.model.layers.1.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
26
+ "language_model.model.layers.1.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
27
+ "language_model.model.layers.10.input_layernorm.weight": "model-00002-of-00004.safetensors",
28
+ "language_model.model.layers.10.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
29
+ "language_model.model.layers.10.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
30
+ "language_model.model.layers.10.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
31
+ "language_model.model.layers.10.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
32
+ "language_model.model.layers.10.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
33
+ "language_model.model.layers.10.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
34
+ "language_model.model.layers.10.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
35
+ "language_model.model.layers.10.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
36
+ "language_model.model.layers.11.input_layernorm.weight": "model-00002-of-00004.safetensors",
37
+ "language_model.model.layers.11.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
38
+ "language_model.model.layers.11.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
39
+ "language_model.model.layers.11.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
40
+ "language_model.model.layers.11.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
41
+ "language_model.model.layers.11.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
42
+ "language_model.model.layers.11.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
43
+ "language_model.model.layers.11.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
44
+ "language_model.model.layers.11.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
45
+ "language_model.model.layers.12.input_layernorm.weight": "model-00002-of-00004.safetensors",
46
+ "language_model.model.layers.12.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
47
+ "language_model.model.layers.12.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
48
+ "language_model.model.layers.12.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
49
+ "language_model.model.layers.12.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
50
+ "language_model.model.layers.12.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
51
+ "language_model.model.layers.12.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
52
+ "language_model.model.layers.12.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
53
+ "language_model.model.layers.12.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
54
+ "language_model.model.layers.13.input_layernorm.weight": "model-00002-of-00004.safetensors",
55
+ "language_model.model.layers.13.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
56
+ "language_model.model.layers.13.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
57
+ "language_model.model.layers.13.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
58
+ "language_model.model.layers.13.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
59
+ "language_model.model.layers.13.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
60
+ "language_model.model.layers.13.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
61
+ "language_model.model.layers.13.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
62
+ "language_model.model.layers.13.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
63
+ "language_model.model.layers.14.input_layernorm.weight": "model-00002-of-00004.safetensors",
64
+ "language_model.model.layers.14.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
65
+ "language_model.model.layers.14.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
66
+ "language_model.model.layers.14.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
67
+ "language_model.model.layers.14.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
68
+ "language_model.model.layers.14.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
69
+ "language_model.model.layers.14.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
70
+ "language_model.model.layers.14.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
71
+ "language_model.model.layers.14.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
72
+ "language_model.model.layers.15.input_layernorm.weight": "model-00002-of-00004.safetensors",
73
+ "language_model.model.layers.15.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
74
+ "language_model.model.layers.15.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
75
+ "language_model.model.layers.15.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
76
+ "language_model.model.layers.15.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
77
+ "language_model.model.layers.15.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
78
+ "language_model.model.layers.15.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
79
+ "language_model.model.layers.15.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
80
+ "language_model.model.layers.15.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
81
+ "language_model.model.layers.16.input_layernorm.weight": "model-00002-of-00004.safetensors",
82
+ "language_model.model.layers.16.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
83
+ "language_model.model.layers.16.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
84
+ "language_model.model.layers.16.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
85
+ "language_model.model.layers.16.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
86
+ "language_model.model.layers.16.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
87
+ "language_model.model.layers.16.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
88
+ "language_model.model.layers.16.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
89
+ "language_model.model.layers.16.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
90
+ "language_model.model.layers.17.input_layernorm.weight": "model-00002-of-00004.safetensors",
91
+ "language_model.model.layers.17.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
92
+ "language_model.model.layers.17.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
93
+ "language_model.model.layers.17.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
94
+ "language_model.model.layers.17.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
95
+ "language_model.model.layers.17.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
96
+ "language_model.model.layers.17.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
97
+ "language_model.model.layers.17.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
98
+ "language_model.model.layers.17.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
99
+ "language_model.model.layers.18.input_layernorm.weight": "model-00002-of-00004.safetensors",
100
+ "language_model.model.layers.18.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
101
+ "language_model.model.layers.18.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
102
+ "language_model.model.layers.18.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
103
+ "language_model.model.layers.18.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
104
+ "language_model.model.layers.18.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
105
+ "language_model.model.layers.18.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
106
+ "language_model.model.layers.18.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
107
+ "language_model.model.layers.18.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
108
+ "language_model.model.layers.19.input_layernorm.weight": "model-00002-of-00004.safetensors",
109
+ "language_model.model.layers.19.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
110
+ "language_model.model.layers.19.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
111
+ "language_model.model.layers.19.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
112
+ "language_model.model.layers.19.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
113
+ "language_model.model.layers.19.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
114
+ "language_model.model.layers.19.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
115
+ "language_model.model.layers.19.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
116
+ "language_model.model.layers.19.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
117
+ "language_model.model.layers.2.input_layernorm.weight": "model-00001-of-00004.safetensors",
118
+ "language_model.model.layers.2.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
119
+ "language_model.model.layers.2.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
120
+ "language_model.model.layers.2.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
121
+ "language_model.model.layers.2.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
122
+ "language_model.model.layers.2.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
123
+ "language_model.model.layers.2.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
124
+ "language_model.model.layers.2.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
125
+ "language_model.model.layers.2.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
126
+ "language_model.model.layers.20.input_layernorm.weight": "model-00003-of-00004.safetensors",
127
+ "language_model.model.layers.20.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
128
+ "language_model.model.layers.20.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
129
+ "language_model.model.layers.20.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
130
+ "language_model.model.layers.20.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
131
+ "language_model.model.layers.20.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
132
+ "language_model.model.layers.20.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
133
+ "language_model.model.layers.20.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
134
+ "language_model.model.layers.20.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
135
+ "language_model.model.layers.21.input_layernorm.weight": "model-00003-of-00004.safetensors",
136
+ "language_model.model.layers.21.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
137
+ "language_model.model.layers.21.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
138
+ "language_model.model.layers.21.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
139
+ "language_model.model.layers.21.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
140
+ "language_model.model.layers.21.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
141
+ "language_model.model.layers.21.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
142
+ "language_model.model.layers.21.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
143
+ "language_model.model.layers.21.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
144
+ "language_model.model.layers.22.input_layernorm.weight": "model-00003-of-00004.safetensors",
145
+ "language_model.model.layers.22.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
146
+ "language_model.model.layers.22.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
147
+ "language_model.model.layers.22.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
148
+ "language_model.model.layers.22.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
149
+ "language_model.model.layers.22.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
150
+ "language_model.model.layers.22.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
151
+ "language_model.model.layers.22.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
152
+ "language_model.model.layers.22.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
153
+ "language_model.model.layers.23.input_layernorm.weight": "model-00003-of-00004.safetensors",
154
+ "language_model.model.layers.23.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
155
+ "language_model.model.layers.23.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
156
+ "language_model.model.layers.23.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
157
+ "language_model.model.layers.23.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
158
+ "language_model.model.layers.23.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
159
+ "language_model.model.layers.23.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
160
+ "language_model.model.layers.23.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
161
+ "language_model.model.layers.23.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
162
+ "language_model.model.layers.24.input_layernorm.weight": "model-00003-of-00004.safetensors",
163
+ "language_model.model.layers.24.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
164
+ "language_model.model.layers.24.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
165
+ "language_model.model.layers.24.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
166
+ "language_model.model.layers.24.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
167
+ "language_model.model.layers.24.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
168
+ "language_model.model.layers.24.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
169
+ "language_model.model.layers.24.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
170
+ "language_model.model.layers.24.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
171
+ "language_model.model.layers.25.input_layernorm.weight": "model-00003-of-00004.safetensors",
172
+ "language_model.model.layers.25.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
173
+ "language_model.model.layers.25.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
174
+ "language_model.model.layers.25.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
175
+ "language_model.model.layers.25.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
176
+ "language_model.model.layers.25.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
177
+ "language_model.model.layers.25.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
178
+ "language_model.model.layers.25.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
179
+ "language_model.model.layers.25.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
180
+ "language_model.model.layers.26.input_layernorm.weight": "model-00003-of-00004.safetensors",
181
+ "language_model.model.layers.26.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
182
+ "language_model.model.layers.26.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
183
+ "language_model.model.layers.26.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
184
+ "language_model.model.layers.26.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
185
+ "language_model.model.layers.26.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
186
+ "language_model.model.layers.26.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
187
+ "language_model.model.layers.26.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
188
+ "language_model.model.layers.26.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
189
+ "language_model.model.layers.27.input_layernorm.weight": "model-00003-of-00004.safetensors",
190
+ "language_model.model.layers.27.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
191
+ "language_model.model.layers.27.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
192
+ "language_model.model.layers.27.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
193
+ "language_model.model.layers.27.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
194
+ "language_model.model.layers.27.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
195
+ "language_model.model.layers.27.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
196
+ "language_model.model.layers.27.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
197
+ "language_model.model.layers.27.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
198
+ "language_model.model.layers.28.input_layernorm.weight": "model-00003-of-00004.safetensors",
199
+ "language_model.model.layers.28.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
200
+ "language_model.model.layers.28.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
201
+ "language_model.model.layers.28.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
202
+ "language_model.model.layers.28.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
203
+ "language_model.model.layers.28.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
204
+ "language_model.model.layers.28.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
205
+ "language_model.model.layers.28.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
206
+ "language_model.model.layers.28.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
207
+ "language_model.model.layers.29.input_layernorm.weight": "model-00003-of-00004.safetensors",
208
+ "language_model.model.layers.29.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
209
+ "language_model.model.layers.29.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
210
+ "language_model.model.layers.29.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
211
+ "language_model.model.layers.29.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
212
+ "language_model.model.layers.29.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
213
+ "language_model.model.layers.29.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
214
+ "language_model.model.layers.29.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
215
+ "language_model.model.layers.29.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
216
+ "language_model.model.layers.3.input_layernorm.weight": "model-00001-of-00004.safetensors",
217
+ "language_model.model.layers.3.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
218
+ "language_model.model.layers.3.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
219
+ "language_model.model.layers.3.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
220
+ "language_model.model.layers.3.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
221
+ "language_model.model.layers.3.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
222
+ "language_model.model.layers.3.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
223
+ "language_model.model.layers.3.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
224
+ "language_model.model.layers.3.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
225
+ "language_model.model.layers.30.input_layernorm.weight": "model-00003-of-00004.safetensors",
226
+ "language_model.model.layers.30.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
227
+ "language_model.model.layers.30.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
228
+ "language_model.model.layers.30.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
229
+ "language_model.model.layers.30.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
230
+ "language_model.model.layers.30.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
231
+ "language_model.model.layers.30.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
232
+ "language_model.model.layers.30.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
233
+ "language_model.model.layers.30.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
234
+ "language_model.model.layers.31.input_layernorm.weight": "model-00004-of-00004.safetensors",
235
+ "language_model.model.layers.31.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
236
+ "language_model.model.layers.31.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
237
+ "language_model.model.layers.31.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
238
+ "language_model.model.layers.31.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
239
+ "language_model.model.layers.31.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
240
+ "language_model.model.layers.31.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
241
+ "language_model.model.layers.31.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
242
+ "language_model.model.layers.31.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
243
+ "language_model.model.layers.4.input_layernorm.weight": "model-00001-of-00004.safetensors",
244
+ "language_model.model.layers.4.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
245
+ "language_model.model.layers.4.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
246
+ "language_model.model.layers.4.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
247
+ "language_model.model.layers.4.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
248
+ "language_model.model.layers.4.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
249
+ "language_model.model.layers.4.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
250
+ "language_model.model.layers.4.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
251
+ "language_model.model.layers.4.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
252
+ "language_model.model.layers.5.input_layernorm.weight": "model-00001-of-00004.safetensors",
253
+ "language_model.model.layers.5.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
254
+ "language_model.model.layers.5.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
255
+ "language_model.model.layers.5.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
256
+ "language_model.model.layers.5.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
257
+ "language_model.model.layers.5.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
258
+ "language_model.model.layers.5.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
259
+ "language_model.model.layers.5.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
260
+ "language_model.model.layers.5.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
261
+ "language_model.model.layers.6.input_layernorm.weight": "model-00001-of-00004.safetensors",
262
+ "language_model.model.layers.6.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
263
+ "language_model.model.layers.6.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
264
+ "language_model.model.layers.6.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
265
+ "language_model.model.layers.6.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
266
+ "language_model.model.layers.6.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
267
+ "language_model.model.layers.6.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
268
+ "language_model.model.layers.6.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
269
+ "language_model.model.layers.6.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
270
+ "language_model.model.layers.7.input_layernorm.weight": "model-00001-of-00004.safetensors",
271
+ "language_model.model.layers.7.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
272
+ "language_model.model.layers.7.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
273
+ "language_model.model.layers.7.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
274
+ "language_model.model.layers.7.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
275
+ "language_model.model.layers.7.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
276
+ "language_model.model.layers.7.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
277
+ "language_model.model.layers.7.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
278
+ "language_model.model.layers.7.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
279
+ "language_model.model.layers.8.input_layernorm.weight": "model-00001-of-00004.safetensors",
280
+ "language_model.model.layers.8.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
281
+ "language_model.model.layers.8.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
282
+ "language_model.model.layers.8.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
283
+ "language_model.model.layers.8.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
284
+ "language_model.model.layers.8.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
285
+ "language_model.model.layers.8.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
286
+ "language_model.model.layers.8.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
287
+ "language_model.model.layers.8.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
288
+ "language_model.model.layers.9.input_layernorm.weight": "model-00002-of-00004.safetensors",
289
+ "language_model.model.layers.9.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
290
+ "language_model.model.layers.9.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
291
+ "language_model.model.layers.9.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
292
+ "language_model.model.layers.9.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
293
+ "language_model.model.layers.9.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
294
+ "language_model.model.layers.9.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
295
+ "language_model.model.layers.9.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
296
+ "language_model.model.layers.9.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
297
+ "language_model.model.norm.weight": "model-00004-of-00004.safetensors",
298
+ "multi_modal_projector.linear_1.bias": "model-00001-of-00004.safetensors",
299
+ "multi_modal_projector.linear_1.weight": "model-00001-of-00004.safetensors",
300
+ "multi_modal_projector.linear_2.bias": "model-00001-of-00004.safetensors",
301
+ "multi_modal_projector.linear_2.weight": "model-00001-of-00004.safetensors",
302
+ "vision_tower.vision_model.embeddings.class_embedding": "model-00001-of-00004.safetensors",
303
+ "vision_tower.vision_model.embeddings.patch_embedding.weight": "model-00001-of-00004.safetensors",
304
+ "vision_tower.vision_model.embeddings.position_embedding.weight": "model-00001-of-00004.safetensors",
305
+ "vision_tower.vision_model.encoder.layers.0.layer_norm1.bias": "model-00001-of-00004.safetensors",
306
+ "vision_tower.vision_model.encoder.layers.0.layer_norm1.weight": "model-00001-of-00004.safetensors",
307
+ "vision_tower.vision_model.encoder.layers.0.layer_norm2.bias": "model-00001-of-00004.safetensors",
308
+ "vision_tower.vision_model.encoder.layers.0.layer_norm2.weight": "model-00001-of-00004.safetensors",
309
+ "vision_tower.vision_model.encoder.layers.0.mlp.fc1.bias": "model-00001-of-00004.safetensors",
310
+ "vision_tower.vision_model.encoder.layers.0.mlp.fc1.weight": "model-00001-of-00004.safetensors",
311
+ "vision_tower.vision_model.encoder.layers.0.mlp.fc2.bias": "model-00001-of-00004.safetensors",
312
+ "vision_tower.vision_model.encoder.layers.0.mlp.fc2.weight": "model-00001-of-00004.safetensors",
313
+ "vision_tower.vision_model.encoder.layers.0.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
314
+ "vision_tower.vision_model.encoder.layers.0.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
315
+ "vision_tower.vision_model.encoder.layers.0.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
316
+ "vision_tower.vision_model.encoder.layers.0.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
317
+ "vision_tower.vision_model.encoder.layers.0.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
318
+ "vision_tower.vision_model.encoder.layers.0.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
319
+ "vision_tower.vision_model.encoder.layers.0.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
320
+ "vision_tower.vision_model.encoder.layers.0.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
321
+ "vision_tower.vision_model.encoder.layers.1.layer_norm1.bias": "model-00001-of-00004.safetensors",
322
+ "vision_tower.vision_model.encoder.layers.1.layer_norm1.weight": "model-00001-of-00004.safetensors",
323
+ "vision_tower.vision_model.encoder.layers.1.layer_norm2.bias": "model-00001-of-00004.safetensors",
324
+ "vision_tower.vision_model.encoder.layers.1.layer_norm2.weight": "model-00001-of-00004.safetensors",
325
+ "vision_tower.vision_model.encoder.layers.1.mlp.fc1.bias": "model-00001-of-00004.safetensors",
326
+ "vision_tower.vision_model.encoder.layers.1.mlp.fc1.weight": "model-00001-of-00004.safetensors",
327
+ "vision_tower.vision_model.encoder.layers.1.mlp.fc2.bias": "model-00001-of-00004.safetensors",
328
+ "vision_tower.vision_model.encoder.layers.1.mlp.fc2.weight": "model-00001-of-00004.safetensors",
329
+ "vision_tower.vision_model.encoder.layers.1.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
330
+ "vision_tower.vision_model.encoder.layers.1.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
331
+ "vision_tower.vision_model.encoder.layers.1.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
332
+ "vision_tower.vision_model.encoder.layers.1.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
333
+ "vision_tower.vision_model.encoder.layers.1.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
334
+ "vision_tower.vision_model.encoder.layers.1.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
335
+ "vision_tower.vision_model.encoder.layers.1.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
336
+ "vision_tower.vision_model.encoder.layers.1.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
337
+ "vision_tower.vision_model.encoder.layers.10.layer_norm1.bias": "model-00001-of-00004.safetensors",
338
+ "vision_tower.vision_model.encoder.layers.10.layer_norm1.weight": "model-00001-of-00004.safetensors",
339
+ "vision_tower.vision_model.encoder.layers.10.layer_norm2.bias": "model-00001-of-00004.safetensors",
340
+ "vision_tower.vision_model.encoder.layers.10.layer_norm2.weight": "model-00001-of-00004.safetensors",
341
+ "vision_tower.vision_model.encoder.layers.10.mlp.fc1.bias": "model-00001-of-00004.safetensors",
342
+ "vision_tower.vision_model.encoder.layers.10.mlp.fc1.weight": "model-00001-of-00004.safetensors",
343
+ "vision_tower.vision_model.encoder.layers.10.mlp.fc2.bias": "model-00001-of-00004.safetensors",
344
+ "vision_tower.vision_model.encoder.layers.10.mlp.fc2.weight": "model-00001-of-00004.safetensors",
345
+ "vision_tower.vision_model.encoder.layers.10.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
346
+ "vision_tower.vision_model.encoder.layers.10.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
347
+ "vision_tower.vision_model.encoder.layers.10.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
348
+ "vision_tower.vision_model.encoder.layers.10.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
349
+ "vision_tower.vision_model.encoder.layers.10.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
350
+ "vision_tower.vision_model.encoder.layers.10.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
351
+ "vision_tower.vision_model.encoder.layers.10.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
352
+ "vision_tower.vision_model.encoder.layers.10.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
353
+ "vision_tower.vision_model.encoder.layers.11.layer_norm1.bias": "model-00001-of-00004.safetensors",
354
+ "vision_tower.vision_model.encoder.layers.11.layer_norm1.weight": "model-00001-of-00004.safetensors",
355
+ "vision_tower.vision_model.encoder.layers.11.layer_norm2.bias": "model-00001-of-00004.safetensors",
356
+ "vision_tower.vision_model.encoder.layers.11.layer_norm2.weight": "model-00001-of-00004.safetensors",
357
+ "vision_tower.vision_model.encoder.layers.11.mlp.fc1.bias": "model-00001-of-00004.safetensors",
358
+ "vision_tower.vision_model.encoder.layers.11.mlp.fc1.weight": "model-00001-of-00004.safetensors",
359
+ "vision_tower.vision_model.encoder.layers.11.mlp.fc2.bias": "model-00001-of-00004.safetensors",
360
+ "vision_tower.vision_model.encoder.layers.11.mlp.fc2.weight": "model-00001-of-00004.safetensors",
361
+ "vision_tower.vision_model.encoder.layers.11.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
362
+ "vision_tower.vision_model.encoder.layers.11.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
363
+ "vision_tower.vision_model.encoder.layers.11.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
364
+ "vision_tower.vision_model.encoder.layers.11.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
365
+ "vision_tower.vision_model.encoder.layers.11.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
366
+ "vision_tower.vision_model.encoder.layers.11.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
367
+ "vision_tower.vision_model.encoder.layers.11.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
368
+ "vision_tower.vision_model.encoder.layers.11.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
369
+ "vision_tower.vision_model.encoder.layers.12.layer_norm1.bias": "model-00001-of-00004.safetensors",
370
+ "vision_tower.vision_model.encoder.layers.12.layer_norm1.weight": "model-00001-of-00004.safetensors",
371
+ "vision_tower.vision_model.encoder.layers.12.layer_norm2.bias": "model-00001-of-00004.safetensors",
372
+ "vision_tower.vision_model.encoder.layers.12.layer_norm2.weight": "model-00001-of-00004.safetensors",
373
+ "vision_tower.vision_model.encoder.layers.12.mlp.fc1.bias": "model-00001-of-00004.safetensors",
374
+ "vision_tower.vision_model.encoder.layers.12.mlp.fc1.weight": "model-00001-of-00004.safetensors",
375
+ "vision_tower.vision_model.encoder.layers.12.mlp.fc2.bias": "model-00001-of-00004.safetensors",
376
+ "vision_tower.vision_model.encoder.layers.12.mlp.fc2.weight": "model-00001-of-00004.safetensors",
377
+ "vision_tower.vision_model.encoder.layers.12.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
378
+ "vision_tower.vision_model.encoder.layers.12.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
379
+ "vision_tower.vision_model.encoder.layers.12.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
380
+ "vision_tower.vision_model.encoder.layers.12.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
381
+ "vision_tower.vision_model.encoder.layers.12.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
382
+ "vision_tower.vision_model.encoder.layers.12.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
383
+ "vision_tower.vision_model.encoder.layers.12.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
384
+ "vision_tower.vision_model.encoder.layers.12.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
385
+ "vision_tower.vision_model.encoder.layers.13.layer_norm1.bias": "model-00001-of-00004.safetensors",
386
+ "vision_tower.vision_model.encoder.layers.13.layer_norm1.weight": "model-00001-of-00004.safetensors",
387
+ "vision_tower.vision_model.encoder.layers.13.layer_norm2.bias": "model-00001-of-00004.safetensors",
388
+ "vision_tower.vision_model.encoder.layers.13.layer_norm2.weight": "model-00001-of-00004.safetensors",
389
+ "vision_tower.vision_model.encoder.layers.13.mlp.fc1.bias": "model-00001-of-00004.safetensors",
390
+ "vision_tower.vision_model.encoder.layers.13.mlp.fc1.weight": "model-00001-of-00004.safetensors",
391
+ "vision_tower.vision_model.encoder.layers.13.mlp.fc2.bias": "model-00001-of-00004.safetensors",
392
+ "vision_tower.vision_model.encoder.layers.13.mlp.fc2.weight": "model-00001-of-00004.safetensors",
393
+ "vision_tower.vision_model.encoder.layers.13.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
394
+ "vision_tower.vision_model.encoder.layers.13.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
395
+ "vision_tower.vision_model.encoder.layers.13.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
396
+ "vision_tower.vision_model.encoder.layers.13.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
397
+ "vision_tower.vision_model.encoder.layers.13.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
398
+ "vision_tower.vision_model.encoder.layers.13.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
399
+ "vision_tower.vision_model.encoder.layers.13.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
400
+ "vision_tower.vision_model.encoder.layers.13.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
401
+ "vision_tower.vision_model.encoder.layers.14.layer_norm1.bias": "model-00001-of-00004.safetensors",
402
+ "vision_tower.vision_model.encoder.layers.14.layer_norm1.weight": "model-00001-of-00004.safetensors",
403
+ "vision_tower.vision_model.encoder.layers.14.layer_norm2.bias": "model-00001-of-00004.safetensors",
404
+ "vision_tower.vision_model.encoder.layers.14.layer_norm2.weight": "model-00001-of-00004.safetensors",
405
+ "vision_tower.vision_model.encoder.layers.14.mlp.fc1.bias": "model-00001-of-00004.safetensors",
406
+ "vision_tower.vision_model.encoder.layers.14.mlp.fc1.weight": "model-00001-of-00004.safetensors",
407
+ "vision_tower.vision_model.encoder.layers.14.mlp.fc2.bias": "model-00001-of-00004.safetensors",
408
+ "vision_tower.vision_model.encoder.layers.14.mlp.fc2.weight": "model-00001-of-00004.safetensors",
409
+ "vision_tower.vision_model.encoder.layers.14.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
410
+ "vision_tower.vision_model.encoder.layers.14.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
411
+ "vision_tower.vision_model.encoder.layers.14.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
412
+ "vision_tower.vision_model.encoder.layers.14.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
413
+ "vision_tower.vision_model.encoder.layers.14.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
414
+ "vision_tower.vision_model.encoder.layers.14.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
415
+ "vision_tower.vision_model.encoder.layers.14.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
416
+ "vision_tower.vision_model.encoder.layers.14.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
417
+ "vision_tower.vision_model.encoder.layers.15.layer_norm1.bias": "model-00001-of-00004.safetensors",
418
+ "vision_tower.vision_model.encoder.layers.15.layer_norm1.weight": "model-00001-of-00004.safetensors",
419
+ "vision_tower.vision_model.encoder.layers.15.layer_norm2.bias": "model-00001-of-00004.safetensors",
420
+ "vision_tower.vision_model.encoder.layers.15.layer_norm2.weight": "model-00001-of-00004.safetensors",
421
+ "vision_tower.vision_model.encoder.layers.15.mlp.fc1.bias": "model-00001-of-00004.safetensors",
422
+ "vision_tower.vision_model.encoder.layers.15.mlp.fc1.weight": "model-00001-of-00004.safetensors",
423
+ "vision_tower.vision_model.encoder.layers.15.mlp.fc2.bias": "model-00001-of-00004.safetensors",
424
+ "vision_tower.vision_model.encoder.layers.15.mlp.fc2.weight": "model-00001-of-00004.safetensors",
425
+ "vision_tower.vision_model.encoder.layers.15.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
426
+ "vision_tower.vision_model.encoder.layers.15.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
427
+ "vision_tower.vision_model.encoder.layers.15.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
428
+ "vision_tower.vision_model.encoder.layers.15.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
429
+ "vision_tower.vision_model.encoder.layers.15.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
430
+ "vision_tower.vision_model.encoder.layers.15.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
431
+ "vision_tower.vision_model.encoder.layers.15.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
432
+ "vision_tower.vision_model.encoder.layers.15.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
433
+ "vision_tower.vision_model.encoder.layers.16.layer_norm1.bias": "model-00001-of-00004.safetensors",
434
+ "vision_tower.vision_model.encoder.layers.16.layer_norm1.weight": "model-00001-of-00004.safetensors",
435
+ "vision_tower.vision_model.encoder.layers.16.layer_norm2.bias": "model-00001-of-00004.safetensors",
436
+ "vision_tower.vision_model.encoder.layers.16.layer_norm2.weight": "model-00001-of-00004.safetensors",
437
+ "vision_tower.vision_model.encoder.layers.16.mlp.fc1.bias": "model-00001-of-00004.safetensors",
438
+ "vision_tower.vision_model.encoder.layers.16.mlp.fc1.weight": "model-00001-of-00004.safetensors",
439
+ "vision_tower.vision_model.encoder.layers.16.mlp.fc2.bias": "model-00001-of-00004.safetensors",
440
+ "vision_tower.vision_model.encoder.layers.16.mlp.fc2.weight": "model-00001-of-00004.safetensors",
441
+ "vision_tower.vision_model.encoder.layers.16.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
442
+ "vision_tower.vision_model.encoder.layers.16.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
443
+ "vision_tower.vision_model.encoder.layers.16.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
444
+ "vision_tower.vision_model.encoder.layers.16.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
445
+ "vision_tower.vision_model.encoder.layers.16.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
446
+ "vision_tower.vision_model.encoder.layers.16.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
447
+ "vision_tower.vision_model.encoder.layers.16.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
448
+ "vision_tower.vision_model.encoder.layers.16.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
449
+ "vision_tower.vision_model.encoder.layers.17.layer_norm1.bias": "model-00001-of-00004.safetensors",
450
+ "vision_tower.vision_model.encoder.layers.17.layer_norm1.weight": "model-00001-of-00004.safetensors",
451
+ "vision_tower.vision_model.encoder.layers.17.layer_norm2.bias": "model-00001-of-00004.safetensors",
452
+ "vision_tower.vision_model.encoder.layers.17.layer_norm2.weight": "model-00001-of-00004.safetensors",
453
+ "vision_tower.vision_model.encoder.layers.17.mlp.fc1.bias": "model-00001-of-00004.safetensors",
454
+ "vision_tower.vision_model.encoder.layers.17.mlp.fc1.weight": "model-00001-of-00004.safetensors",
455
+ "vision_tower.vision_model.encoder.layers.17.mlp.fc2.bias": "model-00001-of-00004.safetensors",
456
+ "vision_tower.vision_model.encoder.layers.17.mlp.fc2.weight": "model-00001-of-00004.safetensors",
457
+ "vision_tower.vision_model.encoder.layers.17.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
458
+ "vision_tower.vision_model.encoder.layers.17.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
459
+ "vision_tower.vision_model.encoder.layers.17.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
460
+ "vision_tower.vision_model.encoder.layers.17.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
461
+ "vision_tower.vision_model.encoder.layers.17.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
462
+ "vision_tower.vision_model.encoder.layers.17.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
463
+ "vision_tower.vision_model.encoder.layers.17.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
464
+ "vision_tower.vision_model.encoder.layers.17.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
465
+ "vision_tower.vision_model.encoder.layers.18.layer_norm1.bias": "model-00001-of-00004.safetensors",
466
+ "vision_tower.vision_model.encoder.layers.18.layer_norm1.weight": "model-00001-of-00004.safetensors",
467
+ "vision_tower.vision_model.encoder.layers.18.layer_norm2.bias": "model-00001-of-00004.safetensors",
468
+ "vision_tower.vision_model.encoder.layers.18.layer_norm2.weight": "model-00001-of-00004.safetensors",
469
+ "vision_tower.vision_model.encoder.layers.18.mlp.fc1.bias": "model-00001-of-00004.safetensors",
470
+ "vision_tower.vision_model.encoder.layers.18.mlp.fc1.weight": "model-00001-of-00004.safetensors",
471
+ "vision_tower.vision_model.encoder.layers.18.mlp.fc2.bias": "model-00001-of-00004.safetensors",
472
+ "vision_tower.vision_model.encoder.layers.18.mlp.fc2.weight": "model-00001-of-00004.safetensors",
473
+ "vision_tower.vision_model.encoder.layers.18.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
474
+ "vision_tower.vision_model.encoder.layers.18.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
475
+ "vision_tower.vision_model.encoder.layers.18.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
476
+ "vision_tower.vision_model.encoder.layers.18.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
477
+ "vision_tower.vision_model.encoder.layers.18.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
478
+ "vision_tower.vision_model.encoder.layers.18.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
479
+ "vision_tower.vision_model.encoder.layers.18.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
480
+ "vision_tower.vision_model.encoder.layers.18.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
481
+ "vision_tower.vision_model.encoder.layers.19.layer_norm1.bias": "model-00001-of-00004.safetensors",
482
+ "vision_tower.vision_model.encoder.layers.19.layer_norm1.weight": "model-00001-of-00004.safetensors",
483
+ "vision_tower.vision_model.encoder.layers.19.layer_norm2.bias": "model-00001-of-00004.safetensors",
484
+ "vision_tower.vision_model.encoder.layers.19.layer_norm2.weight": "model-00001-of-00004.safetensors",
485
+ "vision_tower.vision_model.encoder.layers.19.mlp.fc1.bias": "model-00001-of-00004.safetensors",
486
+ "vision_tower.vision_model.encoder.layers.19.mlp.fc1.weight": "model-00001-of-00004.safetensors",
487
+ "vision_tower.vision_model.encoder.layers.19.mlp.fc2.bias": "model-00001-of-00004.safetensors",
488
+ "vision_tower.vision_model.encoder.layers.19.mlp.fc2.weight": "model-00001-of-00004.safetensors",
489
+ "vision_tower.vision_model.encoder.layers.19.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
490
+ "vision_tower.vision_model.encoder.layers.19.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
491
+ "vision_tower.vision_model.encoder.layers.19.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
492
+ "vision_tower.vision_model.encoder.layers.19.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
493
+ "vision_tower.vision_model.encoder.layers.19.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
494
+ "vision_tower.vision_model.encoder.layers.19.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
495
+ "vision_tower.vision_model.encoder.layers.19.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
496
+ "vision_tower.vision_model.encoder.layers.19.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
497
+ "vision_tower.vision_model.encoder.layers.2.layer_norm1.bias": "model-00001-of-00004.safetensors",
498
+ "vision_tower.vision_model.encoder.layers.2.layer_norm1.weight": "model-00001-of-00004.safetensors",
499
+ "vision_tower.vision_model.encoder.layers.2.layer_norm2.bias": "model-00001-of-00004.safetensors",
500
+ "vision_tower.vision_model.encoder.layers.2.layer_norm2.weight": "model-00001-of-00004.safetensors",
501
+ "vision_tower.vision_model.encoder.layers.2.mlp.fc1.bias": "model-00001-of-00004.safetensors",
502
+ "vision_tower.vision_model.encoder.layers.2.mlp.fc1.weight": "model-00001-of-00004.safetensors",
503
+ "vision_tower.vision_model.encoder.layers.2.mlp.fc2.bias": "model-00001-of-00004.safetensors",
504
+ "vision_tower.vision_model.encoder.layers.2.mlp.fc2.weight": "model-00001-of-00004.safetensors",
505
+ "vision_tower.vision_model.encoder.layers.2.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
506
+ "vision_tower.vision_model.encoder.layers.2.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
507
+ "vision_tower.vision_model.encoder.layers.2.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
508
+ "vision_tower.vision_model.encoder.layers.2.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
509
+ "vision_tower.vision_model.encoder.layers.2.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
510
+ "vision_tower.vision_model.encoder.layers.2.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
511
+ "vision_tower.vision_model.encoder.layers.2.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
512
+ "vision_tower.vision_model.encoder.layers.2.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
513
+ "vision_tower.vision_model.encoder.layers.20.layer_norm1.bias": "model-00001-of-00004.safetensors",
514
+ "vision_tower.vision_model.encoder.layers.20.layer_norm1.weight": "model-00001-of-00004.safetensors",
515
+ "vision_tower.vision_model.encoder.layers.20.layer_norm2.bias": "model-00001-of-00004.safetensors",
516
+ "vision_tower.vision_model.encoder.layers.20.layer_norm2.weight": "model-00001-of-00004.safetensors",
517
+ "vision_tower.vision_model.encoder.layers.20.mlp.fc1.bias": "model-00001-of-00004.safetensors",
518
+ "vision_tower.vision_model.encoder.layers.20.mlp.fc1.weight": "model-00001-of-00004.safetensors",
519
+ "vision_tower.vision_model.encoder.layers.20.mlp.fc2.bias": "model-00001-of-00004.safetensors",
520
+ "vision_tower.vision_model.encoder.layers.20.mlp.fc2.weight": "model-00001-of-00004.safetensors",
521
+ "vision_tower.vision_model.encoder.layers.20.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
522
+ "vision_tower.vision_model.encoder.layers.20.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
523
+ "vision_tower.vision_model.encoder.layers.20.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
524
+ "vision_tower.vision_model.encoder.layers.20.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
525
+ "vision_tower.vision_model.encoder.layers.20.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
526
+ "vision_tower.vision_model.encoder.layers.20.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
527
+ "vision_tower.vision_model.encoder.layers.20.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
528
+ "vision_tower.vision_model.encoder.layers.20.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
529
+ "vision_tower.vision_model.encoder.layers.21.layer_norm1.bias": "model-00001-of-00004.safetensors",
530
+ "vision_tower.vision_model.encoder.layers.21.layer_norm1.weight": "model-00001-of-00004.safetensors",
531
+ "vision_tower.vision_model.encoder.layers.21.layer_norm2.bias": "model-00001-of-00004.safetensors",
532
+ "vision_tower.vision_model.encoder.layers.21.layer_norm2.weight": "model-00001-of-00004.safetensors",
533
+ "vision_tower.vision_model.encoder.layers.21.mlp.fc1.bias": "model-00001-of-00004.safetensors",
534
+ "vision_tower.vision_model.encoder.layers.21.mlp.fc1.weight": "model-00001-of-00004.safetensors",
535
+ "vision_tower.vision_model.encoder.layers.21.mlp.fc2.bias": "model-00001-of-00004.safetensors",
536
+ "vision_tower.vision_model.encoder.layers.21.mlp.fc2.weight": "model-00001-of-00004.safetensors",
537
+ "vision_tower.vision_model.encoder.layers.21.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
538
+ "vision_tower.vision_model.encoder.layers.21.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
539
+ "vision_tower.vision_model.encoder.layers.21.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
540
+ "vision_tower.vision_model.encoder.layers.21.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
541
+ "vision_tower.vision_model.encoder.layers.21.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
542
+ "vision_tower.vision_model.encoder.layers.21.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
543
+ "vision_tower.vision_model.encoder.layers.21.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
544
+ "vision_tower.vision_model.encoder.layers.21.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
545
+ "vision_tower.vision_model.encoder.layers.22.layer_norm1.bias": "model-00001-of-00004.safetensors",
546
+ "vision_tower.vision_model.encoder.layers.22.layer_norm1.weight": "model-00001-of-00004.safetensors",
547
+ "vision_tower.vision_model.encoder.layers.22.layer_norm2.bias": "model-00001-of-00004.safetensors",
548
+ "vision_tower.vision_model.encoder.layers.22.layer_norm2.weight": "model-00001-of-00004.safetensors",
549
+ "vision_tower.vision_model.encoder.layers.22.mlp.fc1.bias": "model-00001-of-00004.safetensors",
550
+ "vision_tower.vision_model.encoder.layers.22.mlp.fc1.weight": "model-00001-of-00004.safetensors",
551
+ "vision_tower.vision_model.encoder.layers.22.mlp.fc2.bias": "model-00001-of-00004.safetensors",
552
+ "vision_tower.vision_model.encoder.layers.22.mlp.fc2.weight": "model-00001-of-00004.safetensors",
553
+ "vision_tower.vision_model.encoder.layers.22.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
554
+ "vision_tower.vision_model.encoder.layers.22.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
555
+ "vision_tower.vision_model.encoder.layers.22.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
556
+ "vision_tower.vision_model.encoder.layers.22.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
557
+ "vision_tower.vision_model.encoder.layers.22.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
558
+ "vision_tower.vision_model.encoder.layers.22.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
559
+ "vision_tower.vision_model.encoder.layers.22.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
560
+ "vision_tower.vision_model.encoder.layers.22.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
561
+ "vision_tower.vision_model.encoder.layers.23.layer_norm1.bias": "model-00001-of-00004.safetensors",
562
+ "vision_tower.vision_model.encoder.layers.23.layer_norm1.weight": "model-00001-of-00004.safetensors",
563
+ "vision_tower.vision_model.encoder.layers.23.layer_norm2.bias": "model-00001-of-00004.safetensors",
564
+ "vision_tower.vision_model.encoder.layers.23.layer_norm2.weight": "model-00001-of-00004.safetensors",
565
+ "vision_tower.vision_model.encoder.layers.23.mlp.fc1.bias": "model-00001-of-00004.safetensors",
566
+ "vision_tower.vision_model.encoder.layers.23.mlp.fc1.weight": "model-00001-of-00004.safetensors",
567
+ "vision_tower.vision_model.encoder.layers.23.mlp.fc2.bias": "model-00001-of-00004.safetensors",
568
+ "vision_tower.vision_model.encoder.layers.23.mlp.fc2.weight": "model-00001-of-00004.safetensors",
569
+ "vision_tower.vision_model.encoder.layers.23.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
570
+ "vision_tower.vision_model.encoder.layers.23.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
571
+ "vision_tower.vision_model.encoder.layers.23.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
572
+ "vision_tower.vision_model.encoder.layers.23.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
573
+ "vision_tower.vision_model.encoder.layers.23.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
574
+ "vision_tower.vision_model.encoder.layers.23.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
575
+ "vision_tower.vision_model.encoder.layers.23.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
576
+ "vision_tower.vision_model.encoder.layers.23.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
577
+ "vision_tower.vision_model.encoder.layers.3.layer_norm1.bias": "model-00001-of-00004.safetensors",
578
+ "vision_tower.vision_model.encoder.layers.3.layer_norm1.weight": "model-00001-of-00004.safetensors",
579
+ "vision_tower.vision_model.encoder.layers.3.layer_norm2.bias": "model-00001-of-00004.safetensors",
580
+ "vision_tower.vision_model.encoder.layers.3.layer_norm2.weight": "model-00001-of-00004.safetensors",
581
+ "vision_tower.vision_model.encoder.layers.3.mlp.fc1.bias": "model-00001-of-00004.safetensors",
582
+ "vision_tower.vision_model.encoder.layers.3.mlp.fc1.weight": "model-00001-of-00004.safetensors",
583
+ "vision_tower.vision_model.encoder.layers.3.mlp.fc2.bias": "model-00001-of-00004.safetensors",
584
+ "vision_tower.vision_model.encoder.layers.3.mlp.fc2.weight": "model-00001-of-00004.safetensors",
585
+ "vision_tower.vision_model.encoder.layers.3.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
586
+ "vision_tower.vision_model.encoder.layers.3.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
587
+ "vision_tower.vision_model.encoder.layers.3.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
588
+ "vision_tower.vision_model.encoder.layers.3.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
589
+ "vision_tower.vision_model.encoder.layers.3.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
590
+ "vision_tower.vision_model.encoder.layers.3.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
591
+ "vision_tower.vision_model.encoder.layers.3.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
592
+ "vision_tower.vision_model.encoder.layers.3.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
593
+ "vision_tower.vision_model.encoder.layers.4.layer_norm1.bias": "model-00001-of-00004.safetensors",
594
+ "vision_tower.vision_model.encoder.layers.4.layer_norm1.weight": "model-00001-of-00004.safetensors",
595
+ "vision_tower.vision_model.encoder.layers.4.layer_norm2.bias": "model-00001-of-00004.safetensors",
596
+ "vision_tower.vision_model.encoder.layers.4.layer_norm2.weight": "model-00001-of-00004.safetensors",
597
+ "vision_tower.vision_model.encoder.layers.4.mlp.fc1.bias": "model-00001-of-00004.safetensors",
598
+ "vision_tower.vision_model.encoder.layers.4.mlp.fc1.weight": "model-00001-of-00004.safetensors",
599
+ "vision_tower.vision_model.encoder.layers.4.mlp.fc2.bias": "model-00001-of-00004.safetensors",
600
+ "vision_tower.vision_model.encoder.layers.4.mlp.fc2.weight": "model-00001-of-00004.safetensors",
601
+ "vision_tower.vision_model.encoder.layers.4.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
602
+ "vision_tower.vision_model.encoder.layers.4.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
603
+ "vision_tower.vision_model.encoder.layers.4.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
604
+ "vision_tower.vision_model.encoder.layers.4.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
605
+ "vision_tower.vision_model.encoder.layers.4.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
606
+ "vision_tower.vision_model.encoder.layers.4.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
607
+ "vision_tower.vision_model.encoder.layers.4.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
608
+ "vision_tower.vision_model.encoder.layers.4.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
609
+ "vision_tower.vision_model.encoder.layers.5.layer_norm1.bias": "model-00001-of-00004.safetensors",
610
+ "vision_tower.vision_model.encoder.layers.5.layer_norm1.weight": "model-00001-of-00004.safetensors",
611
+ "vision_tower.vision_model.encoder.layers.5.layer_norm2.bias": "model-00001-of-00004.safetensors",
612
+ "vision_tower.vision_model.encoder.layers.5.layer_norm2.weight": "model-00001-of-00004.safetensors",
613
+ "vision_tower.vision_model.encoder.layers.5.mlp.fc1.bias": "model-00001-of-00004.safetensors",
614
+ "vision_tower.vision_model.encoder.layers.5.mlp.fc1.weight": "model-00001-of-00004.safetensors",
615
+ "vision_tower.vision_model.encoder.layers.5.mlp.fc2.bias": "model-00001-of-00004.safetensors",
616
+ "vision_tower.vision_model.encoder.layers.5.mlp.fc2.weight": "model-00001-of-00004.safetensors",
617
+ "vision_tower.vision_model.encoder.layers.5.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
618
+ "vision_tower.vision_model.encoder.layers.5.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
619
+ "vision_tower.vision_model.encoder.layers.5.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
620
+ "vision_tower.vision_model.encoder.layers.5.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
621
+ "vision_tower.vision_model.encoder.layers.5.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
622
+ "vision_tower.vision_model.encoder.layers.5.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
623
+ "vision_tower.vision_model.encoder.layers.5.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
624
+ "vision_tower.vision_model.encoder.layers.5.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
625
+ "vision_tower.vision_model.encoder.layers.6.layer_norm1.bias": "model-00001-of-00004.safetensors",
626
+ "vision_tower.vision_model.encoder.layers.6.layer_norm1.weight": "model-00001-of-00004.safetensors",
627
+ "vision_tower.vision_model.encoder.layers.6.layer_norm2.bias": "model-00001-of-00004.safetensors",
628
+ "vision_tower.vision_model.encoder.layers.6.layer_norm2.weight": "model-00001-of-00004.safetensors",
629
+ "vision_tower.vision_model.encoder.layers.6.mlp.fc1.bias": "model-00001-of-00004.safetensors",
630
+ "vision_tower.vision_model.encoder.layers.6.mlp.fc1.weight": "model-00001-of-00004.safetensors",
631
+ "vision_tower.vision_model.encoder.layers.6.mlp.fc2.bias": "model-00001-of-00004.safetensors",
632
+ "vision_tower.vision_model.encoder.layers.6.mlp.fc2.weight": "model-00001-of-00004.safetensors",
633
+ "vision_tower.vision_model.encoder.layers.6.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
634
+ "vision_tower.vision_model.encoder.layers.6.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
635
+ "vision_tower.vision_model.encoder.layers.6.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
636
+ "vision_tower.vision_model.encoder.layers.6.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
637
+ "vision_tower.vision_model.encoder.layers.6.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
638
+ "vision_tower.vision_model.encoder.layers.6.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
639
+ "vision_tower.vision_model.encoder.layers.6.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
640
+ "vision_tower.vision_model.encoder.layers.6.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
641
+ "vision_tower.vision_model.encoder.layers.7.layer_norm1.bias": "model-00001-of-00004.safetensors",
642
+ "vision_tower.vision_model.encoder.layers.7.layer_norm1.weight": "model-00001-of-00004.safetensors",
643
+ "vision_tower.vision_model.encoder.layers.7.layer_norm2.bias": "model-00001-of-00004.safetensors",
644
+ "vision_tower.vision_model.encoder.layers.7.layer_norm2.weight": "model-00001-of-00004.safetensors",
645
+ "vision_tower.vision_model.encoder.layers.7.mlp.fc1.bias": "model-00001-of-00004.safetensors",
646
+ "vision_tower.vision_model.encoder.layers.7.mlp.fc1.weight": "model-00001-of-00004.safetensors",
647
+ "vision_tower.vision_model.encoder.layers.7.mlp.fc2.bias": "model-00001-of-00004.safetensors",
648
+ "vision_tower.vision_model.encoder.layers.7.mlp.fc2.weight": "model-00001-of-00004.safetensors",
649
+ "vision_tower.vision_model.encoder.layers.7.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
650
+ "vision_tower.vision_model.encoder.layers.7.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
651
+ "vision_tower.vision_model.encoder.layers.7.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
652
+ "vision_tower.vision_model.encoder.layers.7.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
653
+ "vision_tower.vision_model.encoder.layers.7.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
654
+ "vision_tower.vision_model.encoder.layers.7.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
655
+ "vision_tower.vision_model.encoder.layers.7.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
656
+ "vision_tower.vision_model.encoder.layers.7.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
657
+ "vision_tower.vision_model.encoder.layers.8.layer_norm1.bias": "model-00001-of-00004.safetensors",
658
+ "vision_tower.vision_model.encoder.layers.8.layer_norm1.weight": "model-00001-of-00004.safetensors",
659
+ "vision_tower.vision_model.encoder.layers.8.layer_norm2.bias": "model-00001-of-00004.safetensors",
660
+ "vision_tower.vision_model.encoder.layers.8.layer_norm2.weight": "model-00001-of-00004.safetensors",
661
+ "vision_tower.vision_model.encoder.layers.8.mlp.fc1.bias": "model-00001-of-00004.safetensors",
662
+ "vision_tower.vision_model.encoder.layers.8.mlp.fc1.weight": "model-00001-of-00004.safetensors",
663
+ "vision_tower.vision_model.encoder.layers.8.mlp.fc2.bias": "model-00001-of-00004.safetensors",
664
+ "vision_tower.vision_model.encoder.layers.8.mlp.fc2.weight": "model-00001-of-00004.safetensors",
665
+ "vision_tower.vision_model.encoder.layers.8.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
666
+ "vision_tower.vision_model.encoder.layers.8.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
667
+ "vision_tower.vision_model.encoder.layers.8.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
668
+ "vision_tower.vision_model.encoder.layers.8.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
669
+ "vision_tower.vision_model.encoder.layers.8.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
670
+ "vision_tower.vision_model.encoder.layers.8.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
671
+ "vision_tower.vision_model.encoder.layers.8.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
672
+ "vision_tower.vision_model.encoder.layers.8.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
673
+ "vision_tower.vision_model.encoder.layers.9.layer_norm1.bias": "model-00001-of-00004.safetensors",
674
+ "vision_tower.vision_model.encoder.layers.9.layer_norm1.weight": "model-00001-of-00004.safetensors",
675
+ "vision_tower.vision_model.encoder.layers.9.layer_norm2.bias": "model-00001-of-00004.safetensors",
676
+ "vision_tower.vision_model.encoder.layers.9.layer_norm2.weight": "model-00001-of-00004.safetensors",
677
+ "vision_tower.vision_model.encoder.layers.9.mlp.fc1.bias": "model-00001-of-00004.safetensors",
678
+ "vision_tower.vision_model.encoder.layers.9.mlp.fc1.weight": "model-00001-of-00004.safetensors",
679
+ "vision_tower.vision_model.encoder.layers.9.mlp.fc2.bias": "model-00001-of-00004.safetensors",
680
+ "vision_tower.vision_model.encoder.layers.9.mlp.fc2.weight": "model-00001-of-00004.safetensors",
681
+ "vision_tower.vision_model.encoder.layers.9.self_attn.k_proj.bias": "model-00001-of-00004.safetensors",
682
+ "vision_tower.vision_model.encoder.layers.9.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
683
+ "vision_tower.vision_model.encoder.layers.9.self_attn.out_proj.bias": "model-00001-of-00004.safetensors",
684
+ "vision_tower.vision_model.encoder.layers.9.self_attn.out_proj.weight": "model-00001-of-00004.safetensors",
685
+ "vision_tower.vision_model.encoder.layers.9.self_attn.q_proj.bias": "model-00001-of-00004.safetensors",
686
+ "vision_tower.vision_model.encoder.layers.9.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
687
+ "vision_tower.vision_model.encoder.layers.9.self_attn.v_proj.bias": "model-00001-of-00004.safetensors",
688
+ "vision_tower.vision_model.encoder.layers.9.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
689
+ "vision_tower.vision_model.post_layernorm.bias": "model-00001-of-00004.safetensors",
690
+ "vision_tower.vision_model.post_layernorm.weight": "model-00001-of-00004.safetensors",
691
+ "vision_tower.vision_model.pre_layrnorm.bias": "model-00001-of-00004.safetensors",
692
+ "vision_tower.vision_model.pre_layrnorm.weight": "model-00001-of-00004.safetensors"
693
+ }
694
+ }
preprocessor_config.json ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "aspect_ratio_setting": "anyres",
3
+ "crop_size": {
4
+ "height": 336,
5
+ "width": 336
6
+ },
7
+ "do_center_crop": true,
8
+ "do_convert_rgb": true,
9
+ "do_normalize": true,
10
+ "do_pad": true,
11
+ "do_rescale": true,
12
+ "do_resize": true,
13
+ "image_grid_pinpoints": [
14
+ [
15
+ 336,
16
+ 672
17
+ ],
18
+ [
19
+ 672,
20
+ 336
21
+ ],
22
+ [
23
+ 672,
24
+ 672
25
+ ],
26
+ [
27
+ 1008,
28
+ 336
29
+ ],
30
+ [
31
+ 336,
32
+ 1008
33
+ ]
34
+ ],
35
+ "image_mean": [
36
+ 0.48145466,
37
+ 0.4578275,
38
+ 0.40821073
39
+ ],
40
+ "image_processor_type": "LlavaNextImageProcessor",
41
+ "image_std": [
42
+ 0.26862954,
43
+ 0.26130258,
44
+ 0.27577711
45
+ ],
46
+ "processor_class": "LlavaNextProcessor",
47
+ "resample": 3,
48
+ "rescale_factor": 0.00392156862745098,
49
+ "size": {
50
+ "shortest_edge": 336
51
+ }
52
+ }
special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "<pad>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "<unk>",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dadfd56d766715c61d2ef780a525ab43b8e6da4de6865bda3d95fdef5e134055
3
+ size 493443
tokenizer_config.json ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "add_prefix_space": null,
5
+ "added_tokens_decoder": {
6
+ "0": {
7
+ "content": "<unk>",
8
+ "lstrip": false,
9
+ "normalized": false,
10
+ "rstrip": false,
11
+ "single_word": false,
12
+ "special": true
13
+ },
14
+ "1": {
15
+ "content": "<s>",
16
+ "lstrip": false,
17
+ "normalized": false,
18
+ "rstrip": false,
19
+ "single_word": false,
20
+ "special": true
21
+ },
22
+ "2": {
23
+ "content": "</s>",
24
+ "lstrip": false,
25
+ "normalized": false,
26
+ "rstrip": false,
27
+ "single_word": false,
28
+ "special": true
29
+ },
30
+ "32000": {
31
+ "content": "<image>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false,
36
+ "special": true
37
+ },
38
+ "32001": {
39
+ "content": "<pad>",
40
+ "lstrip": false,
41
+ "normalized": false,
42
+ "rstrip": false,
43
+ "single_word": false,
44
+ "special": true
45
+ }
46
+ },
47
+ "additional_special_tokens": [],
48
+ "bos_token": "<s>",
49
+ "chat_template": "{{ '<s>' }}{% if messages[0]['role'] == 'system' %}{% set loop_messages = messages[1:] %}{% set system_message = messages[0]['content'] %}{% else %}{% set loop_messages = messages %}{% endif %}{% if system_message is defined %}{{ system_message }}{% endif %}{% for message in loop_messages %}{% set content = message['content'] %}{% if message['role'] == 'user' %}{{ '`[INST] `' + content + ' [/INST]' }}{% elif message['role'] == 'assistant' %}{{ content + '</s>' }}{% endif %}{% endfor %}",
50
+ "clean_up_tokenization_spaces": false,
51
+ "eos_token": "</s>",
52
+ "extra_special_tokens": {
53
+ "image_token": "<image>"
54
+ },
55
+ "image_token": "<image>",
56
+ "legacy": true,
57
+ "max_length": null,
58
+ "model_max_length": 1000000000000000019884624838656,
59
+ "pad_to_multiple_of": null,
60
+ "pad_token": "<pad>",
61
+ "pad_token_type_id": 0,
62
+ "padding_side": "right",
63
+ "processor_class": "LlavaNextProcessor",
64
+ "sp_model_kwargs": {},
65
+ "spaces_between_special_tokens": false,
66
+ "split_special_tokens": false,
67
+ "tokenizer_class": "LlamaTokenizer",
68
+ "unk_token": "<unk>",
69
+ "use_default_system_prompt": false
70
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 2.994871794871795,
3
+ "total_flos": 1.0330118169821184e+16,
4
+ "train_loss": 0.2632859356310134,
5
+ "train_runtime": 40450.3897,
6
+ "train_samples_per_second": 5.549,
7
+ "train_steps_per_second": 0.022
8
+ }
trainer_log.jsonl ADDED
@@ -0,0 +1,197 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"current_steps": 5, "total_steps": 876, "loss": 0.6935, "accuracy": 0.26875001192092896, "learning_rate": 5e-07, "epoch": 0.017094017094017096, "percentage": 0.57, "elapsed_time": "0:02:47", "remaining_time": "8:05:08"}
2
+ {"current_steps": 10, "total_steps": 876, "loss": 0.6875, "accuracy": 0.5062500238418579, "learning_rate": 1e-06, "epoch": 0.03418803418803419, "percentage": 1.14, "elapsed_time": "0:05:30", "remaining_time": "7:57:17"}
3
+ {"current_steps": 15, "total_steps": 876, "loss": 0.6698, "accuracy": 0.612500011920929, "learning_rate": 9.999177507263144e-07, "epoch": 0.05128205128205128, "percentage": 1.71, "elapsed_time": "0:08:14", "remaining_time": "7:52:44"}
4
+ {"current_steps": 20, "total_steps": 876, "loss": 0.6613, "accuracy": 0.6000000238418579, "learning_rate": 9.996710299650301e-07, "epoch": 0.06837606837606838, "percentage": 2.28, "elapsed_time": "0:10:58", "remaining_time": "7:49:38"}
5
+ {"current_steps": 25, "total_steps": 876, "loss": 0.6494, "accuracy": 0.581250011920929, "learning_rate": 9.992599188865604e-07, "epoch": 0.08547008547008547, "percentage": 2.85, "elapsed_time": "0:13:41", "remaining_time": "7:45:49"}
6
+ {"current_steps": 30, "total_steps": 876, "loss": 0.6295, "accuracy": 0.625, "learning_rate": 9.98684552745256e-07, "epoch": 0.10256410256410256, "percentage": 3.42, "elapsed_time": "0:16:23", "remaining_time": "7:42:17"}
7
+ {"current_steps": 35, "total_steps": 876, "loss": 0.6305, "accuracy": 0.6499999761581421, "learning_rate": 9.979451208349055e-07, "epoch": 0.11965811965811966, "percentage": 4.0, "elapsed_time": "0:19:06", "remaining_time": "7:39:00"}
8
+ {"current_steps": 40, "total_steps": 876, "loss": 0.5989, "accuracy": 0.699999988079071, "learning_rate": 9.970418664264595e-07, "epoch": 0.13675213675213677, "percentage": 4.57, "elapsed_time": "0:21:49", "remaining_time": "7:36:17"}
9
+ {"current_steps": 40, "total_steps": 876, "eval_loss": 0.6069236993789673, "epoch": 0.13675213675213677, "percentage": 4.57, "elapsed_time": "0:30:19", "remaining_time": "10:33:54"}
10
+ {"current_steps": 45, "total_steps": 876, "loss": 0.6146, "accuracy": 0.7124999761581421, "learning_rate": 9.95975086687994e-07, "epoch": 0.15384615384615385, "percentage": 5.14, "elapsed_time": "0:33:35", "remaining_time": "10:20:24"}
11
+ {"current_steps": 50, "total_steps": 876, "loss": 0.577, "accuracy": 0.75, "learning_rate": 9.947451325869439e-07, "epoch": 0.17094017094017094, "percentage": 5.71, "elapsed_time": "0:36:17", "remaining_time": "9:59:39"}
12
+ {"current_steps": 55, "total_steps": 876, "loss": 0.571, "accuracy": 0.75, "learning_rate": 9.933524087746347e-07, "epoch": 0.18803418803418803, "percentage": 6.28, "elapsed_time": "0:39:00", "remaining_time": "9:42:17"}
13
+ {"current_steps": 60, "total_steps": 876, "loss": 0.5762, "accuracy": 0.699999988079071, "learning_rate": 9.917973734531549e-07, "epoch": 0.20512820512820512, "percentage": 6.85, "elapsed_time": "0:41:43", "remaining_time": "9:27:32"}
14
+ {"current_steps": 65, "total_steps": 876, "loss": 0.5643, "accuracy": 0.706250011920929, "learning_rate": 9.90080538224607e-07, "epoch": 0.2222222222222222, "percentage": 7.42, "elapsed_time": "0:44:26", "remaining_time": "9:14:35"}
15
+ {"current_steps": 70, "total_steps": 876, "loss": 0.5464, "accuracy": 0.699999988079071, "learning_rate": 9.882024679227938e-07, "epoch": 0.23931623931623933, "percentage": 7.99, "elapsed_time": "0:47:09", "remaining_time": "9:02:56"}
16
+ {"current_steps": 75, "total_steps": 876, "loss": 0.5553, "accuracy": 0.6875, "learning_rate": 9.861637804273881e-07, "epoch": 0.2564102564102564, "percentage": 8.56, "elapsed_time": "0:49:51", "remaining_time": "8:52:29"}
17
+ {"current_steps": 80, "total_steps": 876, "loss": 0.5452, "accuracy": 0.6812499761581421, "learning_rate": 9.83965146460653e-07, "epoch": 0.27350427350427353, "percentage": 9.13, "elapsed_time": "0:52:35", "remaining_time": "8:43:20"}
18
+ {"current_steps": 80, "total_steps": 876, "eval_loss": 0.5331124663352966, "epoch": 0.27350427350427353, "percentage": 9.13, "elapsed_time": "1:01:05", "remaining_time": "10:07:55"}
19
+ {"current_steps": 85, "total_steps": 876, "loss": 0.5581, "accuracy": 0.7437499761581421, "learning_rate": 9.816072893667758e-07, "epoch": 0.2905982905982906, "percentage": 9.7, "elapsed_time": "1:04:21", "remaining_time": "9:58:56"}
20
+ {"current_steps": 90, "total_steps": 876, "loss": 0.5208, "accuracy": 0.637499988079071, "learning_rate": 9.790909848738904e-07, "epoch": 0.3076923076923077, "percentage": 10.27, "elapsed_time": "1:07:05", "remaining_time": "9:45:51"}
21
+ {"current_steps": 95, "total_steps": 876, "loss": 0.5242, "accuracy": 0.7749999761581421, "learning_rate": 9.764170608388647e-07, "epoch": 0.3247863247863248, "percentage": 10.84, "elapsed_time": "1:09:47", "remaining_time": "9:33:45"}
22
+ {"current_steps": 100, "total_steps": 876, "loss": 0.5002, "accuracy": 0.706250011920929, "learning_rate": 9.735863969749371e-07, "epoch": 0.3418803418803419, "percentage": 11.42, "elapsed_time": "1:12:30", "remaining_time": "9:22:42"}
23
+ {"current_steps": 105, "total_steps": 876, "loss": 0.5026, "accuracy": 0.7124999761581421, "learning_rate": 9.705999245622956e-07, "epoch": 0.358974358974359, "percentage": 11.99, "elapsed_time": "1:15:13", "remaining_time": "9:12:25"}
24
+ {"current_steps": 110, "total_steps": 876, "loss": 0.5206, "accuracy": 0.699999988079071, "learning_rate": 9.674586261416873e-07, "epoch": 0.37606837606837606, "percentage": 12.56, "elapsed_time": "1:17:58", "remaining_time": "9:02:58"}
25
+ {"current_steps": 115, "total_steps": 876, "loss": 0.4801, "accuracy": 0.7437499761581421, "learning_rate": 9.641635351911664e-07, "epoch": 0.39316239316239315, "percentage": 13.13, "elapsed_time": "1:20:41", "remaining_time": "8:53:57"}
26
+ {"current_steps": 120, "total_steps": 876, "loss": 0.5026, "accuracy": 0.737500011920929, "learning_rate": 9.607157357860821e-07, "epoch": 0.41025641025641024, "percentage": 13.7, "elapsed_time": "1:23:25", "remaining_time": "8:45:32"}
27
+ {"current_steps": 120, "total_steps": 876, "eval_loss": 0.49246644973754883, "epoch": 0.41025641025641024, "percentage": 13.7, "elapsed_time": "1:31:55", "remaining_time": "9:39:06"}
28
+ {"current_steps": 125, "total_steps": 876, "loss": 0.5017, "accuracy": 0.7124999761581421, "learning_rate": 9.571163622424225e-07, "epoch": 0.42735042735042733, "percentage": 14.27, "elapsed_time": "1:35:10", "remaining_time": "9:31:48"}
29
+ {"current_steps": 130, "total_steps": 876, "loss": 0.4983, "accuracy": 0.6937500238418579, "learning_rate": 9.533665987436261e-07, "epoch": 0.4444444444444444, "percentage": 14.84, "elapsed_time": "1:37:53", "remaining_time": "9:21:43"}
30
+ {"current_steps": 135, "total_steps": 876, "loss": 0.492, "accuracy": 0.7124999761581421, "learning_rate": 9.494676789509899e-07, "epoch": 0.46153846153846156, "percentage": 15.41, "elapsed_time": "1:40:36", "remaining_time": "9:12:13"}
31
+ {"current_steps": 140, "total_steps": 876, "loss": 0.4753, "accuracy": 0.731249988079071, "learning_rate": 9.454208855977985e-07, "epoch": 0.47863247863247865, "percentage": 15.98, "elapsed_time": "1:43:19", "remaining_time": "9:03:13"}
32
+ {"current_steps": 145, "total_steps": 876, "loss": 0.4803, "accuracy": 0.7875000238418579, "learning_rate": 9.41227550067308e-07, "epoch": 0.49572649572649574, "percentage": 16.55, "elapsed_time": "1:46:02", "remaining_time": "8:54:38"}
33
+ {"current_steps": 150, "total_steps": 876, "loss": 0.4895, "accuracy": 0.78125, "learning_rate": 9.36889051954725e-07, "epoch": 0.5128205128205128, "percentage": 17.12, "elapsed_time": "1:48:45", "remaining_time": "8:46:23"}
34
+ {"current_steps": 155, "total_steps": 876, "loss": 0.4608, "accuracy": 0.793749988079071, "learning_rate": 9.324068186133245e-07, "epoch": 0.5299145299145299, "percentage": 17.69, "elapsed_time": "1:51:29", "remaining_time": "8:38:34"}
35
+ {"current_steps": 160, "total_steps": 876, "loss": 0.4511, "accuracy": 0.7124999761581421, "learning_rate": 9.277823246848536e-07, "epoch": 0.5470085470085471, "percentage": 18.26, "elapsed_time": "1:54:11", "remaining_time": "8:31:01"}
36
+ {"current_steps": 160, "total_steps": 876, "eval_loss": 0.4683005213737488, "epoch": 0.5470085470085471, "percentage": 18.26, "elapsed_time": "2:02:41", "remaining_time": "9:09:03"}
37
+ {"current_steps": 165, "total_steps": 876, "loss": 0.4944, "accuracy": 0.7562500238418579, "learning_rate": 9.230170916143793e-07, "epoch": 0.5641025641025641, "percentage": 18.84, "elapsed_time": "2:05:55", "remaining_time": "9:02:37"}
38
+ {"current_steps": 170, "total_steps": 876, "loss": 0.4813, "accuracy": 0.78125, "learning_rate": 9.181126871497378e-07, "epoch": 0.5811965811965812, "percentage": 19.41, "elapsed_time": "2:08:38", "remaining_time": "8:54:15"}
39
+ {"current_steps": 175, "total_steps": 876, "loss": 0.4863, "accuracy": 0.768750011920929, "learning_rate": 9.130707248257491e-07, "epoch": 0.5982905982905983, "percentage": 19.98, "elapsed_time": "2:11:21", "remaining_time": "8:46:10"}
40
+ {"current_steps": 180, "total_steps": 876, "loss": 0.4553, "accuracy": 0.8062499761581421, "learning_rate": 9.078928634333698e-07, "epoch": 0.6153846153846154, "percentage": 20.55, "elapsed_time": "2:14:04", "remaining_time": "8:38:24"}
41
+ {"current_steps": 185, "total_steps": 876, "loss": 0.4854, "accuracy": 0.7562500238418579, "learning_rate": 9.025808064739549e-07, "epoch": 0.6324786324786325, "percentage": 21.12, "elapsed_time": "2:16:48", "remaining_time": "8:30:58"}
42
+ {"current_steps": 190, "total_steps": 876, "loss": 0.4681, "accuracy": 0.7562500238418579, "learning_rate": 8.971363015988113e-07, "epoch": 0.6495726495726496, "percentage": 21.69, "elapsed_time": "2:19:30", "remaining_time": "8:23:43"}
43
+ {"current_steps": 195, "total_steps": 876, "loss": 0.4935, "accuracy": 0.7437499761581421, "learning_rate": 8.91561140034225e-07, "epoch": 0.6666666666666666, "percentage": 22.26, "elapsed_time": "2:22:13", "remaining_time": "8:16:40"}
44
+ {"current_steps": 200, "total_steps": 876, "loss": 0.4562, "accuracy": 0.7562500238418579, "learning_rate": 8.858571559921537e-07, "epoch": 0.6837606837606838, "percentage": 22.83, "elapsed_time": "2:24:56", "remaining_time": "8:09:55"}
45
+ {"current_steps": 200, "total_steps": 876, "eval_loss": 0.4528014361858368, "epoch": 0.6837606837606838, "percentage": 22.83, "elapsed_time": "2:33:27", "remaining_time": "8:38:42"}
46
+ {"current_steps": 205, "total_steps": 876, "loss": 0.4653, "accuracy": 0.768750011920929, "learning_rate": 8.800262260667754e-07, "epoch": 0.7008547008547008, "percentage": 23.4, "elapsed_time": "2:36:41", "remaining_time": "8:32:52"}
47
+ {"current_steps": 210, "total_steps": 876, "loss": 0.4426, "accuracy": 0.731249988079071, "learning_rate": 8.740702686170954e-07, "epoch": 0.717948717948718, "percentage": 23.97, "elapsed_time": "2:39:24", "remaining_time": "8:25:34"}
48
+ {"current_steps": 215, "total_steps": 876, "loss": 0.4521, "accuracy": 0.7562500238418579, "learning_rate": 8.679912431358109e-07, "epoch": 0.7350427350427351, "percentage": 24.54, "elapsed_time": "2:42:08", "remaining_time": "8:18:28"}
49
+ {"current_steps": 220, "total_steps": 876, "loss": 0.4655, "accuracy": 0.793749988079071, "learning_rate": 8.617911496046445e-07, "epoch": 0.7521367521367521, "percentage": 25.11, "elapsed_time": "2:44:51", "remaining_time": "8:11:34"}
50
+ {"current_steps": 225, "total_steps": 876, "loss": 0.4693, "accuracy": 0.731249988079071, "learning_rate": 8.554720278363547e-07, "epoch": 0.7692307692307693, "percentage": 25.68, "elapsed_time": "2:47:34", "remaining_time": "8:04:51"}
51
+ {"current_steps": 230, "total_steps": 876, "loss": 0.4524, "accuracy": 0.762499988079071, "learning_rate": 8.490359568036445e-07, "epoch": 0.7863247863247863, "percentage": 26.26, "elapsed_time": "2:50:17", "remaining_time": "7:58:18"}
52
+ {"current_steps": 235, "total_steps": 876, "loss": 0.4536, "accuracy": 0.7749999761581421, "learning_rate": 8.424850539551856e-07, "epoch": 0.8034188034188035, "percentage": 26.83, "elapsed_time": "2:53:01", "remaining_time": "7:51:56"}
53
+ {"current_steps": 240, "total_steps": 876, "loss": 0.4189, "accuracy": 0.793749988079071, "learning_rate": 8.358214745189829e-07, "epoch": 0.8205128205128205, "percentage": 27.4, "elapsed_time": "2:55:44", "remaining_time": "7:45:42"}
54
+ {"current_steps": 240, "total_steps": 876, "eval_loss": 0.44941428303718567, "epoch": 0.8205128205128205, "percentage": 27.4, "elapsed_time": "3:04:14", "remaining_time": "8:08:15"}
55
+ {"current_steps": 245, "total_steps": 876, "loss": 0.4441, "accuracy": 0.7562500238418579, "learning_rate": 8.290474107933114e-07, "epoch": 0.8376068376068376, "percentage": 27.97, "elapsed_time": "3:07:29", "remaining_time": "8:02:53"}
56
+ {"current_steps": 250, "total_steps": 876, "loss": 0.4919, "accuracy": 0.78125, "learning_rate": 8.221650914254565e-07, "epoch": 0.8547008547008547, "percentage": 28.54, "elapsed_time": "3:10:13", "remaining_time": "7:56:20"}
57
+ {"current_steps": 255, "total_steps": 876, "loss": 0.4651, "accuracy": 0.71875, "learning_rate": 8.151767806784953e-07, "epoch": 0.8717948717948718, "percentage": 29.11, "elapsed_time": "3:12:57", "remaining_time": "7:49:53"}
58
+ {"current_steps": 260, "total_steps": 876, "loss": 0.4474, "accuracy": 0.731249988079071, "learning_rate": 8.080847776863608e-07, "epoch": 0.8888888888888888, "percentage": 29.68, "elapsed_time": "3:15:39", "remaining_time": "7:43:34"}
59
+ {"current_steps": 265, "total_steps": 876, "loss": 0.4427, "accuracy": 0.7562500238418579, "learning_rate": 8.008914156974333e-07, "epoch": 0.905982905982906, "percentage": 30.25, "elapsed_time": "3:18:23", "remaining_time": "7:37:25"}
60
+ {"current_steps": 270, "total_steps": 876, "loss": 0.445, "accuracy": 0.737500011920929, "learning_rate": 7.935990613069086e-07, "epoch": 0.9230769230769231, "percentage": 30.82, "elapsed_time": "3:21:06", "remaining_time": "7:31:22"}
61
+ {"current_steps": 275, "total_steps": 876, "loss": 0.4173, "accuracy": 0.7875000238418579, "learning_rate": 7.862101136781946e-07, "epoch": 0.9401709401709402, "percentage": 31.39, "elapsed_time": "3:23:49", "remaining_time": "7:25:27"}
62
+ {"current_steps": 280, "total_steps": 876, "loss": 0.4484, "accuracy": 0.75, "learning_rate": 7.78727003753595e-07, "epoch": 0.9572649572649573, "percentage": 31.96, "elapsed_time": "3:26:32", "remaining_time": "7:19:39"}
63
+ {"current_steps": 280, "total_steps": 876, "eval_loss": 0.4431803524494171, "epoch": 0.9572649572649573, "percentage": 31.96, "elapsed_time": "3:35:03", "remaining_time": "7:37:45"}
64
+ {"current_steps": 285, "total_steps": 876, "loss": 0.4233, "accuracy": 0.75, "learning_rate": 7.711521934545342e-07, "epoch": 0.9743589743589743, "percentage": 32.53, "elapsed_time": "3:38:19", "remaining_time": "7:32:44"}
65
+ {"current_steps": 290, "total_steps": 876, "loss": 0.4064, "accuracy": 0.8062499761581421, "learning_rate": 7.63488174871594e-07, "epoch": 0.9914529914529915, "percentage": 33.11, "elapsed_time": "3:41:03", "remaining_time": "7:26:41"}
66
+ {"current_steps": 295, "total_steps": 876, "loss": 0.3182, "accuracy": 0.84375, "learning_rate": 7.557374694446221e-07, "epoch": 1.0085470085470085, "percentage": 33.68, "elapsed_time": "3:43:46", "remaining_time": "7:20:42"}
67
+ {"current_steps": 300, "total_steps": 876, "loss": 0.2168, "accuracy": 0.918749988079071, "learning_rate": 7.479026271331863e-07, "epoch": 1.0256410256410255, "percentage": 34.25, "elapsed_time": "3:46:28", "remaining_time": "7:14:49"}
68
+ {"current_steps": 305, "total_steps": 876, "loss": 0.2127, "accuracy": 0.893750011920929, "learning_rate": 7.399862255776448e-07, "epoch": 1.0427350427350428, "percentage": 34.82, "elapsed_time": "3:49:11", "remaining_time": "7:09:04"}
69
+ {"current_steps": 310, "total_steps": 876, "loss": 0.2371, "accuracy": 0.9125000238418579, "learning_rate": 7.319908692511102e-07, "epoch": 1.0598290598290598, "percentage": 35.39, "elapsed_time": "3:51:54", "remaining_time": "7:03:26"}
70
+ {"current_steps": 315, "total_steps": 876, "loss": 0.2077, "accuracy": 0.925000011920929, "learning_rate": 7.239191886025853e-07, "epoch": 1.0769230769230769, "percentage": 35.96, "elapsed_time": "3:54:37", "remaining_time": "6:57:50"}
71
+ {"current_steps": 320, "total_steps": 876, "loss": 0.222, "accuracy": 0.8999999761581421, "learning_rate": 7.15773839191553e-07, "epoch": 1.0940170940170941, "percentage": 36.53, "elapsed_time": "3:57:21", "remaining_time": "6:52:23"}
72
+ {"current_steps": 320, "total_steps": 876, "eval_loss": 0.45035940408706665, "epoch": 1.0940170940170941, "percentage": 36.53, "elapsed_time": "4:05:50", "remaining_time": "7:07:09"}
73
+ {"current_steps": 325, "total_steps": 876, "loss": 0.2187, "accuracy": 0.9125000238418579, "learning_rate": 7.075575008143054e-07, "epoch": 1.1111111111111112, "percentage": 37.1, "elapsed_time": "4:09:05", "remaining_time": "7:02:17"}
74
+ {"current_steps": 330, "total_steps": 876, "loss": 0.2223, "accuracy": 0.925000011920929, "learning_rate": 6.99272876622298e-07, "epoch": 1.1282051282051282, "percentage": 37.67, "elapsed_time": "4:11:47", "remaining_time": "6:56:36"}
75
+ {"current_steps": 335, "total_steps": 876, "loss": 0.2107, "accuracy": 0.875, "learning_rate": 6.909226922328211e-07, "epoch": 1.1452991452991452, "percentage": 38.24, "elapsed_time": "4:14:31", "remaining_time": "6:51:02"}
76
+ {"current_steps": 340, "total_steps": 876, "loss": 0.2184, "accuracy": 0.925000011920929, "learning_rate": 6.82509694832279e-07, "epoch": 1.1623931623931625, "percentage": 38.81, "elapsed_time": "4:17:13", "remaining_time": "6:45:31"}
77
+ {"current_steps": 345, "total_steps": 876, "loss": 0.1978, "accuracy": 0.9125000238418579, "learning_rate": 6.740366522723752e-07, "epoch": 1.1794871794871795, "percentage": 39.38, "elapsed_time": "4:19:57", "remaining_time": "6:40:05"}
78
+ {"current_steps": 350, "total_steps": 876, "loss": 0.2039, "accuracy": 0.9375, "learning_rate": 6.655063521594949e-07, "epoch": 1.1965811965811965, "percentage": 39.95, "elapsed_time": "4:22:40", "remaining_time": "6:34:45"}
79
+ {"current_steps": 355, "total_steps": 876, "loss": 0.1915, "accuracy": 0.9125000238418579, "learning_rate": 6.569216009375929e-07, "epoch": 1.2136752136752136, "percentage": 40.53, "elapsed_time": "4:25:23", "remaining_time": "6:29:29"}
80
+ {"current_steps": 360, "total_steps": 876, "loss": 0.2018, "accuracy": 0.893750011920929, "learning_rate": 6.482852229648801e-07, "epoch": 1.2307692307692308, "percentage": 41.1, "elapsed_time": "4:28:06", "remaining_time": "6:24:17"}
81
+ {"current_steps": 360, "total_steps": 876, "eval_loss": 0.44376233220100403, "epoch": 1.2307692307692308, "percentage": 41.1, "elapsed_time": "4:36:37", "remaining_time": "6:36:29"}
82
+ {"current_steps": 365, "total_steps": 876, "loss": 0.2058, "accuracy": 0.8687499761581421, "learning_rate": 6.396000595846187e-07, "epoch": 1.2478632478632479, "percentage": 41.67, "elapsed_time": "4:39:52", "remaining_time": "6:31:49"}
83
+ {"current_steps": 370, "total_steps": 876, "loss": 0.1952, "accuracy": 0.9375, "learning_rate": 6.30868968190328e-07, "epoch": 1.264957264957265, "percentage": 42.24, "elapsed_time": "4:42:35", "remaining_time": "6:26:27"}
84
+ {"current_steps": 375, "total_steps": 876, "loss": 0.1874, "accuracy": 0.918749988079071, "learning_rate": 6.220948212857111e-07, "epoch": 1.282051282051282, "percentage": 42.81, "elapsed_time": "4:45:17", "remaining_time": "6:21:09"}
85
+ {"current_steps": 380, "total_steps": 876, "loss": 0.2029, "accuracy": 0.9125000238418579, "learning_rate": 6.13280505539608e-07, "epoch": 1.2991452991452992, "percentage": 43.38, "elapsed_time": "4:47:59", "remaining_time": "6:15:54"}
86
+ {"current_steps": 385, "total_steps": 876, "loss": 0.1954, "accuracy": 0.893750011920929, "learning_rate": 6.044289208362914e-07, "epoch": 1.3162393162393162, "percentage": 43.95, "elapsed_time": "4:50:43", "remaining_time": "6:10:45"}
87
+ {"current_steps": 390, "total_steps": 876, "loss": 0.2087, "accuracy": 0.9125000238418579, "learning_rate": 5.955429793214128e-07, "epoch": 1.3333333333333333, "percentage": 44.52, "elapsed_time": "4:53:39", "remaining_time": "6:05:56"}
88
+ {"current_steps": 395, "total_steps": 876, "loss": 0.2183, "accuracy": 0.9125000238418579, "learning_rate": 5.866256044439142e-07, "epoch": 1.3504273504273505, "percentage": 45.09, "elapsed_time": "4:56:38", "remaining_time": "6:01:13"}
89
+ {"current_steps": 400, "total_steps": 876, "loss": 0.2017, "accuracy": 0.9125000238418579, "learning_rate": 5.776797299942235e-07, "epoch": 1.3675213675213675, "percentage": 45.66, "elapsed_time": "4:59:37", "remaining_time": "5:56:33"}
90
+ {"current_steps": 400, "total_steps": 876, "eval_loss": 0.43498364090919495, "epoch": 1.3675213675213675, "percentage": 45.66, "elapsed_time": "5:08:41", "remaining_time": "6:07:20"}
91
+ {"current_steps": 405, "total_steps": 876, "loss": 0.2194, "accuracy": 0.875, "learning_rate": 5.687082991390443e-07, "epoch": 1.3846153846153846, "percentage": 46.23, "elapsed_time": "5:12:09", "remaining_time": "6:03:02"}
92
+ {"current_steps": 410, "total_steps": 876, "loss": 0.1923, "accuracy": 0.9375, "learning_rate": 5.597142634530638e-07, "epoch": 1.4017094017094016, "percentage": 46.8, "elapsed_time": "5:15:07", "remaining_time": "5:58:09"}
93
+ {"current_steps": 415, "total_steps": 876, "loss": 0.2273, "accuracy": 0.918749988079071, "learning_rate": 5.507005819478924e-07, "epoch": 1.4188034188034189, "percentage": 47.37, "elapsed_time": "5:18:05", "remaining_time": "5:53:21"}
94
+ {"current_steps": 420, "total_steps": 876, "loss": 0.2022, "accuracy": 0.9125000238418579, "learning_rate": 5.416702200985584e-07, "epoch": 1.435897435897436, "percentage": 47.95, "elapsed_time": "5:21:04", "remaining_time": "5:48:35"}
95
+ {"current_steps": 425, "total_steps": 876, "loss": 0.2124, "accuracy": 0.9375, "learning_rate": 5.326261488678748e-07, "epoch": 1.452991452991453, "percentage": 48.52, "elapsed_time": "5:24:02", "remaining_time": "5:43:51"}
96
+ {"current_steps": 430, "total_steps": 876, "loss": 0.1905, "accuracy": 0.9375, "learning_rate": 5.235713437290011e-07, "epoch": 1.4700854700854702, "percentage": 49.09, "elapsed_time": "5:27:00", "remaining_time": "5:39:10"}
97
+ {"current_steps": 435, "total_steps": 876, "loss": 0.1887, "accuracy": 0.949999988079071, "learning_rate": 5.145087836865213e-07, "epoch": 1.4871794871794872, "percentage": 49.66, "elapsed_time": "5:29:58", "remaining_time": "5:34:31"}
98
+ {"current_steps": 440, "total_steps": 876, "loss": 0.1999, "accuracy": 0.9375, "learning_rate": 5.054414502963604e-07, "epoch": 1.5042735042735043, "percentage": 50.23, "elapsed_time": "5:32:55", "remaining_time": "5:29:54"}
99
+ {"current_steps": 440, "total_steps": 876, "eval_loss": 0.42879074811935425, "epoch": 1.5042735042735043, "percentage": 50.23, "elapsed_time": "5:42:05", "remaining_time": "5:38:58"}
100
+ {"current_steps": 445, "total_steps": 876, "loss": 0.2006, "accuracy": 0.918749988079071, "learning_rate": 4.963723266848609e-07, "epoch": 1.5213675213675213, "percentage": 50.8, "elapsed_time": "5:45:37", "remaining_time": "5:34:45"}
101
+ {"current_steps": 450, "total_steps": 876, "loss": 0.1836, "accuracy": 0.9437500238418579, "learning_rate": 4.873043965673426e-07, "epoch": 1.5384615384615383, "percentage": 51.37, "elapsed_time": "5:48:35", "remaining_time": "5:29:59"}
102
+ {"current_steps": 455, "total_steps": 876, "loss": 0.2032, "accuracy": 0.925000011920929, "learning_rate": 4.782406432664698e-07, "epoch": 1.5555555555555556, "percentage": 51.94, "elapsed_time": "5:51:33", "remaining_time": "5:25:17"}
103
+ {"current_steps": 460, "total_steps": 876, "loss": 0.2007, "accuracy": 0.90625, "learning_rate": 4.691840487307457e-07, "epoch": 1.5726495726495726, "percentage": 52.51, "elapsed_time": "5:54:31", "remaining_time": "5:20:37"}
104
+ {"current_steps": 465, "total_steps": 876, "loss": 0.1872, "accuracy": 0.925000011920929, "learning_rate": 4.601375925534609e-07, "epoch": 1.5897435897435899, "percentage": 53.08, "elapsed_time": "5:57:30", "remaining_time": "5:15:59"}
105
+ {"current_steps": 470, "total_steps": 876, "loss": 0.1678, "accuracy": 0.981249988079071, "learning_rate": 4.5110425099241564e-07, "epoch": 1.606837606837607, "percentage": 53.65, "elapsed_time": "6:00:28", "remaining_time": "5:11:23"}
106
+ {"current_steps": 475, "total_steps": 876, "loss": 0.1657, "accuracy": 0.925000011920929, "learning_rate": 4.4208699599073867e-07, "epoch": 1.623931623931624, "percentage": 54.22, "elapsed_time": "6:03:26", "remaining_time": "5:06:49"}
107
+ {"current_steps": 480, "total_steps": 876, "loss": 0.1837, "accuracy": 0.925000011920929, "learning_rate": 4.330887941991288e-07, "epoch": 1.641025641025641, "percentage": 54.79, "elapsed_time": "6:06:25", "remaining_time": "5:02:17"}
108
+ {"current_steps": 480, "total_steps": 876, "eval_loss": 0.42615845799446106, "epoch": 1.641025641025641, "percentage": 54.79, "elapsed_time": "6:15:34", "remaining_time": "5:09:50"}
109
+ {"current_steps": 485, "total_steps": 876, "loss": 0.1703, "accuracy": 0.949999988079071, "learning_rate": 4.241126059998332e-07, "epoch": 1.658119658119658, "percentage": 55.37, "elapsed_time": "6:19:07", "remaining_time": "5:05:38"}
110
+ {"current_steps": 490, "total_steps": 876, "loss": 0.2076, "accuracy": 0.90625, "learning_rate": 4.151613845326911e-07, "epoch": 1.6752136752136753, "percentage": 55.94, "elapsed_time": "6:22:04", "remaining_time": "5:00:58"}
111
+ {"current_steps": 495, "total_steps": 876, "loss": 0.1886, "accuracy": 0.925000011920929, "learning_rate": 4.062380747235595e-07, "epoch": 1.6923076923076923, "percentage": 56.51, "elapsed_time": "6:25:00", "remaining_time": "4:56:20"}
112
+ {"current_steps": 500, "total_steps": 876, "loss": 0.1921, "accuracy": 0.9437500238418579, "learning_rate": 3.9734561231544143e-07, "epoch": 1.7094017094017095, "percentage": 57.08, "elapsed_time": "6:27:43", "remaining_time": "4:51:33"}
113
+ {"current_steps": 505, "total_steps": 876, "loss": 0.1821, "accuracy": 0.918749988079071, "learning_rate": 3.8848692290263427e-07, "epoch": 1.7264957264957266, "percentage": 57.65, "elapsed_time": "6:30:25", "remaining_time": "4:46:49"}
114
+ {"current_steps": 510, "total_steps": 876, "loss": 0.1997, "accuracy": 0.9375, "learning_rate": 3.796649209682177e-07, "epoch": 1.7435897435897436, "percentage": 58.22, "elapsed_time": "6:33:08", "remaining_time": "4:42:08"}
115
+ {"current_steps": 515, "total_steps": 876, "loss": 0.168, "accuracy": 0.925000011920929, "learning_rate": 3.708825089251979e-07, "epoch": 1.7606837606837606, "percentage": 58.79, "elapsed_time": "6:35:52", "remaining_time": "4:37:29"}
116
+ {"current_steps": 520, "total_steps": 876, "loss": 0.1942, "accuracy": 0.9312499761581421, "learning_rate": 3.6214257616162237e-07, "epoch": 1.7777777777777777, "percentage": 59.36, "elapsed_time": "6:38:36", "remaining_time": "4:32:53"}
117
+ {"current_steps": 520, "total_steps": 876, "eval_loss": 0.41628795862197876, "epoch": 1.7777777777777777, "percentage": 59.36, "elapsed_time": "6:47:06", "remaining_time": "4:38:42"}
118
+ {"current_steps": 525, "total_steps": 876, "loss": 0.1878, "accuracy": 0.875, "learning_rate": 3.5344799808997837e-07, "epoch": 1.7948717948717947, "percentage": 59.93, "elapsed_time": "6:50:23", "remaining_time": "4:34:22"}
119
+ {"current_steps": 530, "total_steps": 876, "loss": 0.1854, "accuracy": 0.9312499761581421, "learning_rate": 3.448016352011913e-07, "epoch": 1.811965811965812, "percentage": 60.5, "elapsed_time": "6:53:06", "remaining_time": "4:29:41"}
120
+ {"current_steps": 535, "total_steps": 876, "loss": 0.197, "accuracy": 0.925000011920929, "learning_rate": 3.3620633212353176e-07, "epoch": 1.8290598290598292, "percentage": 61.07, "elapsed_time": "6:55:49", "remaining_time": "4:25:02"}
121
+ {"current_steps": 540, "total_steps": 876, "loss": 0.1988, "accuracy": 0.9125000238418579, "learning_rate": 3.2766491668674054e-07, "epoch": 1.8461538461538463, "percentage": 61.64, "elapsed_time": "6:58:33", "remaining_time": "4:20:26"}
122
+ {"current_steps": 545, "total_steps": 876, "loss": 0.2022, "accuracy": 0.90625, "learning_rate": 3.1918019899168167e-07, "epoch": 1.8632478632478633, "percentage": 62.21, "elapsed_time": "7:01:16", "remaining_time": "4:15:51"}
123
+ {"current_steps": 550, "total_steps": 876, "loss": 0.196, "accuracy": 0.9375, "learning_rate": 3.107549704858263e-07, "epoch": 1.8803418803418803, "percentage": 62.79, "elapsed_time": "7:03:59", "remaining_time": "4:11:18"}
124
+ {"current_steps": 555, "total_steps": 876, "loss": 0.1672, "accuracy": 0.96875, "learning_rate": 3.0239200304487555e-07, "epoch": 1.8974358974358974, "percentage": 63.36, "elapsed_time": "7:06:42", "remaining_time": "4:06:47"}
125
+ {"current_steps": 560, "total_steps": 876, "loss": 0.1821, "accuracy": 0.918749988079071, "learning_rate": 2.940940480608207e-07, "epoch": 1.9145299145299144, "percentage": 63.93, "elapsed_time": "7:09:25", "remaining_time": "4:02:18"}
126
+ {"current_steps": 560, "total_steps": 876, "eval_loss": 0.4165222644805908, "epoch": 1.9145299145299144, "percentage": 63.93, "elapsed_time": "7:17:55", "remaining_time": "4:07:06"}
127
+ {"current_steps": 565, "total_steps": 876, "loss": 0.2078, "accuracy": 0.893750011920929, "learning_rate": 2.858638355367439e-07, "epoch": 1.9316239316239316, "percentage": 64.5, "elapsed_time": "7:21:11", "remaining_time": "4:02:50"}
128
+ {"current_steps": 570, "total_steps": 876, "loss": 0.179, "accuracy": 0.9312499761581421, "learning_rate": 2.7770407318865484e-07, "epoch": 1.9487179487179487, "percentage": 65.07, "elapsed_time": "7:23:54", "remaining_time": "3:58:18"}
129
+ {"current_steps": 575, "total_steps": 876, "loss": 0.2082, "accuracy": 0.893750011920929, "learning_rate": 2.696174455546599e-07, "epoch": 1.965811965811966, "percentage": 65.64, "elapsed_time": "7:26:36", "remaining_time": "3:53:47"}
130
+ {"current_steps": 580, "total_steps": 876, "loss": 0.1861, "accuracy": 0.956250011920929, "learning_rate": 2.616066131117562e-07, "epoch": 1.982905982905983, "percentage": 66.21, "elapsed_time": "7:29:20", "remaining_time": "3:49:19"}
131
+ {"current_steps": 585, "total_steps": 876, "loss": 0.1861, "accuracy": 0.925000011920929, "learning_rate": 2.536742114005448e-07, "epoch": 2.0, "percentage": 66.78, "elapsed_time": "7:32:02", "remaining_time": "3:44:51"}
132
+ {"current_steps": 590, "total_steps": 876, "loss": 0.0966, "accuracy": 0.9624999761581421, "learning_rate": 2.4582285015814256e-07, "epoch": 2.017094017094017, "percentage": 67.35, "elapsed_time": "7:34:46", "remaining_time": "3:40:26"}
133
+ {"current_steps": 595, "total_steps": 876, "loss": 0.1006, "accuracy": 0.9624999761581421, "learning_rate": 2.3805511245958815e-07, "epoch": 2.034188034188034, "percentage": 67.92, "elapsed_time": "7:37:29", "remaining_time": "3:36:03"}
134
+ {"current_steps": 600, "total_steps": 876, "loss": 0.0858, "accuracy": 0.949999988079071, "learning_rate": 2.3037355386801683e-07, "epoch": 2.051282051282051, "percentage": 68.49, "elapsed_time": "7:40:13", "remaining_time": "3:31:42"}
135
+ {"current_steps": 600, "total_steps": 876, "eval_loss": 0.44152435660362244, "epoch": 2.051282051282051, "percentage": 68.49, "elapsed_time": "7:48:43", "remaining_time": "3:35:36"}
136
+ {"current_steps": 605, "total_steps": 876, "loss": 0.0852, "accuracy": 0.9750000238418579, "learning_rate": 2.2278070159388872e-07, "epoch": 2.0683760683760686, "percentage": 69.06, "elapsed_time": "7:51:57", "remaining_time": "3:31:24"}
137
+ {"current_steps": 610, "total_steps": 876, "loss": 0.0849, "accuracy": 0.96875, "learning_rate": 2.1527905366354289e-07, "epoch": 2.0854700854700856, "percentage": 69.63, "elapsed_time": "7:54:39", "remaining_time": "3:26:59"}
138
+ {"current_steps": 615, "total_steps": 876, "loss": 0.0868, "accuracy": 0.9750000238418579, "learning_rate": 2.0787107809735372e-07, "epoch": 2.1025641025641026, "percentage": 70.21, "elapsed_time": "7:57:23", "remaining_time": "3:22:35"}
139
+ {"current_steps": 620, "total_steps": 876, "loss": 0.0942, "accuracy": 0.956250011920929, "learning_rate": 2.0055921209776062e-07, "epoch": 2.1196581196581197, "percentage": 70.78, "elapsed_time": "8:00:06", "remaining_time": "3:18:14"}
140
+ {"current_steps": 625, "total_steps": 876, "loss": 0.0898, "accuracy": 0.9750000238418579, "learning_rate": 1.9334586124743446e-07, "epoch": 2.1367521367521367, "percentage": 71.35, "elapsed_time": "8:02:49", "remaining_time": "3:13:53"}
141
+ {"current_steps": 630, "total_steps": 876, "loss": 0.0734, "accuracy": 0.981249988079071, "learning_rate": 1.8623339871784866e-07, "epoch": 2.1538461538461537, "percentage": 71.92, "elapsed_time": "8:05:31", "remaining_time": "3:09:35"}
142
+ {"current_steps": 635, "total_steps": 876, "loss": 0.0837, "accuracy": 0.9750000238418579, "learning_rate": 1.792241644885118e-07, "epoch": 2.1709401709401708, "percentage": 72.49, "elapsed_time": "8:08:15", "remaining_time": "3:05:18"}
143
+ {"current_steps": 640, "total_steps": 876, "loss": 0.0832, "accuracy": 0.9750000238418579, "learning_rate": 1.7232046457712162e-07, "epoch": 2.1880341880341883, "percentage": 73.06, "elapsed_time": "8:10:58", "remaining_time": "3:01:02"}
144
+ {"current_steps": 640, "total_steps": 876, "eval_loss": 0.44137728214263916, "epoch": 2.1880341880341883, "percentage": 73.06, "elapsed_time": "8:19:28", "remaining_time": "3:04:10"}
145
+ {"current_steps": 645, "total_steps": 876, "loss": 0.0723, "accuracy": 0.96875, "learning_rate": 1.65524570280892e-07, "epoch": 2.2051282051282053, "percentage": 73.63, "elapsed_time": "8:22:42", "remaining_time": "3:00:02"}
146
+ {"current_steps": 650, "total_steps": 876, "loss": 0.0845, "accuracy": 0.96875, "learning_rate": 1.5883871742930255e-07, "epoch": 2.2222222222222223, "percentage": 74.2, "elapsed_time": "8:25:25", "remaining_time": "2:55:43"}
147
+ {"current_steps": 655, "total_steps": 876, "loss": 0.0851, "accuracy": 0.9937499761581421, "learning_rate": 1.522651056485173e-07, "epoch": 2.2393162393162394, "percentage": 74.77, "elapsed_time": "8:28:07", "remaining_time": "2:51:26"}
148
+ {"current_steps": 660, "total_steps": 876, "loss": 0.0739, "accuracy": 0.9750000238418579, "learning_rate": 1.458058976377141e-07, "epoch": 2.2564102564102564, "percentage": 75.34, "elapsed_time": "8:30:51", "remaining_time": "2:47:11"}
149
+ {"current_steps": 665, "total_steps": 876, "loss": 0.0756, "accuracy": 0.9624999761581421, "learning_rate": 1.3946321845756276e-07, "epoch": 2.2735042735042734, "percentage": 75.91, "elapsed_time": "8:33:33", "remaining_time": "2:42:56"}
150
+ {"current_steps": 670, "total_steps": 876, "loss": 0.0952, "accuracy": 0.96875, "learning_rate": 1.3323915483108662e-07, "epoch": 2.2905982905982905, "percentage": 76.48, "elapsed_time": "8:36:16", "remaining_time": "2:38:44"}
151
+ {"current_steps": 675, "total_steps": 876, "loss": 0.0753, "accuracy": 0.981249988079071, "learning_rate": 1.2713575445713615e-07, "epoch": 2.3076923076923075, "percentage": 77.05, "elapsed_time": "8:39:00", "remaining_time": "2:34:33"}
152
+ {"current_steps": 680, "total_steps": 876, "loss": 0.0817, "accuracy": 0.96875, "learning_rate": 1.2115502533670252e-07, "epoch": 2.324786324786325, "percentage": 77.63, "elapsed_time": "8:41:44", "remaining_time": "2:30:23"}
153
+ {"current_steps": 680, "total_steps": 876, "eval_loss": 0.45208829641342163, "epoch": 2.324786324786325, "percentage": 77.63, "elapsed_time": "8:50:15", "remaining_time": "2:32:50"}
154
+ {"current_steps": 685, "total_steps": 876, "loss": 0.0723, "accuracy": 0.9624999761581421, "learning_rate": 1.1529893511229066e-07, "epoch": 2.341880341880342, "percentage": 78.2, "elapsed_time": "8:53:31", "remaining_time": "2:28:45"}
155
+ {"current_steps": 690, "total_steps": 876, "loss": 0.0825, "accuracy": 0.981249988079071, "learning_rate": 1.0956941042057105e-07, "epoch": 2.358974358974359, "percentage": 78.77, "elapsed_time": "8:56:14", "remaining_time": "2:24:33"}
156
+ {"current_steps": 695, "total_steps": 876, "loss": 0.0735, "accuracy": 0.949999988079071, "learning_rate": 1.0396833625852147e-07, "epoch": 2.376068376068376, "percentage": 79.34, "elapsed_time": "8:58:57", "remaining_time": "2:20:21"}
157
+ {"current_steps": 700, "total_steps": 876, "loss": 0.0931, "accuracy": 0.956250011920929, "learning_rate": 9.849755536326865e-08, "epoch": 2.393162393162393, "percentage": 79.91, "elapsed_time": "9:01:42", "remaining_time": "2:16:11"}
158
+ {"current_steps": 705, "total_steps": 876, "loss": 0.0747, "accuracy": 0.987500011920929, "learning_rate": 9.31588676058332e-08, "epoch": 2.41025641025641, "percentage": 80.48, "elapsed_time": "9:04:24", "remaining_time": "2:12:02"}
159
+ {"current_steps": 710, "total_steps": 876, "loss": 0.0858, "accuracy": 0.9375, "learning_rate": 8.795402939897678e-08, "epoch": 2.427350427350427, "percentage": 81.05, "elapsed_time": "9:07:08", "remaining_time": "2:07:55"}
160
+ {"current_steps": 715, "total_steps": 876, "loss": 0.0793, "accuracy": 0.9375, "learning_rate": 8.288475311934839e-08, "epoch": 2.4444444444444446, "percentage": 81.62, "elapsed_time": "9:09:51", "remaining_time": "2:03:48"}
161
+ {"current_steps": 720, "total_steps": 876, "loss": 0.0858, "accuracy": 0.96875, "learning_rate": 7.795270654411634e-08, "epoch": 2.4615384615384617, "percentage": 82.19, "elapsed_time": "9:12:34", "remaining_time": "1:59:43"}
162
+ {"current_steps": 720, "total_steps": 876, "eval_loss": 0.4478990435600281, "epoch": 2.4615384615384617, "percentage": 82.19, "elapsed_time": "9:21:04", "remaining_time": "2:01:34"}
163
+ {"current_steps": 725, "total_steps": 876, "loss": 0.0794, "accuracy": 0.987500011920929, "learning_rate": 7.315951230227501e-08, "epoch": 2.4786324786324787, "percentage": 82.76, "elapsed_time": "9:24:19", "remaining_time": "1:57:32"}
164
+ {"current_steps": 730, "total_steps": 876, "loss": 0.0897, "accuracy": 0.956250011920929, "learning_rate": 6.850674734080453e-08, "epoch": 2.4957264957264957, "percentage": 83.33, "elapsed_time": "9:27:02", "remaining_time": "1:53:24"}
165
+ {"current_steps": 735, "total_steps": 876, "loss": 0.075, "accuracy": 0.956250011920929, "learning_rate": 6.399594240585965e-08, "epoch": 2.5128205128205128, "percentage": 83.9, "elapsed_time": "9:29:45", "remaining_time": "1:49:18"}
166
+ {"current_steps": 740, "total_steps": 876, "loss": 0.0794, "accuracy": 0.96875, "learning_rate": 5.962858153915896e-08, "epoch": 2.52991452991453, "percentage": 84.47, "elapsed_time": "9:32:28", "remaining_time": "1:45:12"}
167
+ {"current_steps": 745, "total_steps": 876, "loss": 0.0799, "accuracy": 0.9624999761581421, "learning_rate": 5.540610158973935e-08, "epoch": 2.547008547008547, "percentage": 85.05, "elapsed_time": "9:35:11", "remaining_time": "1:41:08"}
168
+ {"current_steps": 750, "total_steps": 876, "loss": 0.0746, "accuracy": 0.956250011920929, "learning_rate": 5.1329891741236585e-08, "epoch": 2.564102564102564, "percentage": 85.62, "elapsed_time": "9:37:54", "remaining_time": "1:37:05"}
169
+ {"current_steps": 755, "total_steps": 876, "loss": 0.0825, "accuracy": 0.9624999761581421, "learning_rate": 4.740129305484869e-08, "epoch": 2.5811965811965814, "percentage": 86.19, "elapsed_time": "9:40:37", "remaining_time": "1:33:03"}
170
+ {"current_steps": 760, "total_steps": 876, "loss": 0.0723, "accuracy": 0.9750000238418579, "learning_rate": 4.36215980281297e-08, "epoch": 2.5982905982905984, "percentage": 86.76, "elapsed_time": "9:43:19", "remaining_time": "1:29:02"}
171
+ {"current_steps": 760, "total_steps": 876, "eval_loss": 0.4573881924152374, "epoch": 2.5982905982905984, "percentage": 86.76, "elapsed_time": "9:51:50", "remaining_time": "1:30:19"}
172
+ {"current_steps": 765, "total_steps": 876, "loss": 0.0854, "accuracy": 0.9750000238418579, "learning_rate": 3.9992050169762483e-08, "epoch": 2.6153846153846154, "percentage": 87.33, "elapsed_time": "9:55:05", "remaining_time": "1:26:20"}
173
+ {"current_steps": 770, "total_steps": 876, "loss": 0.0839, "accuracy": 0.9750000238418579, "learning_rate": 3.651384359044773e-08, "epoch": 2.6324786324786325, "percentage": 87.9, "elapsed_time": "9:57:48", "remaining_time": "1:22:17"}
174
+ {"current_steps": 775, "total_steps": 876, "loss": 0.0792, "accuracy": 0.9750000238418579, "learning_rate": 3.318812261004467e-08, "epoch": 2.6495726495726495, "percentage": 88.47, "elapsed_time": "10:00:32", "remaining_time": "1:18:15"}
175
+ {"current_steps": 780, "total_steps": 876, "loss": 0.0885, "accuracy": 0.96875, "learning_rate": 3.001598138109407e-08, "epoch": 2.6666666666666665, "percentage": 89.04, "elapsed_time": "10:03:15", "remaining_time": "1:14:14"}
176
+ {"current_steps": 785, "total_steps": 876, "loss": 0.074, "accuracy": 0.9750000238418579, "learning_rate": 2.6998463528844217e-08, "epoch": 2.683760683760684, "percentage": 89.61, "elapsed_time": "10:05:58", "remaining_time": "1:10:14"}
177
+ {"current_steps": 790, "total_steps": 876, "loss": 0.0762, "accuracy": 0.987500011920929, "learning_rate": 2.4136561807901913e-08, "epoch": 2.700854700854701, "percentage": 90.18, "elapsed_time": "10:08:40", "remaining_time": "1:06:15"}
178
+ {"current_steps": 795, "total_steps": 876, "loss": 0.0724, "accuracy": 0.96875, "learning_rate": 2.143121777561868e-08, "epoch": 2.717948717948718, "percentage": 90.75, "elapsed_time": "10:11:23", "remaining_time": "1:02:17"}
179
+ {"current_steps": 800, "total_steps": 876, "loss": 0.0717, "accuracy": 0.9750000238418579, "learning_rate": 1.8883321482321578e-08, "epoch": 2.735042735042735, "percentage": 91.32, "elapsed_time": "10:14:05", "remaining_time": "0:58:20"}
180
+ {"current_steps": 800, "total_steps": 876, "eval_loss": 0.4532097578048706, "epoch": 2.735042735042735, "percentage": 91.32, "elapsed_time": "10:22:36", "remaining_time": "0:59:08"}
181
+ {"current_steps": 805, "total_steps": 876, "loss": 0.08, "accuracy": 0.9624999761581421, "learning_rate": 1.6493711178488744e-08, "epoch": 2.752136752136752, "percentage": 91.89, "elapsed_time": "10:25:51", "remaining_time": "0:55:12"}
182
+ {"current_steps": 810, "total_steps": 876, "loss": 0.0881, "accuracy": 0.96875, "learning_rate": 1.4263173038967624e-08, "epoch": 2.769230769230769, "percentage": 92.47, "elapsed_time": "10:28:34", "remaining_time": "0:51:13"}
183
+ {"current_steps": 815, "total_steps": 876, "loss": 0.076, "accuracy": 0.981249988079071, "learning_rate": 1.2192440904325863e-08, "epoch": 2.786324786324786, "percentage": 93.04, "elapsed_time": "10:31:18", "remaining_time": "0:47:15"}
184
+ {"current_steps": 820, "total_steps": 876, "loss": 0.0871, "accuracy": 0.96875, "learning_rate": 1.0282196039419822e-08, "epoch": 2.8034188034188032, "percentage": 93.61, "elapsed_time": "10:34:00", "remaining_time": "0:43:17"}
185
+ {"current_steps": 825, "total_steps": 876, "loss": 0.084, "accuracy": 0.9937499761581421, "learning_rate": 8.5330669092602e-09, "epoch": 2.8205128205128203, "percentage": 94.18, "elapsed_time": "10:36:43", "remaining_time": "0:39:21"}
186
+ {"current_steps": 830, "total_steps": 876, "loss": 0.0866, "accuracy": 0.949999988079071, "learning_rate": 6.945628972249207e-09, "epoch": 2.8376068376068377, "percentage": 94.75, "elapsed_time": "10:39:26", "remaining_time": "0:35:26"}
187
+ {"current_steps": 835, "total_steps": 876, "loss": 0.0789, "accuracy": 0.987500011920929, "learning_rate": 5.520404490856223e-09, "epoch": 2.8547008547008548, "percentage": 95.32, "elapsed_time": "10:42:10", "remaining_time": "0:31:31"}
188
+ {"current_steps": 840, "total_steps": 876, "loss": 0.0691, "accuracy": 0.987500011920929, "learning_rate": 4.257862359794917e-09, "epoch": 2.871794871794872, "percentage": 95.89, "elapsed_time": "10:44:54", "remaining_time": "0:27:38"}
189
+ {"current_steps": 840, "total_steps": 876, "eval_loss": 0.45144182443618774, "epoch": 2.871794871794872, "percentage": 95.89, "elapsed_time": "10:53:25", "remaining_time": "0:28:00"}
190
+ {"current_steps": 845, "total_steps": 876, "loss": 0.0761, "accuracy": 0.949999988079071, "learning_rate": 3.158417951758474e-09, "epoch": 2.888888888888889, "percentage": 96.46, "elapsed_time": "10:56:40", "remaining_time": "0:24:05"}
191
+ {"current_steps": 850, "total_steps": 876, "loss": 0.0746, "accuracy": 0.981249988079071, "learning_rate": 2.2224329807629118e-09, "epoch": 2.905982905982906, "percentage": 97.03, "elapsed_time": "10:59:24", "remaining_time": "0:20:10"}
192
+ {"current_steps": 855, "total_steps": 876, "loss": 0.079, "accuracy": 0.96875, "learning_rate": 1.450215383144382e-09, "epoch": 2.9230769230769234, "percentage": 97.6, "elapsed_time": "11:02:06", "remaining_time": "0:16:15"}
193
+ {"current_steps": 860, "total_steps": 876, "loss": 0.0725, "accuracy": 0.9624999761581421, "learning_rate": 8.420192162490458e-10, "epoch": 2.9401709401709404, "percentage": 98.17, "elapsed_time": "11:04:49", "remaining_time": "0:12:22"}
194
+ {"current_steps": 865, "total_steps": 876, "loss": 0.085, "accuracy": 0.987500011920929, "learning_rate": 3.98044574848877e-10, "epoch": 2.9572649572649574, "percentage": 98.74, "elapsed_time": "11:07:32", "remaining_time": "0:08:29"}
195
+ {"current_steps": 870, "total_steps": 876, "loss": 0.0743, "accuracy": 0.981249988079071, "learning_rate": 1.1843752531104368e-10, "epoch": 2.9743589743589745, "percentage": 99.32, "elapsed_time": "11:10:15", "remaining_time": "0:04:37"}
196
+ {"current_steps": 875, "total_steps": 876, "loss": 0.0748, "accuracy": 0.949999988079071, "learning_rate": 3.290057542459923e-12, "epoch": 2.9914529914529915, "percentage": 99.89, "elapsed_time": "11:12:58", "remaining_time": "0:00:46"}
197
+ {"current_steps": 876, "total_steps": 876, "epoch": 2.994871794871795, "percentage": 100.0, "elapsed_time": "11:14:05", "remaining_time": "0:00:00"}
trainer_state.json ADDED
The diff for this file is too large to render. See raw diff
 
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:831d672014bf462253aa782d6da94e92dafa0a12ece6f1f8b7e68a5fb7e1420d
3
+ size 7096
training_eval_loss.png ADDED
training_loss.png ADDED
training_rewards_accuracies.png ADDED