Hugging Face's logo

chuthienlong
/
results

Text2Text Generation
Transformers
Safetensors
t5
Generated from Trainer
text-generation-inference
Model card Files Community
chuthienlong commited on
Commit
edebe9a
·
verified ·
1 Parent(s): 10c5b32

End of training

Browse files
Files changed (5) hide show
  1. README.md +183 -0
  2. config.json +61 -0
  3. generation_config.json +7 -0
  4. model.safetensors +3 -0
  5. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,183 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: cssupport/t5-small-awesome-text-to-sql
5
+ tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: results
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # results
16
+
17
+ This model is a fine-tuned version of [cssupport/t5-small-awesome-text-to-sql](https://huggingface.co/cssupport/t5-small-awesome-text-to-sql) on the None dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.1343
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 0.0001
39
+ - train_batch_size: 32
40
+ - eval_batch_size: 32
41
+ - seed: 42
42
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
+ - lr_scheduler_type: linear
44
+ - num_epochs: 5
45
+ - mixed_precision_training: Native AMP
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss |
50
+ |:-------------:|:------:|:-----:|:---------------:|
51
+ | 0.6591 | 0.04 | 100 | 0.4689 |
52
+ | 0.4841 | 0.08 | 200 | 0.3828 |
53
+ | 0.4239 | 0.12 | 300 | 0.3401 |
54
+ | 0.3792 | 0.16 | 400 | 0.3111 |
55
+ | 0.3679 | 0.2 | 500 | 0.2896 |
56
+ | 0.3301 | 0.24 | 600 | 0.2749 |
57
+ | 0.3104 | 0.28 | 700 | 0.2616 |
58
+ | 0.3118 | 0.32 | 800 | 0.2518 |
59
+ | 0.2981 | 0.36 | 900 | 0.2430 |
60
+ | 0.2925 | 0.4 | 1000 | 0.2355 |
61
+ | 0.2772 | 0.44 | 1100 | 0.2289 |
62
+ | 0.2643 | 0.48 | 1200 | 0.2235 |
63
+ | 0.2608 | 0.52 | 1300 | 0.2186 |
64
+ | 0.2594 | 0.56 | 1400 | 0.2145 |
65
+ | 0.2631 | 0.6 | 1500 | 0.2088 |
66
+ | 0.2553 | 0.64 | 1600 | 0.2047 |
67
+ | 0.2481 | 0.68 | 1700 | 0.2011 |
68
+ | 0.2387 | 0.72 | 1800 | 0.1980 |
69
+ | 0.2446 | 0.76 | 1900 | 0.1946 |
70
+ | 0.2355 | 0.8 | 2000 | 0.1916 |
71
+ | 0.2405 | 0.84 | 2100 | 0.1895 |
72
+ | 0.2287 | 0.88 | 2200 | 0.1870 |
73
+ | 0.2291 | 0.92 | 2300 | 0.1848 |
74
+ | 0.2164 | 0.96 | 2400 | 0.1834 |
75
+ | 0.2126 | 1.0 | 2500 | 0.1819 |
76
+ | 0.216 | 1.04 | 2600 | 0.1797 |
77
+ | 0.2139 | 1.08 | 2700 | 0.1776 |
78
+ | 0.21 | 1.12 | 2800 | 0.1761 |
79
+ | 0.2055 | 1.16 | 2900 | 0.1749 |
80
+ | 0.2083 | 1.2 | 3000 | 0.1730 |
81
+ | 0.1979 | 1.24 | 3100 | 0.1718 |
82
+ | 0.2056 | 1.28 | 3200 | 0.1705 |
83
+ | 0.1999 | 1.32 | 3300 | 0.1696 |
84
+ | 0.2014 | 1.3600 | 3400 | 0.1681 |
85
+ | 0.2052 | 1.4 | 3500 | 0.1667 |
86
+ | 0.1858 | 1.44 | 3600 | 0.1659 |
87
+ | 0.2085 | 1.48 | 3700 | 0.1640 |
88
+ | 0.1971 | 1.52 | 3800 | 0.1634 |
89
+ | 0.199 | 1.56 | 3900 | 0.1625 |
90
+ | 0.1962 | 1.6 | 4000 | 0.1618 |
91
+ | 0.1953 | 1.6400 | 4100 | 0.1604 |
92
+ | 0.1925 | 1.6800 | 4200 | 0.1593 |
93
+ | 0.1998 | 1.72 | 4300 | 0.1588 |
94
+ | 0.1937 | 1.76 | 4400 | 0.1572 |
95
+ | 0.1934 | 1.8 | 4500 | 0.1571 |
96
+ | 0.1931 | 1.8400 | 4600 | 0.1563 |
97
+ | 0.1924 | 1.88 | 4700 | 0.1547 |
98
+ | 0.1864 | 1.92 | 4800 | 0.1546 |
99
+ | 0.1878 | 1.96 | 4900 | 0.1535 |
100
+ | 0.1821 | 2.0 | 5000 | 0.1533 |
101
+ | 0.1824 | 2.04 | 5100 | 0.1526 |
102
+ | 0.1814 | 2.08 | 5200 | 0.1523 |
103
+ | 0.1823 | 2.12 | 5300 | 0.1509 |
104
+ | 0.1826 | 2.16 | 5400 | 0.1507 |
105
+ | 0.1828 | 2.2 | 5500 | 0.1500 |
106
+ | 0.1787 | 2.24 | 5600 | 0.1495 |
107
+ | 0.1832 | 2.2800 | 5700 | 0.1491 |
108
+ | 0.173 | 2.32 | 5800 | 0.1485 |
109
+ | 0.1773 | 2.36 | 5900 | 0.1481 |
110
+ | 0.1751 | 2.4 | 6000 | 0.1479 |
111
+ | 0.1658 | 2.44 | 6100 | 0.1472 |
112
+ | 0.1803 | 2.48 | 6200 | 0.1465 |
113
+ | 0.1725 | 2.52 | 6300 | 0.1458 |
114
+ | 0.1711 | 2.56 | 6400 | 0.1456 |
115
+ | 0.1796 | 2.6 | 6500 | 0.1454 |
116
+ | 0.1739 | 2.64 | 6600 | 0.1447 |
117
+ | 0.1689 | 2.68 | 6700 | 0.1441 |
118
+ | 0.166 | 2.7200 | 6800 | 0.1441 |
119
+ | 0.1655 | 2.76 | 6900 | 0.1437 |
120
+ | 0.173 | 2.8 | 7000 | 0.1435 |
121
+ | 0.1693 | 2.84 | 7100 | 0.1423 |
122
+ | 0.1739 | 2.88 | 7200 | 0.1426 |
123
+ | 0.1703 | 2.92 | 7300 | 0.1419 |
124
+ | 0.1675 | 2.96 | 7400 | 0.1419 |
125
+ | 0.1723 | 3.0 | 7500 | 0.1410 |
126
+ | 0.1655 | 3.04 | 7600 | 0.1410 |
127
+ | 0.1671 | 3.08 | 7700 | 0.1409 |
128
+ | 0.1633 | 3.12 | 7800 | 0.1408 |
129
+ | 0.1611 | 3.16 | 7900 | 0.1408 |
130
+ | 0.1622 | 3.2 | 8000 | 0.1403 |
131
+ | 0.1619 | 3.24 | 8100 | 0.1399 |
132
+ | 0.1667 | 3.2800 | 8200 | 0.1395 |
133
+ | 0.164 | 3.32 | 8300 | 0.1393 |
134
+ | 0.1635 | 3.36 | 8400 | 0.1388 |
135
+ | 0.1672 | 3.4 | 8500 | 0.1386 |
136
+ | 0.164 | 3.44 | 8600 | 0.1383 |
137
+ | 0.1673 | 3.48 | 8700 | 0.1381 |
138
+ | 0.1643 | 3.52 | 8800 | 0.1379 |
139
+ | 0.1612 | 3.56 | 8900 | 0.1379 |
140
+ | 0.1578 | 3.6 | 9000 | 0.1378 |
141
+ | 0.1651 | 3.64 | 9100 | 0.1377 |
142
+ | 0.1631 | 3.68 | 9200 | 0.1374 |
143
+ | 0.1645 | 3.7200 | 9300 | 0.1370 |
144
+ | 0.1627 | 3.76 | 9400 | 0.1366 |
145
+ | 0.1607 | 3.8 | 9500 | 0.1371 |
146
+ | 0.1621 | 3.84 | 9600 | 0.1365 |
147
+ | 0.1683 | 3.88 | 9700 | 0.1363 |
148
+ | 0.1559 | 3.92 | 9800 | 0.1361 |
149
+ | 0.1601 | 3.96 | 9900 | 0.1361 |
150
+ | 0.1589 | 4.0 | 10000 | 0.1360 |
151
+ | 0.16 | 4.04 | 10100 | 0.1360 |
152
+ | 0.1589 | 4.08 | 10200 | 0.1359 |
153
+ | 0.1569 | 4.12 | 10300 | 0.1358 |
154
+ | 0.1579 | 4.16 | 10400 | 0.1357 |
155
+ | 0.1667 | 4.2 | 10500 | 0.1356 |
156
+ | 0.1567 | 4.24 | 10600 | 0.1354 |
157
+ | 0.1596 | 4.28 | 10700 | 0.1353 |
158
+ | 0.1584 | 4.32 | 10800 | 0.1351 |
159
+ | 0.1605 | 4.36 | 10900 | 0.1352 |
160
+ | 0.1543 | 4.4 | 11000 | 0.1351 |
161
+ | 0.1588 | 4.44 | 11100 | 0.1348 |
162
+ | 0.1553 | 4.48 | 11200 | 0.1348 |
163
+ | 0.1533 | 4.52 | 11300 | 0.1349 |
164
+ | 0.1529 | 4.5600 | 11400 | 0.1347 |
165
+ | 0.1597 | 4.6 | 11500 | 0.1347 |
166
+ | 0.1518 | 4.64 | 11600 | 0.1347 |
167
+ | 0.1585 | 4.68 | 11700 | 0.1345 |
168
+ | 0.156 | 4.72 | 11800 | 0.1345 |
169
+ | 0.1593 | 4.76 | 11900 | 0.1344 |
170
+ | 0.1622 | 4.8 | 12000 | 0.1344 |
171
+ | 0.1553 | 4.84 | 12100 | 0.1344 |
172
+ | 0.1645 | 4.88 | 12200 | 0.1344 |
173
+ | 0.1535 | 4.92 | 12300 | 0.1343 |
174
+ | 0.1572 | 4.96 | 12400 | 0.1343 |
175
+ | 0.1614 | 5.0 | 12500 | 0.1343 |
176
+
177
+
178
+ ### Framework versions
179
+
180
+ - Transformers 4.47.0
181
+ - Pytorch 2.5.1+cu121
182
+ - Datasets 3.3.1
183
+ - Tokenizers 0.21.0
config.json ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "cssupport/t5-small-awesome-text-to-sql",
3
+ "architectures": [
4
+ "T5ForConditionalGeneration"
5
+ ],
6
+ "classifier_dropout": 0.0,
7
+ "d_ff": 2048,
8
+ "d_kv": 64,
9
+ "d_model": 512,
10
+ "decoder_start_token_id": 0,
11
+ "dense_act_fn": "relu",
12
+ "dropout_rate": 0.1,
13
+ "eos_token_id": 1,
14
+ "feed_forward_proj": "relu",
15
+ "initializer_factor": 1.0,
16
+ "is_encoder_decoder": true,
17
+ "is_gated_act": false,
18
+ "layer_norm_epsilon": 1e-06,
19
+ "model_type": "t5",
20
+ "n_positions": 512,
21
+ "num_decoder_layers": 6,
22
+ "num_heads": 8,
23
+ "num_layers": 6,
24
+ "output_past": true,
25
+ "pad_token_id": 0,
26
+ "relative_attention_max_distance": 128,
27
+ "relative_attention_num_buckets": 32,
28
+ "task_specific_params": {
29
+ "summarization": {
30
+ "early_stopping": true,
31
+ "length_penalty": 2.0,
32
+ "max_length": 200,
33
+ "min_length": 30,
34
+ "no_repeat_ngram_size": 3,
35
+ "num_beams": 4,
36
+ "prefix": "summarize: "
37
+ },
38
+ "translation_en_to_de": {
39
+ "early_stopping": true,
40
+ "max_length": 300,
41
+ "num_beams": 4,
42
+ "prefix": "translate English to German: "
43
+ },
44
+ "translation_en_to_fr": {
45
+ "early_stopping": true,
46
+ "max_length": 300,
47
+ "num_beams": 4,
48
+ "prefix": "translate English to French: "
49
+ },
50
+ "translation_en_to_ro": {
51
+ "early_stopping": true,
52
+ "max_length": 300,
53
+ "num_beams": 4,
54
+ "prefix": "translate English to Romanian: "
55
+ }
56
+ },
57
+ "torch_dtype": "float32",
58
+ "transformers_version": "4.47.0",
59
+ "use_cache": true,
60
+ "vocab_size": 32128
61
+ }
generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "decoder_start_token_id": 0,
4
+ "eos_token_id": 1,
5
+ "pad_token_id": 0,
6
+ "transformers_version": "4.47.0"
7
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66daf671beb39f964e5bb0ba930d59b51872283946a3856d8a4296bb10aa9a76
3
+ size 242041896
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d101e7bc9de86eb3e1a9062aca5246abfc8237c235fcabbe3468adf76c248a2
3
+ size 5368