ht-finbert-cls-v5_ftis_noPretrain

This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 81.1363
• Accuracy: 0.9042
• Macro F1: 0.7667

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 8
• eval_batch_size: 4
• seed: 42
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 6725
• training_steps: 134500

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	Macro F1
45.0676	1.0002	100	31.1821	0.1285	0.0406
19.4006	2.0005	200	68.1208	0.2019	0.0529
8.2771	4.0002	300	136.9383	0.4411	0.1231
6.762	5.0004	400	173.8833	0.5386	0.1539
6.248	7.0002	500	196.1728	0.5787	0.1747
5.4753	8.0004	600	174.4677	0.5994	0.1929
5.0104	10.0001	700	179.9477	0.6251	0.2109
4.3823	11.0004	800	165.2404	0.6412	0.2228
3.8137	13.0001	900	126.2967	0.6494	0.2399
3.037	14.0004	1000	92.4416	0.6709	0.2487
2.6226	16.0001	1100	66.3495	0.6960	0.2739
2.2975	17.0003	1200	43.5563	0.6968	0.2943
1.886	19.0001	1300	32.4852	0.7135	0.3308
1.7708	20.0003	1400	25.2063	0.7362	0.3485
1.5428	22.0000	1500	14.5124	0.7586	0.3908
1.3687	23.0003	1600	12.6483	0.7656	0.3988
1.2077	24.0005	1700	9.9227	0.7728	0.4407
1.0739	26.0002	1800	6.5034	0.7769	0.4490
1.0011	27.0005	1900	4.9661	0.7945	0.4831
0.9156	29.0002	2000	4.2065	0.7991	0.4963
0.8269	30.0004	2100	4.6309	0.7983	0.4969
0.7589	32.0002	2200	4.1331	0.8012	0.5166
0.7167	33.0004	2300	3.5127	0.7973	0.5446
0.7028	35.0001	2400	3.5852	0.8079	0.5536
0.585	36.0004	2500	3.2344	0.8126	0.5567
0.5776	38.0001	2600	3.5203	0.8167	0.5712
0.4885	39.0004	2700	3.5398	0.8195	0.5749
0.4628	41.0001	2800	2.6125	0.8228	0.5911
0.4469	42.0003	2900	3.1494	0.8270	0.5864
0.4206	44.0001	3000	3.1127	0.8363	0.5987
0.3589	45.0003	3100	3.2779	0.8355	0.6062
0.3559	47.0000	3200	4.2942	0.8408	0.6111
0.3242	48.0003	3300	4.0195	0.8426	0.6144
0.283	49.0005	3400	3.8392	0.8380	0.6227
0.2741	51.0002	3500	4.2446	0.8444	0.6320
0.2605	52.0005	3600	4.8914	0.8453	0.6366
0.2494	54.0002	3700	4.8815	0.8493	0.6371
0.2232	55.0004	3800	4.7650	0.8416	0.6303
0.2166	57.0002	3900	6.3975	0.8517	0.6382
0.2011	58.0004	4000	7.1631	0.8559	0.6499
0.1959	60.0001	4100	7.4066	0.8528	0.6502
0.1646	61.0004	4200	8.2311	0.8585	0.6517
0.1564	63.0001	4300	7.1946	0.8561	0.6599
0.1534	64.0004	4400	9.1525	0.8581	0.6502
0.1352	66.0001	4500	10.3164	0.8542	0.6484
0.1329	67.0003	4600	9.9375	0.8616	0.6693
0.1305	69.0001	4700	10.1664	0.8615	0.6597
0.1174	70.0003	4800	11.4316	0.8658	0.6699
0.1112	72.0000	4900	12.6254	0.8584	0.6618
0.1092	73.0003	5000	12.6325	0.8598	0.6639
0.0995	74.0005	5100	13.3681	0.8646	0.6745
0.0961	76.0002	5200	15.6989	0.8655	0.6756
0.0924	77.0005	5300	13.0087	0.8686	0.6830
0.0862	79.0002	5400	15.9182	0.8578	0.6560
0.0817	80.0004	5500	14.4908	0.8691	0.6783
0.0842	82.0002	5600	14.6304	0.8724	0.6830
0.0741	83.0004	5700	14.6875	0.8729	0.6846
0.0744	85.0001	5800	14.5500	0.8703	0.6881
0.0761	86.0004	5900	17.4833	0.8714	0.6910
0.0666	88.0001	6000	19.3463	0.8714	0.6929
0.0699	89.0004	6100	19.4385	0.8697	0.6820
0.0584	91.0001	6200	14.6828	0.8751	0.6990
0.0571	92.0003	6300	19.9995	0.8730	0.7022
0.0465	94.0001	6400	17.5651	0.8728	0.6946
0.0575	95.0003	6500	17.5305	0.8746	0.6949
0.0578	97.0000	6600	16.4489	0.8712	0.6927
0.0518	98.0003	6700	14.3277	0.8714	0.6986
0.0545	99.0005	6800	15.3278	0.8781	0.7030
0.0435	101.0002	6900	14.6482	0.8793	0.7060
0.0476	102.0005	7000	14.2258	0.8766	0.7067
0.0441	104.0002	7100	15.6941	0.8762	0.7055
0.0438	105.0004	7200	15.5653	0.8813	0.7052
0.0369	107.0002	7300	18.7607	0.8823	0.7102
0.0331	108.0004	7400	14.4900	0.8803	0.7061
0.0318	110.0001	7500	15.7354	0.8828	0.7156
0.044	111.0004	7600	11.1731	0.8755	0.7076
0.0597	113.0001	7700	10.0075	0.8695	0.6968
0.0491	114.0004	7800	9.4998	0.8786	0.7092
0.0351	116.0001	7900	12.6520	0.8831	0.7201
0.0341	117.0003	8000	12.2682	0.8848	0.7161
0.0249	119.0001	8100	17.8114	0.8880	0.7252
0.0268	120.0003	8200	15.4698	0.8869	0.7203
0.0232	122.0000	8300	13.2290	0.8848	0.7243
0.0329	123.0003	8400	11.1420	0.8820	0.7139
0.0334	124.0005	8500	10.7191	0.8831	0.7170
0.0259	126.0002	8600	11.7934	0.8840	0.7176
0.0259	127.0005	8700	10.6811	0.8817	0.7187
0.021	129.0002	8800	10.5715	0.8852	0.7208
0.0263	130.0004	8900	11.4068	0.8836	0.7243
0.036	132.0002	9000	9.0095	0.8797	0.7145
0.0361	133.0004	9100	8.9163	0.8773	0.7046
0.0216	135.0001	9200	11.9302	0.8883	0.7236
0.0237	136.0004	9300	11.7925	0.8855	0.7231
0.0211	138.0001	9400	10.9545	0.8856	0.7193
0.0153	139.0004	9500	13.9894	0.8894	0.7286
0.0115	141.0001	9600	14.7466	0.8903	0.7290
0.0122	142.0003	9700	12.1514	0.8904	0.7301
0.0101	144.0001	9800	10.6813	0.8901	0.7271
0.0112	145.0003	9900	11.4336	0.8905	0.7299
0.0122	147.0000	10000	12.2161	0.8862	0.7135
0.0127	148.0003	10100	9.7058	0.8843	0.7183
0.0545	149.0005	10200	6.6516	0.8737	0.6888
0.0674	151.0002	10300	3.3112	0.8793	0.7046
0.0534	152.0005	10400	3.5717	0.8753	0.7071
0.0298	154.0002	10500	7.0293	0.8833	0.7214
0.0256	155.0004	10600	7.5055	0.8836	0.7207
0.0197	157.0002	10700	13.0153	0.8876	0.7299
0.0159	158.0004	10800	17.7438	0.8917	0.7356
0.012	160.0001	10900	17.8027	0.8932	0.7364
0.0134	161.0004	11000	12.3195	0.8934	0.7351
0.0121	163.0001	11100	14.9650	0.8936	0.7339
0.0126	164.0004	11200	8.8533	0.8924	0.7366
0.01	166.0001	11300	8.4018	0.8937	0.7341
0.0158	167.0003	11400	9.3958	0.8923	0.7320
0.0102	169.0001	11500	13.7997	0.8920	0.7344
0.0081	170.0003	11600	11.3117	0.8936	0.7370
0.009	172.0000	11700	11.9036	0.8933	0.7308
0.008	173.0003	11800	15.0448	0.8923	0.7339
0.0076	174.0005	11900	14.3777	0.8946	0.7384
0.0071	176.0002	12000	15.5394	0.8933	0.7304
0.0175	177.0005	12100	7.1299	0.8817	0.7064
0.0349	179.0002	12200	4.0062	0.8765	0.7060
0.0458	180.0004	12300	3.8608	0.8831	0.7230
0.0311	182.0002	12400	4.3278	0.8899	0.7359
0.016	183.0004	12500	10.5550	0.8893	0.7375
0.0169	185.0001	12600	11.4108	0.8862	0.7262
0.0204	186.0004	12700	6.5110	0.8893	0.7360
0.0144	188.0001	12800	5.6207	0.8878	0.7364
0.0236	189.0004	12900	9.0571	0.8879	0.7396
0.0281	191.0001	13000	7.3068	0.8754	0.7239
0.0141	192.0003	13100	9.6482	0.8872	0.7284
0.0138	194.0001	13200	6.9724	0.8886	0.7398
0.0787	195.0003	13300	4.5048	0.8831	0.7316
0.0109	197.0000	13400	9.6796	0.8928	0.7392
0.0052	198.0003	13500	8.9247	0.8951	0.7425
0.0048	199.0005	13600	15.2835	0.8956	0.7431
0.0041	201.0002	13700	16.9510	0.8961	0.7432
0.0043	202.0005	13800	16.5854	0.8958	0.7445
0.0034	204.0002	13900	18.8011	0.8951	0.7429
0.0031	205.0004	14000	20.6246	0.8957	0.7444
0.0038	207.0002	14100	17.3915	0.8958	0.7428
0.0027	208.0004	14200	16.5060	0.8950	0.7435
0.0028	210.0001	14300	20.6538	0.8948	0.7440
0.0042	211.0004	14400	15.1694	0.8945	0.7441
0.0048	213.0001	14500	15.7892	0.8936	0.7421
0.0053	214.0004	14600	12.2524	0.8919	0.7408
0.0071	216.0001	14700	13.9876	0.8943	0.7406
0.0184	217.0003	14800	7.4169	0.8866	0.7354
0.0918	219.0001	14900	8.8100	0.8753	0.7143
0.0306	220.0003	15000	3.3898	0.8879	0.7307
0.0137	222.0000	15100	4.9263	0.8917	0.7329
0.0064	223.0003	15200	14.2685	0.8970	0.7473
0.0094	224.0005	15300	8.1640	0.8930	0.7469
0.0053	226.0002	15400	11.3225	0.8976	0.7473
0.0033	227.0005	15500	19.1844	0.8976	0.7508
0.0032	229.0002	15600	20.4924	0.8975	0.7502
0.0121	230.0004	15700	11.6179	0.8882	0.7434
0.0118	232.0002	15800	21.6421	0.8824	0.7419
0.0284	233.0004	15900	4.5728	0.8889	0.7386
0.0195	235.0001	16000	4.8290	0.8826	0.7251
0.0113	236.0004	16100	14.2772	0.8916	0.7398
0.0054	238.0001	16200	20.3585	0.8961	0.7481
0.0028	239.0004	16300	20.2379	0.8975	0.7499
0.0043	241.0001	16400	19.4160	0.8967	0.7495
0.003	242.0003	16500	20.7979	0.8971	0.7527
0.0035	244.0001	16600	29.2321	0.8956	0.7475
0.0024	245.0003	16700	47.2586	0.8962	0.7503
0.0023	247.0000	16800	29.1709	0.8969	0.7502
0.0025	248.0003	16900	37.5283	0.8966	0.7478
0.0044	249.0005	17000	41.7058	0.8961	0.7496
0.0026	251.0002	17100	31.6237	0.8963	0.7474
0.0023	252.0005	17200	41.6650	0.8965	0.7486
0.0027	254.0002	17300	43.0484	0.8966	0.7498
0.0049	255.0004	17400	37.0223	0.8956	0.7481
0.0303	257.0002	17500	24.6823	0.8921	0.7385
0.0387	258.0004	17600	17.9779	0.8905	0.7310
0.0112	260.0001	17700	18.8216	0.8947	0.7463
0.0058	261.0004	17800	23.2339	0.8945	0.7462
0.0043	263.0001	17900	34.1779	0.8980	0.7527
0.0177	264.0004	18000	24.5262	0.8966	0.7449
0.0235	266.0001	18100	25.9108	0.8941	0.7427
0.0093	267.0003	18200	14.0127	0.8964	0.7514
0.0104	269.0001	18300	29.3661	0.8962	0.7498
0.0051	270.0003	18400	26.7586	0.8992	0.7530
0.0023	272.0000	18500	41.9991	0.8992	0.7560
0.0043	273.0003	18600	42.3595	0.8991	0.7522
0.0038	274.0005	18700	42.9884	0.8989	0.7509
0.0017	276.0002	18800	37.0404	0.8994	0.7532
0.0016	277.0005	18900	42.3473	0.8990	0.7519
0.0013	279.0002	19000	57.6952	0.8998	0.7543
0.0013	280.0004	19100	60.3771	0.8990	0.7541
0.0012	282.0002	19200	53.2421	0.8997	0.7529
0.0014	283.0004	19300	64.6741	0.8993	0.7524
0.0012	285.0001	19400	48.5421	0.8991	0.7533
0.0027	286.0004	19500	34.8083	0.8984	0.7544
0.0156	288.0001	19600	35.5514	0.8866	0.7324
0.0226	289.0004	19700	24.4246	0.8909	0.7414
0.0191	291.0001	19800	19.4421	0.8933	0.7449
0.0393	292.0003	19900	7.0450	0.8883	0.7401
0.0083	294.0001	20000	12.4825	0.8922	0.7470
0.0074	295.0003	20100	11.9688	0.8871	0.7420
0.0046	297.0000	20200	19.6892	0.8995	0.7578
0.0022	298.0003	20300	30.8790	0.8989	0.7575
0.0019	299.0005	20400	33.0787	0.8992	0.7577
0.0013	301.0002	20500	34.6523	0.8993	0.7582
0.0016	302.0005	20600	39.9316	0.8994	0.7586
0.0013	304.0002	20700	51.9175	0.8998	0.7580
0.0011	305.0004	20800	43.7849	0.9000	0.7599
0.001	307.0002	20900	48.0775	0.9002	0.7580
0.0009	308.0004	21000	65.2401	0.8990	0.7558
0.0012	310.0001	21100	49.7671	0.8992	0.7567
0.001	311.0004	21200	70.8881	0.8986	0.7564
0.0011	313.0001	21300	67.3829	0.8983	0.7535
0.003	314.0004	21400	68.4742	0.8947	0.7462
0.0178	316.0001	21500	24.7675	0.8905	0.7439
0.0171	317.0003	21600	9.9862	0.8950	0.7481
0.0262	319.0001	21700	13.0878	0.8959	0.7486
0.0062	320.0003	21800	16.1960	0.8988	0.7572
0.0038	322.0000	21900	27.5440	0.9014	0.7581
0.0017	323.0003	22000	31.9094	0.9022	0.7595
0.0018	324.0005	22100	48.4740	0.9018	0.7601
0.0017	326.0002	22200	51.1269	0.9019	0.7593
0.0012	327.0005	22300	35.8104	0.9025	0.7598
0.0012	329.0002	22400	46.4160	0.9009	0.7579
0.0011	330.0004	22500	36.0973	0.9021	0.7573
0.001	332.0002	22600	44.6799	0.9031	0.7584
0.001	333.0004	22700	55.4978	0.9012	0.7580
0.0009	335.0001	22800	61.3688	0.9016	0.7581
0.0009	336.0004	22900	71.0979	0.9004	0.7588
0.0009	338.0001	23000	62.9048	0.9012	0.7578
0.0014	339.0004	23100	50.8666	0.9014	0.7579
0.0012	341.0001	23200	65.1823	0.9003	0.7585
0.0034	342.0003	23300	30.2251	0.8937	0.7550
0.0174	344.0001	23400	13.0308	0.8939	0.7481
0.0182	345.0003	23500	5.2059	0.8907	0.7454
0.013	347.0000	23600	11.5163	0.8986	0.7514
0.0292	348.0003	23700	13.9127	0.8976	0.7566
0.0137	349.0005	23800	10.6804	0.8984	0.7545
0.0069	351.0002	23900	11.2971	0.8998	0.7575
0.0033	352.0005	24000	21.1634	0.8986	0.7567
0.0018	354.0002	24100	19.6101	0.9016	0.7620
0.0011	355.0004	24200	20.5261	0.9015	0.7632
0.0009	357.0002	24300	29.3978	0.9007	0.7612
0.0009	358.0004	24400	51.2728	0.9010	0.7625
0.0008	360.0001	24500	50.0836	0.9019	0.7640
0.0007	361.0004	24600	60.3942	0.9018	0.7631
0.0008	363.0001	24700	40.0778	0.9011	0.7613
0.0007	364.0004	24800	53.6138	0.9017	0.7635
0.0007	366.0001	24900	62.7782	0.9013	0.7621
0.001	367.0003	25000	55.9975	0.9013	0.7616
0.0019	369.0001	25100	42.9915	0.8990	0.7603
0.0065	370.0003	25200	21.8315	0.8970	0.7562
0.006	372.0000	25300	11.9061	0.8994	0.7603
0.0048	373.0003	25400	45.9796	0.8994	0.7561
0.0323	374.0005	25500	44.4078	0.8734	0.7361
0.0134	376.0002	25600	14.2978	0.8891	0.7461
0.0225	377.0005	25700	14.0887	0.8913	0.7470
0.0231	379.0002	25800	11.5317	0.8969	0.7505
0.0035	380.0004	25900	24.4447	0.9001	0.7559
0.0017	382.0002	26000	40.8653	0.9028	0.7602
0.0013	383.0004	26100	49.7169	0.9020	0.7628
0.001	385.0001	26200	51.5715	0.9029	0.7628
0.001	386.0004	26300	57.2407	0.9030	0.7627
0.0008	388.0001	26400	70.8088	0.9025	0.7635
0.0008	389.0004	26500	72.1200	0.9025	0.7644
0.0007	391.0001	26600	75.3892	0.9025	0.7615
0.0006	392.0003	26700	79.6278	0.9027	0.7621
0.0008	394.0001	26800	92.8254	0.9020	0.7630
0.0008	395.0003	26900	94.8828	0.9023	0.7630
0.0009	397.0000	27000	102.5585	0.9021	0.7619
0.0007	398.0003	27100	85.7570	0.9020	0.7643
0.0006	399.0005	27200	89.4980	0.9025	0.7625
0.0013	401.0002	27300	75.6506	0.9000	0.7586
0.0008	402.0005	27400	80.6390	0.9016	0.7614
0.0007	404.0002	27500	94.0275	0.9015	0.7646
0.0007	405.0004	27600	95.5629	0.9009	0.7610
0.0019	407.0002	27700	101.7122	0.9004	0.7558
0.0138	408.0004	27800	78.1587	0.8963	0.7433
0.0173	410.0001	27900	79.9526	0.8940	0.7440
0.0172	411.0004	28000	99.2792	0.8948	0.7511
0.0029	413.0001	28100	59.4914	0.8994	0.7579
0.0046	414.0004	28200	57.0540	0.9008	0.7600
0.0023	416.0001	28300	64.6390	0.8998	0.7602
0.0145	417.0003	28400	82.8896	0.8920	0.7568
0.0087	419.0001	28500	30.3067	0.8958	0.7557
0.0029	420.0003	28600	35.0321	0.9007	0.7567
0.0015	422.0000	28700	71.1409	0.9018	0.7604
0.001	423.0003	28800	76.6434	0.9035	0.7636
0.0013	424.0005	28900	80.0947	0.9042	0.7667
0.0007	426.0002	29000	100.5315	0.9032	0.7635
0.0007	427.0005	29100	112.5028	0.9041	0.7643
0.0005	429.0002	29200	133.8390	0.9031	0.7637
0.0007	430.0004	29300	107.5043	0.9032	0.7624
0.0006	432.0002	29400	115.0514	0.9030	0.7629
0.0005	433.0004	29500	114.5789	0.9022	0.7623
0.0005	435.0001	29600	104.5168	0.9024	0.7623
0.0006	436.0004	29700	80.4484	0.9043	0.7647
0.0005	438.0001	29800	100.4194	0.9026	0.7631
0.0005	439.0004	29900	95.6818	0.9026	0.7635
0.0005	441.0001	30000	102.6654	0.9032	0.7610
0.0014	442.0003	30100	91.4808	0.9034	0.7637
0.0013	444.0001	30200	123.4039	0.9022	0.7608
0.0007	445.0003	30300	126.6161	0.9024	0.7618
0.0091	447.0000	30400	47.7548	0.8973	0.7519
0.0237	448.0003	30500	30.0946	0.8936	0.7466
0.014	449.0005	30600	25.0813	0.8961	0.7521
0.01	451.0002	30700	27.5127	0.8990	0.7542
0.0042	452.0005	30800	28.1089	0.9018	0.7629
0.0014	454.0002	30900	60.5717	0.9007	0.7622

Framework versions

• Transformers 4.46.0
• Pytorch 2.3.1+cu121
• Datasets 2.20.0
• Tokenizers 0.20.1