ronenh24 commited on
Commit
f019bea
·
verified ·
1 Parent(s): e38c8fa

Update README.md.

Browse files
Files changed (1) hide show
  1. README.md +11 -4
README.md CHANGED
@@ -5,6 +5,11 @@ tags:
5
  model-index:
6
  - name: longformer-base-4096-bible
7
  results: []
 
 
 
 
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -20,18 +25,20 @@ It achieves the following results on the evaluation set:
20
 
21
  ## Model description
22
 
23
- More information needed
24
 
25
  ## Intended uses & limitations
26
 
27
- More information needed
28
 
29
  ## Training and evaluation data
30
 
31
- More information needed
32
 
33
  ## Training procedure
34
 
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
@@ -67,4 +74,4 @@ The following hyperparameters were used during training:
67
  - Transformers 4.50.3
68
  - Pytorch 2.6.0+cu124
69
  - Datasets 2.18.0
70
- - Tokenizers 0.21.1
 
5
  model-index:
6
  - name: longformer-base-4096-bible
7
  results: []
8
+ license: apache-2.0
9
+ language:
10
+ - en
11
+ base_model:
12
+ - allenai/longformer-base-4096
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
25
 
26
  ## Model description
27
 
28
+ Fine-Tuned allenai/longformer-base-4096 model to predict Bible chapter relevance from 1 to 5.
29
 
30
  ## Intended uses & limitations
31
 
32
+ Predict relevance from 1 to 5 for Bible text. Fine-Tune for each query separately.
33
 
34
  ## Training and evaluation data
35
 
36
+ One query. Chapter ID. Chapter Name. Chapter Text. Relevance Label.
37
 
38
  ## Training procedure
39
 
40
+ Train for 12 epochs adjusting learning rate by cosine with 2 restarts and 4 epochs of warmup.
41
+
42
  ### Training hyperparameters
43
 
44
  The following hyperparameters were used during training:
 
74
  - Transformers 4.50.3
75
  - Pytorch 2.6.0+cu124
76
  - Datasets 2.18.0
77
+ - Tokenizers 0.21.1