Muthukumaran commited on
Commit
7b3526c
·
verified ·
1 Parent(s): 3019e36

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -6
README.md CHANGED
@@ -39,14 +39,12 @@ We trained the smaller model, INDUS_SMALL, with 38M parameters through knowledge
39
  - **Strategy**: Masked Language Modeling (MLM)
40
 
41
  ## Evaluation
42
- - BLURB Benchmark
43
- - Pruned SQuAD2.0 (SQ2) Benchmark (Amazon Rainforest, Oxygen, Geology and NASA ES QAs)
44
- - NASA SMD Expert QA Benchmark (WIP)
45
 
 
 
 
 
46
 
47
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/61099e5d86580d4580767226/EtCC3U_tMCv3bfLqQdqQm.png)
48
-
49
- ![Pruned SQ2 Benchmark](https://cdn-uploads.huggingface.co/production/uploads/61099e5d86580d4580767226/ruh6-IyiNlUiK21Ej4lDM.png)
50
 
51
  ## Uses
52
  - Named Entity Recognition (NER)
@@ -56,6 +54,12 @@ We trained the smaller model, INDUS_SMALL, with 38M parameters through knowledge
56
 
57
  For NASA SMD related, scientific usecases.
58
 
 
 
 
 
 
 
59
  ## Citation
60
  If you find this work useful, please cite using the following bibtex citation:
61
 
 
39
  - **Strategy**: Masked Language Modeling (MLM)
40
 
41
  ## Evaluation
 
 
 
42
 
43
+ Please refer to the following dataset cards for benchmark evaluation
44
+ - NASA IR Benchmark - https://huggingface.co/datasets/nasa-impact/nasa-smd-IR-benchmark
45
+ - NASA SMD Expert QA Benchmark - https://huggingface.co/datasets/nasa-impact/nasa-smd-qa-benchmark
46
+ - Climate CHange Benchmark - https://huggingface.co/datasets/ibm/Climate-Change-NER
47
 
 
 
 
48
 
49
  ## Uses
50
  - Named Entity Recognition (NER)
 
54
 
55
  For NASA SMD related, scientific usecases.
56
 
57
+ ## Note
58
+
59
+ This Model is released in support of the training and evaluation of the encoder language model ["Indus"](https://huggingface.co/nasa-impact/nasa-smd-ibm-v0.1).
60
+
61
+ Accompanying paper can be found here: https://arxiv.org/abs/2405.10725
62
+
63
  ## Citation
64
  If you find this work useful, please cite using the following bibtex citation:
65