Update README.md
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ tags:
|
|
14 |
|
15 |
# Model Overview
|
16 |
|
17 |
-
This model is a fine-tuned version of llama3 using the [QueryBridge dataset](https://huggingface.co/datasets/
|
18 |
|
19 |
The tagged questions in the QueryBridge dataset are designed to train language models to understand the components and structure of a question effectively. By annotating questions with specific tags such as `<qt>`, `<p>`, `<o>`, and `<s>`, we provide a detailed breakdown of each question's elements, which aids the model in grasping the roles of different components.
|
20 |
|
@@ -194,7 +194,7 @@ We fine-tuned the `Meta-Llama-3-8B` model by two key steps: preparing the datase
|
|
194 |
|
195 |
### Prepare the Dataset
|
196 |
|
197 |
-
For this fine-tuning, we utilized the [QueryBridge dataset](https://huggingface.co/datasets/
|
198 |
|
199 |
### Fine-Tune the Model
|
200 |
|
|
|
14 |
|
15 |
# Model Overview
|
16 |
|
17 |
+
This model is a fine-tuned version of llama3 using the [QueryBridge dataset](https://huggingface.co/datasets/aorogat/QueryBridge). We utilized **Low-Rank Adaptation (LoRA)** to train it for tagging question components using the tags in the table below. The demo video shows how the mapped question appears and, after converting it to a graph representation, how we visualized it as shown in the video.
|
18 |
|
19 |
The tagged questions in the QueryBridge dataset are designed to train language models to understand the components and structure of a question effectively. By annotating questions with specific tags such as `<qt>`, `<p>`, `<o>`, and `<s>`, we provide a detailed breakdown of each question's elements, which aids the model in grasping the roles of different components.
|
20 |
|
|
|
194 |
|
195 |
### Prepare the Dataset
|
196 |
|
197 |
+
For this fine-tuning, we utilized the [QueryBridge dataset](https://huggingface.co/datasets/aorogat/QueryBridge), specifically the pairs of questions and their corresponding tagged questions. However, before we can use this dataset, it is necessary to convert the data into instruct prompts suitable for fine-tuning the model. You can find these prompts at [this link](https://huggingface.co/datasets/aorogat/Questions_to_Tagged_Questions_Prompts). Download the prompts and save them in the directory: `/home/YOUR_USERNAME/data`
|
198 |
|
199 |
### Fine-Tune the Model
|
200 |
|