Update README.md
Browse files
README.md
CHANGED
|
@@ -48,7 +48,7 @@ This is an **early preview** of our 7B parameter RNN-based model, trained on 2k
|
|
| 48 |
```bash
|
| 49 |
pip3 install --upgrade rwkv-fla transformers
|
| 50 |
```
|
| 51 |
-
|
| 52 |
```python
|
| 53 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 54 |
|
|
|
|
| 48 |
```bash
|
| 49 |
pip3 install --upgrade rwkv-fla transformers
|
| 50 |
```
|
| 51 |
+
Before training: `export WKV_MODE=chunk`
|
| 52 |
```python
|
| 53 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 54 |
|