OpenPipe
/

Hermes-2-Theta-Llama-3-8B-32k

Model card Files Files and versions Community

Hermes-2-Theta-Llama-3-8B-32k

Commit History

fine-tuning the rope_theta value

a1623c4
verified

corbt commited on May 18, 2024

Update config.json

bd09d15
verified

corbt commited on May 17, 2024

manually set max_position_embeddings and rope_theta instead of using dynamic scaling

f288b51
verified

corbt commited on May 17, 2024

bump rope scaling factor to 4

2970ef0
verified

corbt commited on May 17, 2024

Duplicate from NousResearch/Hermes-2-Theta-Llama-3-8B

9116d06
verified

teknium commited on May 17, 2024