mergekit-community
/

UltraLong-Thinking

Text Generation

text-generation-inference

Model card Files Files and versions Community

Isotonic commited on 16 days ago

Commit

5f88d8d

·

verified ·

1 Parent(s): 2fee8a4

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -35,6 +35,6 @@ merge_method: slerp
 base_model: nvidia/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct
 dtype: bfloat16
 parameters:
-  t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Hermes for input & output, WizardMath in the middle layers
 ```

 base_model: nvidia/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct
 dtype: bfloat16
 parameters:
+  t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Nemotron-8B for input & output, ReDistill in the middle layers
 ```