AnirudhRajagopalan1201
/

tinystories-custom-20M

Model card Files Files and versions Community

AnirudhRajagopalan1201 commited on Dec 10, 2024

Commit

de881b7

·

verified ·

1 Parent(s): b8c5961

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ Hyperparams used to train this model:
         "eval_steps": 50,
         "vocab_size": 50257,
         "warmup_tokens": 10000,
-        "gradient_accumulation_steps": 8
 ```
 ---
 EXAMPLE USAGE

         "eval_steps": 50,
         "vocab_size": 50257,
         "warmup_tokens": 10000,
+        "gradient_accumulation_steps": 16
 ```
 ---
 EXAMPLE USAGE