Hugging Face's logo

leftyfeep
/
ape-fiction

Safetensors
mistral
unsloth
trl
sft
Model card Files Community
ape-fiction / README.md
leftyfeep's picture
leftyfeep
Trained with Unsloth
0f0ee9c verified
preview code
|
raw
history blame contribute delete
719 Bytes
metadata
license: apache-2.0
tags:
  - unsloth
  - trl
  - sft

About

ape fiction: The ape stands for Algorithmic Pattern Emulation. I am finetuning this to be used in generating fiction.

Finetuned from Mistral Nemo Base using the fullfictions-85kmax dataset.

This uses about the biggest context size entries in the dataset that I've been able to train without OOM errors.

I used unsloth to do the finetuning on a rented GPU (H100) for 2 epochs. Thanks to everybody who made this possible: the unsloth brothers, folks behind KoboldCPP, team behind Mistral Nemo, organizers and volunteers from Gutenberg.org... there's probably more. Thanks everybody.