keturn commited on
Commit
0081e7f
·
verified ·
1 Parent(s): 98fc94c

README: add note for landscapes-epoch31

Browse files
Files changed (1) hide show
  1. README.md +11 -3
README.md CHANGED
@@ -25,7 +25,7 @@ language:
25
 
26
  ## Model description
27
 
28
- Trained on 336 illustrations from _Nouveau dictionnaire encyclopédique universel illustré,_ A.K.A. the Trousset encyclopedia.
29
 
30
  FLUX.1 [dev] has decent performance with “woodcut illustration” already,
31
  but sometimes it uses mid-tones instead of proper black & white shading.
@@ -46,6 +46,13 @@ They also include “1880s, 19th century”; I haven't tested prompting those.
46
 
47
  ## Download model
48
 
 
 
 
 
 
 
 
49
  Weights for this model are available in Safetensors format.
50
 
51
  [Download](/keturn/woodcut-illustrations-Trousset-LoRA/tree/main) them in the Files & versions tab.
@@ -71,7 +78,8 @@ Some perhaps relevant settings:
71
  I read somewhere that alpha should be set to the same, and raising it from the default 1.0 seems to have helped.</dd>
72
 
73
  <dt>--network_args "train_blocks=single" "train_single_block_indices=18-37" "verbose=True"</dt>
74
- <dd>In hopes that focusing on the higher half of the blocks would help prioritize small-scale detail over large structure.</dd>
 
75
 
76
  <dt>--timestep_sampling shift --discrete_flow_shift 1.0</dt>
77
  <dd>fluxgym's default shift is 3.1. Unverified hunch that we want to bring this back down to focus on lower timesteps for small-scale stuff.</dd>
@@ -84,7 +92,7 @@ To accomodate 12 GB VRAM budget, used bfloat16 precision with the u-net at float
84
  I can think of lots of things one _could_ do to perhaps improve the result, though I don't have a good sense for which are most effective.
85
 
86
  - More dataset curation. The images were _relatively_ consistent, but the botanical illustrations are better than the mammals,
87
- the engineering illustrations are different than the cityscapes, etc.
88
  - [`trousset-bugs-and-botany-sources.txt`](./trousset-bugs-and-botany-sources.txt): mostly flowers, close-up detail illustrations with no backgrounds.
89
  - [`trousset-landscape-sources.txt`](./trousset-landscape-sources.txt): cityscapes and landscapes and a few other scenes with a similar mostly-full-frame style.
90
  - Dataset augmentation. (I haven't yet turned to any of the tricks like mirroring the images, but I'm not sure if more is better at this point.)
 
25
 
26
  ## Model description
27
 
28
+ Trained on illustrations from _Nouveau dictionnaire encyclopédique universel illustré,_ A.K.A. the Trousset encyclopedia.
29
 
30
  FLUX.1 [dev] has decent performance with “woodcut illustration” already,
31
  but sometimes it uses mid-tones instead of proper black & white shading.
 
46
 
47
  ## Download model
48
 
49
+ - [trousset-landscapes.epoch31](./trousset-landscapes.epoch31.safetensors?download=true):
50
+ From a more specific subset of 97 images with a consistent aesthetic;
51
+ cityscapes and landscapes and a few other scenes with a similar mostly-full-frame style.
52
+ Appears to be effective at encouraging finer lines for shading compared to the base model's rendering of _woodcut illustration._
53
+ - [woodcut-illustration.epoch8](./woodcut-illustration.epoch8.safetensors?download=true):
54
+ First published attempt. Sourced from 336 images, trained for 8 epochs (2688 steps). Some effect but not great.
55
+
56
  Weights for this model are available in Safetensors format.
57
 
58
  [Download](/keturn/woodcut-illustrations-Trousset-LoRA/tree/main) them in the Files & versions tab.
 
78
  I read somewhere that alpha should be set to the same, and raising it from the default 1.0 seems to have helped.</dd>
79
 
80
  <dt>--network_args "train_blocks=single" "train_single_block_indices=18-37" "verbose=True"</dt>
81
+ <dd>In hopes that focusing on the higher half of the blocks would help prioritize small-scale detail over large structure.
82
+ (adjusted to `9-37` in the `trousset-landscapes.epoch31` training.)</dd>
83
 
84
  <dt>--timestep_sampling shift --discrete_flow_shift 1.0</dt>
85
  <dd>fluxgym's default shift is 3.1. Unverified hunch that we want to bring this back down to focus on lower timesteps for small-scale stuff.</dd>
 
92
  I can think of lots of things one _could_ do to perhaps improve the result, though I don't have a good sense for which are most effective.
93
 
94
  - More dataset curation. The images were _relatively_ consistent, but the botanical illustrations are better than the mammals,
95
+ the engineering illustrations are different than the cityscapes, etc. I did some of this in the form of:
96
  - [`trousset-bugs-and-botany-sources.txt`](./trousset-bugs-and-botany-sources.txt): mostly flowers, close-up detail illustrations with no backgrounds.
97
  - [`trousset-landscape-sources.txt`](./trousset-landscape-sources.txt): cityscapes and landscapes and a few other scenes with a similar mostly-full-frame style.
98
  - Dataset augmentation. (I haven't yet turned to any of the tricks like mirroring the images, but I'm not sure if more is better at this point.)