README: add note for landscapes-epoch31
Browse files
README.md
CHANGED
@@ -25,7 +25,7 @@ language:
|
|
25 |
|
26 |
## Model description
|
27 |
|
28 |
-
Trained on
|
29 |
|
30 |
FLUX.1 [dev] has decent performance with “woodcut illustration” already,
|
31 |
but sometimes it uses mid-tones instead of proper black & white shading.
|
@@ -46,6 +46,13 @@ They also include “1880s, 19th century”; I haven't tested prompting those.
|
|
46 |
|
47 |
## Download model
|
48 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
49 |
Weights for this model are available in Safetensors format.
|
50 |
|
51 |
[Download](/keturn/woodcut-illustrations-Trousset-LoRA/tree/main) them in the Files & versions tab.
|
@@ -71,7 +78,8 @@ Some perhaps relevant settings:
|
|
71 |
I read somewhere that alpha should be set to the same, and raising it from the default 1.0 seems to have helped.</dd>
|
72 |
|
73 |
<dt>--network_args "train_blocks=single" "train_single_block_indices=18-37" "verbose=True"</dt>
|
74 |
-
<dd>In hopes that focusing on the higher half of the blocks would help prioritize small-scale detail over large structure
|
|
|
75 |
|
76 |
<dt>--timestep_sampling shift --discrete_flow_shift 1.0</dt>
|
77 |
<dd>fluxgym's default shift is 3.1. Unverified hunch that we want to bring this back down to focus on lower timesteps for small-scale stuff.</dd>
|
@@ -84,7 +92,7 @@ To accomodate 12 GB VRAM budget, used bfloat16 precision with the u-net at float
|
|
84 |
I can think of lots of things one _could_ do to perhaps improve the result, though I don't have a good sense for which are most effective.
|
85 |
|
86 |
- More dataset curation. The images were _relatively_ consistent, but the botanical illustrations are better than the mammals,
|
87 |
-
the engineering illustrations are different than the cityscapes, etc.
|
88 |
- [`trousset-bugs-and-botany-sources.txt`](./trousset-bugs-and-botany-sources.txt): mostly flowers, close-up detail illustrations with no backgrounds.
|
89 |
- [`trousset-landscape-sources.txt`](./trousset-landscape-sources.txt): cityscapes and landscapes and a few other scenes with a similar mostly-full-frame style.
|
90 |
- Dataset augmentation. (I haven't yet turned to any of the tricks like mirroring the images, but I'm not sure if more is better at this point.)
|
|
|
25 |
|
26 |
## Model description
|
27 |
|
28 |
+
Trained on illustrations from _Nouveau dictionnaire encyclopédique universel illustré,_ A.K.A. the Trousset encyclopedia.
|
29 |
|
30 |
FLUX.1 [dev] has decent performance with “woodcut illustration” already,
|
31 |
but sometimes it uses mid-tones instead of proper black & white shading.
|
|
|
46 |
|
47 |
## Download model
|
48 |
|
49 |
+
- [trousset-landscapes.epoch31](./trousset-landscapes.epoch31.safetensors?download=true):
|
50 |
+
From a more specific subset of 97 images with a consistent aesthetic;
|
51 |
+
cityscapes and landscapes and a few other scenes with a similar mostly-full-frame style.
|
52 |
+
Appears to be effective at encouraging finer lines for shading compared to the base model's rendering of _woodcut illustration._
|
53 |
+
- [woodcut-illustration.epoch8](./woodcut-illustration.epoch8.safetensors?download=true):
|
54 |
+
First published attempt. Sourced from 336 images, trained for 8 epochs (2688 steps). Some effect but not great.
|
55 |
+
|
56 |
Weights for this model are available in Safetensors format.
|
57 |
|
58 |
[Download](/keturn/woodcut-illustrations-Trousset-LoRA/tree/main) them in the Files & versions tab.
|
|
|
78 |
I read somewhere that alpha should be set to the same, and raising it from the default 1.0 seems to have helped.</dd>
|
79 |
|
80 |
<dt>--network_args "train_blocks=single" "train_single_block_indices=18-37" "verbose=True"</dt>
|
81 |
+
<dd>In hopes that focusing on the higher half of the blocks would help prioritize small-scale detail over large structure.
|
82 |
+
(adjusted to `9-37` in the `trousset-landscapes.epoch31` training.)</dd>
|
83 |
|
84 |
<dt>--timestep_sampling shift --discrete_flow_shift 1.0</dt>
|
85 |
<dd>fluxgym's default shift is 3.1. Unverified hunch that we want to bring this back down to focus on lower timesteps for small-scale stuff.</dd>
|
|
|
92 |
I can think of lots of things one _could_ do to perhaps improve the result, though I don't have a good sense for which are most effective.
|
93 |
|
94 |
- More dataset curation. The images were _relatively_ consistent, but the botanical illustrations are better than the mammals,
|
95 |
+
the engineering illustrations are different than the cityscapes, etc. I did some of this in the form of:
|
96 |
- [`trousset-bugs-and-botany-sources.txt`](./trousset-bugs-and-botany-sources.txt): mostly flowers, close-up detail illustrations with no backgrounds.
|
97 |
- [`trousset-landscape-sources.txt`](./trousset-landscape-sources.txt): cityscapes and landscapes and a few other scenes with a similar mostly-full-frame style.
|
98 |
- Dataset augmentation. (I haven't yet turned to any of the tricks like mirroring the images, but I'm not sure if more is better at this point.)
|