wanghaofan commited on
Commit
69ba319
·
verified ·
1 Parent(s): c483083

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -10
README.md CHANGED
@@ -1,34 +1,64 @@
1
  ---
2
  tags:
3
  - text-to-image
 
4
  - lora
5
  - diffusers
6
- - template:diffusion-lora
 
 
7
  widget:
8
- - text: '-'
 
9
  output:
10
- url: images/example1.png
11
- - text: '-'
 
12
  output:
13
- url: images/example1.png
 
 
 
 
14
  base_model: black-forest-labs/FLUX.1-dev
15
- instance_prompt: ghibli style
 
 
16
  license: other
17
  license_name: flux-1-dev-non-commercial-license
18
  license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
 
 
 
19
  ---
20
  # FLUX.1-dev-LoRA-Ghibli
21
 
22
- <Gallery />
23
 
 
24
 
25
  ## Trigger words
26
 
27
  You should use `ghibli style` to trigger the image generation.
28
 
 
 
 
 
 
 
 
 
 
 
 
29
 
30
- ## Download model
 
 
 
 
 
 
31
 
32
- Weights for this model are available in Safetensors format.
33
 
34
- [Download](/InstantX/FLUX.1-dev-LoRA-Ghibli/tree/main) them in the Files & versions tab.
 
1
  ---
2
  tags:
3
  - text-to-image
4
+ - stable-diffusion
5
  - lora
6
  - diffusers
7
+ - image-generation
8
+ - flux
9
+ - safetensors
10
  widget:
11
+ - text: >-
12
+ ghibli style, a boy and a girl looking out of a window with a cat perched on the window sill. There is a bicycle parked in front of them and a plant with flowers to the right side of the image. The wall behind them is visible in the background.
13
  output:
14
+ url: images/example_1.png
15
+ - text: >-
16
+ ghibli style, a girl in a green cloak walking alone through an ancient forest, sunlight piercing through towering trees like stained glass, glowing pollen swirling around her boots, a rusted lantern hanging from her wooden staff, shadows of deer spirits flickering between moss-covered stones, muted emerald and gold color palette
17
  output:
18
+ url: images/example_2.png
19
+ - text: >-
20
+ ghibli style, a shepherd boy floating on a wooly cloud-whale, holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high-altitude winds, aurora-like ribbons in peach and lavender stretching across the sky
21
+ output:
22
+ url: images/example_3.png
23
  base_model: black-forest-labs/FLUX.1-dev
24
+ instance_prompt: >-
25
+ The background is 4 real photos, and in the middle is a cartoon picture
26
+ summarizing the real photos
27
  license: other
28
  license_name: flux-1-dev-non-commercial-license
29
  license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
30
+ language:
31
+ - en
32
+ library_name: diffusers
33
  ---
34
  # FLUX.1-dev-LoRA-Ghibli
35
 
36
+ This is a Ghibli style LoRA trained on FLUX.1-dev.
37
 
38
+ <Gallery />
39
 
40
  ## Trigger words
41
 
42
  You should use `ghibli style` to trigger the image generation.
43
 
44
+ ## Inference
45
+ ```python
46
+ import torch
47
+ from diffusers import FluxPipeline
48
+
49
+ pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
50
+ pipe.load_lora_weights("InstantX/FLUX.1-dev-LoRA-Ghibli", weight_name="ghibli_style.safetensors")
51
+ pipe.fuse_lora(lora_scale=1.0)
52
+ pipe.to("cuda")
53
+
54
+ prompt = "ghibli style, a shepherd boy floating on a wooly cloud-whale, holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high-altitude winds, aurora-like ribbons in peach and lavender stretching across the sky"
55
 
56
+ image = pipe(prompt,
57
+ num_inference_steps=24,
58
+ guidance_scale=3.5,
59
+ width=960, height=1280,
60
+ ).images[0]
61
+ image.save(f"example.png")
62
+ ```
63
 
 
64