BookWorld: From Novels to Interactive Agent Societies for Creative Story Generation
Paper
ā¢
2504.14538
ā¢
Published
ā¢
26
redaelkate
Pussinsilicon
Ā·
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
7 days ago
BookWorld: From Novels to Interactive Agent Societies for Creative Story
Generation
Organizations
None yet
Pussinsilicon's activity
upvoted
a
paper
7 days ago
upvoted
a
paper
27 days ago
upvoted
a
paper
29 days ago
upvoted
2
papers
about 1 month ago
upvoted
an
article
about 2 months ago
Article
FastRTC: The Real-Time Communication Library for Python
ā¢
159
upvoted
an
article
2 months ago
Article
Open-source DeepResearch ā Freeing our search agents
ā¢
1.23k
liked
a
Space
2 months ago
reacted to
sanaka87's
post with š„
3 months ago
Post
1762
š Excited to Share Our Latest Work: 3DIS & 3DIS-FLUX for Multi-Instance Layout-to-Image Generation! ā¤ļøā¤ļøā¤ļø
šØ Daily Paper: 3DIS-FLUX: simple and efficient multi-instance generation with DiT rendering (2501.05131)
š Code is now open source!
š Project Website: https://limuloo.github.io/3DIS/
š GitHub Repository: https://github.com/limuloo/3DIS
š 3DIS Paper: https://arxiv.org/abs/2410.12669
š 3DIS-FLUX Tech Report: https://arxiv.org/abs/2501.05131
š„ Why 3DIS & 3DIS-FLUX?
Current SOTA multi-instance generation methods are typically adapter-based, requiring additional control modules trained on pre-trained models for layout and instance attribute control. However, with the emergence of more powerful models like FLUX and SD3.5, these methods demand constant retraining and extensive resources.
āØ Our Solution: 3DIS
We introduce a decoupled approach that only requires training a low-resolution Layout-to-Depth model to convert layouts into coarse-grained scene depth maps. Leveraging community and company pre-trained models like ControlNet + SAM2, we enable training-free controllable image generation on high-resolution models such as SDXL and FLUX.
š Benefits of Our Decoupled Multi-Instance Generation:
1. Enhanced Control: By constructing scenes using depth maps in the first stage, the model focuses on coarse-grained scene layout, improving control over instance placement.
2. Flexibility & Preservation: The second stage employs training-free rendering methods, allowing seamless integration with various models (e.g., fine-tuned weights, LoRA) while maintaining the generative capabilities of pre-trained models.
Join us in advancing Layout-to-Image Generation! Follow and star our repository to stay updated! ā
šØ Daily Paper: 3DIS-FLUX: simple and efficient multi-instance generation with DiT rendering (2501.05131)
š Code is now open source!
š Project Website: https://limuloo.github.io/3DIS/
š GitHub Repository: https://github.com/limuloo/3DIS
š 3DIS Paper: https://arxiv.org/abs/2410.12669
š 3DIS-FLUX Tech Report: https://arxiv.org/abs/2501.05131
š„ Why 3DIS & 3DIS-FLUX?
Current SOTA multi-instance generation methods are typically adapter-based, requiring additional control modules trained on pre-trained models for layout and instance attribute control. However, with the emergence of more powerful models like FLUX and SD3.5, these methods demand constant retraining and extensive resources.
āØ Our Solution: 3DIS
We introduce a decoupled approach that only requires training a low-resolution Layout-to-Depth model to convert layouts into coarse-grained scene depth maps. Leveraging community and company pre-trained models like ControlNet + SAM2, we enable training-free controllable image generation on high-resolution models such as SDXL and FLUX.
š Benefits of Our Decoupled Multi-Instance Generation:
1. Enhanced Control: By constructing scenes using depth maps in the first stage, the model focuses on coarse-grained scene layout, improving control over instance placement.
2. Flexibility & Preservation: The second stage employs training-free rendering methods, allowing seamless integration with various models (e.g., fine-tuned weights, LoRA) while maintaining the generative capabilities of pre-trained models.
Join us in advancing Layout-to-Image Generation! Follow and star our repository to stay updated! ā
liked
a
model
4 months ago
updated
a
collection
7 months ago
liked
a
model
7 months ago
updated
a
collection
7 months ago
liked
a
model
7 months ago
updated
a
collection
7 months ago
liked
3
models
7 months ago
liked
a
Space
8 months ago