English
Related papers

Related papers: DreamRenderer: Taming Multi-Instance Attribute Con…

200 papers

Despite the burst of innovative methods for controlling the diffusion process, effectively controlling image styles in text-to-image generation remains a challenging task. Many adapter-based methods impose image representation conditions on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wen Li , Muyuan Fang , Cheng Zou , Biao Gong , Ruobing Zheng , Meng Wang , Jingdong Chen , Ming Yang

The creation of high-fidelity, customizable 3D indoor scene textures remains a significant challenge. While text-driven methods offer flexibility, they lack the precision for fine-grained, instance-level control, and often produce textures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Weilin Chen , Jiahao Rao , Wenhao Wang , Xinyang Li , Xuan Cheng , Liujuan Cao

ControlNets are widely used for adding spatial control to text-to-image diffusion models with different conditions, such as depth maps, scribbles/sketches, and human poses. However, when it comes to controllable video generation,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Han Lin , Jaemin Cho , Abhay Zala , Mohit Bansal

Recent advances in text-to-image diffusion models have enabled the generation of diverse and high-quality images. While impressive, the images often fall short of depicting subtle details and are susceptible to errors due to ambiguity in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Idan Schwartz , Vésteinn Snæbjarnarson , Hila Chefer , Ryan Cotterell , Serge Belongie , Lior Wolf , Sagie Benaim

Recent years have witnessed significant advancements in text-guided style transfer, primarily attributed to innovations in diffusion models. These models excel in conditional guidance, utilizing text or images to direct the sampling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Nisha Huang , Kaer Huang , Yifan Pu , Jiangshan Wang , Jie Guo , Yiqiang Yan , Xiu Li , Tong-Yee Lee

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Current learning-based subject customization approaches, predominantly relying on U-Net architectures, suffer from limited generalization ability and compromised image quality. Meanwhile, optimization-based methods require subject-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Jiale Tao , Yanbing Zhang , Qixun Wang , Yiji Cheng , Haofan Wang , Xu Bai , Zhengguang Zhou , Ruihuang Li , Linqing Wang , Chunyu Wang , Qin Lin , Qinglin Lu

We present Imagen, a text-to-image diffusion model with an unprecedented degree of photorealism and a deep level of language understanding. Imagen builds on the power of large transformer language models in understanding text and hinges on…

Synthesizing visually impressive images that seamlessly align both text prompts and specific artistic styles remains a significant challenge in Text-to-Image (T2I) diffusion models. This paper introduces StyleBlend, a method designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Zichong Chen , Shijin Wang , Yang Zhou

Learned world models summarize an agent's experience to facilitate learning complex behaviors. While learning world models from high-dimensional sensory inputs is becoming feasible through deep learning, there are many potential ways for…

Machine Learning · Computer Science 2020-03-18 Danijar Hafner , Timothy Lillicrap , Jimmy Ba , Mohammad Norouzi

The increasing demand for controllable outputs in text-to-image generation has spurred advancements in multi-instance generation (MIG), allowing users to define both instance layouts and attributes. However, unlike image-conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Dewei Zhou , Ji Xie , Zongxin Yang , Yi Yang

While large-scale pre-trained text-to-image models can synthesize diverse and high-quality human-centric images, an intractable problem is how to preserve the face identity for conditioned face images. Existing methods either require…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhuowei Chen , Shancheng Fang , Wei Liu , Qian He , Mengqi Huang , Yongdong Zhang , Zhendong Mao

3D asset generation is getting massive amounts of attention, inspired by the recent success of text-guided 2D content creation. Existing text-to-3D methods use pretrained text-to-image diffusion models in an optimization problem or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Lukas Höllein , Aljaž Božič , Norman Müller , David Novotny , Hung-Yu Tseng , Christian Richardt , Michael Zollhöfer , Matthias Nießner

Diffusion models have recently become the dominant paradigm for image generation, yet existing systems struggle to interpret and follow numeric instructions for adjusting semantic attributes. In real-world creative scenarios, especially…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Die Chen , Zhongjie Duan , Zhiwen Li , Cen Chen , Daoyuan Chen , Yaliang Li , Yingda Chen

In-context image generation models such as FLUX.2 take a text prompt and an optional reference image as visual conditioning for the output. Internally, all three inputs -- text, reference image, and the noise tokens -- are concatenated and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chris Ge , Rohit Gandikota , Antonio Torralba , Tamar Rott Shaham

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

In the present paper, we propose a decoder-free extension of Dreamer, a leading model-based reinforcement learning (MBRL) method from pixels. Dreamer is a sample- and cost-efficient solution to robot learning, as it is used to train latent…

Machine Learning · Computer Science 2021-03-15 Masashi Okada , Tadahiro Taniguchi

Given a small number of images of a subject, personalized image generation techniques can fine-tune large pre-trained text-to-image diffusion models to generate images of the subject in novel contexts, conditioned on text prompts. In doing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shwetha Ram , Tal Neiman , Qianli Feng , Andrew Stuart , Son Tran , Trishul Chilimbi

In text-to-image (T2I) generation, achieving fine-grained control over attributes - such as age or smile - remains challenging, even with detailed text prompts. Slider-based methods offer a solution for precise control of image attributes.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Zixin Zhu , Kevin Duarte , Mamshad Nayeem Rizve , Chengyuan Xu , Ratheesh Kalarot , Junsong Yuan

Recently, extensive research on image customization (e.g., identity, subject, style, background, etc.) demonstrates strong customization capabilities in large-scale generative models. However, most approaches are designed for specific…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chong Mou , Yanze Wu , Wenxu Wu , Zinan Guo , Pengze Zhang , Yufeng Cheng , Yiming Luo , Fei Ding , Shiwen Zhang , Xinghui Li , Mengtian Li , Mingcong Liu , Yi Zhang , Shaojin Wu , Songtao Zhao , Jian Zhang , Qian He , Xinglong Wu