English
Related papers

Related papers: EliGen: Entity-Level Controlled Image Generation w…

200 papers

Text-to-image generation models have achieved remarkable capabilities in synthesizing images, but often struggle to provide fine-grained control over the output. Existing guidance approaches, such as segmentation maps and depth maps,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Sangmin Jung , Utkarsh Nath , Yezhou Yang , Giulia Pedrielli , Joydeep Biswas , Amy Zhang , Hassan Ghasemzadeh , Pavan Turaga

Controllable face generation poses critical challenges in generative modeling due to the intricate balance required between semantic controllability and photorealism. While existing approaches struggle with disentangling semantic controls…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Xuechao Zou , Shun Zhang , Xing Fu , Yue Li , Kai Li , Yushe Cao , Congyan Lang , Pin Tao , Junliang Xing

In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 YuTeng Ye , Jiale Cai , Hang Zhou , Guanwen Li , Youjia Zhang , Zikai Song , Chenxing Gao , Junqing Yu , Wei Yang

Text-to-image diffusion models achieve impressive generation quality but inherit and amplify training-data biases, skewing coverage of semantic attributes. Prior work addresses this in two ways. Closed-set approaches mitigate biases in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Silpa Vadakkeeveetil Sreelatha , Dan Wang , Serge Belongie , Muhammad Awais , Anjan Dutta

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. To support wider…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runhui Huang , Kaixin Cai , Jianhua Han , Xiaodan Liang , Renjing Pei , Guansong Lu , Songcen Xu , Wei Zhang , Hang Xu

Recently, the growing capabilities of deep generative models have underscored their potential in enhancing image classification accuracy. However, existing methods often demand the generation of a disproportionately large number of images…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Tao Huang , Jiaqi Liu , Shan You , Chang Xu

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

With the continuous advancement of image generation technology, advanced models such as GPT-Image-1 and Qwen-Image have achieved remarkable text-to-image consistency and world knowledge However, these models still fall short in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junyan Ye , Leiqi Zhu , Yuncheng Guo , Dongzhi Jiang , Zilong Huang , Yifan Zhang , Zhiyuan Yan , Haohuan Fu , Conghui He , Weijia Li

While text-to-image diffusion models can generate highquality images from textual descriptions, they generally lack fine-grained control over the visual composition of the generated images. Some recent works tackle this problem by training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Denis Lukovnikov , Asja Fischer

Text-to-image diffusion models have an unprecedented ability to generate diverse and high-quality images. However, they often struggle to faithfully capture the intended semantics of complex input prompts that include multiple subjects.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Omer Dahary , Or Patashnik , Kfir Aberman , Daniel Cohen-Or

The generative modeling landscape has experienced tremendous growth in recent years, particularly in generating natural images and art. Recent techniques have shown impressive potential in creating complex visual compositions while…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Juan A Rodriguez , David Vazquez , Issam Laradji , Marco Pedersoli , Pau Rodriguez

Text-driven motion generation has achieved substantial progress with the emergence of diffusion models. However, existing methods still struggle to generate complex motion sequences that correspond to fine-grained descriptions, depicting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Mingyuan Zhang , Huirong Li , Zhongang Cai , Jiawei Ren , Lei Yang , Ziwei Liu

Diffusion models have recently achieved significant success in various image manipulation tasks, including image super-resolution and perceptual quality enhancement. Pretrained text-to-image models, such as Stable Diffusion, have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sanchar Palit , Subhasis Chaudhuri , Biplab Banerjee

Vector-quantized image modeling has shown great potential in synthesizing high-quality images. However, generating high-resolution images remains a challenging task due to the quadratic computational overhead of the self-attention process.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shiyue Cao , Yueqin Yin , Lianghua Huang , Yu Liu , Xin Zhao , Deli Zhao , Kaiqi Huang

Text-to-image (T2I) generative diffusion models have demonstrated outstanding performance in synthesizing diverse, high-quality visuals from text captions. Several layout-to-image models have been developed to control the generation process…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Ahmad Süleyman , Göksel Biricik

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yiming Zhao , Zhouhui Lian

Current text-to-image diffusion models excel at generating diverse, high-quality images, yet they struggle to incorporate fine-grained camera metadata such as precise aperture settings. In this work, we introduce a novel text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Ayush Shrivastava , Connelly Barnes , Xuaner Zhang , Lingzhi Zhang , Andrew Owens , Sohrab Amirghodsi , Eli Shechtman

Medical image segmentation models struggle with rare abnormalities due to scarce annotated pathological data. We propose DiffAug a novel framework that combines textguided diffusion-based generation with automatic segmentation validation to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Maham Nazir , Muhammad Aqeel , Francesco Setti

The recent popularity of text-to-image diffusion models (DM) can largely be attributed to the intuitive interface they provide to users. The intended generation can be expressed in natural language, with the model producing faithful…

Textual image generation spans diverse fields like advertising, education, product packaging, social media, information visualization, and branding. Despite recent strides in language-guided image synthesis using diffusion models, current…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Shubham Paliwal , Arushi Jain , Monika Sharma , Vikram Jamwal , Lovekesh Vig