English
Related papers

Related papers: DT2I: Dense Text-to-Image Generation from Region D…

200 papers

Recent developments in text-conditioned image generative models have revolutionized the production of realistic results. Unfortunately, this has also led to an increase in privacy violations and the spread of false information, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 An-An Liu , Guokai Zhang , Yuting Su , Ning Xu , Yongdong Zhang , Lanjun Wang

Diffusion models for Text-to-Image (T2I) conditional generation have recently achieved tremendous success. Yet, aligning these models with user's intentions still involves a laborious trial-and-error process, and this challenging alignment…

Machine Learning · Computer Science 2025-02-12 Chao Wang , Giulio Franzese , Alessandro Finamore , Massimo Gallo , Pietro Michiardi

Structural guidance in an image-to-image translation allows intricate control over the shapes of synthesized images. Generating high-quality realistic images from user-specified rough hand-drawn sketches is one such task that aims to impose…

Graphics · Computer Science 2025-02-24 Prasun Roy , Saumik Bhattacharya , Subhankar Ghosh , Umapada Pal , Michael Blumenstein

Multi-modal generation has been widely explored in recent years. Current research directions involve generating text based on an image or vice versa. In this paper, we propose a new task called CIGLI: Conditional Image Generation from…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Xiaopeng Lu , Lynnette Ng , Jared Fernandez , Hao Zhu

The motivation of our research is to explore the possibilities of automatic sound-to-image (S2I) translation for enabling a human receiver to visually infer the occurrence of sound related events. We expect the computer to 'imagine' the…

Sound · Computer Science 2022-03-10 Leonardo A. Fanzeres , Climent Nadeu

Multimodal image-to-image translation (I2IT) aims to learn a conditional distribution that explores multiple possible images in the target domain given an input image in the source domain. Conditional generative adversarial networks (cGANs)…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Zhiwen Zuo , Lei Zhao , Zhizhong Wang , Haibo Chen , Ailin Li , Qijiang Xu , Wei Xing , Dongming Lu

Text-to-image (T2I) generation has seen significant growth over the past few years. Despite this, there has been little work on generating diagrams with T2I models. A diagram is a symbolic/schematic representation that explains information…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Abhay Zala , Han Lin , Jaemin Cho , Mohit Bansal

Text-to-image diffusion generative models can generate high quality images at the cost of tedious prompt engineering. Controllability can be improved by introducing layout conditioning, however existing methods lack layout editing ability…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Alessandro Fontanella , Petru-Daniel Tudosiu , Yongxin Yang , Shifeng Zhang , Sarah Parisot

Text-to-image (T2I) diffusion models are popular for introducing image manipulation methods, such as editing, image fusion, inpainting, etc. At the same time, image-to-video (I2V) and text-to-video (T2V) models are also built on top of T2I…

Large diffusion-based Text-to-Image (T2I) models have shown impressive generative powers for text-to-image generation as well as spatially conditioned image generation. For most applications, we can train the model end-toend with paired…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M Patel

Text-to-Image (T2I) has been prevalent in recent years, with most common condition tasks having been optimized nicely. Besides, counterfactual Text-to-Image is obstructing us from a more versatile AIGC experience. For those scenes that are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Sifan Li , Ming Tao , Hao Zhao , Ling Shao , Hao Tang

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

In this work we propose a new computational framework, based on generative deep models, for synthesis of photo-realistic food meal images from textual descriptions of its ingredients. Previous works on synthesis of images from text…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Fangda Han , Ricardo Guerrero , Vladimir Pavlovic

Image-to-image translation has recently achieved remarkable results. But despite current success, it suffers from inferior performance when translations between classes require large shape changes. We attribute this to the high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Yaxing Wang , Lu Yu , Joost van de Weijer

The requirement of large amounts of annotated images has become one grand challenge while training deep neural network models for various visual detection and recognition tasks. This paper presents a novel image synthesis technique that…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Fangneng Zhan , Shijian Lu , Chuhui Xue

Text-to-image (T2I) generation has made significant advances in recent years, but challenges still remain in the generation of perceptual artifacts, misalignment with complex prompts, and safety. The prevailing approach to address these…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xiaoying Xing , Avinab Saha , Junfeng He , Susan Hao , Paul Vicol , Moonkyung Ryu , Gang Li , Sahil Singla , Sarah Young , Yinxiao Li , Feng Yang , Deepak Ramachandran

Image-to-image (I2I) translation is usually carried out among discrete domains. However, image domains, often corresponding to a physical value, are usually continuous. In other words, images gradually change with the value, and there…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Qiusheng Huang , Xueqi Hu , Li Sun , Qingli Li

Text-to-image synthesis aims to generate a photo-realistic image from a given natural language description. Previous works have made significant progress with Generative Adversarial Networks (GANs). Nonetheless, it is still hard to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Eunyeong Jeon , Kunhee Kim , Daijin Kim

Text-to-image diffusion models have demonstrated an impressive ability to produce high-quality outputs. However, they often struggle to accurately follow fine-grained spatial information in an input text. To this end, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ran Galun , Sagie Benaim

Generative Artificial Intelligence (GenAI) has emerged as a fundamental component of intelligent interactive systems, enabling the automatic generation of multimodal media content. The continuous enhancement in the quality of Artificial…

Human-Computer Interaction · Computer Science 2024-07-23 Yongquan Hu , Dawen Zhang , Mingyue Yuan , Kaiqi Xian , Don Samitha Elvitigala , June Kim , Gelareh Mohammadi , Zhenchang Xing , Xiwei Xu , Aaron Quigley