English
Related papers

Related papers: GMAIL: Generative Modality Alignment for generated…

200 papers

A good Text-to-Image model should not only generate high quality images, but also ensure the consistency between the text and the generated image. Previous models failed to simultaneously fix both sides well. This paper proposes a Gradual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Bo Yang , Fangxiang Feng , Xiaojie Wang

Evaluating generative image models remains a difficult problem. This is due to the high dimensionality of the outputs, the challenging task of representing but not replicating training data, and the lack of metrics that fully correspond to…

Human-Computer Interaction · Computer Science 2023-01-12 Yannick Assogba , Adam Pearce , Madison Elliott

Contemporary benchmark methods for image inpainting are based on deep generative models and specifically leverage adversarial loss for yielding realistic reconstructions. However, these models cannot be directly applied on image/video…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Avisek Lahiri , Arnav Jain , Prabir Kumar Biswas , Pabitra Mitra

A class of recent approaches for generating images, called Generative Adversarial Networks (GAN), have been used to generate impressively realistic images of objects, bedrooms, handwritten digits and a variety of other image modalities.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Swaminathan Gurumurthy , Ravi Kiran Sarvadevabhatla , Venkatesh Babu Radhakrishnan

Recently, generated images could reach very high quality, even human eyes could not tell them apart from real images. Although there are already some methods for detecting generated images in current forensic community, most of these…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Xinsheng Xuan , Bo Peng , Wei Wang , Jing Dong

In this paper, we propose a novel data augmentation technique called GenMix, which combines generative and mixture approaches to leverage the strengths of both methods. While generative models excel at creating new data patterns, they face…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Hansang Lee , Haeil Lee , Helen Hong

Generative AI is transforming image synthesis, enabling the creation of high-quality, diverse, and photorealistic visuals across industries like design, media, healthcare, and autonomous systems. Advances in techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Fouad Bousetouane

Image generation has been heavily investigated in computer vision, where one core research challenge is to generate images from arbitrarily complex distributions with little supervision. Generative Adversarial Networks (GANs) as an implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Hui Ying , He Wang , Tianjia Shao , Yin Yang , Kun Zhou

Multimodal learning for generative models often refers to the learning of abstract concepts from the commonality of information in multiple modalities, such as vision and language. While it has proven effective for learning generalisable…

Machine Learning · Computer Science 2021-04-22 Yuge Shi , Brooks Paige , Philip H. S. Torr , N. Siddharth

Existing methods for multi-domain image-to-image translation (or generation) attempt to directly map an input image (or a random vector) to an image in one of the output domains. However, most existing methods have limited scalability and…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Bo Zhao , Bo Chang , Zequn Jie , Leonid Sigal

Unconditional image generation has recently been dominated by generative adversarial networks (GANs). GAN methods train a generator which regresses images from random noise vectors, as well as a discriminator that attempts to differentiate…

Machine Learning · Computer Science 2018-12-24 Yedid Hoshen , Jitendra Malik

Video matting has traditionally been limited by the lack of high-quality ground-truth data. Most existing video matting datasets provide only human-annotated imperfect alpha and foreground annotations, which must be composited to background…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yongtao Ge , Kangyang Xie , Guangkai Xu , Mingyu Liu , Li Ke , Longtao Huang , Hui Xue , Hao Chen , Chunhua Shen

Current developments in computer vision and deep learning allow to automatically generate hyper-realistic images, hardly distinguishable from real ones. In particular, human face generation achieved a stunning level of realism, opening new…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Francesco Marra , Cristiano Saltori , Giulia Boato , Luisa Verdoliva

Extracting accurate foregrounds from natural images benefits many downstream applications such as film production and augmented reality. However, the furry characteristics and various appearance of the foregrounds, e.g., animal and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Jizhizi Li , Jing Zhang , Stephen J. Maybank , Dacheng Tao

Large-scale generative models have shown impressive image-generation capabilities, propelled by massive data. However, this often inadvertently leads to the generation of harmful or inappropriate content and raises copyright concerns.…

Machine Learning · Computer Science 2025-03-11 Myeongseob Ko , Henry Li , Zhun Wang , Jonathan Patsenker , Jiachen T. Wang , Qinbin Li , Ming Jin , Dawn Song , Ruoxi Jia

Semantic segmentation of medical images is pivotal in applications like disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Li Zhang , Basu Jindal , Ahmed Alaa , Robert Weinreb , David Wilson , Eran Segal , James Zou , Pengtao Xie

Text-to-image models are powerful tools for image creation. However, the generation process is akin to a dice roll and makes it difficult to achieve a single image that captures everything a user wants. In this paper, we propose a framework…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sean J. Liu , Nupur Kumari , Ariel Shamir , Jun-Yan Zhu

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Data augmentation is widely used to enhance generalization in visual classification tasks. However, traditional methods struggle when source and target domains differ, as in domain adaptation, due to their inability to address domain gaps.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar , Naveed Akhtar

Vision-Language Models (VLMs) such as CLIP learn a shared embedding space for images and text, yet their representations remain geometrically separated, a phenomenon known as the modality gap. This gap limits tasks requiring cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hongyuan Liu , Qinli Yang , Wen Li , Zhong Zhang , Jiaming Liu , Wei Han , Zhili Qin , Jinxia Guo , Junming Shao