中文
相关论文

相关论文: Cross-Modal Contrastive Learning for Text-to-Image…

200 篇论文

Over the past few years deep learning-based techniques such as Generative Adversarial Networks (GANs) have significantly improved solutions to image super-resolution and image-to-image translation problems. In this paper, we propose a…

图像与视频处理 · 电气工程与系统科学 2022-06-23 Aref Abedjooy , Mehran Ebrahimi

Cross-modality image estimation involves the generation of images of one medical imaging modality from that of another modality. Convolutional neural networks (CNNs) have been shown to be useful in identifying, characterising and extracting…

图像与视频处理 · 电气工程与系统科学 2021-06-07 Azin Shokraei Fard , David C. Reutens , Viktor Vegh

The conditional generative adversarial network (cGAN) is a powerful tool of generating high-quality images, but existing approaches mostly suffer unsatisfying performance or the risk of mode collapse. This paper presents Omni-GAN, a variant…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Peng Zhou , Lingxi Xie , Bingbing Ni , Cong Geng , Qi Tian

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We…

机器学习 · 统计学 2017-11-21 Yizhe Zhang , Zhe Gan , Kai Fan , Zhi Chen , Ricardo Henao , Dinghan Shen , Lawrence Carin

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Generative Adversarial Networks (GANs) are increasingly used to generate synthetic medical images, addressing the critical shortage of annotated data for training Artificial Intelligence systems. This study introduces CRF-GAN, a novel…

图像与视频处理 · 电气工程与系统科学 2025-04-22 Mahshid Shiri , Chandra Bortolotto , Alessandro Bruno , Alessio Consonni , Daniela Maria Grasso , Leonardo Brizzi , Daniele Loiacono , Lorenzo Preda

We develop an approach for text-to-image generation that embraces additional retrieval images, driven by a combination of implicit visual guidance loss and generative objectives. Unlike most existing text-to-image generation methods which…

计算机视觉与模式识别 · 计算机科学 2022-08-19 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , John Collomosse

Contrastively trained vision-language models have achieved remarkable progress in vision and language representation learning, leading to state-of-the-art models for various downstream multimodal tasks. However, recent research has…

计算与语言 · 计算机科学 2023-10-26 Harman Singh , Pengchuan Zhang , Qifan Wang , Mengjiao Wang , Wenhan Xiong , Jingfei Du , Yu Chen

The task of text-to-image generation has achieved remarkable progress due to the advances in the conditional generative adversarial networks (GANs). However, existing conditional text-to-image GANs approaches mostly concentrate on improving…

计算机视觉与模式识别 · 计算机科学 2022-04-28 Zhenxing Zhang , Lambert Schomaker

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Zhenxing Zhang , Lambert Schomaker

Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar…

图像与视频处理 · 电气工程与系统科学 2021-10-08 Uddeshya Upadhyay , Viswanath P. Sudarshan , Suyash P. Awate

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we…

机器学习 · 计算机科学 2019-11-27 Osaid Rehman Nasir , Shailesh Kumar Jha , Manraj Singh Grover , Yi Yu , Ajit Kumar , Rajiv Ratn Shah

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

计算机视觉与模式识别 · 计算机科学 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Generative Adversarial Networks (GANs) coupled with self-supervised tasks have shown promising results in unconditional and semi-supervised image generation. We propose a self-supervised approach (LT-GAN) to improve the generation quality…

计算机视觉与模式识别 · 计算机科学 2020-10-21 Parth Patel , Nupur Kumari , Mayank Singh , Balaji Krishnamurthy

Recently, Generative Adversarial Network (GAN) has been found wide applications in style transfer, image-to-image translation and image super-resolution. In this paper, a color-depth conditional GAN is proposed to concurrently resolve the…

计算机视觉与模式识别 · 计算机科学 2018-11-29 Lijun Zhao , Huihui Bai , Jie Liang , Bing Zeng , Anhong Wang , Yao Zhao

Endoscopic videos from multicentres often have different imaging conditions, e.g., color and illumination, which make the models trained on one domain usually fail to generalize well to another. Domain adaptation is one of the potential…

计算机视觉与模式识别 · 计算机科学 2020-04-20 Jiawei Chen , Yuexiang Li , Kai Ma , Yefeng Zheng

This paper addresses the problem of manipulating images using natural language description. Our task aims to semantically modify visual attributes of an object in an image according to the text describing the new visual appearance. Although…

计算机视觉与模式识别 · 计算机科学 2018-11-29 Seonghyeon Nam , Yunji Kim , Seon Joo Kim

Personalized image generation aims to integrate user-provided concepts into text-to-image models, enabling the generation of customized content based on a given prompt. Recent zero-shot approaches, particularly those leveraging diffusion…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Yiheng Lin , Shifang Zhao , Ting Liu , Xiaochao Qu , Luoqi Liu , Yao Zhao , Yunchao Wei

Cross-modal hashing aims to map heterogeneous multimedia data into a common Hamming space, which can realize fast and flexible retrieval across different modalities. Supervised cross-modal hashing methods have achieved considerable progress…

计算机视觉与模式识别 · 计算机科学 2018-02-08 Jian Zhang , Yuxin Peng , Mingkuan Yuan

Image clustering, which involves grouping images into different clusters without labels, is a key task in unsupervised learning. Although previous deep clustering methods have achieved remarkable results, they only explore the intrinsic…

计算机视觉与模式识别 · 计算机科学 2024-09-23 Haixin Zhang , Yongjun Li , Dong Huang