中文
相关论文

相关论文: Cross-Modal Contrastive Learning for Text-to-Image…

200 篇论文

Learning to generate natural scenes has always been a challenging task in computer vision. It is even more painstaking when the generation is conditioned on images with drastically different views. This is mainly because understanding,…

计算机视觉与模式识别 · 计算机科学 2018-03-30 Krishna Regmi , Ali Borji

Generative Adversarial Networks (GANs) have become the de-facto standard in image synthesis. However, without considering the foreground-background decomposition, existing GANs tend to capture excessive content correlation between…

计算机视觉与模式识别 · 计算机科学 2021-07-08 Kaiwen Cui , Gongjie Zhang , Fangneng Zhan , Jiaxing Huang , Shijian Lu

Generative adversarial nets (GANs) are widely used to learn the data sampling process and their performance may heavily depend on the loss functions, given a limited computational budget. This study revisits MMD-GAN that uses the maximum…

机器学习 · 计算机科学 2019-02-11 Wei Wang , Yuan Sun , Saman Halgamuge

Recent self-supervised contrastive learning provides an effective approach for unsupervised person re-identification (ReID) by learning invariance from different views (transformed versions) of an input. In this paper, we incorporate a…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Hao Chen , Yaohui Wang , Benoit Lagadec , Antitza Dantcheva , Francois Bremond

Image generation has been heavily investigated in computer vision, where one core research challenge is to generate images from arbitrarily complex distributions with little supervision. Generative Adversarial Networks (GANs) as an implicit…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Hui Ying , He Wang , Tianjia Shao , Yin Yang , Kun Zhou

The state-of-the-art approaches in Generative Adversarial Networks (GANs) are able to learn a mapping function from one image domain to another with unpaired image data. However, these methods often produce artifacts and can only be able to…

计算机视觉与模式识别 · 计算机科学 2019-08-29 Hao Tang , Dan Xu , Nicu Sebe , Yan Yan

We review research on generating visual data from text from the angle of "cross-modal generation." This point of view allows us to draw parallels between various methods geared towards working on input text and producing visual output,…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Maciej Żelaszczyk , Jacek Mańdziuk

Vocoder models have recently achieved substantial progress in generating authentic audio comparable to human quality while significantly reducing memory requirement and inference time. However, these data-hungry generative models require…

声音 · 计算机科学 2023-12-19 Haoming Guo , Seth Z. Zhao , Jiachen Lian , Gopala Anumanchipalli , Gerald Friedland

Generative adversarial networks have seen rapid development in recent years and have led to remarkable improvements in generative modelling of images. However, their application in the audio domain has received limited attention, and…

Synthesising a text-to-image model of high-quality images by guiding the generative model through the Text description is an innovative and challenging task. In recent years, AttnGAN based on the Attention mechanism to guide GAN training…

计算机视觉与模式识别 · 计算机科学 2023-07-07 Mingyu Jin , Chong Zhang , Qinkai Yu , Haochen Xue , Xiaobo Jin , Xi Yang

Class-conditional extensions of generative adversarial networks (GANs), such as auxiliary classifier GAN (AC-GAN) and conditional GAN (cGAN), have garnered attention owing to their ability to decompose representations into class labels and…

计算机视觉与模式识别 · 计算机科学 2019-07-25 Takuhiro Kaneko , Yoshitaka Ushiku , Tatsuya Harada

Generative Adversarial Networks (GANs) have been at the forefront of image synthesis, especially in medical fields like histopathology, where they help address challenges such as data scarcity, patient privacy, and class imbalance. However,…

图像与视频处理 · 电气工程与系统科学 2024-10-30 Osama Mustafa

In this paper, we propose a novel way to interpret text information by extracting visual feature presentation from multiple high-resolution and photo-realistic synthetic images generated by Text-to-image Generative Adversarial Network (GAN)…

计算机视觉与模式识别 · 计算机科学 2019-08-05 Tao Hu , Chengjiang Long , Leheng Zhang , Chunxia Xiao

In this paper, we propose a novel generative network (SegAttnGAN) that utilizes additional segmentation information for the text-to-image synthesis task. As the segmentation data introduced to the model provides useful guidance on the…

计算机视觉与模式识别 · 计算机科学 2020-05-27 Yuchuan Gou , Qiancheng Wu , Minghao Li , Bo Gong , Mei Han

Complete and high-quality multi-modal Magnetic Resonance Imaging (MRI) is essential for accurate neuro-oncological assessment, as each contrast provides complementary anatomical and pathological information. However, acquiring all…

图像与视频处理 · 电气工程与系统科学 2026-05-04 Zaid A. Abod , Furqan Aziz

Synthesizing a realistic image from textual description is a major challenge in computer vision. Current text to image synthesis approaches falls short of producing a highresolution image that represent a text descriptor. Most existing…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Haileleol Tibebu , Aadil Malik , Varuna De Silva

Text-to-image generation aims at generating realistic images which are semantically consistent with the given text. Previous works mainly adopt the multi-stage architecture by stacking generator-discriminator pairs to engage multiple…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Mengqi Huang , Zhendong Mao , Penghui Wang , Quan Wang , Yongdong Zhang

We introduce a multi-modal diffusion model tailored for the bi-directional conditional generation of video and audio. We propose a joint contrastive training loss to improve the synchronization between visual and auditory occurrences. We…

机器学习 · 计算机科学 2024-10-10 Ruihan Yang , Hannes Gamper , Sebastian Braun

Generative adversarial networks (GANs) have provided promising data enrichment solutions by synthesizing high-fidelity images. However, generating large sets of labeled images with new anatomical variations remains unexplored. We propose a…

图像与视频处理 · 电气工程与系统科学 2020-08-03 Sina Amirrajab , Samaneh Abbasi-Sureshjani , Yasmina Al Khalil , Cristian Lorenz , Juergen Weese , Josien Pluim , Marcel Breeuwer

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel…

计算与语言 · 计算机科学 2020-02-13 Wangchunshu Zhou , Tao Ge , Ke Xu , Furu Wei , Ming Zhou