English
Related papers

Related papers: Cross-Modal Contrastive Learning for Text-to-Image…

200 papers

Learning to generate natural scenes has always been a challenging task in computer vision. It is even more painstaking when the generation is conditioned on images with drastically different views. This is mainly because understanding,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Krishna Regmi , Ali Borji

Generative Adversarial Networks (GANs) have become the de-facto standard in image synthesis. However, without considering the foreground-background decomposition, existing GANs tend to capture excessive content correlation between…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Kaiwen Cui , Gongjie Zhang , Fangneng Zhan , Jiaxing Huang , Shijian Lu

Generative adversarial nets (GANs) are widely used to learn the data sampling process and their performance may heavily depend on the loss functions, given a limited computational budget. This study revisits MMD-GAN that uses the maximum…

Machine Learning · Computer Science 2019-02-11 Wei Wang , Yuan Sun , Saman Halgamuge

Recent self-supervised contrastive learning provides an effective approach for unsupervised person re-identification (ReID) by learning invariance from different views (transformed versions) of an input. In this paper, we incorporate a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Hao Chen , Yaohui Wang , Benoit Lagadec , Antitza Dantcheva , Francois Bremond

Image generation has been heavily investigated in computer vision, where one core research challenge is to generate images from arbitrarily complex distributions with little supervision. Generative Adversarial Networks (GANs) as an implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Hui Ying , He Wang , Tianjia Shao , Yin Yang , Kun Zhou

The state-of-the-art approaches in Generative Adversarial Networks (GANs) are able to learn a mapping function from one image domain to another with unpaired image data. However, these methods often produce artifacts and can only be able to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Hao Tang , Dan Xu , Nicu Sebe , Yan Yan

We review research on generating visual data from text from the angle of "cross-modal generation." This point of view allows us to draw parallels between various methods geared towards working on input text and producing visual output,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Maciej Żelaszczyk , Jacek Mańdziuk

Vocoder models have recently achieved substantial progress in generating authentic audio comparable to human quality while significantly reducing memory requirement and inference time. However, these data-hungry generative models require…

Sound · Computer Science 2023-12-19 Haoming Guo , Seth Z. Zhao , Jiachen Lian , Gopala Anumanchipalli , Gerald Friedland

Generative adversarial networks have seen rapid development in recent years and have led to remarkable improvements in generative modelling of images. However, their application in the audio domain has received limited attention, and…

Synthesising a text-to-image model of high-quality images by guiding the generative model through the Text description is an innovative and challenging task. In recent years, AttnGAN based on the Attention mechanism to guide GAN training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Mingyu Jin , Chong Zhang , Qinkai Yu , Haochen Xue , Xiaobo Jin , Xi Yang

Class-conditional extensions of generative adversarial networks (GANs), such as auxiliary classifier GAN (AC-GAN) and conditional GAN (cGAN), have garnered attention owing to their ability to decompose representations into class labels and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Takuhiro Kaneko , Yoshitaka Ushiku , Tatsuya Harada

Generative Adversarial Networks (GANs) have been at the forefront of image synthesis, especially in medical fields like histopathology, where they help address challenges such as data scarcity, patient privacy, and class imbalance. However,…

Image and Video Processing · Electrical Eng. & Systems 2024-10-30 Osama Mustafa

In this paper, we propose a novel way to interpret text information by extracting visual feature presentation from multiple high-resolution and photo-realistic synthetic images generated by Text-to-image Generative Adversarial Network (GAN)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Chengjiang Long , Leheng Zhang , Chunxia Xiao

In this paper, we propose a novel generative network (SegAttnGAN) that utilizes additional segmentation information for the text-to-image synthesis task. As the segmentation data introduced to the model provides useful guidance on the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Yuchuan Gou , Qiancheng Wu , Minghao Li , Bo Gong , Mei Han

Complete and high-quality multi-modal Magnetic Resonance Imaging (MRI) is essential for accurate neuro-oncological assessment, as each contrast provides complementary anatomical and pathological information. However, acquiring all…

Image and Video Processing · Electrical Eng. & Systems 2026-05-04 Zaid A. Abod , Furqan Aziz

Synthesizing a realistic image from textual description is a major challenge in computer vision. Current text to image synthesis approaches falls short of producing a highresolution image that represent a text descriptor. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Haileleol Tibebu , Aadil Malik , Varuna De Silva

Text-to-image generation aims at generating realistic images which are semantically consistent with the given text. Previous works mainly adopt the multi-stage architecture by stacking generator-discriminator pairs to engage multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Mengqi Huang , Zhendong Mao , Penghui Wang , Quan Wang , Yongdong Zhang

We introduce a multi-modal diffusion model tailored for the bi-directional conditional generation of video and audio. We propose a joint contrastive training loss to improve the synchronization between visual and auditory occurrences. We…

Machine Learning · Computer Science 2024-10-10 Ruihan Yang , Hannes Gamper , Sebastian Braun

Generative adversarial networks (GANs) have provided promising data enrichment solutions by synthesizing high-fidelity images. However, generating large sets of labeled images with new anatomical variations remains unexplored. We propose a…

Image and Video Processing · Electrical Eng. & Systems 2020-08-03 Sina Amirrajab , Samaneh Abbasi-Sureshjani , Yasmina Al Khalil , Cristian Lorenz , Juergen Weese , Josien Pluim , Marcel Breeuwer

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel…

Computation and Language · Computer Science 2020-02-13 Wangchunshu Zhou , Tao Ge , Ke Xu , Furu Wei , Ming Zhou
‹ Prev 1 3 4 5 6 7 10 Next ›