English
Related papers

Related papers: M3D-GAN: Multi-Modal Multi-Domain Translation with…

200 papers

Generative adversarial networks (GANs) have succeeded in inducing cross-lingual word embeddings -- maps of matching words across languages -- without supervision. Despite these successes, GANs' performance for the difficult case of distant…

Computation and Language · Computer Science 2021-08-27 Haozhou Wang , James Henderson , Paola Merlo

Audio-visual speech recognition (AVSR) attracts a surge of research interest recently by leveraging multimodal signals to understand human speech. Mainstream approaches addressing this task have developed sophisticated architectures and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-21 Yuchen Hu , Chen Chen , Ruizhe Li , Heqing Zou , Eng Siong Chng

3D-controllable portrait synthesis has significantly advanced, thanks to breakthroughs in generative adversarial networks (GANs). However, it is still challenging to manipulate existing face images with precise 3D control. While…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yuchen Liu , Zhixin Shu , Yijun Li , Zhe Lin , Richard Zhang , S. Y. Kung

Generative Adversarial Networks (GANs) have emerged as a significant player in generative modeling by mapping lower-dimensional random noise to higher-dimensional spaces. These networks have been used to generate high-resolution images and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Satya Pratheek Tata , Subhankar Mishra

Recent efforts on training visual navigation agents conditioned on language using deep reinforcement learning have been successful in learning policies for different multimodal tasks, such as semantic goal navigation and embodied question…

Machine Learning · Computer Science 2019-02-05 Devendra Singh Chaplot , Lisa Lee , Ruslan Salakhutdinov , Devi Parikh , Dhruv Batra

Many multi-domain neural machine translation (NMT) models achieve knowledge transfer by enforcing one encoder to learn shared embedding across domains. However, this design lacks adaptation to individual domains. To overcome this…

Computation and Language · Computer Science 2021-02-15 Haoming Jiang , Chen Liang , Chong Wang , Tuo Zhao

Recent Image-to-Image Translation algorithms have achieved significant progress in neural style transfer and image attribute manipulation tasks. However, existing approaches require exhaustively labelling training data, which is labor…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Jichao Zhang , Yezhi Shu , Songhua Xu , Gongze Cao , Fan Zhong , Meng Liu , Xueying Qin

We present a new weakly supervised learning-based method for generating novel category-specific 3D shapes from unoccluded image collections. Our method is weakly supervised and only requires silhouette annotations from unoccluded,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Xiao Li , Yue Dong , Pieter Peers , Xin Tong

Optimising the analysis of cardiac structure and function requires accurate 3D representations of shape and motion. However, techniques such as cardiac magnetic resonance imaging are conventionally limited to acquiring contiguous…

Image and Video Processing · Electrical Eng. & Systems 2021-07-19 Nicolo Savioli , Antonio de Marvao , Wenjia Bai , Shuo Wang , Stuart A. Cook , Calvin W. L. Chin , Daniel Rueckert , Declan P. O'Regan

Portrait editing is a popular subject in photo manipulation. The Generative Adversarial Network (GAN) advances the generating of realistic faces and allows more face editing. In this paper, we argue about three issues in existing…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Shuyang Gu , Jianmin Bao , Hao Yang , Dong Chen , Fang Wen , Lu Yuan

Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar…

Image and Video Processing · Electrical Eng. & Systems 2021-10-08 Uddeshya Upadhyay , Viswanath P. Sudarshan , Suyash P. Awate

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Sungmin Hong , Razvan Marinescu , Adrian V. Dalca , Anna K. Bonkhoff , Martin Bretzner , Natalia S. Rost , Polina Golland

Domain Generalization (DG) aims to enhance model robustness in unseen or distributionally shifted target domains through training exclusively on source domains. Although existing DG techniques, such as data manipulation, learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hai Huang , Yan Xia , Sashuai Zhou , Hanting Wang , Shulei Wang , Zhou Zhao

Generative adversarial networks (GANs) have ushered in a revolution in image-to-image translation. The development and proliferation of GANs raises an interesting question: can we train a GAN to remove an object, if present, from an image…

Image and Video Processing · Electrical Eng. & Systems 2019-08-30 Md Mahfuzur Rahman Siddiquee , Zongwei Zhou , Nima Tajbakhsh , Ruibin Feng , Michael B. Gotway , Yoshua Bengio , Jianming Liang

Generative models have achieved impressive fidelity in text-to-image synthesis, yet struggle with complex compositional prompts involving multiple constraints. We introduce \textbf{M3 (Multi-Modal, Multi-Agent, Multi-Round)}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Bangji Yang , Ruihan Guo , Jiajun Fan , Chaoran Cheng , Ge Liu

Generative Adversarial Networks (GANs), particularly StyleGAN and its variants, have demonstrated remarkable capabilities in generating highly realistic images. Despite their success, adapting these models to diverse tasks such as domain…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Abdul Basit Anees , Ahmet Canberk Baykal , Muhammed Burak Kizil , Duygu Ceylan , Erkut Erdem , Aykut Erdem

Image-to-image translation is considered a new frontier in the field of medical image analysis, with numerous potential applications. However, a large portion of recent approaches offers individualized solutions based on specialized…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Karim Armanious , Chenming Jiang , Marc Fischer , Thomas Küstner , Konstantin Nikolaou , Sergios Gatidis , Bin Yang

Learning to generate natural scenes has always been a daunting task in computer vision. This is even more laborious when generating images with very different views. When the views are very different, the view fields have little overlap or…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hao Ding , Songsong Wu , Hao Tang , Fei Wu , Guangwei Gao , Xiao-Yuan Jing

We introduce BSD-GAN, a novel multi-branch and scale-disentangled training method which enables unconditional Generative Adversarial Networks (GANs) to learn image representations at multiple scales, benefiting a wide range of generation…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Zili Yi , Zhiqin Chen , Hao Cai , Wendong Mao , Minglun Gong , Hao Zhang