中文
相关论文

相关论文: Consistent Multimodal Generation via A Unified GAN…

200 篇论文

Generative adversarial networks (GANs) are unsupervised Deep Learning approach in the computer vision community which has gained significant attention from the last few years in identifying the internal structure of multimodal medical…

图像与视频处理 · 电气工程与系统科学 2020-05-22 Nripendra Kumar Singh , Khalid Raza

Grayscale image colorization is a fascinating application of AI for information restoration. The inherently ill-posed nature of the problem makes it even more challenging since the outputs could be multi-modal. The learning-based methods…

计算机视觉与模式识别 · 计算机科学 2022-08-18 Himanshu Kumar , Abeer Banerjee , Sumeet Saurav , Sanjay Singh

In this work, we propose a novel Cycle In Cycle Generative Adversarial Network (C$^2$GAN) for the task of keypoint-guided image generation. The proposed C$^2$GAN is a cross-modal framework exploring a joint exploitation of the keypoint and…

计算机视觉与模式识别 · 计算机科学 2020-04-17 Hao Tang , Dan Xu , Gaowen Liu , Wei Wang , Nicu Sebe , Yan Yan

Generative Adversarial Networks (GANs) have proven to be a powerful tool in generating artistic images, capable of mimicking the styles of renowned painters, such as Claude Monet. This paper introduces a tiered GAN model to progressively…

计算机视觉与模式识别 · 计算机科学 2024-12-10 FNU Neha , Deepshikha Bhati , Deepak Kumar Shukla , Md Amiruzzaman

Last-generation GAN models allow to generate synthetic images which are visually indistinguishable from natural ones, raising the need to develop tools to distinguish fake and natural images thus contributing to preserve the trustworthiness…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Mauro Barni , Kassem Kallas , Ehsan Nowroozi , Benedetta Tondi

Coarse building mass models are now routinely generated at scales ranging from individual buildings through to whole cities. For example, they can be abstracted from raw measurements, generated procedurally, or created manually. However,…

图形学 · 计算机科学 2019-03-08 Tom Kelly , Paul Guerrero , Anthony Steed , Peter Wonka , Niloy J. Mitra

Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However,…

图像与视频处理 · 电气工程与系统科学 2021-07-22 Sungmin Hong , Razvan Marinescu , Adrian V. Dalca , Anna K. Bonkhoff , Martin Bretzner , Natalia S. Rost , Polina Golland

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

机器学习 · 计算机科学 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

The advent of Generative Adversarial Networks (GANs) has brought about completely novel ways of transforming and manipulating pixels in digital images. GAN based techniques such as Image-to-Image translations, DeepFakes, and other automated…

Most conditional generation tasks expect diverse outputs given a single conditional context. However, conditional generative adversarial networks (cGANs) often focus on the prior conditional information and ignore the input noise vectors,…

计算机视觉与模式识别 · 计算机科学 2019-05-07 Qi Mao , Hsin-Ying Lee , Hung-Yu Tseng , Siwei Ma , Ming-Hsuan Yang

In this work, we introduce CC3D, a conditional generative model that synthesizes complex 3D scenes conditioned on 2D semantic scene layouts, trained using single-view images. Different from most existing 3D GANs that limit their…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Xingguang Yan , Gordon Wetzstein , Leonidas Guibas , Andrea Tagliasacchi

Unified multimodal models (UMMs) aim to integrate multimodal understanding and generation within a unified architecture, yet it remains unclear to what extent their representations are truly aligned across modalities. To investigate this…

计算与语言 · 计算机科学 2026-04-08 Cheng Yang , Chufan Shi , Bo Shui , Yaokang Wu , Muzi Tao , Huijuan Wang , Ivan Yee Lee , Yong Liu , Xuezhe Ma , Taylor Berg-Kirkpatrick

Synthesizing MR imaging sequences is highly relevant in clinical practice, as single sequences are often missing or are of poor quality (e.g. due to motion). Naturally, the idea arises that a target modality would benefit from multi-modal…

计算机视觉与模式识别 · 计算机科学 2019-07-29 Hongwei Li , Johannes C. Paetzold , Anjany Sekuboyina , Florian Kofler , Jianguo Zhang , Jan S. Kirschke , Benedikt Wiestler , Bjoern Menze

In this research, we introduce an innovative method for synthesizing medical images using generative adversarial networks (GANs). Our proposed GANs method demonstrates the capability to produce realistic synthetic images even when trained…

图像与视频处理 · 电气工程与系统科学 2024-06-28 Yinqiu Feng , Bo Zhang , Lingxi Xiao , Yutian Yang , Tana Gegen , Zexi Chen

Style synthesis attracts great interests recently, while few works focus on its dual problem "style separation". In this paper, we propose the Style Separation and Synthesis Generative Adversarial Network (S3-GAN) to simultaneously…

计算机视觉与模式识别 · 计算机科学 2018-11-08 Rui Zhang , Sheng Tang , Yu Li , Junbo Guo , Yongdong Zhang , Jintao Li , Shuicheng Yan

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

计算机视觉与模式识别 · 计算机科学 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

Generative Adversarial Networks (GAN) have been widely investigated for image synthesis based on their powerful representation learning ability. In this work, we explore the StyleGAN and its application of synthetic food image generation.…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Wenjin Fu , Yue Han , Jiangpeng He , Sriram Baireddy , Mridul Gupta , Fengqing Zhu

While recent NeRF-based generative models achieve the generation of diverse 3D-aware images, these approaches have limitations when generating images that contain user-specified characteristics. In this paper, we propose a novel model,…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Kyungmin Jo , Gyumin Shim , Sanghun Jung , Soyoung Yang , Jaegul Choo

Deep generative modeling has emerged as a powerful tool for synthesizing realistic medical images, driving advances in medical image analysis, disease diagnosis, and treatment planning. This chapter explores various deep generative models…

图像与视频处理 · 电气工程与系统科学 2024-10-24 Paul Friedrich , Yannik Frisch , Philippe C. Cattin

In the last few years, we have witnessed the rise of a series of deep learning methods to generate synthetic images that look extremely realistic. These techniques prove useful in the movie industry and for artistic purposes. However, they…

计算机视觉与模式识别 · 计算机科学 2022-03-07 Sara Mandelli , Nicolò Bonettini , Paolo Bestagini , Stefano Tubaro