English
Related papers

Related papers: Consistent Multimodal Generation via A Unified GAN…

200 papers

Existing generative adversarial network (GAN) based conditional image generative models typically produce fixed output for the same conditional input, which is unreasonable for highly subjective tasks, such as large-mask image inpainting or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tianyi Chu , Wei Xing , Jiafu Chen , Zhizhong Wang , Jiakai Sun , Lei Zhao , Haibo Chen , Huaizhong Lin

In biomedical image analysis, the applicability of deep learning methods is directly impacted by the quantity of image data available. This is due to deep learning models requiring large image datasets to provide high-level performance.…

Machine Learning · Computer Science 2023-08-14 Muhammad Muneeb Saad , Ruairi O'Reilly , Mubashir Husain Rehmani

We present a new method for synthesizing high-resolution photo-realistic images from semantic label maps using conditional generative adversarial networks (conditional GANs). Conditional GANs have enabled a variety of applications, but the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Ting-Chun Wang , Ming-Yu Liu , Jun-Yan Zhu , Andrew Tao , Jan Kautz , Bryan Catanzaro

Understanding and replicating the real world is a critical challenge in Artificial General Intelligence (AGI) research. To achieve this, many existing approaches, such as world models, aim to capture the fundamental principles governing the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yuqi Hu , Longguang Wang , Xian Liu , Ling-Hao Chen , Yuwei Guo , Yukai Shi , Ce Liu , Anyi Rao , Zeyu Wang , Hui Xiong

Synthesizing high resolution photorealistic images has been a long-standing challenge in machine learning. In this paper we introduce new methods for the improved training of generative adversarial networks (GANs) for image synthesis. We…

Machine Learning · Statistics 2017-07-24 Augustus Odena , Christopher Olah , Jonathon Shlens

Human generation has achieved significant progress. Nonetheless, existing methods still struggle to synthesize specific regions such as faces and hands. We argue that the main reason is rooted in the training data. A holistic human dataset…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jianglin Fu , Shikai Li , Yuming Jiang , Kwan-Yee Lin , Wayne Wu , Ziwei Liu

We introduce the DP-auto-GAN framework for synthetic data generation, which combines the low dimensional representation of autoencoders with the flexibility of Generative Adversarial Networks (GANs). This framework can be used to take in…

Machine Learning · Computer Science 2020-12-11 Uthaipon Tantipongpipat , Chris Waites , Digvijay Boob , Amaresh Ankit Siva , Rachel Cummings

Generative adversarial networks (GANs) are popular for generative tasks; however, they often require careful architecture selection, extensive empirical tuning, and are prone to mode collapse. To overcome these challenges, we propose a…

Machine Learning · Computer Science 2024-07-08 Wonjun Lee , Yifei Yang , Dongmian Zou , Gilad Lerman

The rapid progression of Generative Adversarial Networks (GANs) has raised a concern of their misuse for malicious purposes, especially in creating fake face images. Although many proposed methods succeed in detecting GAN-based synthetic…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Binh M. Le , Simon S. Woo

Recent face generation methods have tried to synthesize faces based on the given contour condition, like a low-resolution image or sketch. However, the problem of identity ambiguity remains unsolved, which usually occurs when the contour is…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Qingyan Bai , Weihao Xia , Fei Yin , Yujiu Yang

Previous works (Donahue et al., 2018a; Engel et al., 2019a) have found that generating coherent raw audio waveforms with GANs is challenging. In this paper, we show that it is possible to train GANs reliably to generate high quality…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-10 Kundan Kumar , Rithesh Kumar , Thibault de Boissiere , Lucas Gestin , Wei Zhen Teoh , Jose Sotelo , Alexandre de Brebisson , Yoshua Bengio , Aaron Courville

We propose a temporally coherent generative model addressing the super-resolution problem for fluid flows. Our work represents a first approach to synthesize four-dimensional physics fields with neural networks. Based on a conditional…

Machine Learning · Computer Science 2025-03-20 You Xie , Aleksandra Franz , Mengyu Chu , Nils Thuerey

Multisequence Magnetic Resonance Imaging (MRI) provides a more reliable diagnosis in clinical applications through complementary information across sequences. However, in practice, the absence of certain MR sequences is a common problem…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Jihoon Cho , Jonghye Woo , Jinah Park

Recent generative models can synthesize "views" of artificial images that mimic real-world variations, such as changes in color or pose, simply by learning from unlabeled image collections. Here, we investigate whether such views can be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Lucy Chai , Jun-Yan Zhu , Eli Shechtman , Phillip Isola , Richard Zhang

Generative adversarial networks (GANs) have achieved remarkable progress in the natural image field. However, when applying GANs in the remote sensing (RS) image generation task, an extraordinary phenomenon is observed: the GAN model is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Xingzhe Su , Wenwen Qiang , Jie Hu , Fengge Wu , Changwen Zheng , Fuchun Sun

Generative models have shown great promise in synthesizing photorealistic 3D objects, but they require large amounts of training data. We introduce SinGRAF, a 3D-aware generative model that is trained with a few input images of a single…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Minjung Son , Jeong Joon Park , Leonidas Guibas , Gordon Wetzstein

Real-time estimation of actual environment depth is an essential module for various autonomous system tasks such as localization, obstacle detection and pose estimation. During the last decade of machine learning, extensive deployment of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Christoph Angermann , Adéla Moravová , Markus Haltmeier , Steinbjörn Jónsson , Christian Laubichler

Multilabel conditional image generation is a challenging problem in computer vision. In this work we propose Multi-ingredient Pizza Generator (MPG), a conditional Generative Neural Network (GAN) framework for synthesizing multilabel images.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Fangda Han , Guoyao Hao , Ricardo Guerrero , Vladimir Pavlovic

Coupling the high-fidelity generation capabilities of label-conditional image synthesis methods with the flexibility of unconditional generative models, we propose a semantic bottleneck GAN model for unconditional synthesis of complex…

Machine Learning · Computer Science 2019-11-27 Samaneh Azadi , Michael Tschannen , Eric Tzeng , Sylvain Gelly , Trevor Darrell , Mario Lucic

People get informed of a daily task plan through diverse media involving both texts and images. However, most prior research only focuses on LLM's capability of textual plan generation. The potential of large-scale models in providing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Xiaoxin Lu , Ranran Haoran Zhang , Yusen Zhang , Rui Zhang