English
Related papers

Related papers: Harmonic Unpaired Image-to-image Translation

200 papers

We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to conditioning on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Hao Tang , Hong Liu , Nicu Sebe

Recently, unsupervised exemplar-based image-to-image translation, conditioned on a given exemplar without the paired data, has accomplished substantial advancements. In order to transfer the information from an exemplar to an input image,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Wonwoong Cho , Sungha Choi , David Keetae Park , Inkyu Shin , Jaegul Choo

Semantic Image Synthesis (SIS) is a subclass of image-to-image translation where a semantic layout is used to generate a photorealistic image. State-of-the-art conditional Generative Adversarial Networks (GANs) need a huge amount of paired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 George Eskandar , Mohamed Abdelsamad , Karim Armanious , Shuai Zhang , Bin Yang

While attention-based transformer networks achieve unparalleled success in nearly all language tasks, the large number of tokens (pixels) found in images coupled with the quadratic activation memory usage makes them prohibitive for problems…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 George Cazenavette , Manuel Ladron De Guevara

Ultrasound imaging is pivotal in various medical diagnoses due to its non-invasive nature and safety. In clinical practice, the accuracy and precision of ultrasound image analysis are critical. Recent advancements in deep learning are…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Yuhan Song , Nak Young Chong

Current `dry lab' surgical phantom simulators are a valuable tool for surgeons which allows them to improve their dexterity and skill with surgical instruments. These phantoms mimic the haptic and shape of organs of interest, but lack a…

Computers and Society · Computer Science 2019-04-09 Sandy Engelhardt , Raffaele De Simone , Peter M. Full , Matthias Karck , Ivo Wolf

In image-to-image translation, each patch in the output should reflect the content of the corresponding patch in the input, independent of domain. We propose a straightforward method for doing so -- maximizing mutual information between the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Taesung Park , Alexei A. Efros , Richard Zhang , Jun-Yan Zhu

Image-to-image translation tasks have been widely investigated with Generative Adversarial Networks (GANs) and dual learning. However, existing models lack the ability to control the translated results in the target domain and their results…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jianxin Lin , Yingce Xia , Tao Qin , Zhibo Chen , Tie-Yan Liu

Image-to-Image (I2I) multi-domain translation models are usually evaluated also using the quality of their semantic interpolation results. However, state-of-the-art models frequently show abrupt changes in the image appearance during…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Yahui Liu , Enver Sangineto , Yajing Chen , Linchao Bao , Haoxian Zhang , Nicu Sebe , Bruno Lepri , Wei Wang , Marco De Nadai

Scarcity of labeled data has motivated the development of semi-supervised learning methods, which learn from large portions of unlabeled data alongside a few labeled samples. Consistency Regularization between model's predictions under…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Aamir Mustafa , Rafal K. Mantiuk

Several studies indicate that deep learning models can learn to detect breast cancer from mammograms (X-ray images of the breasts). However, challenges with overfitting and poor generalisability prevent their routine use in the clinic.…

Image and Video Processing · Electrical Eng. & Systems 2025-02-05 Emir Ahmed , Spencer A. Thomas , Ciaran Bench

We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hao Tang , Philip H. S. Torr , Nicu Sebe

State-of-the-art techniques in Generative Adversarial Networks (GANs) have shown remarkable success in image-to-image translation from peer domain X to domain Y using paired image data. However, obtaining abundant paired data is a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Xuewen Yang , Dongliang Xie , Xin Wang

In the field of Image-to-Image (I2I) translation, ensuring consistency between input images and their translated results is a key requirement for producing high-quality and desirable outputs. Previous I2I methods have relied on result…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yaxin Shi , Xiaowei Zhou , Ping Liu , Ivor W. Tsang

Image-to-image translation is a vital component in medical imaging processing, with many uses in a wide range of imaging modalities and clinical scenarios. Previous methods include Generative Adversarial Networks (GANs) and Diffusion Models…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Yinchi Zhou , Tianqi Chen , Jun Hou , Huidong Xie , Nicha C. Dvornek , S. Kevin Zhou , David L. Wilson , James S. Duncan , Chi Liu , Bo Zhou

In the big data era, the impetus to digitize the vast reservoirs of data trapped in unstructured scanned documents such as invoices, bank documents and courier receipts has gained fresh momentum. The scanning process often results in the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Monika Sharma , Abhishek Verma , Lovekesh Vig

Unsupervised image-to-image translation aims to learn the translation between two visual domains without paired data. Despite the recent progress in image translation models, it remains challenging to build mappings between complex domains…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

Unsupervised cross-spectral stereo matching aims at recovering disparity given cross-spectral image pairs without any supervision in the form of ground truth disparity or depth. The estimated depth provides additional information…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Mingyang Liang , Xiaoyang Guo , Hongsheng Li , Xiaogang Wang , You Song

Generative adversarial networks using a cycle-consistency loss facilitate unpaired training of image-translation models and thereby exhibit a very high potential in manifold medical applications. However, the fact that images in one domain…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 Michael Gadermayr , Maximilian Tschuchnig , Laxmi Gupta , Dorit Merhof , Nils Krämer , Daniel Truhn , Burkhard Gess

Image-to-Image (I2I) translation is a heated topic in academia, and it also has been applied in real-world industry for tasks like image synthesis, super-resolution, and colorization. However, traditional I2I translation methods train data…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Jialu Huang , Jing Liao , Sam Kwong