English
Related papers

Related papers: Neural Neural Textures Make Sim2Real Consistent

200 papers

Unpaired image-to-image translation is a class of vision problems whose goal is to find the mapping between different image domains using unpaired training data. Cycle-consistency loss is a widely used constraint for such problems. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yihao Zhao , Ruihai Wu , Hao Dong

Recovering images distorted by atmospheric turbulence is a challenging inverse problem due to the stochastic nature of turbulence. Although numerous turbulence mitigation (TM) algorithms have been proposed, their efficiency and…

Image and Video Processing · Electrical Eng. & Systems 2024-04-09 Xingguang Zhang , Nicholas Chimitt , Yiheng Chi , Zhiyuan Mao , Stanley H. Chan

In many video restoration/translation tasks, image processing operations are na\"ively extended to the video domain by processing each frame independently, disregarding the temporal connection of the video frames. This disregard for the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Muhammad Kashif Ali , Dongjin Kim , Tae Hyun Kim

In this study, we present an efficient and effective approach for achieving temporally consistent synthetic-to-real video translation in videos of varying lengths. Our method leverages off-the-shelf conditional image diffusion models,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Ernie Chu , Shuo-Yen Lin , Jun-Cheng Chen

Image matting aims to predict alpha values of elaborate uncertainty areas of natural images, like hairs, smoke, and spider web. However, existing methods perform poorly when faced with highly transparent foreground objects due to the large…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huanqia Cai , Fanglei Xue , Lele Xu , Lili Guo

With the advent of perceptual loss functions, new possibilities in super-resolution have emerged, and we currently have models that successfully generate near-photorealistic high-resolution images from their low-resolution observations. Up…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Eduardo Pérez-Pellitero , Mehdi S. M. Sajjadi , Michael Hirsch , Bernhard Schölkopf

Neural implicit surfaces have become an important technique for multi-view 3D reconstruction but their accuracy remains limited. In this paper, we argue that this comes from the difficulty to learn and render high frequency textures with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 François Darmon , Bénédicte Bascle , Jean-Clément Devaux , Pascal Monasse , Mathieu Aubry

Existing image-to-image translation (I2IT) methods are either constrained to low-resolution images or long inference time due to their heavy computational burden on the convolution of high-resolution feature maps. In this paper, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Jie Liang , Hui Zeng , Lei Zhang

The following article introduces a new parametric synthesis algorithm for sound textures inspired by existing methods used for visual textures. Using a 2D Convolutional Neural Network (CNN), a sound signal is modified until the temporal…

Sound · Computer Science 2019-05-10 Hugo Caracalla , Axel Roebel

We present a novel algorithm for transferring artistic styles of semantically meaningful local regions of an image onto local regions of a target video while preserving its photorealism. Local regions may be selected either fully…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Xide Xia , Tianfan Xue , Wei-sheng Lai , Zheng Sun , Abby Chang , Brian Kulis , Jiawen Chen

High-quality video inpainting that completes missing regions in video frames is a promising yet challenging task. State-of-the-art approaches adopt attention models to complete a frame by searching missing contents from reference frames,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yanhong Zeng , Jianlong Fu , Hongyang Chao

With the widespread application of convolutional neural networks (CNNs), the traditional model based denoising algorithms are now outperformed. However, CNNs face two problems. First, they are computationally demanding, which makes their…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Yu Guo , Axel Davy , Gabriele Facciolo , Jean-Michel Morel , Qiyu Jin

Robotic ultrasound (US) systems have shown great potential to make US examinations easier and more accurate. Recently, various machine learning techniques have been proposed to realize automatic US image interpretation for robotic US…

Robotics · Computer Science 2023-05-17 Keyu Li , Xinyu Mao , Chengwei Ye , Ang Li , Yangxin Xu , Max Q. -H. Meng

With the development of Generative Adversarial Network, image-based virtual try-on methods have made great progress. However, limited work has explored the task of video-based virtual try-on while it is important in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Xiaojing Zhong , Zhonghua Wu , Taizhe Tan , Guosheng Lin , Qingyao Wu

Distinguishing between computer-generated (CG) and natural photographic (PG) images is of great importance to verify the authenticity and originality of digital images. However, the recent cutting-edge generation methods enable high…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Qiang Xu , Shan Jia , Xinghao Jiang , Tanfeng Sun , Zhe Wang , Hong Yan

In image morphing, a sequence of plausible frames are synthesized and composited together to form a smooth transformation between given instances. Intermediates must remain faithful to the input, stand on their own as members of the set,…

Graphics · Computer Science 2020-05-05 Noa Fish , Richard Zhang , Lilach Perry , Daniel Cohen-Or , Eli Shechtman , Connelly Barnes

Advancements in graphics technology has increased the use of simulated data for training machine learning models. However, the simulated data often differs from real-world data, creating a distribution gap that can decrease the efficacy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Charles Y Zhang , Ashish Shrivastava

3D reconstruction of dynamic scenes is a long-standing problem in computer graphics and increasingly difficult the less information is available. Shape-from-Template (SfT) methods aim to reconstruct a template-based geometry from RGB images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 David Stotko , Nils Wandel , Reinhard Klein

4D reconstruction and rendering of human activities is critical for immersive VR/AR experience.Recent advances still fail to recover fine geometry and texture results with the level of detail present in the input images from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Xin Suo , Yuheng Jiang , Pei Lin , Yingliang Zhang , Kaiwen Guo , Minye Wu , Lan Xu

Synthesizing realistic videos of humans using neural networks has been a popular alternative to the conventional graphics-based rendering pipeline due to its high efficiency. Existing works typically formulate this as an image-to-image…