English
Related papers

Related papers: Content-aware Warping for View Synthesis

200 papers

In recent years, novel view synthesis from a single image has seen significant progress thanks to the rapid advancements in 3D scene representation and image inpainting techniques. While the current approaches are able to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Avinash Paliwal , Brandon Nguyen , Andrii Tsarov , Nima Khademi Kalantari

Generating novel views of an object from a single image is a challenging task. It requires an understanding of the underlying 3D structure of the object from an image and rendering high-quality, spatially consistent new views. While recent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Jeong-gi Kwak , Erqun Dong , Yuhe Jin , Hanseok Ko , Shweta Mahajan , Kwang Moo Yi

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Image-based virtual try-on aims to fit an in-shop garment onto a clothed person image. Garment warping, which aligns the target garment with the corresponding body parts in the person image, is a crucial step in achieving this goal.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sanhita Pathak , Vinay Kaushik , Brejesh Lall

Optical flow estimation is an essential step for many real-world computer vision tasks. Existing deep networks have achieved satisfactory results by mostly employing a pyramidal coarse-to-fine paradigm, where a key process is to adopt…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Lingtong Kong , Xiaohang Yang , Jie Yang

Recent neural rendering and reconstruction techniques, such as NeRFs or Gaussian Splatting, have shown remarkable novel view synthesis capabilities but require hundreds of images of the scene from diverse viewpoints to render high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Felix Tristram , Stefano Gasperini , Nassir Navab , Federico Tombari

Non-photorealistic rendering techniques work on image features and often manipulate a set of characteristics such as edges and texture to achieve a desired depiction of the scene. Most computational photography methods decompose an image…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Akshay Gadi Patil , Shanmuganathan Raman

We present See360, which is a versatile and efficient framework for 360 panoramic view interpolation using latent space viewpoint estimation. Most of the existing view rendering approaches only focus on indoor or synthetic 3D environments…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Zhi-Song Liu , Marie-Paule Cani , Wan-Chi Siu

Consumer light-field (LF) cameras suffer from a low or limited resolution because of the angular-spatial trade-off. To alleviate this drawback, we propose a novel learning-based approach utilizing attention mechanism to synthesize novel…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 M. Shahzeb Khan Gul , Umair Mukati , Michel Bätz , Søren Forchhammer , Joachim Keinert

Large diffusion models demonstrate remarkable zero-shot capabilities in novel view synthesis from a single image. However, these models often face challenges in maintaining consistency across novel and reference views. A crucial factor…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Botao Ye , Sifei Liu , Xueting Li , Marc Pollefeys , Ming-Hsuan Yang

The versatility of recent machine learning approaches makes them ideal for improvement of next generation video compression solutions. Unfortunately, these approaches typically bring significant increases in computational complexity and are…

Image and Video Processing · Electrical Eng. & Systems 2021-06-18 Luka Murn , Saverio Blasi , Alan F. Smeaton , Marta Mrak

Novel view synthesis from a single image has recently achieved remarkable results, although the requirement of some form of 3D, pose, or multi-view supervision at training time limits the deployment in real scenarios. This work aims at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Pierluigi Zama Ramirez , Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

This paper proposes Sparse View Synthesis. This is a view synthesis problem where the number of reference views is limited, and the baseline between target and reference view is significant. Under these conditions, current radiance field…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Violeta Menéndez González , Andrew Gilbert , Graeme Phillipson , Stephen Jolly , Simon Hadfield

A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to single-view view…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Richard Tucker , Noah Snavely

This study presents the development of a spatially adaptive weighting strategy for Total Variation regularization, aimed at addressing under-determined linear inverse problems. The method leverages the rapid computation of an accurate…

Numerical Analysis · Mathematics 2025-01-20 Elena Morotti , Davide Evangelista , Andrea Sebastiani , Elena Loli Piccolomini

Generating consistent multi-view images from a single image remains challenging. Lack of spatial consistency often degrades 3D mesh quality in surface reconstruction. To address this, we propose LoomNet, a novel multi-view diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Giulio Federico , Fabio Carrara , Claudio Gennaro , Giuseppe Amato , Marco Di Benedetto

Feature warping is a core technique in optical flow estimation; however, the ambiguity caused by occluded areas during warping is a major problem that remains unsolved. In this paper, we propose an asymmetric occlusion-aware feature…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Shengyu Zhao , Yilun Sheng , Yue Dong , Eric I-Chao Chang , Yan Xu

Image warping is a necessary step in many multimedia applications such as texture mapping, image-based rendering, panorama stitching, image resizing and optical flow computation etc. Traditionally, color image warping interpolation is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Chuangye Zhang , Yan Niu , Tieru Wu , Ximing Li

3D Gaussian splatting has surpassed neural radiance field methods in novel view synthesis by achieving lower computational costs and real-time high-quality rendering. Although it produces a high-quality rendering with a lot of input views,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Raja Kumar , Vanshika Vats

In this paper, we tackle the task of establishing dense visual correspondences between images containing objects of the same category. This is a challenging task due to large intra-class variations and a lack of dense pixel level…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Shuda Li , Kai Han , Theo W. Costain , Henry Howard-Jenkins , Victor Prisacariu