English
Related papers

Related papers: PS4PRO: Pixel-to-pixel Supervision for Photorealis…

200 papers

Neural implicit modeling permits to achieve impressive 3D reconstruction results on small objects, while it exhibits significant limitations in large indoor scenes. In this work, we propose a novel neural implicit modeling method that…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Federico Lincetto , Gianluca Agresti , Mattia Rossi , Pietro Zanuttigh

Recent methods for 3D reconstruction and rendering increasingly benefit from end-to-end optimization of the entire image formation process. However, this approach is currently limited: effects of the optical hardware stack and in particular…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Wenqi Xian , Aljaž Božič , Noah Snavely , Christoph Lassner

This paper presents a novel approach 4DRecons that takes a single camera RGB-D sequence of a dynamic subject as input and outputs a complete textured deforming 3D model over time. 4DRecons encodes the output as a 4D neural implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Xiaoyan Cong , Haitao Yang , Liyan Chen , Kaifeng Zhang , Li Yi , Chandrajit Bajaj , Qixing Huang

Synthetic data is a scalable alternative to manual supervision, but it requires overcoming the sim-to-real domain gap. This discrepancy between virtual and real worlds is addressed by two seemingly opposed approaches: improving the realism…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Sergey Zakharov , Rares Ambrus , Vitor Guizilini , Wadim Kehl , Adrien Gaidon

Super-resolution imaging (S.R.) is a series of techniques that enhance the resolution of an imaging system, especially in surveillance cameras where simplicity and low cost are of great importance. S.R. image reconstruction can be viewed as…

Image and Video Processing · Electrical Eng. & Systems 2020-09-22 Donya Khaledyan , Abdolah Amirany , Kian Jafari , Mohammad Hossein Moaiyeri , Abolfazl Zargari Khuzani , Najmeh Mashhadi

Neural implicit representations have revolutionized dense multi-view surface reconstruction, yet their performance significantly diminishes with sparse input views. A few pioneering works have sought to tackle the challenge of sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Sheng Ye , Yuze He , Matthieu Lin , Jenny Sheng , Ruoyu Fan , Yiheng Han , Yubin Hu , Ran Yi , Yu-Hui Wen , Yong-Jin Liu , Wenping Wang

Recently, it has been shown that a high resolution image can be obtained without the usage of a high resolution sensor. The main idea has been that a low resolution sensor is covered with a non-regular sampling mask followed by a…

Image and Video Processing · Electrical Eng. & Systems 2022-04-11 Markus Jonscher , Jürgen Seiler , Michel Bätz , Thomas Richter , Wolfgang Schnurrer , André Kaup

Deep learning based methods have recently pushed the state-of-the-art on the problem of Single Image Super-Resolution (SISR). In this work, we revisit the more traditional interpolation-based methods, that were popular before, now with the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Xu Jia , Hong Chang , Tinne Tuytelaars

There are increasing interests of studying the video-to-depth (V2D) problem with machine learning techniques. While earlier methods directly learn a mapping from images to depth maps and camera poses, more recent works enforce multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Xiaodong Gu , Weihao Yuan , Zuozhuo Dai , Siyu Zhu , Chengzhou Tang , Zilong Dong , Ping Tan

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi

Previous multi-view normal integration methods typically sample a single ray per pixel, without considering the spatial area covered by each pixel, which varies with camera intrinsics and the camera-to-object distance. Consequently, when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Tongyu Yang , Heng Guo , Yasuyuki Matsushita , Fumio Okura , Yu Luo , Xin Fan

We propose a novel method for 3D object reconstruction from a sparse set of views captured from a 360-degree calibrated camera rig. We represent the object surface through a hybrid model that uses both an MLP-based neural representation and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Llukman Cerkezi , Paolo Favaro

The photometric stereo (PS) problem consists in reconstructing the 3D-surface of an object, thanks to a set of photographs taken under different lighting directions. In this paper, we propose a multi-scale architecture for PS which,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Clément Hardy , Yvain Quéau , David Tschumperlé

Rendering realistic images from 3D reconstruction is an essential task of many Computer Vision and Robotics pipelines, notably for mixed-reality applications as well as training autonomous agents in simulated environments. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Lukas Bösiger , Mihai Dusmanu , Marc Pollefeys , Zuria Bauer

Human re-rendering from a single image is a starkly under-constrained problem, and state-of-the-art algorithms often exhibit undesired artefacts, such as over-smoothing, unrealistic distortions of the body parts and garments, or implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kripasindhu Sarkar , Dushyant Mehta , Weipeng Xu , Vladislav Golyanik , Christian Theobalt

We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic image of the scene…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Nishant Jain , Suryansh Kumar , Luc Van Gool

We present SuperNormal, a fast, high-fidelity approach to multi-view 3D reconstruction using surface normal maps. With a few minutes, SuperNormal produces detailed surfaces on par with 3D scanners. We harness volume rendering to optimize a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xu Cao , Takafumi Taketomi

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

We propose a novel deep-learning framework for super-resolution ultrasound images and videos in terms of spatial resolution and line reconstruction. We up-sample the acquired low-resolution image through a vision-based interpolation method;…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Simone Cammarasana , Paolo Nicolardi , Giuseppe Patanè

Methods for 3D reconstruction such as Photometric stereo recover the shape and reflectance properties using multiple images of an object taken with variable lighting conditions from a fixed viewpoint. Photometric stereo assumes that a scene…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Anish R. Khadka , Paolo Remagnino , Vasileios Argyriou