English
Related papers

Related papers: Learning Robust Multi-Scale Representation for Neu…

200 papers

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

Pose-free neural radiance fields (NeRF) aim to train NeRF with unposed multi-view images and it has achieved very impressive success in recent years. Most existing works share the pipeline of training a coarse pose estimator with rendered…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Jiahui Zhang , Fangneng Zhan , Yingchen Yu , Kunhao Liu , Rongliang Wu , Xiaoqin Zhang , Ling Shao , Shijian Lu

We address the problem of multi-object 3D pose control in image diffusion models. Instead of conditioning on a sequence of text tokens, we propose to use a set of per-object representations, Neural Assets, to control the 3D pose of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Ziyi Wu , Yulia Rubanova , Rishabh Kabra , Drew A. Hudson , Igor Gilitschenski , Yusuf Aytar , Sjoerd van Steenkiste , Kelsey R. Allen , Thomas Kipf

This paper addresses the challenge of novel view synthesis for a human performer from a very sparse set of camera views. Some recent works have shown that learning implicit neural representations of 3D scenes achieves remarkable view…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sida Peng , Yuanqing Zhang , Yinghao Xu , Qianqian Wang , Qing Shuai , Hujun Bao , Xiaowei Zhou

A multi-view image sequence provides a much richer capacity for object recognition than from a single image. However, most existing solutions to multi-view recognition typically adopt hand-crafted, model-based geometric methods, which do…

Computer Vision and Pattern Recognition · Computer Science 2016-05-27 Edward Johns , Stefan Leutenegger , Andrew J. Davison

In this work, we propose a camera self-calibration algorithm for generic cameras with arbitrary non-linear distortions. We jointly learn the geometry of the scene and the accurate camera parameters without any calibration objects. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yoonwoo Jeong , Seokjun Ahn , Christopher Choy , Animashree Anandkumar , Minsu Cho , Jaesik Park

Unsupervised change detection techniques are generally constrained to two multi-band optical images acquired at different times through sensors sharing the same spatial and spectral resolution. This scenario is suitable for a straight…

Image and Video Processing · Electrical Eng. & Systems 2018-04-10 Vinicius Ferraris , Nicolas Dobigeon , Marie Chabert

Deep unrolling is an emerging deep learning-based image reconstruction methodology that bridges the gap between model-based and purely deep learning-based image reconstruction methods. Although deep unrolling methods achieve…

Image and Video Processing · Electrical Eng. & Systems 2022-12-21 Canberk Ekmekci , Mujdat Cetin

Scene recognition, particularly for aerial and underwater images, often suffers from various types of degradation, such as blurring or overexposure. Previous works that focus on convolutional neural networks have been shown to be able to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jianqi Zhang , Mengxuan Wang , Jingyao Wang , Lingyu Si , Changwen Zheng , Fanjiang Xu

We present a novel deep learning framework that models the scene dependent image processing inside cameras. Often called as the radiometric calibration, the process of recovering RAW images from processed images (JPEG format in the sRGB…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Seonghyeon Nam , Seon Joo Kim

We present a learning based approach for multi-view stereopsis (MVS). While current deep MVS methods achieve impressive results, they crucially rely on ground-truth 3D training data, and acquisition of such precise 3D geometry for…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Tejas Khot , Shubham Agrawal , Shubham Tulsiani , Christoph Mertz , Simon Lucey , Martial Hebert

Current methods based on Neural Radiance Fields (NeRF) significantly lack the capacity to quantify uncertainty in their predictions, particularly on the unseen space including the occluded and outside scene content. This limitation hinders…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Jianxiong Shen , Ruijie Ren , Adria Ruiz , Francesc Moreno-Noguer

We propose a framework for aligning and fusing multiple images into a single view using neural image representations (NIRs), also known as implicit or coordinate-based neural representations. Our framework targets burst images that exhibit…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Seonghyeon Nam , Marcus A. Brubaker , Michael S. Brown

Implicit neural representations are a promising new avenue of representing general signals by learning a continuous function that, parameterized as a neural network, maps the domain of a signal to its codomain; the mapping from spatial…

Machine Learning · Computer Science 2021-11-09 Jaeho Lee , Jihoon Tack , Namhoon Lee , Jinwoo Shin

Neural Radiance Fields (NeRF) have recently demonstrated photo-realistic results for the task of novel view synthesis. In this paper, we propose to apply novel view synthesis to the robot relocalization problem: we demonstrate improvement…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Arthur Moreau , Nathan Piasco , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

Super-resolution is a fundamental problem in computer vision which aims to overcome the spatial limitation of camera sensors. While significant progress has been made in single image super-resolution, most algorithms only perform well on…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Xiangyu Xu , Yongrui Ma , Wenxiu Sun , Ming-Hsuan Yang

The shutter strategy applied to the photo-shooting process has a significant influence on the quality of the captured photograph. An improper shutter may lead to a blurry image, video discontinuity, or rolling shutter artifact. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Xinyu Zhang , Hefei Huang , Xu Jia , Dong Wang , Huchuan Lu

Recovering structure and motion parameters given a image pair or a sequence of images is a well studied problem in computer vision. This is often achieved by employing Structure from Motion (SfM) or Simultaneous Localization and Mapping…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Thanuja Dharmasiri , Andrew Spek , Tom Drummond

Aleatoric uncertainty is an intrinsic property of ill-posed inverse and imaging problems. Its quantification is vital for assessing the reliability of relevant point estimates. In this paper, we propose an efficient framework for…

Image and Video Processing · Electrical Eng. & Systems 2020-01-16 Chen Zhang , Bangti Jin