English
Related papers

Related papers: Structural Multiplane Image: Bridging Neural View …

200 papers

We present NeX, a new approach to novel view synthesis based on enhancements of multiplane image (MPI) that can reproduce next-level view-dependent effects -- in real time. Unlike traditional MPI that uses a set of simple RGB$\alpha$…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Suttisak Wizadwongsa , Pakkapon Phongthawee , Jiraphon Yenphraphai , Supasorn Suwajanakorn

Automatic reconstruction of 3D models from images using multi-view Structure-from-Motion methods has been one of the most fruitful outcomes of computer vision. These advances combined with the growing popularity of Micro Aerial Vehicles as…

Robotics · Computer Science 2016-11-15 Shreyansh Daftry , Christof Hoppe , Horst Bischof

This paper studies the problem of view synthesis with certain amount of rotations from a pair of images, what we called stereo unstructured magnification. While the multi-plane image representation is well suited for view synthesis with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Qi Zhang , Xin Huang , Ying Feng , Xue Wang , Hongdong Li , Qing Wang

We present a novel approach to view synthesis using multiplane images (MPIs). Building on recent advances in learned gradient descent, our algorithm generates an MPI from a set of sparse camera viewpoints. The resulting method incorporates…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 John Flynn , Michael Broxton , Paul Debevec , Matthew DuVall , Graham Fyffe , Ryan Overbeck , Noah Snavely , Richard Tucker

Purpose: To develop a general framework for Parallel Imaging (PI) with the use of Maxwell regularization for the estimation of the sensitivity maps (SMs) and constrained optimization for the parameter-free image reconstruction. Theory and…

Image and Video Processing · Electrical Eng. & Systems 2020-08-21 Matteo Alessandro Francavilla , Stamatios Lefkimmiatis , Jorge F. Villena , Athanasios G. Polimeridis

Magnetic particle imaging (MPI) is an imaging modality exploiting the nonlinear magnetization behavior of (super-)paramagnetic nanoparticles to obtain a space- and often also time-dependent concentration of a tracer consisting of these…

Image and Video Processing · Electrical Eng. & Systems 2020-07-06 Sören Dittmer , Tobias Kluth , Mads Thorstein Roar Henriksen , Peter Maass

Magnetic particle imaging (MPI) offers unparalleled contrast and resolution for tracing magnetic nanoparticles. A common imaging procedure calibrates a system matrix (SM) that is used to reconstruct data from subsequent scans. The ill-posed…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Alper Güngör , Baris Askin , Damla Alptekin Soydan , Can Barış Top , Emine Ulku Saritas , Tolga Çukur

Human instance matting aims to estimate an alpha matte for each human instance in an image, which is challenging as it easily fails in complex cases requiring disentangling mingled pixels belonging to multiple instances along hairy and thin…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Siyi Jiao , Wenzheng Zeng , Yerong Li , Huayu Zhang , Changxin Gao , Nong Sang , Mike Zheng Shou

The accuracy of learning-based optical flow estimation models heavily relies on the realism of the training datasets. Current approaches for generating such datasets either employ synthetic data or generate images with limited realism.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Yingping Liang , Jiaming Liu , Debing Zhang , Ying Fu

We introduce a compressive single-pixel imaging (SPI) framework for high-resolution image capture in fractions of a second. This framework combines a dedicated sampling strategy with a tailored reconstruction method to enable high-quality…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Anna Pastuszczak , Rafał Stojek , Piotr Wróbel , Magdalena Cwojdzińska , Kacper Sobczak , Rafał Kotyński

We propose a scalable neural network framework to reconstruct the 3D mesh of a human body from multi-view images, in the subspace of the SMPL model. Use of multi-view images can significantly reduce the projection ambiguity of the problem,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Junbang Liang , Ming C. Lin

This paper addresses the challenge of reconstructing 3D indoor scenes from multi-view images. Many previous works have shown impressive reconstruction results on textured objects, but they still have difficulty in handling low-textured…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Haoyu Guo , Sida Peng , Haotong Lin , Qianqian Wang , Guofeng Zhang , Hujun Bao , Xiaowei Zhou

We propose a learning-based approach for novel view synthesis for multi-camera 360$^{\circ}$ panorama capture rigs. Previous work constructs RGBD panoramas from such data, allowing for view synthesis with small amounts of translation, but…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Kai-En Lin , Zexiang Xu , Ben Mildenhall , Pratul P. Srinivasan , Yannick Hold-Geoffroy , Stephen DiVerdi , Qi Sun , Kalyan Sunkavalli , Ravi Ramamoorthi

3D line mapping from multi-view RGB images provides a compact and structured visual representation of scenes. We study the problem from a physical and topological perspective: a 3D line most naturally emerges as the edge of a finite 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zeran Ke , Bin Tan , Gui-Song Xia , Yujun Shen , Nan Xue

Single-pixel imaging (SPI) is significant for applications constrained by transmission bandwidth or lighting band, where 3D SPI can be further realized through capturing signals carrying depth. Sampling strategy and reconstruction algorithm…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Xinyue Ma , Chenxing Wang

Purpose: We present SCAMPI (Sparsity Constrained Application of deep Magnetic resonance Priors for Image reconstruction), an untrained deep Neural Network for MRI reconstruction without previous training on datasets. It expands the Deep…

Medical Physics · Physics 2024-05-21 Thomas M. Siedler , Peter M. Jakob , Volker Herold

PatchMatch based Multi-view Stereo (MVS) algorithms have achieved great success in large-scale scene reconstruction tasks. However, reconstruction of texture-less planes often fails as similarity measurement methods may become ineffective…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Shang Sun , Yunan Zheng , Xuelei Shi , Zhenyu Xu , Yiguang Liu

Magnetic particle imaging (MPI) is an imaging method that can visualize magnetic nanoparticles in positive contrast, without radiation exposure. Recently, we proposed an image reconstruction method for projection-based MPI (pMPI), in which…

Medical Physics · Physics 2023-05-01 Kenya Murase

Purpose: To introduce a combined machine learning (ML) and physics-based image reconstruction framework that enables navigator-free, highly accelerated multishot echo planar imaging (msEPI), and demonstrate its application in…

Multispectral imaging (MSI) captures data across multiple spectral bands, offering enhanced informational depth compared to standard RGB imaging and benefiting diverse fields such as agriculture, medical diagnostics, and industrial…

Instrumentation and Detectors · Physics 2025-08-29 Muchen Zhu , Baolei Liu , Yao Wang , Linjun Zhai , Jiaqi Song , Nana Liu , Zhaohua Yang , Lei Ding , Fan Wang