English
Related papers

Related papers: RayNet: Learning Volumetric 3D Reconstruction with…

200 papers

Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Henry Chan , Youssef S. G. Nashed , Saugat Kandel , Stephan Hruszkewycz , Subramanian Sankaranarayanan , Ross J. Harder , Mathew J. Cherukara

This paper presents an end-to-end convolutional neural network (CNN) for 2D-3D exemplar detection. We demonstrate that the ability to adapt the features of natural images to better align with those of CAD rendered views is critical to the…

Computer Vision and Pattern Recognition · Computer Science 2016-04-19 Francisco Massa , Bryan Russell , Mathieu Aubry

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

Recent neural rendering methods have demonstrated accurate view interpolation by predicting volumetric density and color with a neural network. Although such volumetric representations can be supervised on static and dynamic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Julian Knodt , Joe Bartusek , Seung-Hwan Baek , Felix Heide

All current non-rigid structure from motion (NRSfM) algorithms are limited with respect to: (i) the number of images, and (ii) the type of shape variability they can handle. This has hampered the practical utility of NRSfM for many…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Chen Kong , Simon Lucey

Recent volumetric 3D reconstruction methods can produce very accurate results, with plausible geometry even for unobserved surfaces. However, they face an undesirable trade-off when it comes to multi-view fusion. They can fuse all available…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Noah Stier , Alexander Rich , Pradeep Sen , Tobias Höllerer

Deep neural networks (DNNs) trained on large-scale datasets have recently achieved impressive improvements in face recognition. But a persistent challenge remains to develop methods capable of handling large pose variations that are…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Xi Peng , Xiang Yu , Kihyuk Sohn , Dimitris Metaxas , Manmohan Chandraker

We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Alex Trevithick , Bo Yang

Partial differential equations (PDEs) are indispensable for modeling many physical phenomena and also commonly used for solving image processing tasks. In the latter area, PDE-based approaches interpret image data as discretizations of…

Machine Learning · Computer Science 2018-12-12 Lars Ruthotto , Eldad Haber

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

Vision Transformers (ViT) have recently demonstrated the significant potential of transformer architectures for computer vision. To what extent can image-based deep reinforcement learning also benefit from ViT architectures, as compared to…

Machine Learning · Computer Science 2022-05-17 Tianxin Tao , Daniele Reda , Michiel van de Panne

In many inertial confinement fusion experiments, the neutron yield and other parameters cannot be completely accounted for with one and two dimensional models. This discrepancy suggests that there are three dimensional effects which may be…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Bradley T. Wolfe , Michael J. Falato , Xinhua Zhang , Nga T. T. Nguyen-Fotiadis , J. P. Sauppe , P. M. Kozlowski , P. A. Keiter , R. E. Reinovsky , S. A. Batha , Zhehui Wang

It is widely believed that the success of deep convolutional networks is based on progressively discarding uninformative variability about the input with respect to the problem at hand. This is supported empirically by the difficulty of…

Machine Learning · Computer Science 2018-06-25 Jörn-Henrik Jacobsen , Arnold Smeulders , Edouard Oyallon

Nowadays, the Convolutional Neural Networks (CNNs) have achieved impressive performance on many computer vision related tasks, such as object detection, image recognition, image retrieval, etc. These achievements benefit from the CNNs…

Computer Vision and Pattern Recognition · Computer Science 2018-06-04 Zhuwei Qin , Fuxun Yu , Chenchen Liu , Xiang Chen

NeRF is a popular model that efficiently represents 3D objects from 2D images. However, vanilla NeRF has some important limitations. NeRF must be trained on each object separately. The training time is long since we encode the object's…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Dominik Zimny , Artur Kasymov , Adam Kania , Jacek Tabor , Maciej Zięba , Marcin Mazur , Przemysław Spurek

In this paper, we explore a novel method for tomographic image reconstruction in the field of SPECT imaging. Deep Learning methodologies and more specifically deep convolutional neural networks (CNN) are employed in the new reconstruction…

Machine Learning · Computer Science 2020-10-20 Charalambos Chrysostomou , Loizos Koutsantonis , Christos Lemesios , Costas N. Papanicolas

This paper shows how to extract dense optical flow from videos with a convolutional neural network (CNN). The proposed model constitutes a potential building block for deeper architectures to allow using motion without resorting to an…

Computer Vision and Pattern Recognition · Computer Science 2016-01-28 Damien Teney , Martial Hebert

We introduce an approach for analyzing the variation of features generated by convolutional neural networks (CNNs) with respect to scene factors that occur in natural images. Such factors may include object style, 3D viewpoint, color, and…

Computer Vision and Pattern Recognition · Computer Science 2015-06-04 Mathieu Aubry , Bryan Russell

Modern vision-based reinforcement learning techniques often use convolutional neural networks (CNN) as universal function approximators to choose which action to take for a given visual input. Until recently, CNNs have been treated like…

Machine Learning · Computer Science 2018-09-28 Jieliang Luo , Sam Green , Peter Feghali , George Legrady , Çetin Kaya Koç

Monocular 3D object parsing is highly desirable in various scenarios including occlusion reasoning and holistic scene interpretation. We present a deep convolutional neural network (CNN) architecture to localize semantic parts in 2D image…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Chi Li , M. Zeeshan Zia , Quoc-Huy Tran , Xiang Yu , Gregory D. Hager , Manmohan Chandraker