English
Related papers

Related papers: Beyond Pixels: A Differentiable Pipeline for Probi…

200 papers

This paper presents a novel approach to learn and detect distinctive regions on 3D shapes. Unlike previous works, which require labeled data, our method is unsupervised. We conduct the analysis on point sets sampled from 3D shapes, then…

Graphics · Computer Science 2020-04-22 Xianzhi Li , Lequan Yu , Chi-Wing Fu , Daniel Cohen-Or , Pheng-Ann Heng

The modern computer graphics pipeline can synthesize images at remarkable visual quality; however, it requires well-defined, high-quality 3D content as input. In this work, we explore the use of imperfect 3D content, for instance, obtained…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Justus Thies , Michael Zollhöfer , Matthias Nießner

We propose Differentiable Stereopsis, a multi-view stereo approach that reconstructs shape and texture from few input views and noisy cameras. We pair traditional stereopsis and modern differentiable rendering to build an end-to-end model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shubham Goel , Georgia Gkioxari , Jitendra Malik

Though performed almost effortlessly by humans, segmenting 2D gray-scale or color images into respective regions of interest (e.g.~background, objects, or portions of objects) constitutes one of the greatest challenges in science and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alexandre Benatti , Luciano da F. Costa

We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Nanyang Wang , Yinda Zhang , Zhuwen Li , Yanwei Fu , Wei Liu , Yu-Gang Jiang

Modeling the distribution of natural images is a landmark problem in unsupervised learning. This task requires an image model that is at once expressive, tractable and scalable. We present a deep neural network that sequentially predicts…

Computer Vision and Pattern Recognition · Computer Science 2016-08-22 Aaron van den Oord , Nal Kalchbrenner , Koray Kavukcuoglu

Real-time, accurate, and robust pupil detection is an essential prerequisite for pervasive video-based eye-tracking. However, automated pupil detection in real-world scenarios has proven to be an intricate challenge due to fast illumination…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Wolfgang Fuhl , Thiago Santini , Gjergji Kasneci , Enkelejda Kasneci

3D-Polarized Light Imaging (3D-PLI) is a neuroimaging technique used to study the structural connectivity of the human brain at the meso- and microscale. In 3D-PLI, the complex nerve fiber architecture of the brain is characterized by 3D…

Computational Physics · Physics 2020-12-21 Felix Matuschke , Kévin Ginsburger , Cyril Poupon , Katrin Amunts , Markus Axer

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

Deep convolutional neural networks are powerful tools for learning visual representations from images. However, designing efficient deep architectures to analyse volumetric medical images remains challenging. This work investigates…

Computer Vision and Pattern Recognition · Computer Science 2017-07-10 Wenqi Li , Guotai Wang , Lucas Fidon , Sebastien Ourselin , M. Jorge Cardoso , Tom Vercauteren

Autonomous driving is a challenging scenario for image segmentation due to the presence of uncontrolled environmental conditions and the eventually catastrophic consequences of failures. Previous work suggested that a biologically motivated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Pablo Hernández-Cámara , Jorge Vila-Tomás , Paula Dauden-Oliver , Nuria Alabau-Bosque , Valero Laparra , Jesús Malo

The generation of triangle meshes from point clouds, i.e. meshing, is a core task in computer graphics and computer vision. Traditional techniques directly construct a surface mesh using local decision heuristics, while some recent methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Mathias Vetsch , Sandro Lombardi , Marc Pollefeys , Martin R. Oswald

This paper presents a method to reconstruct high-quality textured 3D models from both multi-view and single-view images. The reconstruction is posed as an adaptation problem and is done progressively where in the first stage, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Aysegul Dundar , Jun Gao , Andrew Tao , Bryan Catanzaro

Learning-based 3D reconstruction methods have shown impressive results. However, most methods require 3D supervision which is often hard to obtain for real-world datasets. Recently, several works have proposed differentiable rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Michael Niemeyer , Lars Mescheder , Michael Oechsle , Andreas Geiger

We present an efficient method for joint optimization of topology, materials and lighting from multi-view image observations. Unlike recent multi-view reconstruction approaches, which typically produce entangled 3D representations encoded…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jacob Munkberg , Jon Hasselgren , Tianchang Shen , Jun Gao , Wenzheng Chen , Alex Evans , Thomas Müller , Sanja Fidler

Visual localization techniques rely upon some underlying scene representation to localize against. These representations can be explicit such as 3D SFM map or implicit, such as a neural network that learns to encode the scene. The former…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Maxime Pietrantoni , Gabriela Csurka , Martin Humenberger , Torsten Sattler

We consider the problem of estimating an object's physical properties such as mass, friction, and elasticity directly from video sequences. Such a system identification problem is fundamentally ill-posed due to the loss of information…

Today, most methods for image understanding tasks rely on feed-forward neural networks. While this approach has allowed for empirical accuracy, efficiency, and task adaptation via fine-tuning, it also comes with fundamental disadvantages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Julian Ost , Tanushree Banerjee , Mario Bijelic , Felix Heide

Scene recognition, particularly for aerial and underwater images, often suffers from various types of degradation, such as blurring or overexposure. Previous works that focus on convolutional neural networks have been shown to be able to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jianqi Zhang , Mengxuan Wang , Jingyao Wang , Lingyu Si , Changwen Zheng , Fanjiang Xu

While both shape and texture are fundamental to visual recognition, research on deep neural networks (DNNs) has predominantly focused on the latter, leaving their geometric understanding poorly probed. Here, we show: first, that optimized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Jian Wang , Yixing Yong , Haixia Bi , Lijun He , Fan Li