English
Related papers

Related papers: Multiview Textured Mesh Recovery by Differentiable…

200 papers

Given a set of calibrated images of a scene, we present an approach that produces a simple, compact, and actionable 3D world representation by means of 3D primitives. While many approaches focus on recovering high-fidelity 3D scenes, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Tom Monnier , Jake Austin , Angjoo Kanazawa , Alexei A. Efros , Mathieu Aubry

Differentiable rendering has been widely adopted in computer graphics as a powerful approach to inverse problems, enabling efficient gradient-based optimization by differentiating the image formation process with respect to millions of…

We present a novel multi-view implicit surface reconstruction technique, termed StreetSurf, that is readily applicable to street view images in widely-used autonomous driving datasets, such as Waymo-perception sequences, without necessarily…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Jianfei Guo , Nianchen Deng , Xinyang Li , Yeqi Bai , Botian Shi , Chiyu Wang , Chenjing Ding , Dongliang Wang , Yikang Li

We present an efficient method for joint optimization of topology, materials and lighting from multi-view image observations. Unlike recent multi-view reconstruction approaches, which typically produce entangled 3D representations encoded…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jacob Munkberg , Jon Hasselgren , Tianchang Shen , Jun Gao , Wenzheng Chen , Alex Evans , Thomas Müller , Sanja Fidler

We propose Pulsar, an efficient sphere-based differentiable renderer that is orders of magnitude faster than competing techniques, modular, and easy-to-use due to its tight integration with PyTorch. Differentiable rendering is the…

Graphics · Computer Science 2020-12-23 Christoph Lassner , Michael Zollhöfer

Precise human mesh recovery (HMR) from multi-view images remains challenging: end-to-end methods produce entangled errors hard to localize, while fitting-based methods rely on sparse keypoints that provide limited surface constraints. We…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Renke Wang , Zhenyu Zhang , Ying Tai , Jun Li , Jian Yang

Given a 3D mesh, we aim to synthesize 3D textures that correspond to arbitrary textual descriptions. Current methods for generating and assembling textures from sampled views often result in prominent seams or excessive smoothing. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Dong Huo , Zixin Guo , Xinxin Zuo , Zhihao Shi , Juwei Lu , Peng Dai , Songcen Xu , Li Cheng , Yee-Hong Yang

Differentiable renderers have been used successfully for unsupervised 3D structure learning from 2D images because they can bridge the gap between 3D and 2D. To optimize 3D shape parameters, current renderers rely on pixel-wise losses…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Zhizhong Han , Chao Chen , Yu-Shen Liu , Matthias Zwicker

Majority of the current dimensionality reduction or retrieval techniques rely on embedding the learned feature representations onto a computable metric space. Once the learned features are mapped, a distance metric aids the bridging of gaps…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Muhammad Kamran Janjua , Shah Nawaz , Alessandro Calefati , Ignazio Gallo

We propose DiMeR, a novel geometry-texture disentangled feed-forward model with 3D supervision for sparse-view mesh reconstruction. Existing methods confront two persistent obstacles: (i) textures can conceal geometric errors, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Lutao Jiang , Jiantao Lin , Kanghao Chen , Wenhang Ge , Xin Yang , Yifan Jiang , Yuanhuiyi Lyu , Xu Zheng , Yinchuan Li , Yingcong Chen

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

We consider the problem of reconstructing an image from compressive measurements using a multi-resolution grid. In this context, the reconstructed image is divided into multiple regions, each one with a different resolution. This problem…

Computer Vision and Pattern Recognition · Computer Science 2016-02-19 Adriana Gonzalez , Hong Jiang , Gang Huang , Laurent Jacques

Due to inevitable noises introduced during scanning and quantization, 3D reconstruction via RGB-D sensors suffers from errors both in geometry and texture, leading to artifacts such as camera drifting, mesh distortion, texture ghosting, and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Jingbo Zhang , Ziyu Wan , Jing Liao

Recovering a textured 3D mesh from a monocular image is highly challenging, particularly for in-the-wild objects that lack 3D ground truths. In this work, we present MeshInversion, a novel framework to improve the reconstruction by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Junzhe Zhang , Daxuan Ren , Zhongang Cai , Chai Kiat Yeo , Bo Dai , Chen Change Loy

Recently, methods for neural surface representation and rendering, for example NeuS, have shown that learning neural implicit surfaces through volume rendering is becoming increasingly popular and making good progress. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hanqi Jiang , Cheng Zeng , Runnan Chen , Shuai Liang , Yinhe Han , Yichao Gao , Conglin Wang

Textured 3D meshes jointly represent geometry, topology, and appearance, yet their irregular structure poses significant challenges for deep-learning-based semantic segmentation. While a few recent methods operate directly on meshes without…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Mohammadreza Heidarianbaei , Max Mehltretter , Franz Rottensteiner

Diffusion MRI (dMRI) is sensitive to microstructural barriers, yet most existing methods either assume impermeable boundaries or estimate voxel-level parameters without recovering explicit interfaces. We present Spinverse, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Prathamesh Pradeep Khole , Mario M. Brenes , Zahra Kais Petiwala , Ehsan Mirafzali , Utkarsh Gupta , Jing-Rebecca Li , Andrada Ianus , Razvan Marinescu

We present a modern solution to the multi-view photometric stereo problem (MVPS). Our work suitably exploits the image formation model in a MVPS experimental setup to recover the dense 3D reconstruction of an object from images. We procure…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Berk Kaya , Suryansh Kumar , Francesco Sarno , Vittorio Ferrari , Luc Van Gool

We propose a novel method to reconstruct the 3D shapes of transparent objects using hand-held captured images under natural light conditions. It combines the advantage of explicit mesh and multi-layer perceptron (MLP) network, a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Jiamin Xu , Zihan Zhu , Hujun Bao , Weiwei Xu

Transforming a thermal infrared image into a robust perceptual colour Visible image is an ill-posed problem due to the differences in their spectral domains and in the objects' representations. Objects appear in one spectrum but not…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Feras Almasri , Olivier Debeir