English
Related papers

Related papers: Depth Field Networks for Generalizable Multi-view …

200 papers

Recent advances in neural scene representations have led to unprecedented quality in 3D reconstruction and view synthesis. Despite achieving high-quality results for common benchmarks with curated data, outputs often degrade for data that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Michael Niemeyer , Fabian Manhardt , Marie-Julie Rakotosaona , Michael Oechsle , Christina Tsalicoglou , Keisuke Tateno , Jonathan T. Barron , Federico Tombari

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

Depth estimation is a fundamental task in 3D computer vision, crucial for applications such as 3D reconstruction, free-viewpoint rendering, robotics, autonomous driving, and AR/VR technologies. Traditional methods relying on hardware…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Zhen Xu , Hongyu Zhou , Sida Peng , Haotong Lin , Haoyu Guo , Jiahao Shao , Peishan Yang , Qinglin Yang , Sheng Miao , Xingyi He , Yifan Wang , Yue Wang , Ruizhen Hu , Yiyi Liao , Xiaowei Zhou , Hujun Bao

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski

Recent works on implicit neural representations have shown promising results for multi-view surface reconstruction. However, most approaches are limited to relatively simple geometries and usually require clean object masks for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jingyang Zhang , Yao Yao , Long Quan

Reconstructing 3D human heads in low-view settings presents technical challenges, mainly due to the pronounced risk of overfitting with limited views and high-frequency signals. To address this, we propose geometry decomposition and adopt a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Baixin Xu , Jiarui Zhang , Kwan-Yee Lin , Chen Qian , Ying He

Realistic speech-driven 3D facial animation is a challenging problem due to the complex relationship between speech and face. In this paper, we propose a deep architecture, called Geometry-guided Dense Perspective Network (GDPnet), to…

Graphics · Computer Science 2020-08-25 Jingying Liu , Binyuan Hui , Kun Li , Yunke Liu , Yu-Kun Lai , Yuxiang Zhang , Yebin Liu , Jingyu Yang

In this work, we aim to address the 3D scene stylization problem - generating stylized images of the scene at arbitrary novel view angles. A straightforward solution is to combine existing novel view synthesis and image/video style transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Pei-Ze Chiang , Meng-Shiun Tsai , Hung-Yu Tseng , Wei-sheng Lai , Wei-Chen Chiu

Combining the signed distance function (SDF) and differentiable volume rendering has emerged as a powerful paradigm for surface reconstruction from multi-view images without 3D supervision. However, current methods are impeded by requiring…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rui Peng , Xiaodong Gu , Luyang Tang , Shihe Shen , Fanqi Yu , Ronggang Wang

Many image processing tasks involve image-to-image mapping, which can be addressed well by fully convolutional networks (FCN) without any heavy preprocessing. Although empirically designing and training FCNs can achieve satisfactory…

Machine Learning · Computer Science 2019-01-25 Jianjie Lu , Kai-yu Tong

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

Recent advances in implicit scene representation enable high-fidelity street view novel view synthesis. However, existing methods optimize a neural radiance field for each scene, relying heavily on dense training images and extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Sheng Miao , Jiaxin Huang , Dongfeng Bai , Weichao Qiu , Bingbing Liu , Andreas Geiger , Yiyi Liao

Implicit neural representation has demonstrated promising results in 3D reconstruction on various scenes. However, existing approaches either struggle to model fast-moving objects or are incapable of handling large-scale camera ego-motions…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Tianchen Deng , Yanbo Wang , Yejia Liu , Chenpeng Su , Jingchuan Wang , Danwei Wang , Shao-Yuan Lo , Weidong Chen

We propose a novel Deformed Implicit Field (DIF) representation for modeling 3D shapes of a category and generating dense correspondences among shapes. With DIF, a 3D shape is represented by a template implicit field shared across the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Yu Deng , Jiaolong Yang , Xin Tong

Though a large body of computer vision research has investigated developing generic semantic representations, efforts towards developing a similar representation for 3D has been limited. In this paper, we learn a generic 3D representation…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Amir R. Zamir , Tilman Wekel , Pulkit Argrawal , Colin Weil , Jitendra Malik , Silvio Savarese

3D Gaussians have recently emerged as an effective scene representation for real-time splatting and accurate novel-view synthesis, motivating several works to adapt multi-view structure prediction networks to regress per-pixel 3D Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Mehdi Hosseinzadeh , Shin-Fang Chng , Yi Xu , Simon Lucey , Ian Reid , Ravi Garg

Recovery of a 3D head model including the complete face and hair regions is still a challenging problem in computer vision and graphics. In this paper, we consider this problem using only a few multi-view portrait images as input. Previous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xueying Wang , Yudong Guo , Zhongqi Yang , Juyong Zhang

As overparameterized models become increasingly prevalent, training loss alone offers limited insight into generalization performance. While smoothness has been linked to improved generalization across various settings, directly enforcing…

Machine Learning · Computer Science 2025-09-30 Yifan Hao , Yanxin Lu , Hanning Zhang , Xinwei Shen , Tong Zhang

Modern digital engineering design process commonly involves expensive repeated simulations on varying three-dimensional (3D) geometries. The efficient prediction capability of neural networks (NNs) makes them a suitable surrogate to provide…

Computational Engineering, Finance, and Science · Computer Science 2024-06-17 Junyan He , Seid Koric , Diab Abueidda , Ali Najafi , Iwona Jasiuk

Deep Neural Networks achieve state-of-the-art results in many different problem settings by exploiting vast amounts of training data. However, collecting, storing and - in the case of supervised learning - labelling the data is expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Matthias Rath , Alexandru Paul Condurache