English
Related papers

Related papers: Boost 3D Reconstruction using Diffusion-based Mono…

200 papers

Portrait customization (PC) has recently garnered significant attention due to its potential applications. However, existing PC methods lack precise identity (ID) preservation and face control. To address these tissues, we propose Diff-PC,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yifang Xu , Benxiang Zhai , Chenyu Zhang , Ming Li , Yang Li , Sidan Du

Depth estimation is a foundational component for 3D reconstruction in minimally invasive endoscopic surgeries. However, existing monocular depth estimation techniques often exhibit limited performance to the varying illumination and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xinning Yao , Bo Liu , Bojian Li , Jingjing Wang , Jinghua Yue , Fugen Zhou

Scene flow is the dense 3D reconstruction of motion and geometry of a scene. Most state-of-the-art methods use a pair of stereo images as input for full scene reconstruction. These methods depend a lot on the quality of the RGB images and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Rishav , Ramy Battrawy , René Schuster , Oliver Wasenmüller , Didier Stricker

Monocular depth estimation from RGB images plays a pivotal role in 3D vision. However, its accuracy can deteriorate in challenging environments such as nighttime or adverse weather conditions. While long-wave infrared cameras offer stable…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jialei Xu , Xianming Liu , Junjun Jiang , Kui Jiang , Rui Li , Kai Cheng , Xiangyang Ji

Current traditional methods for LiDAR-camera extrinsics estimation depend on offline targets and human efforts, while learning-based approaches resort to iterative refinement for calibration results, posing constraints on their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shuang Xu , Sifan Zhou , Zhi Tian , Jizhou Ma , Qiong Nie , Xiangxiang Chu

The integration of multiple cameras and 3D Li- DARs has become basic configuration of augmented reality devices, robotics, and autonomous vehicles. The calibration of multi-modal sensors is crucial for a system to properly function, but it…

Robotics · Computer Science 2021-07-13 Chuan Fang , Shuai Ding , Zilong Dong , Honghua Li , Siyu Zhu , Ping Tan

Despite advances in neural rendering, due to the scarcity of high-quality 3D datasets and the inherent limitations of multi-view diffusion models, view synthesis and 3D model generation are restricted to low resolutions with suboptimal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Yihang Luo , Shangchen Zhou , Yushi Lan , Xingang Pan , Chen Change Loy

Computer vision techniques play a central role in the perception stack of autonomous vehicles. Such methods are employed to perceive the vehicle surroundings given sensor data. 3D LiDAR sensors are commonly used to collect sparse 3D point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Lucas Nunes , Rodrigo Marcuzzi , Benedikt Mersch , Jens Behley , Cyrill Stachniss

While deep neural networks (NN) significantly advance image compressed sensing (CS) by improving reconstruction quality, the necessity of training current CS NNs from scratch constrains their effectiveness and hampers rapid deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Chen , Zhenyu Zhang , Weiqi Li , Chen Zhao , Jiwen Yu , Shijie Zhao , Jie Chen , Jian Zhang

Deep learning-based 3D imaging, in particular magnetic resonance imaging (MRI), is challenging because of limited availability of 3D training data. Therefore, 2D diffusion models trained on 2D slices are starting to be leveraged for 3D MRI…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Anselm Krainovic , Stefan Ruschke , Reinhard Heckel

We introduce a novel framework for metric depth estimation that enhances pretrained diffusion-based monocular depth estimation (DB-MDE) models with stereo vision guidance. While existing DB-MDE methods excel at predicting relative depth,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tuan Pham , Thanh-Tung Le , Xiaohui Xie , Stephan Mandt

Sensor setups of robotic platforms commonly include both camera and LiDAR as they provide complementary information. However, fusing these two modalities typically requires a highly accurate calibration between them. In this paper, we…

Solving the challenging problem of 3D object reconstruction from a single image appropriately gives existing technologies the ability to perform with a single monocular camera rather than requiring depth sensors. In recent years, thanks to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Guiju Ping , Mahdi Abolfazli Esfahani , Han Wang

Multi-turn compositional image generation (M-CIG) is a challenging task that aims to iteratively manipulate a reference image given a modification text. While most of the existing methods for M-CIG are based on generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Chao Wang

Color plays an important role in human visual perception, reflecting the spectrum of objects. However, the existing infrared and visible image fusion methods rarely explore how to handle multi-spectral/channel data directly and achieve high…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Jun Yue , Leyuan Fang , Shaobo Xia , Yue Deng , Jiayi Ma

Scene flow estimation is an extremely important task in computer vision to support the perception of dynamic changes in the scene. For robust scene flow, learning-based approaches have recently achieved impressive results using either…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Rajai Alhimdiat , Ramy Battrawy , René Schuster , Didier Stricker , Wesam Ashour

Snapshot multi-dimensional imaging offers a promising alternative to traditional low-dimensional imaging techniques by enabling the simultaneous capture of spatial, spectral, polarization, and other information in a single shot for improved…

Monocular 3D human pose estimation (HPE) often encounters challenges such as depth ambiguity and occlusion during the 2D-to-3D lifting process. Additionally, traditional methods may overlook multi-scale skeleton features when utilizing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Bing Han , Yuhua Huang , Pan Gao

Manipulating transparent objects presents significant challenges due to the complexities introduced by their reflection and refraction properties, which considerably hinder the accurate estimation of their 3D shapes. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Haoxiao Wang , Kaichen Zhou , Binrui Gu , Zhiyuan Feng , Weijie Wang , Peilin Sun , Yicheng Xiao , Jianhua Zhang , Hao Dong

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang