中文
相关论文

相关论文: 3D Former: Monocular Scene Reconstruction with 3D …

200 篇论文

3D scene reconstruction is essential for applications in virtual reality, robotics, and autonomous driving, enabling machines to understand and interact with complex environments. Traditional 3D Gaussian Splatting techniques rely on images…

图形学 · 计算机科学 2025-03-04 Changlin Song , Jiaqi Wang , Liyun Zhu , He Weng

State-of-the-art neural implicit surface representations have achieved impressive results in indoor scene reconstruction by incorporating monocular geometric priors as additional supervision. However, we have observed that multi-view…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Ziyi Chen , Xiaolong Wu , Yu Zhang

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atypical convolutional…

计算机视觉与模式识别 · 计算机科学 2022-02-07 Hong-Yu Zhou , Jiansen Guo , Yinghao Zhang , Lequan Yu , Liansheng Wang , Yizhou Yu

Incrementally recovering 3D dense structures from monocular videos is of paramount importance since it enables various robotics and AR applications. Feature volumes have recently been shown to enable efficient and accurate incremental dense…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Xingxing Zuo , Nan Yang , Nathaniel Merrill , Binbin Xu , Stefan Leutenegger

Transformers have shown dominant performance across a range of domains including language and vision. However, their computational cost grows quadratically with the sequence length, making their usage prohibitive for resource-constrained…

计算与语言 · 计算机科学 2023-10-24 Yinghan Long , Sayeed Shafayet Chowdhury , Kaushik Roy

Dense depth completion is essential for autonomous systems and 3D reconstruction. In this paper, a lightweight yet efficient network (S\&CNet) is proposed to obtain a good trade-off between efficiency and accuracy for the dense depth…

图像与视频处理 · 电气工程与系统科学 2019-08-30 Lei Zhang , Weihai Chen , Chao Hu , Xingming Wu , Zhengguo Li

Recently, transformer-based methods have shown exceptional performance in monocular 3D object detection, which can predict 3D attributes from a single 2D image. These methods typically use visual and depth representations to generate query…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Xuan He , Jin Yuan , Kailun Yang , Zhenchao Zeng , Zhiyong Li

Deep learning applied to the reconstruction of 3D shapes has seen growing interest. A popular approach to 3D reconstruction and generation in recent years has been the CNN encoder-decoder model usually applied in voxel space. However, this…

计算机视觉与模式识别 · 计算机科学 2020-05-12 Mateusz Michalkiewicz , Eugene Belilovsky , Mahsa Baktashmotlagh , Anders Eriksson

We present a novel real-time capable learning method that jointly perceives a 3D scene's geometry structure and semantic labels. Recent approaches to real-time 3D scene reconstruction mostly adopt a volumetric scheme, where a Truncated…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Ziyang Hong , C. Patrick Yue

Most modern deep learning-based multi-view 3D reconstruction techniques use RNNs or fusion modules to combine information from multiple images after independently encoding them. These two separate steps have loose connections and do not…

计算机视觉与模式识别 · 计算机科学 2022-07-11 Farid Yagubbayli , Yida Wang , Alessio Tonioni , Federico Tombari

Until now, it has been difficult for volumetric super-resolution to utilize the recent advances in transformer-based models seen in 2D super-resolution. The memory required for self-attention in 3D volumes limits the receptive field.…

计算机视觉与模式识别 · 计算机科学 2024-12-10 August Leander Høeg , Sophia W. Bardenfleth , Hans Martin Kjer , Tim B. Dyrby , Vedrana Andersen Dahl , Anders Dahl

Recently, the transformer model has been successfully employed for the multi-view 3D reconstruction problem. However, challenges remain on designing an attention mechanism to explore the multiview features and exploit their relations for…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Leslie Ching Ow Tiong , Dick Sigmund , Andrew Beng Jin Teoh

Surface reconstruction from raw point clouds has been studied for decades in the computer graphics community, which is highly demanded by modeling and rendering applications nowadays. Classic solutions, such as Poisson surface…

图形学 · 计算机科学 2023-10-11 Hui Tian , Zheng Qin , Renjiao Yi , Chenyang Zhu , Kai Xu

3D reconstruction from a single 2D image was extensively covered in the literature but relies on depth supervision at training time, which limits its applicability. To relax the dependence to depth we propose SceneRF, a self-supervised…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Anh-Quan Cao , Raoul de Charette

3D occupancy, an advanced perception technology for driving scenarios, represents the entire scene without distinguishing between foreground and background by quantifying the physical space into a grid map. The widely adopted…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Jinke Li , Xiao He , Chonghua Zhou , Xiaoqiang Cheng , Yang Wen , Dan Zhang

Self-supervised monocular depth estimation has emerged as a promising approach since it does not rely on labeled training data. Most methods combine convolution and Transformer to model long-distance dependencies to estimate depth…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Xuezhi Xiang , Yao Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

While transformers have shown great potential on video recognition with their strong capability of capturing long-range dependencies, they often suffer high computational costs induced by the self-attention to the huge number of 3D tokens.…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Yuxuan Liang , Pan Zhou , Roger Zimmermann , Shuicheng Yan

Extracting features from a huge amount of data for object recognition is a challenging task. Convolution neural network can be used to meet the challenge, but it often requires a large number of computation resources. In this paper, a…

图像与视频处理 · 电气工程与系统科学 2018-05-08 Yunlong Ma , Chunyan Wang

The advent of autonomous driving and advanced driver assistance systems necessitates continuous developments in computer vision for 3D scene understanding. Self-supervised monocular depth estimation, a method for pixel-wise distance…

计算机视觉与模式识别 · 计算机科学 2023-02-03 Arnav Varma , Hemang Chawla , Bahram Zonooz , Elahe Arani

Indoor monocular semantic scene completion (MSSC) is notably more challenging than its outdoor counterpart due to complex spatial layouts and severe occlusions. While transformers are well suited for modeling global dependencies, their high…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Xuzhi Wang , Xinran Wu , Song Wang , Lingdong Kong , Ziping Zhao