English
Related papers

Related papers: 3D Former: Monocular Scene Reconstruction with 3D …

200 papers

Inferring geometrically consistent dense 3D scenes across a tuple of temporally consecutive images remains challenging for self-supervised monocular depth prediction pipelines. This paper explores how the increasingly popular transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Patrick Ruhkamp , Daoyi Gao , Hanzhi Chen , Nassir Navab , Benjamin Busam

Image restoration has witnessed significant advancements with the development of deep learning models. Transformer-based models, particularly those using window-based self-attention, have become a dominant force. However, their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Gang Wu , Junjun Jiang , Kui Jiang , Xianming Liu , Liqiang Nie

Vision transformers have shown excellent performance in computer vision tasks. As the computation cost of their self-attention mechanism is expensive, recent works tried to replace the self-attention mechanism in vision transformers with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Zimian Wei , Hengyue Pan , Lujun Li , Menglong Lu , Xin Niu , Peijie Dong , Dongsheng Li

Implicit neural networks have emerged as a crucial technology in 3D surface reconstruction. To reconstruct continuous surfaces from discrete point clouds, encoding the input points into regular grid features (plane or volume) has been…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Shengtao Li , Ge Gao , Yudong Liu , Yu-Shen Liu , Ming Gu

We propose octree-based transformers, named OctFormer, for 3D point cloud learning. OctFormer can not only serve as a general and effective backbone for 3D point cloud segmentation and object detection but also have linear complexity and is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Peng-Shuai Wang

Vision transformers have gained popularity recently, leading to the development of new vision backbones with improved features and consistent performance gains. However, these advancements are not solely attributable to novel feature…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Xiaowei Hu , Min Shi , Weiyun Wang , Sitong Wu , Linjie Xing , Wenhai Wang , Xizhou Zhu , Lewei Lu , Jie Zhou , Xiaogang Wang , Yu Qiao , Jifeng Dai

In this paper, we propose a Monocular 3D Single Stage object Detector (M3DSSD) with feature alignment and asymmetric non-local attention. Current anchor-based monocular 3D object detection methods suffer from feature mismatching. To…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Shujie Luo , Hang Dai , Ling Shao , Yong Ding

The structured light (SL)-based three-dimensional (3D) measurement techniques with deep learning have been widely studied to improve measurement efficiency, among which fringe projection profilometry (FPP) and speckle projection…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Mingyang Lei , Jingfan Fan , Long Shao , Hong Song , Deqiang Xiao , Danni Ai , Tianyu Fu , Ying Gu , Jian Yang

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Fuchen Zheng , Xuhang Chen , Weihuang Liu , Haolun Li , Yingtie Lei , Jiahui He , Chi-Man Pun , Shounjun Zhou

High-fidelity 3D scene reconstruction has been substantially advanced by recent progress in neural fields. However, most existing methods train a separate network from scratch for each individual scene. This is not scalable, inefficient,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Yang Fu , Shalini De Mello , Xueting Li , Amey Kulkarni , Jan Kautz , Xiaolong Wang , Sifei Liu

Transformer-based models have revolutionized the field of image super-resolution (SR) by harnessing their inherent ability to capture complex contextual features. The overlapping rectangular shifted window technique used in transformer…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Abhisek Ray , Gaurav Kumar , Maheshkumar H. Kolekar

Recently, Transformer architecture has been introduced into image restoration to replace convolution neural network (CNN) with surprising results. Considering the high computational complexity of Transformer with global attention, some…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zheng Chen , Yulun Zhang , Jinjin Gu , Yongbing Zhang , Linghe Kong , Xin Yuan

Depth estimation from monocular images is a challenging problem in computer vision. In this paper, we tackle this problem using a novel network architecture using multi scale feature fusion. Our network uses two different blocks, first…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Abhinav Sagar

Query-based transformer has shown great potential in constructing long-range attention in many image-domain tasks, but has rarely been considered in LiDAR-based 3D object detection due to the overwhelming size of the point cloud data. In…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Zixiang Zhou , Xiangchen Zhao , Yu Wang , Panqu Wang , Hassan Foroosh

Detection Transformers represent end-to-end object detection approaches based on a Transformer encoder-decoder architecture, exploiting the attention mechanism for global relation modeling. Although Detection Transformers deliver results on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Bastian Wittmann , Fernando Navarro , Suprosanna Shit , Bjoern Menze

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Generating 3D models from multi-view 2D RGB images has gained significant attention, extending the capabilities of technologies like Virtual Reality, Robotic Vision, and human-machine interaction. In this paper, we introduce a hybrid…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ajith Balakrishnan , Sreeja S , Linu Shine

Multi-view counting (MVC) methods have shown their superiority over single-view counterparts, particularly in situations characterized by heavy occlusion and severe perspective distortions. However, hand-crafted heuristic features and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Hong Mo , Xiong Zhang , Jianchao Tan , Cheng Yang , Qiong Gu , Bo Hang , Wenqi Ren

In this paper, we propose a new operator, called 3D DeFormable Attention (DFA3D), for 2D-to-3D feature lifting, which transforms multi-view 2D image features into a unified 3D space for 3D object detection. Existing feature lifting…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Hongyang Li , Hao Zhang , Zhaoyang Zeng , Shilong Liu , Feng Li , Tianhe Ren , Lei Zhang

Reconstructing hand-held objects in 3D from monocular images remains a significant challenge in computer vision. Most existing approaches rely on implicit 3D representations, which produce overly smooth reconstructions and are…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zerui Chen , Rolandos Alexandros Potamias , Shizhe Chen , Cordelia Schmid