English
Related papers

Related papers: Depthformer : Multiscale Vision Transformer For Mo…

200 papers

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Jian Qian , Miao Sun , Ashley Lee , Jie Li , Shenglong Zhuo , Patrick Yin Chiang

Since context modeling is critical for estimating depth from a single image, researchers put tremendous effort into obtaining global context. Many global manipulations are designed for traditional CNN-based architectures to overcome the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Chang Shu , Ziming Chen , Lei Chen , Kuan Ma , Minghui Wang , Haibing Ren

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

Monocular depth estimation is an ongoing challenge in computer vision. Recent progress with Transformer models has demonstrated notable advantages over conventional CNNs in this area. However, there's still a gap in understanding how these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Jiawei Yao , Tong Wu , Xiaofeng Zhang

Depth estimation from monocular images is a challenging problem in computer vision. In this paper, we tackle this problem using a novel network architecture using multi scale feature fusion. Our network uses two different blocks, first…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Abhinav Sagar

In this work, we present Multiformer, a novel approach to depth-aware video panoptic segmentation (DVPS) based on the mask transformer paradigm. Our method learns object representations that are shared across segmentation, monocular depth…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Kurt H. W. Stolle

Recently, the performance of monocular depth estimation (MDE) has been significantly boosted with the integration of transformer models. However, the transformer models are usually computationally-expensive, and their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zhimeng Zheng , Tao Huang , Gongsheng Li , Zuyi Wang

Depth estimation plays a pivotal role in advancing human-robot interactions, especially in indoor environments where accurate 3D scene reconstruction is essential for tasks like navigation and object handling. Monocular depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Siddiqui Muhammad Yasir , Hyunsik Ahn

Monocular depth estimation is very challenging because clues to the exact depth are incomplete in a single RGB image. To overcome the limitation, deep neural networks rely on various visual hints such as size, shade, and texture extracted…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Kyuhong Shim , Jiyoung Kim , Gusang Lee , Byonghyo Shim

Monocular Depth Estimation (MDE) is a fundamental computer vision task with important applications in 3D vision. The current mainstream MDE methods employ an encoder-decoder architecture with multi-level/scale feature processing. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Huibin Bai , Shuai Li , Hanxiao Zhai , Yanbo Gao , Chong Lv , Yibo Wang , Haipeng Ping , Wei Hua , Xingyu Gao

Monocular depth estimation (MDE) has widely applicable but remains highly challenging due to the inherently ill-posed nature of reconstructing 3D scenes from single 2D images. Modern Vision Foundation Models (VFMs), pre-trained on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Gongshu Wang , Zhirui Wang , Kan Yang

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

In this paper, we propose an encoder-decoder neural architecture (called Channelformer) to achieve improved channel estimation for orthogonal frequency-division multiplexing (OFDM) waveforms in downlink scenarios. The self-attention…

Signal Processing · Electrical Eng. & Systems 2023-02-10 Dianxin Luan , John Thompson

Transformer-based models have been achieving state-of-the-art results in several fields of Natural Language Processing. However, its direct application to speech tasks is not trivial. The nature of this sequences carries problems such as…

Computation and Language · Computer Science 2022-05-17 Gerard Sant , Gerard I. Gállego , Belen Alastruey , Marta R. Costa-Jussà

Despite the widespread adoption of transformers in medical applications, the exploration of multi-scale learning through transformers remains limited, while hierarchical representations are considered advantageous for computer-aided medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xiaoya Tang , Bodong Zhang , Man Minh Ho , Beatrice S. Knudsen , Tolga Tasdizen

Magnetic resonance imaging (MRI) is critically important for brain mapping in both scientific research and clinical studies. Precise segmentation of brain tumors facilitates clinical diagnosis, evaluations, and surgical planning. Deep…

Image and Video Processing · Electrical Eng. & Systems 2023-05-01 Rui Nian , Guoyao Zhang , Yao Sui , Yuqi Qian , Qiuying Li , Mingzhang Zhao , Jianhui Li , Ali Gholipour , Simon K. Warfield

In this paper, we propose a Bidirectional Attention Network (BANet), an end-to-end framework for monocular depth estimation (MDE) that addresses the limitation of effectively integrating local and global information in convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Shubhra Aich , Jean Marie Uwabeza Vianney , Md Amirul Islam , Mannat Kaur , Bingbing Liu

Recent advances in end-to-end unsupervised learning has significantly improved the performance of monocular depth prediction and alleviated the requirement of ground truth depth. Although a plethora of work has been done in enforcing…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Vinay Kaushik , Brejesh Lall

Transformers have recently gained increasing attention in computer vision. However, existing studies mostly use Transformers for feature representation learning, e.g. for image classification and dense predictions, and the generalizability…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Shengcai Liao , Ling Shao

Vision transformers have been applied successfully for image recognition tasks. There have been either multi-headed self-attention based (ViT \cite{dosovitskiy2020image}, DeIT, \cite{touvron2021training}) similar to the original work in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Badri N. Patro , Vinay P. Namboodiri , Vijay Srinivas Agneeswaran