English
Related papers

Related papers: Adaptive Multi-Scale Channel-Spatial Attention Agg…

200 papers

Multi-modal unsupervised domain adaptation (MM-UDA) for 3D semantic segmentation is a practical solution to embed semantic understanding in autonomous systems without expensive point-wise annotations. While previous MM-UDA methods can…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Haozhi Cao , Yuecong Xu , Jianfei Yang , Pengyu Yin , Shenghai Yuan , Lihua Xie

The quadratic computational complexity of MultiHead SelfAttention (MHSA) remains a fundamental bottleneck in scaling Large Language Models (LLMs) for longcontext tasks. While sparse and linearized attention mechanisms attempt to mitigate…

Computation and Language · Computer Science 2025-12-19 Caner Erden

The rise of highly convincing synthetic speech poses a growing threat to audio communications. Although existing Audio Deepfake Detection (ADD) methods have demonstrated good performance under clean conditions, their effectiveness drops…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-05 Haohan Shi , Xiyu Shi , Safak Dogan , Tianjin Huang , Yunxiao Zhang

Semantic segmentation is a fundamental task in computer vision that involves dense pixel-wise classification for scene understanding. Despite significant progress, achieving high accuracy while maintaining real-time performance remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Abhinav Sagar

The demand for lightweight models in image classification tasks under resource-constrained environments necessitates a balance between computational efficiency and robust feature representation. Traditional attention mechanisms, despite…

Machine Learning · Computer Science 2025-04-21 Zhenkai Qin , Feng Zhu , Huan Zeng , Xunyi Nong

Self-supervised learning of depth has been a highly studied topic of research as it alleviates the requirement of having ground truth annotations for predicting depth. Depth is learnt as an intermediate solution to the task of view…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Vinay Kaushik , Kartik Jindgar , Brejesh Lall

Monocular depth estimation plays a crucial role in 3D recognition and understanding. One key limitation of existing approaches lies in their lack of structural information exploitation, which leads to inaccurate spatial layout,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Tian Chen , Shijie An , Yuan Zhang , Chongyang Ma , Huayan Wang , Xiaoyan Guo , Wen Zheng

Accurate medical image segmentation requires effective modeling of both long-range dependencies and fine-grained boundary details. While transformers mitigate the issue of insufficient semantic information arising from the limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yanxin Li , Hui Wan , Libin Lan

The design choices in the Transformer attention mechanism, including weak inductive bias and quadratic computational complexity, have limited its application for modeling long sequences. In this paper, we introduce Mega, a simple,…

Machine Learning · Computer Science 2023-01-31 Xuezhe Ma , Chunting Zhou , Xiang Kong , Junxian He , Liangke Gui , Graham Neubig , Jonathan May , Luke Zettlemoyer

Monocular simultaneous localization and mapping (SLAM) is emerging in advanced driver assistance systems and autonomous driving, because a single camera is cheap and easy to install. Conventional monocular SLAM has two major challenges…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Jinkyu Lee , Muhyun Back , Sung Soo Hwang , Il Yong Chun

Two factors have proven to be very important to the performance of semantic segmentation models: global context and multi-level semantics. However, generating features that capture both factors always leads to high computational complexity,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Qi Song , Kangfu Mei , Rui Huang

Monocular 3D object detection aims to predict the object location, dimension and orientation in 3D space alongside the object category given only a monocular image. It poses a great challenge due to its ill-posed property which is…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Zheyuan Zhou , Liang Du , Xiaoqing Ye , Zhikang Zou , Xiao Tan , Li Zhang , Xiangyang Xue , Jianfeng Feng

Attention models have recently emerged as a powerful approach, demonstrating significant progress in various fields. Visualization techniques, such as class activation mapping, provide visual insights into the reasoning of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Ali Caglayan , Nevrez Imamoglu , Oguzhan Guclu , Ali Osman Serhatoglu , Ahmet Burak Can , Ryosuke Nakamura

The 3D scene understanding is mainly considered as a crucial requirement in computer vision and robotics applications. One of the high-level tasks in 3D scene understanding is semantic segmentation of RGB-Depth images. With the availability…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Fahimeh Fooladgar , Shohreh Kasaei

The task of 3D semantic scene completion using monocular cameras is gaining significant attention in the field of autonomous driving. This task aims to predict the occupancy status and semantic labels of each voxel in a 3D scene from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jiawei Yao , Jusheng Zhang , Xiaochao Pan , Tong Wu , Canran Xiao

Transformers have improved the state-of-the-art across numerous tasks in sequence modeling. Besides the quadratic computational and memory complexity w.r.t the sequence length, the self-attention mechanism only processes information at the…

Machine Learning · Computer Science 2021-08-12 Yao Zhang , Yunpu Ma , Thomas Seidl , Volker Tresp

The diversity of retinal imaging devices poses a significant challenge: domain shift, which leads to performance degradation when applying the deep learning models trained on one domain to new testing domains. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-10-07 Peng Liu , Charlie T. Tran , Bin Kong , Ruogu Fang

The bundle of geometry and appearance in computer vision has proven to be a promising solution for robots across a wide variety of applications. Stereo cameras and RGB-D sensors are widely used to realise fast 3D reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Xuanpeng Li , Rachid Belaroussi

3D semantic occupancy prediction is a pivotal task in autonomous driving, providing a dense and fine-grained understanding of the surrounding environment, yet single-modality methods face trade-offs between camera semantics and LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 A. Enes Doruk , Hasan F. Ates

Detecting and localizing glass in 3D environments poses significant challenges for visual perception systems, as the optical properties of glass often hinder conventional sensors from accurately distinguishing glass surfaces. The lack of…

Robotics · Computer Science 2025-09-09 Kai Zhang , Guoyang Zhao , Jianxing Shi , Bonan Liu , Weiqing Qi , Jun Ma