English
Related papers

Related papers: Hierarchical Cross-modal Transformer for RGB-D Sal…

200 papers

Salient object detection is the pixel-level dense prediction task which can highlight the prominent object in the scene. Recently U-Net framework is widely used, and continuous convolution and pooling operations generate multi-level…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Zhengyi Liu , Yuan Wang , Zhengzheng Tu , Yun Xiao , Bin Tang

The multi-modal salient object detection model based on RGB-D information has better robustness in the real world. However, it remains nontrivial to better adaptively balance effective multi-modal information in the feature fusion phase. In…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Jinchao Zhu , Xiaoyu Zhang , Xian Fang , Feng Dong , Qiu Yu

There are two main issues in RGB-D salient object detection: (1) how to effectively integrate the complementarity from the cross-modal RGB-D data; (2) how to prevent the contamination effect from the unreliable depth map. In fact, these two…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Zuyao Chen , Runmin Cong , Qianqian Xu , Qingming Huang

We present an advanced study on more challenging high-resolution salient object detection (HRSOD) from both dataset and network framework perspectives. To compensate for the lack of HRSOD dataset, we thoughtfully collect a large-scale high…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Changqun Xia , Chenxi Xie , Zhentao He , Tianshu Yu , Jia Li

This paper delves into the task of arbitrary modality salient object detection (AM SOD), aiming to detect salient objects from arbitrary modalities, eg RGB images, RGB-D images, and RGB-D-T images. A novel modality-adaptive Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Nianchang Huang , Yang Yang , Qiang Zhang , Jungong Han , Jin Huang

RGB-T salient object detection (SOD) aims to segment attractive objects by combining RGB and thermal infrared images. To enhance performance, the Segment Anything Model has been fine-tuned for this task. However, the imbalance convergence…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Zhengyi Liu , Xinrui Wang , Xianyong Fang , Zhengzheng Tu , Linbo Wang

Recent progress on salient object detection mainly aims at exploiting how to effectively integrate convolutional side-output features in convolutional neural networks (CNN). Based on this, most of the existing state-of-the-art saliency…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yun Liu , Yu Qiu , Le Zhang , JiaWang Bian , Guang-Yu Nie , Ming-Ming Cheng

Fusing multiple modalities has proven effective for multimodal information processing. However, the incongruity between modalities poses a challenge for multimodal fusion, especially in affect recognition. In this study, we first analyze…

Computation and Language · Computer Science 2023-11-14 Yaoting Wang , Yuanchao Li , Paul Pu Liang , Louis-Philippe Morency , Peter Bell , Catherine Lai

Depth maps contain geometric clues for assisting Salient Object Detection (SOD). In this paper, we propose a novel Cross-Modal Weighting (CMW) strategy to encourage comprehensive interactions between RGB and depth channels for RGB-D SOD.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Gongyang Li , Zhi Liu , Linwei Ye , Yang Wang , Haibin Ling

Salient object detection (SOD) in remote sensing images faces significant challenges due to large variations in object sizes, the computational cost of self-attention mechanisms, and the limitations of CNN-based extractors in capturing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Bin Wan , Runmin Cong , Xiaofei Zhou , Hao Fang , Yaoqi Sun , Sam Kwong

Salient object detection (SOD) on RGB and depth images has attracted more and more research interests, due to its effectiveness and the fact that depth cues can now be conveniently captured. Existing RGB-D SOD models usually adopt different…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Tao Zhou , Deng-Ping Fan , Geng Chen , Yi Zhou , Huazhu Fu

Salient object detection requires a comprehensive and scalable receptive field to locate the visually significant objects in the image. Recently, the emergence of visual transformers and multi-branch modules has significantly enhanced the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Mingcan Ma , Changqun Xia , Chenxi Xie , Xiaowu Chen , Jia Li

RGB-T saliency detection has emerged as an important computer vision task, identifying conspicuous objects in challenging scenes such as dark environments. However, existing methods neglect the characteristics of cross-modal features and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Guangyu Ren , Jitesh Joshi , Youngjun Cho

Most existing lightweight RGB-D salient object detection (SOD) models are based on two-stream structure or single-stream structure. The former one first uses two sub-networks to extract unimodal features from RGB and depth images,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Nianchang Huang , Qiang Zhang , Jungong Han

Numerous efforts have been made to design different low level saliency cues for the RGBD saliency detection, such as color or depth contrast features, background and color compactness priors. However, how these saliency cues interact with…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Liangqiong Qu , Shengfeng He , Jiawei Zhang , Jiandong Tian , Yandong Tang , Qingxiong Yang

Salient Object Detection (SOD) plays a crucial role in many computer vision applications, requiring accurate localization and precise boundary delineation of salient regions. In this work, we present a novel framework that integrates…

Machine Learning · Computer Science 2025-09-30 Abhinav Sagar

In autonomous driving, LiDAR point-clouds and RGB images are two major data modalities with complementary cues for 3D object detection. However, it is quite difficult to sufficiently use them, due to large inter-modal discrepancies. To…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yanan Zhang , Jiaxin Chen , Di Huang

In this paper, we present a Hybrid Spectral Denoising Transformer (HSDT) for hyperspectral image denoising. Challenges in adapting transformer for HSI arise from the capabilities to tackle existing limitations of CNN-based methods in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zeqiang Lai , Chenggang Yan , Ying Fu

Multimodal object detection leverages diverse modal information to enhance the accuracy and robustness of detectors. By learning long-term dependencies, Transformer can effectively integrate multimodal features in the feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Shuhan Dong , Yunsong Li , Weiying Xie , Jiaqing Zhang , Jiayuan Tian , Danian Yang , Jie Lei

In view of the problems that existing salient object detection (SOD) methods are prone to losing details, blurring edges, and insufficient fusion of single-modal information in complex scenes, this paper proposes a dynamic uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuqi Xiong , Wuzhen Shi , Yang Wen , Ruhan Liu