English
Related papers

Related papers: Modality Prompts for Arbitrary Modality Salient Ob…

200 papers

Multi-modal object Re-IDentification (ReID) aims to obtain complete identity features across heterogeneous modalities. However, most existing methods rely on implicit feature fusion modules, making it difficult to model fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Shihao Li , Huaibo Huang , Junxian Duan , Aihua Zheng , Jin Tang , Jixin Ma

Recently segment anything model (SAM) has attracted widespread concerns, and it is often treated as a vision foundation model for universal segmentation. Some researchers have attempted to directly apply the foundation model to the RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jia Lin , Xiaofei Zhou , Jiyuan Liu , Runmin Cong , Guodao Zhang , Zhi Liu , Jiyong Zhang

The flourishing success of Deep Neural Networks(DNNs) on RGB-input perception tasks has opened unbounded possibilities for non-RGB-input perception tasks, such as object detection from wireless signals, lidar scans, and infrared images.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yutian Lei , Jun Liu , Dong Huang

Developing a new Salient Object Detection (SOD) model involves selecting an ImageNet pre-trained backbone and creating novel feature refinement modules to use backbone features. However, adding new components to a pre-trained backbone needs…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Rohit Venkata Sai Dulam , Chandra Kambhamettu

Anomaly detection in complex industrial processes plays a pivotal role in ensuring efficient, stable, and secure operation. Existing anomaly detection methods primarily focus on analyzing dominant anomalies using the process variables (such…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Gaochang Wu , Yapeng Zhang , Lan Deng , Jingxin Zhang , Tianyou Chai

RGB-Thermal Salient Object Detection aims to pinpoint prominent objects within aligned pairs of visible and thermal infrared images. Traditional encoder-decoder architectures, while designed for cross-modality feature interactions, may not…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hao Tang , Zechao Li , Dong Zhang , Shengfeng He , Jinhui Tang

Improving the performance of semantic segmentation models using multispectral information is crucial, especially for environments with low-light and adverse conditions. Multi-modal fusion techniques pursue either the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Aniruddh Sikdar , Jayant Teotia , Suresh Sundaram

The availability of handy multi-modal (i.e., RGB-D) sensors has brought about a surge of face anti-spoofing research. However, the current multi-modal face presentation attack detection (PAD) has two defects: (1) The framework based on…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Ajian Liu , Zichang Tan , Zitong Yu , Chenxu Zhao , Jun Wan , Yanyan Liang , Zhen Lei , Du Zhang , Stan Z. Li , Guodong Guo

Salient object detection (SOD) and camouflaged object detection (COD) are related yet distinct binary mapping tasks. These tasks involve multiple modalities, sharing commonalities and unique cues. Existing research often employs intricate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Ziyang Luo , Nian Liu , Wangbo Zhao , Xuguang Yang , Dingwen Zhang , Deng-Ping Fan , Fahad Khan , Junwei Han

Multispectral pedestrian detection is capable of adapting to insufficient illumination conditions by leveraging color-thermal modalities. On the other hand, it is still lacking of in-depth insights on how to fuse the two modalities…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Kailai Zhou , Linsen Chen , Xun Cao

Accurate 3D object detection for autonomous driving requires complementary sensors. Cameras provide dense semantics but unreliable depth, while millimeter-wave radar offers precise range and velocity measurements with sparse geometry. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mayank Mayank , Bharanidhar Duraisamy , Florian Geiß , Abhinav Valada

Existing RGB-thermal salient object detection (RGB-T SOD) methods aim to identify visually significant objects by leveraging both RGB and thermal modalities to enable robust performance in complex scenarios, but they often suffer from…

Multimedia · Computer Science 2025-04-09 Xingyuan Li , Ruichao Hou , Tongwei Ren , Gangshan Wu

An important paradigm in 3D object detection is the use of multiple modalities to enhance accuracy in both normal and challenging conditions, particularly for long-tail scenarios. To address this, recent studies have explored two directions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Minkyoung Cho , Yulong Cao , Jiachen Sun , Qingzhao Zhang , Marco Pavone , Jeong Joon Park , Heng Yang , Z. Morley Mao

In this paper, we present a weakly-supervised RGB-D salient object detection model via scribble supervision. Specifically, as a multimodal learning task, we focus on effective multimodal representation learning via inter-modal mutual…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Aixuan Li , Yuxin Mao , Jing Zhang , Yuchao Dai

Prompt tuning, like CoOp, has recently shown promising vision recognizing and transfer learning ability on various downstream tasks with the emergence of large pre-trained vision-language models like CLIP. However, we identify that existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yongzhu Miao , Shasha Li , Jintao Tang , Ting Wang

Traditional systems typically require different models for processing different modalities, such as one model for RGB images and another for depth images. Recent research has demonstrated that a single model for one modality can be adapted…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Xiaoke Shen , Ioannis Stamos

Co-salient Object Detection (CoSOD) aims to segment salient objects that consistently appear across a group of related images. Despite the notable progress achieved by recent training-based approaches, they still remain constrained by the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Zhijin He , Shuo Jin , Siyue Yu , Shuwei Wu , Bingfeng Zhang , Li Yu , Jimin Xiao

The advent of morphing attacks has posed significant security concerns for automated Face Recognition systems, raising the pressing need for robust and effective Morphing Attack Detection (MAD) methods able to effectively address this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Nicolò Di Domenico , Guido Borghi , Annalisa Franco , Davide Maltoni

For the video salient object detection (VSOD) task, how to excavate the information from the appearance modality and the motion modality has always been a topic of great concern. The two-stream structure, including an RGB appearance stream…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Runmin Cong , Weiyu Song , Jianjun Lei , Guanghui Yue , Yao Zhao , Sam Kwong

3D vehicle detection based on multi-modal fusion is an important task of many applications such as autonomous driving. Although significant progress has been made, we still observe two aspects that need to be further improvement: First, the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Zehan Zhang , Ming Zhang , Zhidong Liang , Xian Zhao , Ming Yang , Wenming Tan , ShiLiang Pu