English
Related papers

Related papers: Adapting Segment Anything Model to Multi-modal Sal…

200 papers

Segment Anything Model (SAM) has emerged as a powerful tool for numerous vision applications. A key component that drives the impressive performance for zero-shot transfer and high versatility is a super large Transformer model trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yunyang Xiong , Bala Varadarajan , Lemeng Wu , Xiaoyu Xiang , Fanyi Xiao , Chenchen Zhu , Xiaoliang Dai , Dilin Wang , Fei Sun , Forrest Iandola , Raghuraman Krishnamoorthi , Vikas Chandra

Fully convolutional networks (FCN) has significantly improved the performance of many pixel-labeling tasks, such as semantic segmentation and depth estimation. However, it still remains non-trivial to thoroughly utilize the multi-level…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Yunzhi Zhuge , Pingping Zhang , Huchuan Lu

Grasp detection requires flexibility to handle objects of various shapes without relying on prior knowledge of the object, while also offering intuitive, user-guided control. This paper introduces GraspSAM, an innovative extension of the…

Robotics · Computer Science 2024-09-24 Sangjun Noh , Jongwon Kim , Dongwoo Nam , Seunghyeok Back , Raeyoung Kang , Kyoobin Lee

RGB-D salient object detection (SOD), aiming to highlight prominent regions of a given scene by jointly modeling RGB and depth information, is one of the challenging pixel-level prediction tasks. Recently, the dual-attention mechanism has…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Kang Yi , Haoran Tang , Yumeng Li , Jing Xu , Jun Zhang

With the emergence of the Segment Anything Model (SAM) as a foundational model for image segmentation, its application has been extensively studied across various domains, including the medical field. However, its potential in the context…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 SeungKyu Kim , Hyun-Jic Oh , Seonghui Min , Won-Ki Jeong

Due to the inherent flexibility of prompting, foundation models have emerged as the predominant force in the fields of natural language processing and computer vision. The recent introduction of the Segment Anything Model (SAM) signifies a…

Image and Video Processing · Electrical Eng. & Systems 2024-01-09 Yichi Zhang , Zhenrong Shen , Rushi Jiao

Recently, Segment Anything Model (SAM) has demonstrated strong generalizability in various instance segmentation tasks. However, its performance is severely dependent on the quality of manual prompts. In addition, the RGB images that…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yihan Shang , Wei Wang , Chao Huang , Xinghui Dong

Co-salient Object Detection (CoSOD) endeavors to replicate the human visual system's capacity to recognize common and salient objects within a collection of images. Despite recent advancements in deep learning models, these models still…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Haoke Xiao , Lv Tang , Bo Li , Zhiming Luo , Shaozi Li

Salient Object Detection (SOD) domain using RGB-D data has lately emerged with some current models' adequately precise results. However, they have restrained generalization abilities and intensive computational complexity. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Tanveer Hussain , Saeed Anwar , Amin Ullah , Khan Muhammad , Sung Wook Baik

Semantic segmentation is a significant perception task in autonomous driving. It suffers from the risks of adversarial examples. In the past few years, deep learning has gradually transitioned from convolutional neural network (CNN) models…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Jun Yan , Pengyu Wang , Danni Wang , Weiquan Huang , Daniel Watzenig , Huilin Yin

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

Video salient object detection (VSOD) is an important task in many vision applications. Reliable VSOD requires to simultaneously exploit the information from both the spatial domain and the temporal domain. Most of the existing algorithms…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Yi Tang , Yuanman Li , Guoliang Xing

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Zhongxi Qiu , Yan Hu , Heng Li , Jiang Liu

Beneficial from Fully Convolutional Neural Networks (FCNs), saliency detection methods have achieved promising results. However, it is still challenging to learn effective features for detecting salient objects in complicated scenarios, in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Sina Mohammadi , Mehrdad Noori , Ali Bahri , Sina Ghofrani Majelan , Mohammad Havaei

The recent Segment Anything Model (SAM) demonstrates strong instance segmentation performance across various downstream tasks. However, SAM is trained solely on RGB data, limiting its direct applicability to RGB-thermal (RGB-T) semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dong Xing , Xianxun Zhu , Wei Zhou , Qika Lin , Hang Yang , Yuqing Wang

The Segment Anything Model (SAM) demonstrates impressive zero-shot segmentation ability on natural images but encounters difficulties in medical imaging due to domain shifts, anatomical variability, and its reliance on user-provided…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yingzhen Hu , Yiheng Zhong , Ruobing Li , Yingxue Su , Jiabao An , Feilong Tang , Jionglong Su , Imran Razzak

Salient Object Detection (SOD) has traditionally relied on feature refinement modules that utilize the features of an ImageNet pre-trained backbone. However, this approach limits the possibility of pre-training the entire network because of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Rohit Venkata Sai Dulam , Chandra Kambhamettu

Depth cues with affluent spatial information have been proven beneficial in boosting salient object detection (SOD), while the depth quality directly affects the subsequent SOD performance. However, it is inevitable to obtain some…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Zhou Huang , Huai-Xin Chen , Tao Zhou , Yun-Zhi Yang , Bi-Yuan Liu

The goal of this work is to present a systematic solution for RGB-D salient object detection, which addresses the following three aspects with a unified framework: modal-specific representation learning, complementary cue selection and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Hao Chen , Youfu Li

While the human visual system employs distinct mechanisms to perceive salient and camouflaged objects, existing models struggle to disentangle these tasks. Specifically, salient object detection (SOD) models frequently misclassify…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zhangjun Zhou , Yiping Li , Chunlin Zhong , Jianuo Huang , Jialun Pei , Hua Li , He Tang