English
Related papers

Related papers: Adapting Segment Anything Model to Multi-modal Sal…

200 papers

Salient Object Detection (SOD) aims to identify and segment the most prominent objects in images. Advanced SOD methods often utilize various Convolutional Neural Networks (CNN) or Transformers for deep feature extraction. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Shixuan Gao , Pingping Zhang , Tianyu Yan , Huchuan Lu

Robust and accurate segmentation of scenes has become one core functionality in various visual recognition and navigation tasks. This has inspired the recent development of Segment Anything Model (SAM), a foundation model for general mask…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Naoto Yokoya , Shijian Lu

Camouflaged Object Detection (COD) aims to segment objects that blend seamlessly into complex backgrounds, with growing interest in exploiting additional visual modalities to enhance robustness through complementary information. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Hao Wang , Jiqing Zhang , Xin Yang , Baocai Yin , Lu Jiang , Zetian Mi , Huibing Wang

Foundation models, such as OpenAI's GPT-3 and GPT-4, Meta's LLaMA, and Google's PaLM2, have revolutionized the field of artificial intelligence. A notable paradigm shift has been the advent of the Segment Anything Model (SAM), which has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruikai Cui , Siyuan He , Shi Qiu

We present a simple yet effective progressive self-guided loss function to facilitate deep learning-based salient object detection (SOD) in images. The saliency maps produced by the most relevant works still suffer from incomplete…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Sheng Yang , Weisi Lin , Guosheng Lin , Qiuping Jiang , Zichuan Liu

Recently segment anything model (SAM) has attracted widespread concerns, and it is often treated as a vision foundation model for universal segmentation. Some researchers have attempted to directly apply the foundation model to the RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jia Lin , Xiaofei Zhou , Jiyuan Liu , Runmin Cong , Guodao Zhang , Zhi Liu , Jiyong Zhang

Multimodal image fusion and semantic segmentation are critical for autonomous driving. Despite advancements, current models often struggle with segmenting densely packed elements due to a lack of comprehensive fusion features for guidance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Daixun Li , Weiying Xie , Mingxiang Cao , Yunke Wang , Yusi Zhang , Leyuan Fang , Yunsong Li , Chang Xu

Salient object detection (SOD) is a task that involves identifying and segmenting the most visually prominent object in an image. Existing solutions can accomplish this use a multi-scale feature fusion mechanism to detect the global context…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yongwoo Lee , Minhyeok Lee , Suhwan Cho , Sangyoun Lee

Toward desirable saliency prediction, the types and numbers of inputs for a salient object detection (SOD) algorithm may dynamically change in many real-life applications. However, existing SOD algorithms are mainly designed or trained for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Nianchang Huang , Yang Yang , Ruida Xi , Qiang Zhang , Jungong Han , Jin Huang

This paper delves into the task of arbitrary modality salient object detection (AM SOD), aiming to detect salient objects from arbitrary modalities, eg RGB images, RGB-D images, and RGB-D-T images. A novel modality-adaptive Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Nianchang Huang , Yang Yang , Qiang Zhang , Jungong Han , Jin Huang

Salient Object Detection (SOD) remains an essential yet underexplored task in the era of large-scale vision models. Although foundation models like SAM exhibit strong generalization, their potential for SOD is not fully realized, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Morteza Moradi , Mohammad Moradi , Simone Palazzo , Ali Borji , Concetto Spampinato

RGB-thermal salient object detection (RGB-T SOD) aims to identify prominent objects by integrating complementary information from RGB and thermal modalities. However, learning the precise boundaries and complete objects remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Ruichao Hou , Xingyuan Li , Tongwei Ren , Dongming Zhou , Gangshan Wu , Jinde Cao

RGB-T salient object detection (SOD) aims to segment attractive objects by combining RGB and thermal infrared images. To enhance performance, the Segment Anything Model has been fine-tuned for this task. However, the imbalance convergence…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Zhengyi Liu , Xinrui Wang , Xianyong Fang , Zhengzheng Tu , Linbo Wang

Salient object detection(SOD) aims at locating the most significant object within a given image. In recent years, great progress has been made in applying SOD on many vision tasks. The depth map could provide additional spatial prior and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Guangyu Ren , Yanchu Xie , Tianhong Dai , Tania Stathaki

Salient object detection (SOD), which aims to find the most important region of interest and segment the relevant object/item in that area, is an important yet challenging vision task. This problem is inspired by the fact that human seems…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Pingping Zhang , Huchuan Lu , Chunhua Shen

The Segment Anything Model (SAM), a foundational model designed for promptable segmentation tasks, demonstrates exceptional generalization capabilities, making it highly promising for natural scene image segmentation. However, SAM's lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Linghao Zheng , Xinyang Pu , Feng Xu

Semantic segmentation, a key task in computer vision with broad applications in autonomous driving, medical imaging, and robotics, has advanced substantially with deep learning. Nevertheless, current approaches remain vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Iacopo Curti , Pierluigi Zama Ramirez , Alioscia Petrelli , Luigi Di Stefano

Existing single-modal and multi-modal salient object detection (SOD) methods focus on designing specific architectures tailored for their respective tasks. However, developing completely different models for different tasks leads to labor…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Kunpeng Wang , Chenglong Li , Zhengzheng Tu , Zhengyi Liu , Bin Luo

The Segment Anything Model 2 (SAM2) has emerged as a foundation model for universal segmentation. Owing to its generalizable visual representations, SAM2 has been successfully applied to various downstream tasks. However, extending SAM2 to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiyuan Liu , Jia Lin , Xiaofei Zhou , Runmin Cong , Deyang Liu , Zhi Liu

The recent Segment Anything Model (SAM) has emerged as a new paradigmatic vision foundation model, showcasing potent zero-shot generalization and flexible prompting. Despite SAM finding applications and adaptations in various domains, its…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Xumeng Han , Longhui Wei , Xuehui Yu , Zhiyang Dou , Xin He , Kuiran Wang , Yingfei Sun , Zhenjun Han , Qi Tian
‹ Prev 1 2 3 10 Next ›