中文
相关论文

相关论文: Adapting Segment Anything Model to Multi-modal Sal…

200 篇论文

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

Object extraction and segmentation from remote sensing (RS) images is a critical yet challenging task in urban environment monitoring. Urban morphology is inherently complex, with irregular objects of diverse shapes and varying scales.…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Chenyu Li , Danfeng Hong , Bing Zhang , Yuxuan Li , Gustau Camps-Valls , Xiao Xiang Zhu , Jocelyn Chanussot

Despite significant progress in Unified Multimodal Retrieval (UMR) powered by Large Multimodal Models (LMMs), existing embedding methods primarily focus on sample-level objectives via contrastive learning while overlooking the crucial…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Guosheng Zhang , Linkai Liu , Keyao Wang , Haixiao Yue , Zhiwen Tan , Xiao Tan

Single-point annotation in visual tasks, with the goal of minimizing labelling costs, is becoming increasingly prominent in research. Recently, visual foundation models, such as Segment Anything (SAM), have gained widespread usage due to…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Zhaoyang Wei , Pengfei Chen , Xuehui Yu , Guorong Li , Jianbin Jiao , Zhenjun Han

The Segment Anything Model (SAM) has achieved remarkable successes in the realm of natural image segmentation, but its deployment in the medical imaging sphere has encountered challenges. Specifically, the model struggles with medical…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Shreyank N Gowda , David A. Clifton

In view of the problems that existing salient object detection (SOD) methods are prone to losing details, blurring edges, and insufficient fusion of single-modal information in complex scenes, this paper proposes a dynamic uncertainty…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Yuqi Xiong , Wuzhen Shi , Yang Wen , Ruhan Liu

The Segment Anything Model (SAM) is a foundational model for image segmentation tasks, known for its strong generalization across diverse applications. However, its impressive performance comes with significant computational and resource…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Xiaorui Sun , Jun Liu , Heng Tao Shen , Xiaofeng Zhu , Ping Hu

Salient Object Detection (SOD) with deep learning often requires substantial computational resources and large annotated datasets, making it impractical for resource-constrained applications. Lightweight models address computational demands…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Leonardo M. Joao , Jancarlo F. Gomes , Silvio J. F. Guimaraes , Ewa Kijak , Alexandre X. Falcao

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

While we enjoy the richness and informativeness of multimodal data, it also introduces interference and redundancy of information. To achieve optimal domain interpretation with limited resources, we propose CSDNet, a lightweight…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Xiaotong Yu , Ruihan Xie , Zhihe Zhao , Chang-Wen Chen

Semantic segmentation of remote sensing imagery plays a pivotal role in extracting precise information for diverse down-stream applications. Recent development of the Segment Anything Model (SAM), an advanced general-purpose segmentation…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Xianping Ma , Qianqian Wu , Xingyu Zhao , Xiaokang Zhang , Man-On Pun , Bo Huang

Segment anything model (SAM) has demonstrated excellent generalizability in common vision scenarios, yet falling short of the ability to understand specialized data. Recently, several methods have combined parameter-efficient techniques…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Yiran Song , Qianyu Zhou , Xuequan Lu , Zhiwen Shao , Lizhuang Ma

RGB-D salient object detection (SOD) aims to identify the most conspicuous objects in a scene with the incorporation of depth cues. Existing methods mainly rely on CNNs, limited by the local receptive fields, or Vision Transformers that…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Lanhu Wu , Zilin Gao , Hao Fei , Mong-Li Lee , Wynne Hsu

Salient object detection (SOD) in optical remote sensing images (ORSIs) faces numerous challenges, including significant variations in target scales and low contrast between targets and the background. Existing methods based on vision…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Mengyu Ren , Yutong Li , Hua Li , Chuhong Wang , Runmin Cong

Salient Object Detection (SOD) aims to identify and segment prominent regions within a scene. Traditional models rely on manually annotated pseudo labels with precise pixel-level accuracy, which is time-consuming. We developed a low-cost,…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Miaoyang He , Shuyong Gao , Tsui Qin Mok , Weifeng Ge , Wengqiang Zhang

Few-shot object detection~(FSOD), which aims to detect novel objects with limited annotated instances, has made significant progress in recent years. However, existing methods still suffer from biased representations, especially for novel…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Zheng Wang , Yingjie Gao , Qingjie Liu , Yunhong Wang

The semantic representation of deep features is essential for image context understanding, and effective fusion of features with different semantic representations can significantly improve the model's performance on salient object…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Han Sun , Jun Cen , Ningzhong Liu , Dong Liang , Huiyu Zhou

The Segment Anything Model (SAM) marks a significant advancement in segmentation models, offering robust zero-shot abilities and dynamic prompting. However, existing medical SAMs are not suitable for the multi-scale nature of whole-slide…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Hong Liu , Haosen Yang , Paul J. van Diest , Josien P. W. Pluim , Mitko Veta

Salient object detection (SOD) aims at finding the most salient objects in images and outputs pixel-level binary masks. Transformer-based methods achieve promising performance due to their global semantic understanding, crucial for…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Wen Liang , Peipei Ran , Mengchao Bai , Xiao Liu , P. Bilha Githinji , Wei Zhao , Peiwu Qin

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

计算机视觉与模式识别 · 计算机科学 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia