English
Related papers

Related papers: Customize Segment Anything Model for Multi-Modal S…

200 papers

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

The Segment Anything Model (SAM) has gained significant attention in the field of image segmentation due to its impressive capabilities and prompt-based interface. While SAM has already been extensively evaluated in various domains, its…

Image and Video Processing · Electrical Eng. & Systems 2023-09-01 Botond Fazekas , José Morano , Dmitrii Lachinov , Guilherme Aresta , Hrvoje Bogunović

Nuclei instance segmentation is critical in computational pathology for cancer diagnosis and prognosis. Recently, the Segment Anything Model has demonstrated exceptional performance in various segmentation tasks, leveraging its rich priors…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jingze Su , Tianle Zhu , Jiaxin Cai , Zhiyi Wang , Qi Li , Xiao Zhang , Tong Tong , Shu Wang , Wenxi Liu

We present Perceive Anything Model (PAM), a conceptually straightforward and efficient framework for comprehensive region-level visual understanding in images and videos. Our approach extends the powerful segmentation model SAM 2 by…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Weifeng Lin , Xinyu Wei , Ruichuan An , Tianhe Ren , Tingwei Chen , Renrui Zhang , Ziyu Guo , Wentao Zhang , Lei Zhang , Hongsheng Li

Foundation models for medical image segmentation have achieved remarkable performance. Adaptive fine-tuning of natural image segmentation foundation models is crucial for medical image segmentation tasks. However, some limitations exist in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Xinwei Zhang , Hu Chen , Zhe Yuan , Sukun Tian , Peng Feng

Recently, Meta AI Research approaches a general, promptable Segment Anything Model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Wei Ji , Jingjing Li , Qi Bi , Tingwei Liu , Wenbo Li , Li Cheng

In this paper, we delve into the nuanced challenge of tailoring the Segment Anything Models (SAMs) for integration with event data, with the overarching objective of attaining robust and universal object segmentation within the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Zhiwen Chen , Zhiyu Zhu , Yifan Zhang , Junhui Hou , Guangming Shi , Jinjian Wu

Sparse autoencoders (SAEs) have emerged as a powerful tool for interpreting large language models (LLMs) by decomposing token activations into combinations of human-understandable features. While SAEs provide crucial insights into LLM…

Machine Learning · Computer Science 2025-11-11 Zhen Xu , Zhen Tan , Song Wang , Kaidi Xu , Tianlong Chen

Segment Anything Model (SAM) has attracted significant attention due to its impressive zero-shot transfer performance and high versatility for numerous vision applications (like image editing with fine-grained control). Many of such…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Chaoning Zhang , Dongshen Han , Yu Qiao , Jung Uk Kim , Sung-Ho Bae , Seungkyu Lee , Choong Seon Hong

Accurate segmentation of regions of interest in biomedical images holds substantial value in image analysis. Although several foundation models for biomedical segmentation have currently achieved excellent performance on certain datasets,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Manyu Li , Ruian He , Zixian Zhang , Chenxi Ma , Weimin Tan , Bo Yan

Segment Anything Model (SAM) exhibits remarkable zero-shot segmentation capability; however, its prohibitive computational costs make edge deployment challenging. Although post-training quantization (PTQ) offers a promising compression…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jing Zhang , Zhikai Li , Chengzhi Hu , Xuewen Liu , Qingyi Gu

Segment Anything Model (SAM) has achieved impressive performance in many computer vision tasks. However, as a large-scale model, the immense memory and computation costs hinder its practical deployment. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Chengtao Lv , Hong Chen , Jinyang Guo , Yifu Ding , Xianglong Liu

We propose SAM-Road, an adaptation of the Segment Anything Model (SAM) for extracting large-scale, vectorized road network graphs from satellite imagery. To predict graph geometry, we formulate it as a dense semantic segmentation task,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Congrui Hetang , Haoru Xue , Cindy Le , Tianwei Yue , Wenping Wang , Yihui He

The success of the Segment Anything Model (SAM) demonstrates the significance of data-centric machine learning. However, due to the difficulties and high costs associated with annotating Remote Sensing (RS) images, a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Di Wang , Jing Zhang , Bo Du , Minqiang Xu , Lin Liu , Dacheng Tao , Liangpei Zhang

Mixture-of-Experts (MoE) architectures employ sparse activation to deliver faster training and inference with higher accuracy than dense LLMs. However, in production serving, MoE models require batch inference to optimize hardware…

Machine Learning · Computer Science 2026-02-10 Juntong Wu , Jialiang Cheng , Fuyu Lv , Ou Dan , Li Yuan

Leveraging the Segment Anything Model (SAM) for medical image segmentation remains challenging due to its limited adaptability across diverse medical domains. Although fine-tuned variants, such as MedSAM, improve performance in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jianghao Wu , Yicheng Wu , Yutong Xie , Wenjia Bai , You Zhang , Feilong Tang , Yulong Li , Imran Razzak , Daniel F Schmidt , Yasmeen George

The rapid rise of large-scale foundation models has reshaped the landscape of image segmentation, with models such as Segment Anything achieving unprecedented versatility across diverse vision tasks. However, previous generations-including…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Tianrun Chen , Runlong Cao , Xinda Yu , Lanyun Zhu , Chaotao Ding , Deyi Ji , Cheng Chen , Qi Zhu , Chunyan Xu , Papa Mao , Ying Zang

The Segment Anything Model (SAM) demonstrates impressive zero-shot segmentation ability on natural images but encounters difficulties in medical imaging due to domain shifts, anatomical variability, and its reliance on user-provided…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yingzhen Hu , Yiheng Zhong , Ruobing Li , Yingxue Su , Jiabao An , Feilong Tang , Jionglong Su , Imran Razzak

Medical image segmentation often faces the challenge of prohibitively expensive annotation costs. While few-shot learning offers a promising solution to alleviate this burden, conventional approaches still rely heavily on pre-training with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jie Xu , Xiaokang Li , Chengyu Yue , Yuanyuan Wang , Yi Guo

Recently segment anything model (SAM) has shown powerful segmentation capability and has drawn great attention in computer vision fields. Massive following works have developed various applications based on the pre-trained SAM and achieved…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Han Shu , Wenshuo Li , Yehui Tang , Yiman Zhang , Yihao Chen , Houqiang Li , Yunhe Wang , Xinghao Chen