English
Related papers

Related papers: Customize Segment Anything Model for Multi-Modal S…

200 papers

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Zhongxi Qiu , Yan Hu , Heng Li , Jiang Liu

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

Segment Anything Model (SAM) has recently shown its powerful effectiveness in visual segmentation tasks. However, there is less exploration concerning how SAM works on audio-visual tasks, such as visual sound localization and segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Shentong Mo , Yapeng Tian

Improving robustness of the Segment Anything Model (SAM) to input degradations is critical for its deployment in high-stakes applications such as autonomous driving and robotics. Our approach to this challenge prioritizes three key aspects:…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Sohyun Lee , Yeho Gwon , Lukas Hoyer , Suha Kwak

We introduce SAM4MLLM, an innovative approach which integrates the Segment Anything Model (SAM) with Multi-Modal Large Language Models (MLLMs) for pixel-aware tasks. Our method enables MLLMs to learn pixel-level location information without…

Artificial Intelligence · Computer Science 2024-12-17 Yi-Chia Chen , Wei-Hua Li , Cheng Sun , Yu-Chiang Frank Wang , Chu-Song Chen

With the emergence of the Segment Anything Model (SAM) as a foundational model for image segmentation, its application has been extensively studied across various domains, including the medical field. However, its potential in the context…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 SeungKyu Kim , Hyun-Jic Oh , Seonghui Min , Won-Ki Jeong

The advent of Large Language Models (LLMs) has ushered in a new era of artificial intelligence, with the potential to transform various sectors through automation and insightful analysis. The Mixture of Experts (MoE) architecture has been…

Machine Learning · Computer Science 2024-10-22 Xurui Li , Juanjuan Yao

The Segment Anything Model (SAM) has demonstrated exceptional performance and versatility, making it a promising tool for various related tasks. In this report, we explore the application of SAM in Weakly-Supervised Semantic Segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Weixuan Sun , Zheyuan Liu , Yanhao Zhang , Yiran Zhong , Nick Barnes

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Recent advancements in biomedical image analysis have been significantly driven by the Segment Anything Model (SAM). This transformative technology, originally developed for general-purpose computer vision, has found rapid application in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Ho Hin Lee , Yu Gu , Theodore Zhao , Yanbo Xu , Jianwei Yang , Naoto Usuyama , Cliff Wong , Mu Wei , Bennett A. Landman , Yuankai Huo , Alberto Santamaria-Pang , Hoifung Poon

The Segment Anything Model (SAM) excels at generating precise object masks from input prompts but lacks semantic awareness, failing to associate its generated masks with specific object categories. To address this limitation, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Rohit Kundu , Sudipta Paul , Arindam Dutta , Amit K. Roy-Chowdhury

Foundational models such as the Segment Anything Model (SAM) are gaining traction in medical imaging segmentation, supporting multiple downstream tasks. However, such models are supervised in nature, still relying on large annotated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Aishik Konwer , Zhijian Yang , Erhan Bas , Cao Xiao , Prateek Prasanna , Parminder Bhatia , Taha Kass-Hout

Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Mohammad Peivandi , Jason Zhang , Michael Lu , Dongxiao Zhu , Zhifeng Kou

Object extraction and segmentation from remote sensing (RS) images is a critical yet challenging task in urban environment monitoring. Urban morphology is inherently complex, with irregular objects of diverse shapes and varying scales.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Chenyu Li , Danfeng Hong , Bing Zhang , Yuxuan Li , Gustau Camps-Valls , Xiao Xiang Zhu , Jocelyn Chanussot

Large Language Models (LLMs) demonstrate strong capabilities in broad knowledge representation, yet they are inherently deficient in pixel-level perceptual understanding. Although the Segment Anything Model (SAM) represents a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Hao Wang , Limeng Qiao , Zequn Jie , Zhijian Huang , Chengjian Feng , Qingfang Zheng , Lin Ma , Xiangyuan Lan , Xiaodan Liang

The Segment Anything Model (SAM) has set a new standard in interactive image segmentation, offering robust performance across various tasks. However, its significant computational requirements limit its deployment in real-time or…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Kunal Dasharath Patil , Gowthamaan Palani , Ganapathy Krishnamurthi

Recent advancements in general-purpose or domain-specific multimodal large language models (LLMs) have witnessed remarkable progress for medical decision-making. However, they are designated for specific classification or generative tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Songtao Jiang , Tuo Zheng , Yan Zhang , Yeying Jin , Li Yuan , Zuozhu Liu

The Segment Anything Model (SAM) exhibits remarkable versatility and zero-shot learning abilities, owing largely to its extensive training data (SA-1B). Recognizing SAM's dependency on manual guidance given its category-agnostic nature, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Xiyu Qi , Yifan Wu , Yongqiang Mao , Wenhui Zhang , Yidan Zhang

Segment Anything Model (SAM), a new AI model from Meta AI released in April 2023, is an ambitious tool designed to identify and separate individual objects within a given image through semantic interpretation. The advanced capabilities of…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Gabriel Bellon de Carvalho , Jurandy Almeida

Industrial X-ray computed tomography (XCT) is a powerful tool for non-destructive characterization of materials and manufactured components. XCT commonly accompanied by advanced image analysis and computer vision algorithms to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Anika Tabassum , Amirkoushyar Ziabari