English
Related papers

Related papers: SAM3-I: Segment Anything with Instructions

200 papers

In this paper, we investigate Open-Vocabulary 3D Instance Segmentation (OV-3DIS) with free-form language instructions. Earlier works that rely on only annotated base categories for training suffer from limited generalization to unseen novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Seungjun Lee , Yuyang Zhao , Gim Hee Lee

Understanding human instructions to identify the target objects is vital for perception systems. In recent years, the advancements of Large Language Models (LLMs) have introduced new possibilities for image segmentation. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Junchi Wang , Lei Ke

The Segment Anything Model (SAM) excels at generating precise object masks from input prompts but lacks semantic awareness, failing to associate its generated masks with specific object categories. To address this limitation, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Rohit Kundu , Sudipta Paul , Arindam Dutta , Amit K. Roy-Chowdhury

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei

Large Language Models (LLMs) demonstrate strong capabilities in broad knowledge representation, yet they are inherently deficient in pixel-level perceptual understanding. Although the Segment Anything Model (SAM) represents a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Hao Wang , Limeng Qiao , Zequn Jie , Zhijian Huang , Chengjian Feng , Qingfang Zheng , Lin Ma , Xiangyuan Lan , Xiaodan Liang

Curating annotations for medical image segmentation is a labor-intensive and time-consuming task that requires domain expertise, resulting in "narrowly" focused deep learning (DL) models with limited translational utility. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Pranav Kulkarni , Adway Kanhere , Dharmam Savani , Andrew Chan , Devina Chatterjee , Paul H. Yi , Vishwa S. Parekh

We present SAM4EM, a novel approach for 3D segmentation of complex neural structures in electron microscopy (EM) data by leveraging the Segment Anything Model (SAM) alongside advanced fine-tuning strategies. Our contributions include the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Uzair Shah , Marco Agus , Daniya Boges , Vanessa Chiappini , Mahmood Alzubaidi , Jens Schneider , Markus Hadwiger , Pierre J. Magistretti , Mowafa Househ , Corrado Calı

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Localizing object parts precisely is essential for tasks such as object recognition and robotic manipulation. Recent part segmentation methods require extensive training data and labor-intensive annotations. Segment-Anything Model (SAM) has…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 S. B. van Rooij , G. J. Burghouts

Recent advancements in 3D perception systems have significantly improved their ability to perform visual recognition tasks such as segmentation. However, these systems still heavily rely on explicit human instruction to identify target…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Amrin Kareem , Jean Lahoud , Hisham Cholakkal

The Segment Anything Model (SAM) has demonstrated impressive generalization in prompt-based segmentation. Yet, the potential of semantic text prompts remains underexplored compared to traditional spatial prompts like points and boxes. This…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Shayan Jalilian , Abdul Bais

Robust and accurate segmentation of scenes has become one core functionality in various visual recognition and navigation tasks. This has inspired the recent development of Segment Anything Model (SAM), a foundation model for general mask…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Naoto Yokoya , Shijian Lu

Open-vocabulary segmentation models such as SAM3 perform well across broad categories via text prompting, yet degrade when target classes are visually underrepresented in pretraining or depart from canonical depictions-limitations text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Abderrahmene Boudiaf , Irfan Hussain , Sajid Javed

Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Nhat-Tan Bui , Dinh-Hieu Hoang , Minh-Triet Tran , Gianfranco Doretto , Donald Adjeroh , Brijesh Patel , Arabinda Choudhary , Ngan Le

Promptable segmentation, introduced by the Segment Anything Model (SAM), is a promising approach for medical imaging, as it enables clinicians to guide and refine model predictions interactively. However, SAM's architecture is designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Théo Danielou , Daniel Tordjman , Pierre Manceron , Corentin Dancette

The Segment Anything Model (SAM) has demonstrated strong performance in image segmentation of natural scene images. However, its effectiveness diminishes markedly when applied to specific scientific domains, such as Scanning Probe…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yao Shen , Ziwei Wei , Chunmeng Liu , Shuming Wei , Qi Zhao , Kaiyang Zeng , Guangyao Li

The development of machine learning models for CT imaging depends on the availability of large, high-quality, and diverse annotated datasets. Although large volumes of CT images and reports are readily available in clinical picture…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Samuel Church , Joshua D. Warner , Danyal Maqbool , Xin Tie , Junjie Hu , Meghan G. Lubner , Tyler J. Bradshaw

The recent Segment Anything Model (SAM) represents a big leap in scaling up segmentation models, allowing for powerful zero-shot capabilities and flexible prompting. Despite being trained with 1.1 billion masks, SAM's mask prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Lei Ke , Mingqiao Ye , Martin Danelljan , Yifan Liu , Yu-Wing Tai , Chi-Keung Tang , Fisher Yu

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang

Recently, large vision model, Segment Anything Model (SAM), has revolutionized the computer vision field, especially for image segmentation. SAM presented a new promptable segmentation paradigm that exhibit its remarkable zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Chenglong Wang , Dexuan Li , Sucheng Wang , Chengxiu Zhang , Yida Wang , Yun Liu , Guang Yang