English
Related papers

Related papers: Talk2SAM: Text-Guided Semantic Enhancement for Com…

200 papers

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Segment Anything Models (SAMs) like SEEM and SAM have demonstrated great potential in learning to segment anything. The core design of SAMs lies with Promptable Segmentation, which takes a handcrafted prompt as input and returns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiaxing Huang , Kai Jiang , Jingyi Zhang , Han Qiu , Lewei Lu , Shijian Lu , Eric Xing

Multi-organ medical segmentation is a crucial component of medical image processing, essential for doctors to make accurate diagnoses and develop effective treatment plans. Despite significant progress in this field, current multi-organ…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Xinlei Yu , Changmiao Wang , Hui Jin , Ahmed Elazab , Gangyong Jia , Xiang Wan , Changqing Zou , Ruiquan Ge

Segment Anything Models (SAM) have achieved remarkable success in object segmentation tasks across diverse datasets. However, these models are predominantly trained on large-scale semantic segmentation datasets, which introduce a bias…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Inbal Cohen , Boaz Meivar , Peihan Tu , Shai Avidan , Gal Oren

In geographical image segmentation, performance is often constrained by the limited availability of training data and a lack of generalizability, particularly for segmenting mobility infrastructure such as roads, sidewalks, and crosswalks.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Rafi Ibn Sultan , Chengyin Li , Hui Zhu , Prashant Khanduri , Marco Brocanelli , Dongxiao Zhu

The Segment Anything Model (SAM), a foundation model pretrained on millions of images and segmentation masks, has significantly advanced semantic segmentation, a fundamental task in computer vision. Despite its strengths, SAM encounters two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Li Zhang , Youwei Liang , Ruiyi Zhang , Amirhosein Javadi , Pengtao Xie

The goal of Audio-Visual Segmentation (AVS) is to localize and segment the sounding source objects from video frames. Research on AVS suffers from data scarcity due to the high cost of fine-grained manual annotations. Recent works attempt…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Kyungbok Lee , You Zhang , Zhiyao Duan

Medical image segmentation of anatomical structures and pathology is crucial in modern clinical diagnosis, disease study, and treatment planning. To date, great progress has been made in deep learning-based segmentation techniques, but most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

Fire segmentation remains a critical challenge in computer vision due to flames' irregular boundaries, translucent edges, and highly variable intensities. While the Segment Anything Models (SAM and SAM2) have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Emmanuel U. Ugwu , Zhang Xinming

Accurate tongue segmentation is crucial for reliable TCM analysis. Supervised models require large annotated datasets, while SAM-family models remain prompt-driven. We present Memory-SAM, a training-free, human-prompt-free pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Joongwon Chae , Lihui Luo , Xi Yuan , Dongmei Yu , Zhenglin Chen , Lian Zhang , Peiwu Qin

Medical image segmentation is a crucial and time-consuming task in clinical care, where mask precision is extremely important. The Segment Anything Model (SAM) offers a promising approach, as it provides an interactive interface based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Julien Khlaut , Elodie Ferreres , Daniel Tordjman , Hélène Philippe , Tom Boeken , Pierre Manceron , Corentin Dancette

The Segment Anything Model (SAM) achieves remarkable promptable segmentation given high-quality prompts which, however, often require good skills to specify. To make SAM robust to casual prompts, this paper presents the first comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Qi Fan , Xin Tao , Lei Ke , Mingqiao Ye , Yuan Zhang , Pengfei Wan , Zhongyuan Wang , Yu-Wing Tai , Chi-Keung Tang

Precision medicine, such as patient-adaptive treatments assisted by medical image analysis, poses new challenges for segmentation algorithms in adapting to new patients, due to the large variability across different patients and the limited…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chenhui Zhao , Liyue Shen

Multimodal image fusion and semantic segmentation are critical for autonomous driving. Despite advancements, current models often struggle with segmenting densely packed elements due to a lack of comprehensive fusion features for guidance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Daixun Li , Weiying Xie , Mingxiang Cao , Yunke Wang , Yusi Zhang , Leyuan Fang , Yunsong Li , Chang Xu

Open-Vocabulary Segmentation (OVS) aims at segmenting images from free-form textual concepts without predefined training classes. While existing vision-language models such as CLIP can generate segmentation masks by leveraging coarse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Luca Barsellotti , Lorenzo Bianchi , Nicola Messina , Fabio Carrara , Marcella Cornia , Lorenzo Baraldi , Fabrizio Falchi , Rita Cucchiara

Accurate vessel segmentation is critical for clinical applications such as disease diagnosis and surgical planning, yet remains challenging due to thin, branching structures and low texture contrast. While foundation models like the Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Suzhong Fu , Rui Sun , Xuan Ding , Jingqi Dong , Yiming Yang , Yao Zhu , Min Chang Jordan Ren , Delin Deng , Angelica Aviles-Rivero , Shuguang Cui , Zhen Li

Promptable video object segmentation and tracking (VOST) has seen significant advances with the emergence of foundation models like Segment Anything Model 2 (SAM2); however, their application in surgical video analysis remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Guoping Xu , Hua-Chieh Shao , You Zhang

The newly released Segment Anything Model (SAM) is a popular tool used in image processing due to its superior segmentation accuracy, variety of input prompts, training capabilities, and efficient model design. However, its current model is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Aimee Guo , Grace Fei , Hemanth Pasupuleti , Jing Wang

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang

The Segment Anything Model (SAM) represents a significant breakthrough into foundation models for computer vision, providing a large-scale image segmentation model. However, despite SAM's zero-shot performance, its segmentation masks lack…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Xianjie Liu , Keren Fu , Yao Jiang , Qijun Zhao