English
Related papers

Related papers: LIMIS: Towards Language-based Interactive Medical …

200 papers

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

Segmentation of anatomical structures and pathological regions in medical images is essential for modern clinical diagnosis, disease research, and treatment planning. While significant advancements have been made in deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

Despite significant progress in pixel-level medical image analysis, existing medical image segmentation models rarely explore medical segmentation and diagnosis tasks jointly. However, it is crucial for patients that models can provide…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Lingran Song , Yucheng Zhou , Jianbing Shen

Recent works on click-based interactive segmentation have demonstrated state-of-the-art results by using various inference-time optimization schemes. These methods are considerably more computationally expensive compared to feedforward…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Konstantin Sofiiuk , Ilia A. Petrov , Anton Konushin

In medical imaging, precise annotation of lesions or organs is often required. However, 3D volumetric images typically consist of hundreds or thousands of slices, making the annotation process extremely time-consuming and laborious.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Bingzhi Shen , Lufan Chang , Siqi Chen , Shuxiang Guo , Hao Liu

In this paper, we present a method to interactively create segmentation masks on the basis of user clicks. We pay particular attention to the segmentation of multiple surfaces that are simultaneously present in the same image. Since these…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Robin Schön , Julian Lorenz , Katja Ludwig , Daniel Kienzle , Rainer Lienhart

We propose SAMed, a general solution for medical image segmentation. Different from the previous methods, SAMed is built upon the large-scale image segmentation model, Segment Anything Model (SAM), to explore the new research paradigm of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Kaidong Zhang , Dong Liu

Due to low tissue contrast, irregular object appearance, and unpredictable location variation, segmenting the objects from different medical imaging modalities (e.g., CT, MR) is considered as an important yet challenging task. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Jinquan Sun , Yinghuan Shi , Yang Gao , Lei Wang , Luping Zhou , Wanqi Yang , Dinggang Shen

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Medical image segmentation is vital for clinical diagnosis, yet current deep learning methods often demand extensive expert effort, i.e., either through annotating large training datasets or providing prompts at inference time for each new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xingjian Li , Qifeng Wu , Adithya S. Ubaradka , Yiran Ding , Colleen Que , Runmin Jiang , Jianhua Xing , Tianyang Wang , Min Xu

We present LawDIS, a language-window-based controllable dichotomous image segmentation (DIS) framework that produces high-quality object masks. Our framework recasts DIS as an image-conditioned mask generation task within a latent diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xinyu Yan , Meijun Sun , Ge-Peng Ji , Fahad Shahbaz Khan , Salman Khan , Deng-Ping Fan

This paper proposes LLaFS, the first attempt to leverage large language models (LLMs) in few-shot segmentation. In contrast to the conventional few-shot segmentation methods that only rely on the limited and biased information from the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Lanyun Zhu , Tianrun Chen , Deyi Ji , Jieping Ye , Jun Liu

Medical image segmentation of anatomical structures and pathology is crucial in modern clinical diagnosis, disease study, and treatment planning. To date, great progress has been made in deep learning-based segmentation techniques, but most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

In this paper, we present PRISM, a Promptable and Robust Interactive Segmentation Model, aiming for precise segmentation of 3D medical images. PRISM accepts various visual inputs, including points, boxes, and scribbles as sparse prompts, as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

While LISA effectively bridges the gap between segmentation and large language models to enable reasoning segmentation, it poses certain limitations: unable to distinguish different instances of the target region, and constrained by the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Senqiao Yang , Tianyuan Qu , Xin Lai , Zhuotao Tian , Bohao Peng , Shu Liu , Jiaya Jia

Segmentation remains an important preprocessing step both in languages where "words" or other important syntactic/semantic units (like morphemes) are not clearly delineated by white space, as well as when dealing with continuous speech…

Computation and Language · Computer Science 2021-09-07 C. M. Downey , Fei Xia , Gina-Anne Levow , Shane Steinert-Threlkeld

Placenta volume measured from 3D ultrasound (3DUS) images is an important tool for tracking the growth trajectory and is associated with pregnancy outcomes. Manual segmentation is the gold standard, but it is time-consuming and subjective.…

Image and Video Processing · Electrical Eng. & Systems 2024-08-13 Hao Li , Baris Oguz , Gabriel Arenas , Xing Yao , Jiacheng Wang , Alison Pouch , Brett Byram , Nadav Schwartz , Ipek Oguz

The applicability of current lesion segmentation models for chest X-rays (CXRs) has been limited both by a small number of target labels and the reliance on complex, expert-level text inputs, creating a barrier to practical use. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Geon Choi , Hangyul Yoon , Hyunju Shin , Hyunki Park , Sang Hoon Seo , Eunho Yang , Edward Choi

Recent advancements in foundation models, such as the Segment Anything Model (SAM), have significantly impacted medical image segmentation, especially in retinal imaging, where precise segmentation is vital for diagnosis. Despite this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Xiangtong Yao , Quanmin Liang , Shahrooz Faghihroohi , Kai Huang , Nassir Navab , M. Ali Nasseri

Recent developments underscore the potential of textual information in enhancing learning models for a deeper understanding of medical visual semantics. However, language-guided medical image segmentation still faces a challenging issue.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xiaoshuang Huang , Hongxiang Li , Meng Cao , Long Chen , Chenyu You , Dong An