English
Related papers

Related papers: Text-Promptable Propagation for Referring Medical …

200 papers

Existing Referring Image Segmentation (RIS) methods typically require expensive pixel-level or box-level annotations for supervision. In this paper, we observe that the referring texts used in RIS already provide sufficient information to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Fang Liu , Yuhao Liu , Yuqiu Kong , Ke Xu , Lihe Zhang , Baocai Yin , Gerhard Hancke , Rynson Lau

The goal of this work is to segment the objects in an image that are referred to by a sequence of linguistic descriptions (referring expressions). We propose a deep neural network with recurrent layers that output a sequence of binary…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 Alba Herrera-Palacio , Carles Ventura , Carina Silberer , Ionut-Teodor Sorodoc , Gemma Boleda , Xavier Giro-i-Nieto

Medical image computing has advanced rapidly with the advent of deep learning techniques such as convolutional neural networks. Deep convolutional neural networks can perform exceedingly well given full supervision. However, the success of…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Abdullah-Al-Zubaer Imran , Demetri Terzopoulos

Medical referring image segmentation (MRIS) requires pixel-level masks aligned with textual descriptions of anatomical locations, making annotation costly in low-label regimes. Semi-supervised learning (SSL) can mitigate this burden by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuchen Li , Zhen Zhao , Yi Liu , Luping Zhou

Referring remote sensing image segmentation (RRSIS) enables the precise delineation of regions within remote sensing imagery through natural language descriptions, serving critical applications in disaster response, urban development, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zhe Dong , Yuzhe Sun , Tianzhu Liu , Yanfeng Gu

Recent advances in large foundation models, such as the Segment Anything Model (SAM), have demonstrated considerable promise across various tasks. Despite their progress, these models still encounter challenges in specialized medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Wenxue Li , Xinyu Xiong , Peng Xia , Lie Ju , Zongyuan Ge

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning. Although models based on convolutional neural networks (CNNs) and Transformers have achieved remarkable success in medical image segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Jiashu Xu

The Segment Anything Model (SAM), originally built on a 2D Vision Transformer (ViT), excels at capturing global patterns in 2D natural images but struggles with 3D medical imaging modalities like CT and MRI. These modalities require…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiang Gao , Kai Lu

Computed tomography (CT) is extensively used for accurate visualization and segmentation of organs and lesions. While deep learning models such as convolutional neural networks (CNNs) and vision transformers (ViTs) have significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuheng Li , Yuxiang Lai , Maria Thor , Deborah Marshall , Zachary Buchwald , David S. Yu , Xiaofeng Yang

Existing promptable segmentation methods in the medical imaging field primarily consider either textual or visual prompts to segment relevant objects, yet they often fall short when addressing anomalies in medical images, like tumors, which…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhongzhen Huang , Yankai Jiang , Rongzhao Zhang , Shaoting Zhang , Xiaofan Zhang

Pathology image segmentation is crucial in computational pathology for analyzing histological features relevant to cancer diagnosis and prognosis. However, current methods face major challenges in clinical applications due to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Zhixuan Chen , Junlin Hou , Liqi Lin , Yihui Wang , Yequan Bie , Xi Wang , Yanning Zhou , Ronald Cheong Kin Chan , Hao Chen

The advancement of medical image segmentation techniques has been propelled by the adoption of deep learning techniques, particularly UNet-based approaches, which exploit semantic information to improve the accuracy of segmentations.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ranmin Wang , Limin Zhuang , Hongkun Chen , Boyan Xu , Ruichu Cai

Volumetric segmentation is important in medical imaging, but current methods face challenges like requiring lots of manual annotations and being tailored to specific tasks, which limits their versatility. General segmentation models used…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Zifan Chen , Xinyu Nan , Jiazheng Li , Jie Zhao , Haifeng Li , Ziling Lin , Haoshen Li , Heyun Chen , Yiting Liu , Lei Tang , Li Zhang , Bin Dong

Medical image segmentation aims to delineate the anatomical or pathological structures of interest, playing a crucial role in clinical diagnosis. A substantial amount of high-quality annotated data is crucial for constructing high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Zhongnuo Yan , Tong Han , Yuhao Huang , Lian Liu , Han Zhou , Jiongquan Chen , Wenlong Shi , Yan Cao , Xin Yang , Dong Ni

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Referring Image Segmentation (RIS) aims at segmenting the target object from an image referred by one given natural language expression. The diverse and flexible expressions as well as complex visual contents in the images raise the RIS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yang Jiao , Zequn Jie , Weixin Luo , Jingjing Chen , Yu-Gang Jiang , Xiaolin Wei , Lin Ma

Radiotherapy-induced normal tissue injury is a clinically important complication, and accurate segmentation of injury regions from medical images could facilitate disease assessment, treatment planning, and longitudinal monitoring. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Caiwen Jiang , Lei Zeng , Wei Liu

Medical image segmentation is more clinically valuable when it supports diagnosis rather than merely producing lesion masks. However, diagnostically relevant lesion cues are often subtle and localized, while existing models may be…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Fengyi Zhang , Xujie Zeng , Mohan Liu , Zengyi Wang , Yalong Jiang

Referring image segmentation aims to segment an object referred to by natural language expression from an image. However, this task is challenging due to the distinct data properties between text and image, and the randomness introduced by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yichen Yan , Xingjian He , Wenxuan Wan , Jing Liu

Referring image segmentation (RIS) aims to segment a particular region based on a language expression prompt. Existing methods incorporate linguistic features into visual features and obtain multi-modal features for mask decoding. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Mengxi Zhang , Yiming Liu , Xiangjun Yin , Huanjing Yue , Jingyu Yang