English
Related papers

Related papers: Alleviating Textual Reliance in Medical Language-g…

200 papers

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

Medical image segmentation remains challenging due to the high cost of pixel-level annotations for training. In the context of weak supervision, clinician gaze data captures regions of diagnostic interest; however, its sparsity limits its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jingkun Chen , Haoran Duan , Xiao Zhang , Boyan Gao , Vicente Grau , Jungong Han

Aside from offering state-of-the-art performance in medical image generation, denoising diffusion probabilistic models (DPM) can also serve as a representation learner to capture semantic information and potentially be used as an image…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Chun-Mei Feng

In this work, we investigate performing semantic segmentation solely through the training on image-sentence pairs. Due to the lack of dense annotations, existing text-supervised methods can only learn to group an image into semantic regions…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Yabo Zhang , Zihao Wang , Jun Hao Liew , Jingjia Huang , Manyu Zhu , Jiashi Feng , Wangmeng Zuo

To address prevalent issues in medical imaging, such as data acquisition challenges and label availability, transfer learning from natural to medical image domains serves as a viable strategy to produce reliable segmentation results.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

Accurate segmentation of Optical Coherence Tomography (OCT) images is crucial for diagnosing and monitoring retinal diseases. However, the labor-intensive nature of pixel-level annotation limits the scalability of supervised learning for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Jiaqi Yang , Nitish Mehta , Xiaoling Hu , Chao Chen , Chia-Ling Tsai

With the rapid advancement of pathology foundation models (FMs), the representation learning of whole slide images (WSIs) attracts increasing attention. Existing studies develop high-quality patch feature extractors and employ carefully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yuxuan Chen , Jiawen Li , Jiali Hu , Xitong Ling , Tian Guan , Anjia Han , Yonghong He

Reasoning segmentation seeks pixel-accurate masks for targets referenced by complex, often implicit instructions, requiring context-dependent reasoning over the scene. Recent multimodal language models have advanced instruction following…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Prantik Howlader , Hoang Nguyen-Canh , Srijan Das , Jingyi Xu , Hieu Le , Dimitris Samaras

Medical image segmentation is critical for computer-aided diagnosis. However, dense pixel-level annotation is time-consuming and expensive, and medical datasets often exhibit severe class imbalance. Such imbalance causes minority structures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Yingxue Su , Yiheng Zhong , Keying Zhu , Zimu Zhang , Zhuoru Zhang , Yifang Wang , Yuxin Zhang , Jingxin Liu

Medical diagnosis requires the effective synthesis of visual manifestations and clinical metadata. However, existing methods often treat metadata as isolated tags, failing to exploit the rich semantic knowledge embedded in clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yiqing Wang , Chunming He , Ming-Chen Lu , Mercy Pawar , Leslie Niziol , Maria Woodward , Sina Farsiu

Recently, CLIP-based approaches have exhibited remarkable performance on generalization and few-shot learning tasks, fueled by the power of contrastive language-vision pre-training. In particular, prompt tuning has emerged as an effective…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Balamurali Murugesan , Rukhshanda Hussain , Rajarshi Bhattacharya , Ismail Ben Ayed , Jose Dolz

Medical image segmentation allows quantifying target structure size and shape, aiding in disease diagnosis, prognosis, surgery planning, and comprehension.Building upon recent advancements in foundation Vision-Language Models (VLMs) from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Kanchan Poudel , Manish Dhakal , Prasiddha Bhandari , Rabin Adhikari , Safal Thapaliya , Bishesh Khanal

The previous advancements in pathology image understanding primarily involved developing models tailored to specific tasks. Recent studies has demonstrated that the large vision-language model can enhance the performance of various…

Artificial Intelligence · Computer Science 2024-08-20 Dawei Dai , Yuanhui Zhang , Long Xu , Qianlan Yang , Xiaojing Shen , Shuyin Xia , Guoyin Wang

Text guided 3D medical image segmentation offers a flexible alternative to class based and spatial prompt based models by allowing users to specify regions of interest directly in natural language. This paradigm avoids reliance on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Yu Xin , Gorkem Can Ates , Jun Ma , Sumin Kim , Ying Zhang , Kaleb E Smith , Kuang Gong , Wei Shao

Learning medical visual representations from image-report pairs through joint learning has garnered increasing research attention due to its potential to alleviate the data scarcity problem in the medical domain. The primary challenges stem…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jun Wang , Lixing Zhu , Xiaohan Yu , Abhir Bhalerao , Yulan He

Semi-supervised learning (SSL) has achieved significant progress in medical image segmentation (SSMIS) through effective utilization of limited labeled data. While current SSL methods for medical images predominantly rely on consistency…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Mengzhu Wang , Jiao Li , Shanshan Wang , Long Lan , Huibin Tan , Liang Yang , Guoli Yang

Deep learning has greatly advanced medical image segmentation, but its success relies heavily on fully supervised learning, which requires dense annotations that are costly and time-consuming for 3D volumetric scans. Barely-supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Shuang Zeng , Boxu Xie , Lei Zhu , Xinliang Zhang , Jiakui Hu , Zhengjian Yao , Yuanwei Li , Yuxing Lu , Yanye Lu

Current state-of-the-art semantic role labeling (SRL) uses a deep neural network with no explicit linguistic features. However, prior work has shown that gold syntax trees can dramatically improve SRL decoding, suggesting the possibility of…

Computation and Language · Computer Science 2018-11-13 Emma Strubell , Patrick Verga , Daniel Andor , David Weiss , Andrew McCallum

Deep learning-based medical image segmentation typically requires large amount of labeled data for training, making it less applicable in clinical settings due to high annotation cost. Semi-supervised learning (SSL) has emerged as an…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Yichi Zhang , Bohao Lv , Le Xue , Wenbo Zhang , Yuchen Liu , Yu Fu , Yuan Cheng , Yuan Qi

In clinical practice, segmenting specific lesions based on the needs of physicians can significantly enhance diagnostic accuracy and treatment efficiency. However, conventional lesion segmentation models lack the flexibility to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuyi Ouyang , Jinyang Zhang , Xiangye Lin , Xilai Wang , Qingqing Chen , Yen-Wei Chen , Lanfen Lin