English
Related papers

Related papers: Alleviating Textual Reliance in Medical Language-g…

200 papers

Segmentation of infected areas in chest X-rays is pivotal for facilitating the accurate delineation of pulmonary structures and pathological anomalies. Recently, multi-modal language-guided image segmentation methods have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Shuchang Ye , Mingyuan Meng , Mingjian Li , Dagan Feng , Jinman Kim

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

Large language models (LLMs) have shown remarkable performance in vision-language tasks, but their application in the medical field remains underexplored, particularly for integrating structured time series data with unstructured clinical…

Computation and Language · Computer Science 2025-06-17 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Wei Bi , Yida Xu , Guo Li , Xian Yang

Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yunhe Gao , Yabin Zhang , Chong Wang , Jiaming Liu , Maya Varma , Jean-Benoit Delbrouck , Akshay Chaudhari , Curtis Langlotz

Self-supervised vision-language pretraining from pure images and text with a contrastive loss is effective, but ignores fine-grained alignment due to a dual-stream architecture that aligns image and text representations only on a global…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Zaid Khan , Vijay Kumar BG , Xiang Yu , Samuel Schulter , Manmohan Chandraker , Yun Fu

Vision-language segmentation models have recently achieved strong performance by leveraging high-level semantic object categories expressed in natural language. However, this semantic dependence limits their ability to reason about…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Corentin Seutin , Mohamed Amine Ettaki , Michaël Clément , Pierrick Coupé , Rémi Giraud

Recent developments underscore the potential of textual information in enhancing learning models for a deeper understanding of medical visual semantics. However, language-guided medical image segmentation still faces a challenging issue.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xiaoshuang Huang , Hongxiang Li , Meng Cao , Long Chen , Chenyu You , Dong An

Medical contrastive vision-language pre-training (VLP) has demonstrated significant potential in improving performance on downstream tasks. Traditional approaches typically employ contrastive learning, treating paired image-report samples…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Phuoc-Nguyen Bui , Toan Duc Nguyen , Junghyun Bum , Duc-Tai Le , Hyunseung Choo

Medical image segmentation remains challenging due to limited annotations for training, ambiguous anatomical features, and domain shifts. While vision-language models such as CLIP offer strong cross-modal representations, their potential…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Taha Koleilat , Hojat Asgariandehkordi , Omid Nejati Manzari , Berardino Barile , Yiming Xiao , Hassan Rivaz

Recent progress in deep learning has significantly advanced CT image analysis, particularly for segmentation tasks. However, these advances are largely confined to image-level pattern recognition, with most methods lacking explicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuyuan Liu , Can Peng , Yingyu Yang , Qianye Yang , Cheng Ouyang , J. Alison Noble

Weakly-supervised medical image segmentation is a challenging task that aims to reduce the annotation cost while keep the segmentation performance. In this paper, we present a novel framework, SimTxtSeg, that leverages simple text cues to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yuxin Xie , Tao Zhou , Yi Zhou , Geng Chen

Open-vocabulary semantic segmentation models associate vision and text to label pixels from an undefined set of classes using textual queries, providing versatile performance on novel datasets. However, large shifts between training and…

Segmentation of the infected areas of the lung is essential for quantifying the severity of lung disease like pulmonary infections. Existing medical image segmentation methods are almost uni-modal methods based on image. However, these…

Image and Video Processing · Electrical Eng. & Systems 2023-07-11 Yi Zhong , Mengqiu Xu , Kongming Liang , Kaixin Chen , Ming Wu

Supervised deep learning for semantic segmentation has achieved excellent results in accurately identifying anatomical and pathological structures in medical images. However, it often requires large annotated training datasets, which limits…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Luca Ciampi , Gabriele Lagani , Giuseppe Amato , Fabrizio Falchi

The absence of adequately sufficient expert-level tumor annotations hinders the effectiveness of supervised learning based opportunistic cancer screening on medical imaging. Clinical reports (that are rich in descriptive textual details)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Guangyu Guo , Jiawen Yao , Yingda Xia , Tony C. W. Mok , Zhilin Zheng , Junwei Han , Le Lu , Dingwen Zhang , Jian Zhou , Ling Zhang

Audio-visual semantic segmentation (AVSS) represents an extension of the audio-visual segmentation (AVS) task, necessitating a semantic understanding of audio-visual scenes beyond merely identifying sound-emitting objects at the visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yujian Lee , Peng Gao , Yongqi Xu , Wentao Fan

Prompt-based medical image segmentation has rapidly emerged, yet existing methods rely on explicit prompts like bounding boxes and struggle to reason about the spatial relationships essential for clinical diagnosis. While general-domain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Quoc-Huy Trinh , Minh-Van Nguyen , Jun Zeng , Debesh Jha , Ulas Bagci

Although active learning (AL) in segmentation tasks enables experts to annotate selected regions of interest (ROIs) instead of entire images, it remains highly challenging, labor-intensive, and cognitively demanding due to the blurry and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Md Shazid Islam , Shreyangshu Bera , Sudipta Paul , Amit K. Roy-Chowdhury

Medical image analysis using deep learning is often challenged by limited labeled data and high annotation costs. Fine-tuning the entire network in label-limited scenarios can lead to overfitting and suboptimal performance. Recently, prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Fan Bai , Ke Yan , Xiaoyu Bai , Xinyu Mao , Xiaoli Yin , Jingren Zhou , Yu Shi , Le Lu , Max Q. -H. Meng

Automatic segmentation of medical images with DL algorithms has proven to be highly successful. With most of these algorithms, inter-observer variation is an acknowledged problem, leading to sub-optimal results. This problem is even more…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Anjali Balagopal , Howard Morgan , Michael Dohopoloski , Ramsey Timmerman , Jie Shan , Daniel F. Heitjan , Wei Liu , Dan Nguyen , Raquibul Hannan , Aurelie Garant , Neil Desai , Steve Jiang