中文
相关论文

相关论文: Alleviating Textual Reliance in Medical Language-g…

200 篇论文

Segmentation of infected areas in chest X-rays is pivotal for facilitating the accurate delineation of pulmonary structures and pathological anomalies. Recently, multi-modal language-guided image segmentation methods have emerged as a…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Shuchang Ye , Mingyuan Meng , Mingjian Li , Dagan Feng , Jinman Kim

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

Large language models (LLMs) have shown remarkable performance in vision-language tasks, but their application in the medical field remains underexplored, particularly for integrating structured time series data with unstructured clinical…

计算与语言 · 计算机科学 2025-06-17 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Wei Bi , Yida Xu , Guo Li , Xian Yang

Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Yunhe Gao , Yabin Zhang , Chong Wang , Jiaming Liu , Maya Varma , Jean-Benoit Delbrouck , Akshay Chaudhari , Curtis Langlotz

Self-supervised vision-language pretraining from pure images and text with a contrastive loss is effective, but ignores fine-grained alignment due to a dual-stream architecture that aligns image and text representations only on a global…

计算机视觉与模式识别 · 计算机科学 2022-07-29 Zaid Khan , Vijay Kumar BG , Xiang Yu , Samuel Schulter , Manmohan Chandraker , Yun Fu

Vision-language segmentation models have recently achieved strong performance by leveraging high-level semantic object categories expressed in natural language. However, this semantic dependence limits their ability to reason about…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Corentin Seutin , Mohamed Amine Ettaki , Michaël Clément , Pierrick Coupé , Rémi Giraud

Recent developments underscore the potential of textual information in enhancing learning models for a deeper understanding of medical visual semantics. However, language-guided medical image segmentation still faces a challenging issue.…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Xiaoshuang Huang , Hongxiang Li , Meng Cao , Long Chen , Chenyu You , Dong An

Medical contrastive vision-language pre-training (VLP) has demonstrated significant potential in improving performance on downstream tasks. Traditional approaches typically employ contrastive learning, treating paired image-report samples…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Phuoc-Nguyen Bui , Toan Duc Nguyen , Junghyun Bum , Duc-Tai Le , Hyunseung Choo

Medical image segmentation remains challenging due to limited annotations for training, ambiguous anatomical features, and domain shifts. While vision-language models such as CLIP offer strong cross-modal representations, their potential…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Taha Koleilat , Hojat Asgariandehkordi , Omid Nejati Manzari , Berardino Barile , Yiming Xiao , Hassan Rivaz

Recent progress in deep learning has significantly advanced CT image analysis, particularly for segmentation tasks. However, these advances are largely confined to image-level pattern recognition, with most methods lacking explicit…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Yuyuan Liu , Can Peng , Yingyu Yang , Qianye Yang , Cheng Ouyang , J. Alison Noble

Weakly-supervised medical image segmentation is a challenging task that aims to reduce the annotation cost while keep the segmentation performance. In this paper, we present a novel framework, SimTxtSeg, that leverages simple text cues to…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Yuxin Xie , Tao Zhou , Yi Zhou , Geng Chen

Open-vocabulary semantic segmentation models associate vision and text to label pixels from an undefined set of classes using textual queries, providing versatile performance on novel datasets. However, large shifts between training and…

Segmentation of the infected areas of the lung is essential for quantifying the severity of lung disease like pulmonary infections. Existing medical image segmentation methods are almost uni-modal methods based on image. However, these…

图像与视频处理 · 电气工程与系统科学 2023-07-11 Yi Zhong , Mengqiu Xu , Kongming Liang , Kaixin Chen , Ming Wu

Supervised deep learning for semantic segmentation has achieved excellent results in accurately identifying anatomical and pathological structures in medical images. However, it often requires large annotated training datasets, which limits…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Luca Ciampi , Gabriele Lagani , Giuseppe Amato , Fabrizio Falchi

The absence of adequately sufficient expert-level tumor annotations hinders the effectiveness of supervised learning based opportunistic cancer screening on medical imaging. Clinical reports (that are rich in descriptive textual details)…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Guangyu Guo , Jiawen Yao , Yingda Xia , Tony C. W. Mok , Zhilin Zheng , Junwei Han , Le Lu , Dingwen Zhang , Jian Zhou , Ling Zhang

Audio-visual semantic segmentation (AVSS) represents an extension of the audio-visual segmentation (AVS) task, necessitating a semantic understanding of audio-visual scenes beyond merely identifying sound-emitting objects at the visual…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Yujian Lee , Peng Gao , Yongqi Xu , Wentao Fan

Prompt-based medical image segmentation has rapidly emerged, yet existing methods rely on explicit prompts like bounding boxes and struggle to reason about the spatial relationships essential for clinical diagnosis. While general-domain…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Quoc-Huy Trinh , Minh-Van Nguyen , Jun Zeng , Debesh Jha , Ulas Bagci

Although active learning (AL) in segmentation tasks enables experts to annotate selected regions of interest (ROIs) instead of entire images, it remains highly challenging, labor-intensive, and cognitively demanding due to the blurry and…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Md Shazid Islam , Shreyangshu Bera , Sudipta Paul , Amit K. Roy-Chowdhury

Medical image analysis using deep learning is often challenged by limited labeled data and high annotation costs. Fine-tuning the entire network in label-limited scenarios can lead to overfitting and suboptimal performance. Recently, prompt…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Fan Bai , Ke Yan , Xiaoyu Bai , Xinyu Mao , Xiaoli Yin , Jingren Zhou , Yu Shi , Le Lu , Max Q. -H. Meng

Automatic segmentation of medical images with DL algorithms has proven to be highly successful. With most of these algorithms, inter-observer variation is an acknowledged problem, leading to sub-optimal results. This problem is even more…