English
Related papers

Related papers: RadBERT-CL: Factually-Aware Contrastive Learning F…

200 papers

Contrastive pretraining is well-known to improve downstream task performance and model generalisation, especially in limited label settings. However, it is sensitive to the choice of augmentation pipeline. Positive pairs should preserve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Melanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Zeyu Fu , Jianbo Jiao , Robail Yasrab , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

As the digital news industry becomes the main channel of information dissemination, the adverse impact of fake news is explosively magnified. The credibility of a news report should not be considered in isolation. Rather, previously…

Computation and Language · Computer Science 2021-09-13 Wenjia Zhang , Lin Gui , Yulan He

Multimodal foundation models hold significant potential for automating radiology report generation, thereby assisting clinicians in diagnosing cardiac diseases. However, generated reports often suffer from serious factual inaccuracy. In…

Computation and Language · Computer Science 2025-02-07 Liwen Sun , James Zhao , Megan Han , Chenyan Xiong

Due to the common content of anatomy, radiology images with their corresponding reports exhibit high similarity. Such inherent data bias can predispose automatic report generation models to learn entangled and spurious representations…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Mingjie Li , Haokun Lin , Liang Qiu , Xiaodan Liang , Ling Chen , Abdulmotaleb Elsaddik , Xiaojun Chang

This paper presents a novel positive and negative set selection strategy for contrastive learning of medical images based on labels that can be extracted from clinical data. In the medical field, there exists a variety of labels for data…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib

Obtaining datasets labeled to facilitate model development is a challenge for most machine learning tasks. The difficulty is heightened for medical imaging, where data itself is limited in accessibility and labeling requires costly time and…

Computation and Language · Computer Science 2018-10-03 Nithya Attaluri , Ahmed Nasir , Carolynne Powe , Harold Racz , Ben Covington , Li Yao , Jordan Prosky , Eric Poblenz , Tobi Olatunji , Kevin Lyman

Semi-supervised medical image segmentation has shown promise in training models with limited labeled data and abundant unlabeled data. However, state-of-the-art methods ignore a potentially valuable source of unsupervised semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qianying Liu , Paul Henderson , Xiao Gu , Hang Dai , Fani Deligianni

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

This paper presents a novel positive and negative set selection strategy for contrastive learning of medical images based on labels that can be extracted from clinical data. In the medical field, there exists a variety of labels for data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Kiran Kokilepersaud , Stephanie Trejo Corona , Mohit Prabhushankar , Ghassan AlRegib , Charles Wykoff

Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guangyu Meng , Pengfei Gu , Peixian Liang , John P. Lalor , Erin Wolf Chambers , Danny Z. Chen

Contrastive learning -- a modern approach to extract useful representations from unlabeled data by training models to distinguish similar samples from dissimilar ones -- has driven significant progress in foundation models. In this work, we…

Machine Learning · Statistics 2025-10-15 Licong Lin , Song Mei

Machine learning methods have recently achieved high-performance in biomedical text analysis. However, a major bottleneck in the widespread application of these methods is obtaining the required large amounts of annotated training data,…

Machine Learning · Computer Science 2019-12-06 Xing Meng , Craig H. Ganoe , Ryan T. Sieberg , Yvonne Y. Cheung , Saeed Hassanpour

Contrastive learning has been used to learn a high-quality representation of the image in computer vision. However, contrastive learning is not widely utilized in natural language processing due to the lack of a general method of data…

Computation and Language · Computer Science 2021-04-29 Peng Su , Yifan Peng , K. Vijay-Shanker

Developing imaging models capable of detecting pathologies from chest X-rays can be cost and time-prohibitive for large datasets as it requires supervision to attain state-of-the-art performance. Instead, labels extracted from radiology…

Computation and Language · Computer Science 2024-08-09 Panagiotis Fytas , Anna Breger , Ian Selby , Simon Baker , Shahab Shahipasand , Anna Korhonen

Radiology reports are critical for clinical decision-making but often lack a standardized format, limiting both human interpretability and machine learning (ML) applications. While large language models (LLMs) have shown strong capabilities…

Computation and Language · Computer Science 2025-07-15 Johannes Moll , Louisa Fay , Asfandyar Azhar , Sophie Ostmeier , Tim Lueth , Sergios Gatidis , Curtis Langlotz , Jean-Benoit Delbrouck

Spoken communication plays a central role in clinical workflows. In radiology, for example, most reports are created through dictation. Yet, nearly all medical AI systems rely exclusively on written text. In this work, we address this gap…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-06 Lukas Buess , Jan Geier , David Bani-Harouni , Chantal Pellegrini , Matthias Keicher , Paula Andrea Perez-Toro , Nassir Navab , Andreas Maier , Tomas Arias-Vergara

The emergence of Large Language Models (LLMs) presents unprecedented opportunities to revolutionize medical contrastive vision-language pre-training. In this paper, we show how LLMs can facilitate large-scale supervised pre-training,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yingtai Li , Haoran Lai , Xiaoqian Zhou , Shuai Ming , Wenxin Ma , Wei Wei , Shaohua Kevin Zhou

Automated radiology report generation offers an effective solution to alleviate radiologists' workload. However, most existing methods focus primarily on single or fixed-view images to model current disease conditions, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Kang Liu , Zhuoqi Ma , Xiaolu Kang , Yunan Li , Kun Xie , Zhicheng Jiao , Qiguang Miao

Automated radiology report generation has the potential to improve radiology reporting and alleviate the workload of radiologists. However, the medical report generation task poses unique challenges due to the limited availability of…

Computation and Language · Computer Science 2023-12-27 Ruoqing Zhao , Xi Wang , Hongliang Dai , Pan Gao , Piji Li
‹ Prev 1 2 3 10 Next ›