English
Related papers

Related papers: CoCa-CXR: Contrastive Captioners Learn Strong Temp…

200 papers

Contrastive learning has been proved to be a promising technique for image-level representation learning from unlabeled data. Many existing works have demonstrated improved results by applying contrastive learning in classification and…

Image and Video Processing · Electrical Eng. & Systems 2021-09-20 Dewen Zeng , John N. Kheir , Peng Zeng , Yiyu Shi

Longitudinal chest X-ray (CXR) interpretation requires reasoning over disease evolution across multiple patient visits, yet most existing medical VQA benchmarks focus on single images or short-horizon image pairs. We introduce MI-CXR, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Sunghwan Steve Cho , Yunseok Han , Jaeyoung Do

Exploring large-scale pretrained foundation models is of significant interest in computer vision because these models can be quickly transferred to many downstream tasks. This paper presents Contrastive Captioner (CoCa), a minimalist design…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Jiahui Yu , Zirui Wang , Vijay Vasudevan , Legg Yeung , Mojtaba Seyedhosseini , Yonghui Wu

Chest X-rays (CXRs) are a widely used imaging modality for the diagnosis and prognosis of lung disease. The image analysis tasks vary. Examples include pathology detection and lung segmentation. There is a large body of work where machine…

Image and Video Processing · Electrical Eng. & Systems 2023-05-19 Syed Muhammad Anwar , Abhijeet Parida , Sara Atito , Muhammad Awais , Gustavo Nino , Josef Kitler , Marius George Linguraru

Automated interpretation of chest X-rays (CXR) is a critical task with the potential to significantly improve clinical workflow and patient care. While recent advances in multimodal foundation models have shown promise, effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Alexander Davis , Rafael Souza , Jia-Hao Lim

Contrastive learning is a form of self-supervision that can leverage unlabeled data to produce pretrained models. While contrastive learning has demonstrated promising results on natural image classification tasks, its application to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Hari Sowrirajan , Jingbo Yang , Andrew Y. Ng , Pranav Rajpurkar

Self-supervised learning in vision-language processing exploits semantic alignment between imaging and text modalities. Prior work in biomedical VLP has mostly relied on the alignment of single image and report pairs even though clinical…

State-of-the-art (SOTA) image and text generation models are multimodal models that have many similarities to large language models (LLMs). Despite achieving strong performances, leading foundational multimodal model architectures…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jake R. Patock , Nicole Catherine Lewis , Kevin McCoy , Christina Gomez , Canling Chen , Lorenzo Luzi

Chest imaging plays an essential role in diagnosing and predicting patients with COVID-19 with evidence of worsening respiratory status. Many deep learning-based approaches for pneumonia recognition have been developed to enable…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Shengchao Chen , Sufen Ren , Guanjun Wang , Mengxing Huang , Chenyang Xue

Purpose: This study aimed to develop an open-source multimodal large language model (CXR-LLAVA) for interpreting chest X-ray images (CXRs), leveraging recent advances in large language models (LLMs) to potentially replicate the image…

Computation and Language · Computer Science 2024-01-17 Seowoo Lee , Jiwon Youn , Hyungjin Kim , Mansu Kim , Soon Ho Yoon

Public datasets of Chest X-Rays (CXRs) have long been a popular benchmark for developing machine learning (ML) computer vision models in healthcare. However, the reported strong average-case performance of these models do not necessarily…

Machine Learning · Computer Science 2026-02-10 Andrew Wang , Jiashuo Zhang , Michael Oberst

Chest X-ray radiography (CXR) is an essential medical imaging technique for disease diagnosis. However, as 2D projectional images, CXRs are limited by structural superposition and hence fail to capture 3D anatomies. This limitation makes…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Zefan Yang , Ge Wang , James Hendler , Mannudeep K. Kalra , Pingkun Yan

Recently, chest X-ray report generation, which aims to automatically generate descriptions of given chest X-ray images, has received growing research interests. The key challenge of chest X-ray report generation is to accurately capture and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Fenglin Liu , Changchang Yin , Xian Wu , Shen Ge , Yuexian Zou , Ping Zhang , Yuexian Zou , Xu Sun

Medical report generation is a challenging task since it is time-consuming and requires expertise from experienced radiologists. The goal of medical report generation is to accurately capture and describe the image findings. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Yu-Jen Chen , Wei-Hsiang Shen , Hao-Wei Chung , Ching-Hao Chiu , Da-Cheng Juan , Tsung-Ying Ho , Chi-Tung Cheng , Meng-Lin Li , Tsung-Yi Ho

A large-scale image-text pair dataset has greatly contributed to the development of vision-language pre-training (VLP) models, which enable zero-shot or few-shot classification without costly annotation. However, in the medical domain, the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Kihyun You , Jawook Gu , Jiyeon Ham , Beomhee Park , Jiho Kim , Eun Kyoung Hong , Woonhyunk Baek , Byungseok Roh

Vision-language pretraining has advanced image-text alignment, yet progress in radiology remains constrained by the heterogeneity of clinical reports, including abbreviations, impression-only notes, and stylistic variability. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Hanbin Ko , Gihun Cho , Inhyeok Baek , Donguk Kim , Joonbeom Koo , Changi Kim , Dongheon Lee , Chang Min Park

In intensive care units (ICUs), patients with complex clinical conditions require vigilant monitoring and prompt interventions. Chest X-rays (CXRs) are a vital diagnostic tool, providing insights into clinical trajectories, but their…

Chest X-ray radiographs (CXRs) play a pivotal role in diagnosing and monitoring cardiopulmonary diseases. However, lung opacities in CXRs frequently obscure anatomical structures, impeding clear identification of lung borders and…

Image and Video Processing · Electrical Eng. & Systems 2025-03-30 Junzhi Ning , Dominic Marshall , Yijian Gao , Xiaodan Xing Yang Nan , Yingying Fang , Sheng Zhang , Matthieu Komorowski , Guang Yang

Chest radiograph interpretation requires temporal reasoning over prior and current studies, yet most vision-language models are trained on static image-report pairs and lack explicit supervision for modeling longitudinal change. We…

Chest radiography is an effective screening tool for diagnosing pulmonary diseases. In computer-aided diagnosis, extracting the relevant region of interest, i.e., isolating the lung region of each radiography image, can be an essential step…

Image and Video Processing · Electrical Eng. & Systems 2022-02-23 Hilda Azimi , Jianxing Zhang , Pengcheng Xi , Hala Asad , Ashkan Ebadi , Stephane Tremblay , Alexander Wong
‹ Prev 1 2 3 10 Next ›