English
Related papers

Related papers: CheXalign: Preference fine-tuning in chest X-ray i…

200 papers

Preference-based reinforcement learning (PbRL) provides a powerful paradigm to avoid meticulous reward engineering by learning rewards based on human preferences. However, real-time human feedback is hard to obtain in online tasks. Most…

Machine Learning · Computer Science 2024-12-24 Songjun Tu , Jingbo Sun , Qichao Zhang , Xiangyuan Lan , Dongbin Zhao

Vision--language models (VLMs) for radiology report generation (RRG) can produce long-form chest CT reports from volumetric scans and show strong potential to improve radiology workflow efficiency and consistency. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chenyu Wang , Weicheng Dai , Han Liu , Wenchao Li , Kayhan Batmanghelich

Data labeling is currently a time-consuming task that often requires expert knowledge. In research settings, the availability of correctly labeled data is crucial to ensure that model predictions are accurate and useful. We propose…

Machine Learning · Computer Science 2018-12-31 Marina Bendersky , Joy Wu , Tanveer Syeda-Mahmood

Multimodal models trained on large natural image-text pair datasets have exhibited astounding abilities in generating high-quality images. Medical imaging data is fundamentally different to natural images, and the language used to…

Drafting radiology reports is a complex task requiring flexibility, where radiologists tail content to available information and particular clinical demands. However, most current radiology report generation (RRG) models are constrained to…

Computation and Language · Computer Science 2024-12-17 Zhuhao Wang , Yihua Sun , Zihan Li , Xuan Yang , Fang Chen , Hongen Liao

Recent advances in generative super-resolution (SR) have greatly improved visual realism, yet existing evaluation and optimization frameworks remain misaligned with human perception. Full-Reference and No-Reference metrics often fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yushuai Song , Weize Quan , Weining Wang , Jiahui Sun , Jing Liu , Meng Li , Pengbin Yu , Zhentao Chen , Wei Shen , Lunxi Yuan , Dong-ming Yan

Large vision-language models (VLMs) have evolved from general-purpose applications to specialized use cases such as in the clinical domain, demonstrating potential for decision support in radiology. One promising application is assisting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Zhifan Jiang , Dong Yang , Vishwesh Nath , Abhijeet Parida , Nishad P. Kulkarni , Ziyue Xu , Daguang Xu , Syed Muhammad Anwar , Holger R. Roth , Marius George Linguraru

Chest radiograph interpretation requires temporal reasoning over prior and current studies, yet most vision-language models are trained on static image-report pairs and lack explicit supervision for modeling longitudinal change. We…

Chest X-ray interpretation is one of the most frequently performed diagnostic tasks in medicine and a primary target for AI development, yet current vision-language models are primarily trained on datasets of paired images and reports, not…

Automated radiology report generation offers an effective solution to alleviate radiologists' workload. However, most existing methods focus primarily on single or fixed-view images to model current disease conditions, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Kang Liu , Zhuoqi Ma , Xiaolu Kang , Yunan Li , Kun Xie , Zhicheng Jiao , Qiguang Miao

We propose a new automated evaluation metric for machine-generated radiology reports using the successful COMET architecture adapted for the radiology domain. We train and publish four medically-oriented model checkpoints, including one…

Computation and Language · Computer Science 2023-11-29 Amos Calamida , Farhad Nooralahzadeh , Morteza Rohanian , Koji Fujimoto , Mizuho Nishio , Michael Krauthammer

Radiology report generation (RRG) has emerged as a promising approach to alleviate radiologists' workload and reduce human errors by automatically generating diagnostic reports from medical images. A key challenge in RRG is achieving…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Yucheng Chen , Yang Yu , Yufei Shi , Conghao Xiong , Xulei Yang , Si Yong Yeo

Acquiring high-quality annotations in medical imaging is usually a costly process. Automatic label extraction with natural language processing (NLP) has emerged as a promising workaround to bypass the need of expert annotation. Despite the…

Computation and Language · Computer Science 2019-05-08 Tobi Olatunji , Li Yao , Ben Covington , Alexander Rhodes , Anthony Upton

Existing large video-language models (LVLMs) struggle to comprehend long videos correctly due to limited context. To address this problem, fine-tuning long-context LVLMs and employing GPT-based agents have emerged as promising solutions.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yongdong Luo , Xiawu Zheng , Guilin Li , Shukang Yin , Haojia Lin , Chaoyou Fu , Jinfa Huang , Jiayi Ji , Fei Chao , Jiebo Luo , Rongrong Ji

Medical report generation from imaging data remains a challenging task in clinical practice. While large language models (LLMs) show great promise in addressing this challenge, their effective integration with medical imaging data still…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Chunlei Li , Jingyang Hou , Yilei Shi , Jingliang Hu , Xiao Xiang Zhu , Lichao Mou

Radiology report generation (RRG) aims to describe automatically a radiology image with human-like language and could potentially support the work of radiologists, reducing the burden of manual reporting. Previous approaches often adopt an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Jun Wang , Abhir Bhalerao , Yulan He

Recent advancements in Large Language Models (LLMs) have been remarkable, with new models consistently surpassing their predecessors. These advancements are underpinned by extensive research on various training mechanisms. Among these,…

Computation and Language · Computer Science 2024-12-12 Hansle Gwon , Imjin Ahn , Young-Hak Kim , Sanghyun Park , Tae Joon Jun

Radiology report generation from chest X-rays is an important task in artificial intelligence with the potential to greatly reduce radiologists' workload and shorten patient wait times. Despite recent advances, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Puzhen Wu , Hexin Dong , Yi Lin , Yihao Ding , Yifan Peng

Recent progress in Large Vision-Language Models (LVLMs) has enabled promising applications in medical tasks, such as report generation and visual question answering. However, existing benchmarks focus mainly on the final diagnostic answer,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hyungyung Lee , Geon Choi , Jung-Oh Lee , Hangyul Yoon , Hyuk Gi Hong , Edward Choi

Automatic radiology report generation holds significant potential to streamline the labor-intensive process of report writing by radiologists, particularly for 3D radiographs such as CT scans. While CT scans are critical for clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Che Liu , Zhongwei Wan , Yuqi Wang , Hui Shen , Haozhe Wang , Kangyu Zheng , Mi Zhang , Rossella Arcucci