中文
相关论文

相关论文: CheXalign: Preference fine-tuning in chest X-ray i…

200 篇论文

Foundation models, trained on vast amounts of data using self-supervised techniques, have emerged as a promising frontier for advancing artificial intelligence (AI) applications in medicine. This study evaluates three different…

In recent years, automated radiology report generation has experienced significant growth. This paper introduces MRScore, an automatic evaluation metric tailored for radiology report generation by leveraging Large Language Models (LLMs).…

计算与语言 · 计算机科学 2024-04-30 Yunyi Liu , Zhanyu Wang , Yingshu Li , Xinyu Liang , Lingqiao Liu , Lei Wang , Luping Zhou

In this paper we introduce RE-tune, a novel approach for fine-tuning pre-trained Multimodal Biomedical Vision-Language models (VLMs) in Incremental Learning scenarios for multi-label chest disease diagnosis. RE-tune freezes the backbones…

人工智能 · 计算机科学 2024-10-24 Marco Mistretta , Andrew D. Bagdanov

RAG systems face limitations when semantic relevance alone does not guarantee improved generation quality. This issue becomes particularly evident due to the sensitivity of large language models (LLMs) to the ordering of few-shot prompts,…

信息检索 · 计算机科学 2024-11-04 Yu Bai , Yukai Miao , Li Chen , Dawei Wang , Dan Li , Yanyu Ren , Hongtao Xie , Ce Yang , Xuhui Cai

The manual creation of the "Impression" section in radiology reports is a primary driver of radiologist burnout. To address this challenge, we propose a coarse-to-fine framework that leverages open-source large language models (LLMs) to…

计算与语言 · 计算机科学 2025-09-30 Chengbo Sun , Hui Yi Leong , Lei Li

Vision-Language Models (VLMs) have significantly advanced automated Radiology Report Generation (RRG). However, existing methods implicitly assume high-quality inputs, overlooking the noise and artifacts prevalent in real-world clinical…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Hongze Zhu , Chen Hu , Jiaxuan Jiang , Hong Liu , Yawen Huang , Ming Hu , Tianyu Wang , Zhijian Wu , Yefeng Zheng

Visuomotor robot policies, increasingly pre-trained on large-scale datasets, promise significant advancements across robotics domains. However, aligning these policies with end-user preferences remains a challenge, particularly when the…

机器人学 · 计算机科学 2024-12-09 Ran Tian , Yilin Wu , Chenfeng Xu , Masayoshi Tomizuka , Jitendra Malik , Andrea Bajcsy

Generating radiology reports is time-consuming and requires extensive expertise in practice. Therefore, reliable automatic radiology report generation is highly desired to alleviate the workload. Although deep learning techniques have been…

图像与视频处理 · 电气工程与系统科学 2019-07-24 Jianbo Yuan , Haofu Liao , Rui Luo , Jiebo Luo

Chest X-ray (CXR) imaging is one of the most widely used diagnostic modalities in clinical practice, encompassing a broad spectrum of diagnostic tasks. Recent advancements have seen the extensive application of reasoning-based multimodal…

Radiology report summarization (RRS) is crucial for patient care, requiring concise "Impressions" from detailed "Findings." This paper introduces a novel prompting strategy to enhance RRS by first generating a layperson summary. This…

计算与语言 · 计算机科学 2024-06-21 Xingmeng Zhao , Tongnian Wang , Anthony Rios

Designing effective reward functions remains a fundamental challenge in reinforcement learning (RL), as it often requires extensive human effort and domain expertise. While RL from human feedback has been successful in aligning agents with…

机器学习 · 计算机科学 2025-06-17 Tung Minh Luu , Younghwan Lee , Donghoon Lee , Sunho Kim , Min Jun Kim , Chang D. Yoo

Radiology reports are highly technical documents aimed primarily at doctor-doctor communication. There has been an increasing interest in sharing those reports with patients, necessitating providing them patient-friendly simplifications of…

计算与语言 · 计算机科学 2024-06-28 Ziyu Yang , Santhosh Cherian , Slobodan Vucetic

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

图像与视频处理 · 电气工程与系统科学 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

We present a method and dataset for fine-tuning language models with preference supervision using feedback-driven improvement chains. Given a model response, an annotator provides fine-grained feedback by marking ``liked'' and ``disliked''…

计算与语言 · 计算机科学 2025-12-30 Sky CH-Wang , Justin Svegliato , Helen Appel , Jason Eisner

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

Chest X-ray report generation (CXR-RG) has the potential to substantially alleviate radiologists' workload. However, conventional autoregressive vision--language models (VLMs) suffer from high inference latency due to sequential token…

机器学习 · 计算机科学 2026-05-19 Lifeng Chen , Tianqi You , Hao Liu , Zhimin Bao , Jile Jiao , Xiao Han , Zhicai Ou , Tao Sun , Xiaofeng Mou , Xiaojie Jin , Yi Xu

The widespread use of chest X-rays (CXRs), coupled with a shortage of radiologists, has driven growing interest in automated CXR analysis and AI-assisted reporting. While existing vision-language models (VLMs) show promise in specific tasks…

Test-time scaling offers a promising way to improve the reasoning performance of vision-language large models (VLLMs) without additional training. In this paper, we explore a simple but effective approach for applying test-time scaling to…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Yue Yao , Zelin Wen , Yan Tong , Xinyu Tian , Xuqing Li , Xiao Ma , Dongliang Xu , Tom Gedeon

Automated structured radiology report generation (SRRG) from chest X-ray images offers significant potential to reduce workload of radiologists by generating reports in structured formats that ensure clarity, consistency, and adherence to…

机器学习 · 计算机科学 2025-10-02 Seongjae Kang , Dong Bok Lee , Juho Jung , Dongseop Kim , Won Hwa Kim , Sunghoon Joo

Automated radiology report generation (RRG) holds potential to reduce the workload of radiologists, and recent advances in multimodal large language models (MLLMs) have enabled multimodal chest X-ray (CXR) report generation. However,…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Jonggwon Park , Byungmu Yoon , Soobum Kim , Kyoyun Choi