English
Related papers

Related papers: RadPhi-3: Small Language Models for Radiology

200 papers

Radiology reporting generative AI holds significant potential to alleviate clinical workloads and streamline medical care. However, achieving high clinical accuracy is challenging, as radiological images often feature subtle lesions and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yijian Gao , Dominic Marshall , Xiaodan Xing , Junzhi Ning , Giorgos Papanastasiou , Guang Yang , Matthieu Komorowski

Proprietary Large Language Models (LLMs), such as ChatGPT, have garnered significant attention due to their exceptional capabilities in handling a diverse range of tasks. Recent studies demonstrate that open-sourced smaller foundational…

Computation and Language · Computer Science 2023-10-10 Yue Zhang , Leyang Cui , Deng Cai , Xinting Huang , Tao Fang , Wei Bi

Medical imaging is frequently used in clinical practice and trials for diagnosis and treatment. Writing imaging reports is time-consuming and can be error-prone for inexperienced radiologists. Therefore, automatically generating radiology…

Computation and Language · Computer Science 2022-04-29 Zhihong Chen , Yan Song , Tsung-Hui Chang , Xiang Wan

Reinforcement learning with AI feedback (RLAIF) is a popular paradigm for improving the instruction-following abilities of powerful pre-trained language models. RLAIF first performs supervised fine-tuning (SFT) using demonstrations from a…

Machine Learning · Computer Science 2024-02-20 Archit Sharma , Sedrick Keh , Eric Mitchell , Chelsea Finn , Kushal Arora , Thomas Kollar

This paper explores training medical vision-language models (VLMs) -- where the visual and language inputs are embedded into a common space -- with a particular focus on scenarios where training data is limited, as is often the case in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Rhydian Windsor , Amir Jamaludin , Timor Kadir , Andrew Zisserman

Automated radiology report generation holds significant potential to reduce radiologists' workload and enhance diagnostic accuracy. However, generating precise and clinically meaningful reports from chest radiographs remains challenging due…

Image and Video Processing · Electrical Eng. & Systems 2026-05-20 Md. Zihad Bin Jahangir , Muhammad Ashad Kabir , Sumaiya Akter , Israt Jahan , Minh Chau

Parameter-efficient fine-tuning (PEFT) that was initially developed for exploiting pre-trained large language models has recently emerged as an effective approach to perform transfer learning on computer vision tasks. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Chenyu Lian , Hong-Yu Zhou , Yizhou Yu , Liansheng Wang

As foundation AI models continue to increase in size, an important question arises - is massive scale the only path forward? This survey of about 160 papers presents a family of Small Language Models (SLMs) in the 1 to 8 billion parameter…

Electronic Patient Record (EPR) systems contain valuable clinical information, but much of it is trapped in unstructured text, limiting its use for research and decision-making. Large language models can extract such information but require…

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

Large Language Models (LLMs) have demonstrated promise in medical knowledge assessments, yet their practical utility in real-world clinical decision-making remains underexplored. In this study, we evaluated the performance of three…

Computation and Language · Computer Science 2025-12-30 Mengdi Chai , Ali R. Zomorrodi

Large language models (LLMs) have become increasingly popular in medical domains to assist physicians with a variety of clinical and operational tasks. Given the fast-paced and high-stakes environment of emergency departments (EDs), small…

Computation and Language · Computer Science 2025-10-07 Zirui Wang , Jiajun Wu , Braden Teitge , Jessalyn Holodinsky , Steve Drew

Recent advances in AI combine large language models (LLMs) with vision encoders that bring forward unprecedented technical capabilities to leverage for a wide range of healthcare applications. Focusing on the domain of radiology,…

Radiology report generation (RRG) has attracted significant attention due to its potential to reduce the workload of radiologists. Current RRG approaches are still unsatisfactory against clinical standards. This paper introduces a novel RRG…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Zijian Zhou , Miaojing Shi , Meng Wei , Oluwatosin Alabi , Zijie Yue , Tom Vercauteren

Due to advances in machine learning and artificial intelligence (AI), a new role is emerging for machines as intelligent assistants to radiologists in their clinical workflows. But what systematic clinical thought processes are these…

Artificial Intelligence · Computer Science 2020-09-15 Karina Kanjaria , Anup Pillai , Chaitanya Shivade , Marina Bendersky , Ashutosh Jadhav , Vandana Mukherjee , Tanveer Syeda-Mahmood

Extraction of relevant pathological terms from radiology reports is important for correct image label generation and disease population studies. In this letter, we compare the performance of some known application program interface (APIs)…

Information Retrieval · Computer Science 2018-12-08 Tahsin Mostafiz , Khalid Ashraf

Background: Large language models (LLMs) are gaining use in clinical settings, but their performance can suffer with incomplete radiology reports. We tested whether multimodal LLMs (using text and images) could improve accuracy and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-10 Choonghan Kim , Seonhee Cho , Joo Heung Yoon

In few-shot classification tasks (so-called episodes), a small set of labeled support samples is provided during inference to aid the classification of unlabeled query samples. Metric-based models typically operate by computing similarities…

Machine Learning · Computer Science 2025-06-24 Xuanyu Zhuang , Geoffroy Peeters , Gaël Richard

Medical report generation automates radiology descriptions from images, easing the burden on physicians and minimizing errors. However, current methods lack structured outputs and physician interactivity for clear, clinically relevant…

Artificial Intelligence · Computer Science 2024-04-18 Hongzhao Li , Hongyu Wang , Xia Sun , Hua He , Jun Feng

Large language models (LLMs) are increasingly used to extract structured information from free-text clinical records, but prior work often focuses on single tasks, limited models, and English-language reports. We evaluated 15 open-weight…