English
Related papers

Related papers: FlexR: Few-shot Classification with Language Embed…

200 papers

Text to image latent diffusion models have recently advanced medical image synthesis, but applications to 3D CT generation remain limited. Existing approaches rely on simplified prompts, neglecting the rich semantic detail in full radiology…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Sina Amirrajab , Zohaib Salahuddin , Sheng Kuang , Henry C. Woodruff , Philippe Lambin

Automated diagnosis prediction from medical images is a valuable resource to support clinical decision-making. However, such systems usually need to be trained on large amounts of annotated data, which often is scarce in the medical domain.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Chantal Pellegrini , Matthias Keicher , Ege Özsoy , Petra Jiraskova , Rickmer Braren , Nassir Navab

In chest X-ray (CXR) image analysis, rule-based systems are usually employed to extract labels from reports for dataset releases. However, there is still room for improvement in label quality. These labelers typically output only presence…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Ricardo Bigolin Lanfredi , Pritam Mukherjee , Ronald Summers

Radiologists highly desire fully automated versatile AI for medical imaging interpretation. However, the lack of extensively annotated large-scale multi-disease datasets has hindered the achievement of this goal. In this paper, we explore…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Weiwei Cao , Jianpeng Zhang , Yingda Xia , Tony C. W. Mok , Zi Li , Xianghua Ye , Le Lu , Jian Zheng , Yuxing Tang , Ling Zhang

Deep learning has shown recent success in classifying anomalies in chest x-rays, but datasets are still small compared to natural image datasets. Supervision of abnormality localization has been shown to improve trained models, partially…

The field of medical diagnostics contains a wealth of challenges which closely resemble classical machine learning problems; practical constraints, however, complicate the translation of these endpoints naively into classical architectures.…

Computer Vision and Pattern Recognition · Computer Science 2018-02-05 Li Yao , Eric Poblenz , Dmitry Dagunts , Ben Covington , Devon Bernard , Kevin Lyman

The extraction of structured clinical information from free-text radiology reports in the form of radiology graphs has been demonstrated to be a valuable approach for evaluating the clinical correctness of report-generation methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yiheng Xiong , Jingsong Liu , Kamilia Zaripova , Sahand Sharifzadeh , Matthias Keicher , Nassir Navab

Medical consultation dialogues contain critical clinical information, yet their unstructured nature hinders effective utilization in diagnosis and treatment. Traditional methods, relying on rule-based or shallow machine learning techniques,…

Computation and Language · Computer Science 2025-04-24 Shuguang Zhao , Qiangzhong Feng , Zhiyang He , Peipei Sun , Yingying Wang , Xiaodong Tao , Xiaoliang Lu , Mei Cheng , Xinyue Wu , Yanyan Wang , Wei Liang

The complexity of stacked imaging and the massive number of radiographs make writing radiology reports complex and inefficient. Even highly experienced radiologists struggle to maintain accuracy and consistency in interpreting radiographs…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jianfei Xu , Thanet Markchom , Huizhi Liang

By describing the features and abstractions of our world, language is a crucial tool for human learning and a promising source of supervision for machine learning models. We use language to improve few-shot visual classification in the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Jesse Mu , Percy Liang , Noah Goodman

Segmentation of infected areas in chest X-rays is pivotal for facilitating the accurate delineation of pulmonary structures and pathological anomalies. Recently, multi-modal language-guided image segmentation methods have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Shuchang Ye , Mingyuan Meng , Mingjian Li , Dagan Feng , Jinman Kim

Chest X-rays (CXRs) are the most widely used medical imaging modality and play a pivotal role in diagnosing diseases. However, as 2D projection images, CXRs are limited by structural superposition, which constrains their effectiveness in…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Zefan Yang , Xinrui Song , Xuanang Xu , Yongyi Shi , Ge Wang , Mannudeep K. Kalra , Pingkun Yan

Machine learning has significantly advanced healthcare by aiding in disease prevention and treatment identification. However, accessing patient data can be challenging due to privacy concerns and strict regulations. Generating synthetic,…

Obtaining datasets labeled to facilitate model development is a challenge for most machine learning tasks. The difficulty is heightened for medical imaging, where data itself is limited in accessibility and labeling requires costly time and…

Computation and Language · Computer Science 2018-10-03 Nithya Attaluri , Ahmed Nasir , Carolynne Powe , Harold Racz , Ben Covington , Li Yao , Jordan Prosky , Eric Poblenz , Tobi Olatunji , Kevin Lyman

Chest radiograph (or Chest X-Ray, CXR) is a popular medical imaging modality that is used by radiologists across the world to diagnose heart or lung conditions. Over the last decade, Convolutional Neural Networks (CNN), have seen success in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Arsh Verma , Makarand Tapaswi

Medical report generation demands automatic creation of coherent and precise descriptions for medical images. However, the scarcity of labelled medical image-report pairs poses formidable challenges in developing large-scale neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shibin Wu , Bang Yang , Zhiyu Ye , Haoqian Wang , Hairong Zheng , Tong Zhang

Structured reporting (SR) and artificial intelligence (AI) may transform how radiologists interact with imaging studies. This prospective study (July to December 2024) evaluated the impact of three reporting modes: free-text (FT),…

The automatic detection of critical findings in chest X-rays (CXR), such as pneumothorax, is important for assisting radiologists in their clinical workflow like triaging time-sensitive cases and screening for incidental findings. While…

Machine Learning · Computer Science 2020-01-27 Evan Schwab , André Gooßen , Hrishikesh Deshpande , Axel Saalbach

Medical images are widely used in clinical practice for diagnosis. Automatically generating interpretable medical reports can reduce radiologists' burden and facilitate timely care. However, most existing approaches to automatic report…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Jinghan Sun , Dong Wei , Liansheng Wang , Yefeng Zheng

Purpose: This study aimed to develop an open-source multimodal large language model (CXR-LLAVA) for interpreting chest X-ray images (CXRs), leveraging recent advances in large language models (LLMs) to potentially replicate the image…

Computation and Language · Computer Science 2024-01-17 Seowoo Lee , Jiwon Youn , Hyungjin Kim , Mansu Kim , Soon Ho Yoon