English
Related papers

Related papers: PaliGemma-CXR: A Multi-task Multimodal Model for T…

200 papers

The global challenge in chest radiograph X-ray (CXR) abnormalities often being misdiagnosed is primarily associated with perceptual errors, where healthcare providers struggle to accurately identify the location of abnormalities, rather…

Image and Video Processing · Electrical Eng. & Systems 2023-11-06 Sanskriti Singh

Tuberculosis (TB) is a major global health challenge, and is compounded by co-morbidities such as HIV, diabetes, and anemia, which complicate treatment outcomes and contribute to heterogeneous patient responses. Traditional models of TB…

Machine Learning · Computer Science 2024-11-19 Ethan Wu , Caleb Ellington , Ben Lengerich , Eric P. Xing

Diagnosing and treating skin diseases require advanced visual skills across domains and the ability to synthesize information from multiple imaging modalities. While current deep learning models excel at specific tasks like skin cancer…

The segmentation and classification of carotid plaques in ultrasound images play important roles in the treatment of atherosclerosis and assessment for the risk of stroke. Although deep learning methods have been used for carotid plaque…

Image and Video Processing · Electrical Eng. & Systems 2023-11-21 Haitao Gan , Ran Zhou , Yanghan Ou , Furong Wang , Xinyao Cheng , Aaron Fenster

Deep learning-based models, when trained in a fully-supervised manner, can be effective in performing complex image analysis tasks, although contingent upon the availability of large labeled datasets. Especially in the medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Ayaan Haque , Abdullah-Al-Zubaer Imran , Adam Wang , Demetri Terzopoulos

The use of ImageNet pre-trained networks is becoming widespread in the medical imaging community. It enables training on small datasets, commonly available in medical imaging tasks. The recent emergence of a large Chest X-ray dataset opened…

Image and Video Processing · Electrical Eng. & Systems 2019-06-04 Ophir Gozes , Hayit Greenspan

The development of AI-based methods to analyze radiology reports could lead to significant advances in medical diagnosis, from improving diagnostic accuracy to enhancing efficiency and reducing workload. However, the lack of…

Computation and Language · Computer Science 2025-08-14 Yuyan Ge , Kwan Ho Ryan Chan , Pablo Messina , René Vidal

The method of microwave radiometry is one of the areas of medical diagnosis of breast cancer. It is based on analysis of the spatial distribution of internal and surface tissue temperatures, which are measured in the microwave (RTM) and…

Quantitative Methods · Quantitative Biology 2019-10-08 Vladislav Levshinskii , Maxim Polyakov , Alexander Losev , Alexander Khoperskov

X-ray imaging is a ubiquitous in radiology, yet most existing AI foundation models are limited to chest anatomy and fail to generalize across broader clinical tasks. In this work, we introduce XR-0, the multi-anatomy X-ray foundation model…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Nishank Singla , Krisztian Koos , Farzin Haddadpour , Amin Honarmandi Shandiz , Lovish Chum , Xiaojian Xu , Qing Jin , Erhan Bas

Recent advances in training deep learning models have demonstrated the potential to provide accurate chest X-ray interpretation and increase access to radiology expertise. However, poor generalization due to data distribution shifts in…

Image and Video Processing · Electrical Eng. & Systems 2021-02-23 Pranav Rajpurkar , Anirudh Joshi , Anuj Pareek , Andrew Y. Ng , Matthew P. Lungren

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

Multimodal Large Language Models (MLLMs) have shown success in various general image processing tasks, yet their application in medical imaging is nascent, lacking tailored models. This study investigates the potential of MLLMs in improving…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Ling Yang , Zhanyu Wang , Zhenghao Chen , Xinyu Liang , Luping Zhou

Breast cancer screening, primarily conducted through mammography, is often supplemented with ultrasound for women with dense breast tissue. However, existing deep learning models analyze each modality independently, missing opportunities to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-16 Yiqiu Shen , Jungkyu Park , Frank Yeung , Eliana Goldberg , Laura Heacock , Farah Shamout , Krzysztof J. Geras

The latest breakthroughs in large vision-language models, such as Bard and GPT-4, have showcased extraordinary abilities in performing a wide range of tasks. Such models are trained on massive datasets comprising billions of public…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Omkar Thawakar , Abdelrahman Shaker , Sahal Shaji Mullappilly , Hisham Cholakkal , Rao Muhammad Anwer , Salman Khan , Jorma Laaksonen , Fahad Shahbaz Khan

Automated generation of clinically accurate radiology reports can improve patient care. Previous report generation methods that rely on image captioning models often generate incoherent and incorrect text due to their lack of relevant…

While state-of-the-art models for breast cancer detection leverage multi-view mammograms for enhanced diagnostic accuracy, they often focus solely on visual mammography data. However, radiologists document valuable lesion descriptors that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Gil Ben-Artzi , Feras Daragma , Shahar Mahpod

Chest radiography is an effective screening tool for diagnosing pulmonary diseases. In computer-aided diagnosis, extracting the relevant region of interest, i.e., isolating the lung region of each radiography image, can be an essential step…

Image and Video Processing · Electrical Eng. & Systems 2022-02-23 Hilda Azimi , Jianxing Zhang , Pengcheng Xi , Hala Asad , Ashkan Ebadi , Stephane Tremblay , Alexander Wong

In a complex disease such as tuberculosis, the evidence for the disease and its evolution may be present in multiple modalities such as clinical, genomic, or imaging data. Effective patient-tailored outcome prediction and therapeutic…

Clinical deployment of chest radiograph classifiers requires models that can be updated as new datasets become available without retraining on previously observed data or degrading validated performance. We study a task-incremental…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Muthu Subash Kavitha , Anas Zafar , Amgad Muneer , Jia Wu

In healthcare, it is essential to explain the decision-making process of machine learning models to establish the trustworthiness of clinicians. This paper introduces BI-RADS-Net, a novel explainable deep learning approach for cancer…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Boyu Zhang , Aleksandar Vakanski , Min Xian