English
Related papers

Related papers: Radiologist-Guided Causal Concept Bottleneck Model…

200 papers

COVID-19, due to its accelerated spread has brought in the need to use assistive tools for faster diagnosis in addition to typical lab swab testing. Chest X-Rays for COVID cases tend to show changes in the lungs such as ground glass…

Image and Video Processing · Electrical Eng. & Systems 2020-10-27 Gayathiri Murugamoorthy , Naimul Khan

Image-to-text radiology report generation aims to automatically produce radiology reports that describe the findings in medical images. Most existing methods focus solely on the image data, disregarding the other patient information…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nurbanu Aksoy , Serge Sharoff , Selcuk Baser , Nishant Ravikumar , Alejandro F Frangi

Concept Bottleneck Models (CBMs) ground image classification on human-understandable concepts to allow for interpretable model decisions. Crucially, the CBM design inherently allows for human interventions, in which expert users are given…

Machine Learning · Computer Science 2024-08-07 Nishad Singhi , Jae Myung Kim , Karsten Roth , Zeynep Akata

Radiology is essential to modern healthcare, yet rising demand and staffing shortages continue to pose major challenges. Recent advances in artificial intelligence have the potential to support radiologists and help address these…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Phillip Sloan , Edwin Simpson , Majid Mirmehdi

Chest radiograph interpretation requires temporal reasoning over prior and current studies, yet most vision-language models are trained on static image-report pairs and lack explicit supervision for modeling longitudinal change. We…

Concept Bottleneck Models (CBMs) ground predictions in human-understandable concepts but face fundamental limitations: the absence of a metric to pre-evaluate concept relevance, the "linearity problem" causing recent CBMs to bypass the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Merve Tapli , Quentin Bouniot , Wolfgang Stammer , Zeynep Akata , Emre Akbas

Medical image interpretation is central to most clinical applications such as disease diagnosis, treatment planning, and prognostication. In clinical practice, radiologists examine medical images and manually compile their findings into…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nurbanu Aksoy , Nishant Ravikumar , Alejandro F Frangi

Recent advances in deep learning have led to increasingly complex models with deeper layers and more parameters, reducing interpretability and making their decisions harder to understand. While many methods explain black-box reasoning, most…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Nuoye Xiong , Anqi Dong , Ning Wang , Cong Hua , Guangming Zhu , Lin Mei , Peiyi Shen , Liang Zhang

Prevalent in biomedical applications (e.g., human phenotype research), multimodal datasets can provide valuable insights into the underlying physiological mechanisms. However, current machine learning (ML) models designed to analyze these…

Bayesian causal discovery benefits from prior information elicited from domain experts, and in heterogeneous domains any prior knowledge would be badly needed. However, so far prior elicitation approaches have assumed a single causal graph…

Machine Learning · Computer Science 2026-04-30 Zachris Björkman , Jorge Loría , Sophie Wharrie , Samuel Kaski

Concept Bottleneck Models (CBMs) aim to deliver interpretable predictions by routing decisions through a human-understandable concept layer, yet they often suffer reduced accuracy and concept leakage that undermines faithfulness. We…

Machine Learning · Computer Science 2026-02-17 Karim Galliamov , Syed M Ahsan Kazmi , Adil Khan , Adín Ramírez Rivera

Radiomics analysis has achieved great success in recent years. However, conventional Radiomics analysis suffers from insufficiently expressive hand-crafted features. Recently, emerging deep learning techniques, e.g., convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-10-22 Jiancheng Yang , Rongyao Fang , Bingbing Ni , Yamin Li , Yi Xu , Linguo Li

The chest X-rays (CXRs) is one of the views most commonly ordered by radiologists (NHS),which is critical for diagnosis of many different thoracic diseases. Accurately detecting thepresence of multiple diseases from CXRs is still a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Hieu H. Pham , Tung T. Le , Dat T. Ngo , Dat Q. Tran , Ha Q. Nguyen

Despite the success of deep learning in dermoscopy image analysis, its inherent black-box nature hinders clinical trust, motivating the use of prototypical networks for case-based visual transparency. However, inevitable selection bias in…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Junhao Jia , Yueyi Wu , Huangwei Chen , Haodong Jing , Haishuai Wang , Jiajun Bu , Lei Wu

Concept bottleneck models (CBMs) are inherently interpretable and intervenable neural network models, which explain their final label prediction by the intermediate prediction of high-level semantic concepts. However, they require target…

Machine Learning · Computer Science 2026-04-06 Shin'ya Yamaguchi , Kosuke Nishida , Daiki Chijiwa , Yasutoshi Ida

3D brain MRI studies often examine subtle morphometric differences between cohorts that are hard to detect visually. Given the high cost of MRI acquisition, these studies could greatly benefit from image syntheses, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Binxu Li , Wei Peng , Mingjie Li , Ehsan Adeli , Kilian M. Pohl

Context-Aware Emotion Recognition (CAER) is a crucial and challenging task that aims to perceive the emotional states of the target person with contextual information. Recent approaches invariably focus on designing sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Dingkang Yang , Zhaoyu Chen , Yuzheng Wang , Shunli Wang , Mingcheng Li , Siao Liu , Xiao Zhao , Shuai Huang , Zhiyan Dong , Peng Zhai , Lihua Zhang

Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept values, affecting the downstream output. In this work, we…

Machine Learning · Computer Science 2024-10-29 Sonia Laguna , Ričards Marcinkevičs , Moritz Vandenhirtz , Julia E. Vogt

Radiology reports are an important means of communication between radiologists and other physicians. These reports express a radiologist's interpretation of a medical imaging examination and are critical in establishing a diagnosis and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Hojjat Salehinejad , Shahrokh Valaee , Aren Mnatzakanian , Tim Dowdell , Joseph Barfett , Errol Colak

The COVID-19 pandemic has strained global public health, necessitating accurate diagnosis and intervention to control disease spread and reduce mortality rates. This paper introduces an interpretable deep survival prediction model designed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhusi Zhong , Jie Li , Zhuoqi Ma , Scott Collins , Harrison Bai , Paul Zhang , Terrance Healey , Xinbo Gao , Michael K. Atalay , Zhicheng Jiao