English
Related papers

Related papers: CBM-RAG: Demonstrating Enhanced Interpretability i…

200 papers

Retrieval Augmented Generation (RAG) systems have seen huge popularity in augmenting Large-Language Model (LLM) outputs with domain specific and time sensitive data. Very recently a shift is happening from simple RAG setups that query a…

Information Retrieval · Computer Science 2024-03-05 Tristan Kenneweg , Philip Kenneweg , Barbara Hammer

Radiology report generation (RRG) aims to describe automatically a radiology image with human-like language and could potentially support the work of radiologists, reducing the burden of manual reporting. Previous approaches often adopt an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Jun Wang , Abhir Bhalerao , Yulan He

Concept Bottleneck Models (CBMs) provide explicit interpretations for deep neural networks through concepts and allow intervention with concepts to adjust final predictions. Existing CBMs assume concepts are conditionally independent given…

Machine Learning · Computer Science 2026-05-04 Haotian Xu , Tsui-Wei Weng , Lam M. Nguyen , Tengfei Ma

Among all the sub-sections in a typical radiology report, the Clinical Indications, Findings, and Impression often reflect important details about the health status of a patient. The information included in Impression is also often covered…

We propose a novel, flexible, and efficient framework for designing Concept Bottleneck Models (CBMs) that enables practitioners to explicitly encode and extend their prior knowledge and beliefs about the concept-concept ($C-C$) and…

Machine Learning · Computer Science 2026-04-14 Nektarios Kalampalikis , Kavya Gupta , Georgi Vitanov , Isabel Valera

Medical large vision-language Models (Med-LVLMs) have shown promise in clinical applications but suffer from factual inaccuracies and unreliable outputs, posing risks in real-world diagnostics. While RAG has emerged as a potential solution,…

Computation and Language · Computer Science 2026-05-05 Zhe Chen , Yusheng Liao , Zhiyuan Zhu , Haolin Li , Hongcheng Liu , Yanfeng Wang , Yu Wang

Retrieval-Augmented Generation (RAG) has become a standard architectural pattern for incorporating domain-specific knowledge into user-facing chat applications powered by Large Language Models (LLMs). RAG systems are characterized by (1) a…

Computation and Language · Computer Science 2025-01-17 Robert Friel , Masha Belyi , Atindriyo Sanyal

Concept Bottleneck Models (CBMs) aim to enhance interpretability by predicting human-understandable concepts as intermediates for decision-making. However, these models often face challenges in ensuring reliable concept representations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yuxuan Cai , Xiyu Wang , Satoshi Tsutsui , Winnie Pang , Bihan Wen

The rapid increase of computed tomography (CT) scans and their time-consuming manual analysis have created an urgent need for robust automated analysis techniques in clinical settings. These aim to assist radiologists and help them managing…

Image and Video Processing · Electrical Eng. & Systems 2026-02-24 Theo Di Piazza , Carole Lazarus , Olivier Nempont , Loic Boussel

Radiology report generation (RRG) methods often lack sufficient medical knowledge to produce clinically accurate reports. The scene graph contains rich information to describe the objects in an image. We explore enriching the medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

Clinical decision-making in radiology increasingly benefits from artificial intelligence (AI), particularly through large language models (LLMs). However, traditional retrieval-augmented generation (RAG) systems for radiology question…

With growing demand for interpretability in deep learning, especially in high stakes domains, Concept Bottleneck Models (CBMs) address this by inserting human understandable concepts into the prediction pipeline, but they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiakai Lin , Jinchang Zhang , Guoyu Lu

We present MA-RAG, a Multi-Agent framework for Retrieval-Augmented Generation (RAG) that addresses the inherent ambiguities and reasoning challenges in complex information-seeking tasks. Unlike conventional RAG methods that rely on…

Computation and Language · Computer Science 2025-10-14 Thang Nguyen , Peter Chin , Yu-Wing Tai

The rapid development of large language models has led to the widespread adoption of Retrieval-Augmented Generation (RAG), which integrates external knowledge to alleviate knowledge bottlenecks and mitigate hallucinations. However, the…

Computation and Language · Computer Science 2024-10-10 Ruotong Pan , Boxi Cao , Hongyu Lin , Xianpei Han , Jia Zheng , Sirui Wang , Xunliang Cai , Le Sun

Large language models (LLMs) have demonstrated remarkable capabilities in various domains, including radiology report generation. Previous approaches have attempted to utilize multimodal LLMs for this task, enhancing their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Wenjun Hou , Yi Cheng , Kaishuai Xu , Heng Li , Yan Hu , Wenjie Li , Jiang Liu

The widespread use of chest X-rays (CXRs), coupled with a shortage of radiologists, has driven growing interest in automated CXR analysis and AI-assisted reporting. While existing vision-language models (VLMs) show promise in specific tasks…

Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve…

Machine Learning · Computer Science 2024-05-29 Florent Forest , Katharina Rombach , Olga Fink

Retrieval-augmented generation (RAG) has proven effective in integrating knowledge into large language models (LLMs). However, conventional RAGs struggle to capture complex relationships between pieces of knowledge, limiting their…

Information Retrieval · Computer Science 2025-12-12 Linhao Luo , Zicheng Zhao , Gholamreza Haffari , Dinh Phung , Chen Gong , Shirui Pan

Large language models (LLM) hold significant potential for applications in biomedicine, but they struggle with hallucinations and outdated knowledge. While retrieval-augmented generation (RAG) is generally employed to address these issues,…

Computation and Language · Computer Science 2025-09-23 Jiwoong Sohn , Yein Park , Chanwoong Yoon , Sihyeon Park , Hyeon Hwang , Mujeen Sung , Hyunjae Kim , Jaewoo Kang

Generating radiology reports automatically reduces the workload of radiologists and helps the diagnoses of specific diseases. Many existing methods take this task as modality transfer process. However, since the key information related to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yitian Tao , Liyan Ma , Jing Yu , Han Zhang