English
Related papers

Related papers: ProtoMedAgent: Multimodal Clinical Interpretabilit…

200 papers

Foundation models are becoming valuable tools in medicine. Yet despite their promise, the best way to leverage Large Language Models (LLMs) in complex medical tasks remains an open question. We introduce a novel multi-agent framework, named…

Computation and Language · Computer Science 2024-10-31 Yubin Kim , Chanwoo Park , Hyewon Jeong , Yik Siu Chan , Xuhai Xu , Daniel McDuff , Hyeonhoon Lee , Marzyeh Ghassemi , Cynthia Breazeal , Hae Won Park

Large language models (LLMs) have recently become the leading source of answers for users' questions online. Despite their ability to offer eloquent answers, their accuracy and reliability can pose a significant challenge. This is…

Computation and Language · Computer Science 2024-07-09 Bojana Bašaragin , Adela Ljajić , Darija Medvecki , Lorenzo Cassano , Miloš Košprdić , Nikola Milošević

Deep neural networks have achieved remarkable performance in various text-based tasks but often lack interpretability, making them less suitable for applications where transparency is critical. To address this, we propose ProtoLens, a novel…

Computation and Language · Computer Science 2024-10-25 Bowen Wei , Ziwei Zhu

The rapid growth of medical knowledge and increasing complexity of clinical practice pose challenges. In this context, large language models (LLMs) have demonstrated value; however, inherent limitations remain. Retrieval-augmented…

Medical reasoning models remain constrained by parametric knowledge and are thus susceptible to forgetting and hallucinations. DeepResearch (DR) models ground outputs in verifiable evidence from tools and perform strongly in general…

Artificial Intelligence · Computer Science 2026-02-05 Zihan Wang , Hao Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yiqun Zhang , Jinghao Lin , Haihua Yang , Xiaozhong Ji

Retrieval-augmented generation (RAG) is a widely adopted paradigm for enhancing LLMs in medical applications by incorporating expert multimodal knowledge during generation. However, the underlying retrieval databases may naturally contain,…

Cryptography and Security · Computer Science 2026-05-12 Peiru Yang , Haoran Zheng , Tong Ju , Shiting Wang , Wanchun Ni , Jiajun Liu , Shangguang Wang , Yongfeng Huang , Tao Qi

The recent emergence of Medical Large Vision Language Models (Med-LVLMs) has enhanced medical diagnosis. However, current Med-LVLMs frequently encounter factual issues, often generating responses that do not align with established medical…

Machine Learning · Computer Science 2024-10-18 Peng Xia , Kangyu Zhu , Haoran Li , Hongtu Zhu , Yun Li , Gang Li , Linjun Zhang , Huaxiu Yao

Automated radiology report generation holds immense potential to alleviate the heavy workload of radiologists. Despite the formidable vision-language capabilities of recent Multimodal Large Language Models (MLLMs), their clinical deployment…

Artificial Intelligence · Computer Science 2026-03-17 Tuoshi Qi , Shenshen Bu , Yingfei Xiang , Zhiming Dai

Document Question Answering (DocQA) is a very common task. Existing methods using Large Language Models (LLMs) or Large Vision Language Models (LVLMs) and Retrieval Augmented Generation (RAG) often prioritize information from a single…

Machine Learning · Computer Science 2025-03-19 Siwei Han , Peng Xia , Ruiyi Zhang , Tong Sun , Yun Li , Hongtu Zhu , Huaxiu Yao

Large language models (LLMs) have shown remarkable performance on many tasks in different domains. However, their performance in closed-book biomedical machine reading comprehension (MRC) has not been evaluated in depth. In this work, we…

Computation and Language · Computer Science 2024-10-28 Shubham Vatsal , Ayush Singh

Vision-language models (VLM) have markedly advanced AI-driven interpretation and reporting of complex medical imaging, such as computed tomography (CT). Yet, existing methods largely relegate clinicians to passive observers of final…

Retrieval-augmented generation (RAG) for language models significantly improves language understanding systems. The basic retrieval-then-read pipeline of response generation has evolved into a more extended process due to the integration of…

Computation and Language · Computer Science 2025-04-22 Yunxiao Shi , Xing Zi , Zijing Shi , Haimin Zhang , Qiang Wu , Min Xu

Retrieval-augmented generation combined with reinforcement learning has shown promise for grounding large language models in trustworthy medical evidence. However, existing methods rely on exact-match binary rewards, which in clinical…

Artificial Intelligence · Computer Science 2026-05-28 Yuwei Miao , Gen Li , Yunsheng Zeng , Xiandong Li , Yujin Wang , Siyu Chen , Luning Wang , Yunhao Qiao , Junfeng Wang , Jianwei Lv , Bo Yuan

Clinical dialogue represents a complex duality requiring both the empathetic fluency of natural conversation and the rigorous precision of evidence-based medicine. While Large Language Models possess unprecedented linguistic capabilities,…

Other Quantitative Biology · Quantitative Biology 2025-12-02 Xiaoquan Zhi , Hongke Zhao , Likang Wu , Chuang Zhao , Hengshu Zhu

Deep learning-based electrocardiogram (ECG) classification has shown impressive performance but clinical adoption has been slowed by the lack of transparent and faithful explanations. Post hoc methods such as saliency maps may fail to…

Medical Multimodal Large Language Models (Med-MLLMs) have shown great promise in medical visual question answering (Med-VQA). However, when deployed in low-resource settings where abundant labeled data are unavailable, existing Med-MLLMs…

Computation and Language · Computer Science 2025-10-06 Ziqing Wang , Chengsheng Mao , Xiaole Wen , Yuan Luo , Kaize Ding

Biomedical question answering (QA) requires accurate interpretation of complex medical knowledge. Large language models (LLMs) have shown promising capabilities in this domain, with retrieval-augmented generation (RAG) systems enhancing…

Computation and Language · Computer Science 2025-10-21 Yingpeng Ning , Yuanyuan Sun , Ling Luo , Yanhua Wang , Yuchen Pan , Hongfei Lin

Large language models are increasingly being assembled into medical multi-agent systems that emulate multidisciplinary consultation through specialist roles, peer review and consensus formation. In clinical decision support, however,…

Computation and Language · Computer Science 2026-05-28 Yinghao Zhu , Lei Gu , Zixiang Wang , Haoran Sang , Dehao Sui , Wen Tang , Lan Mi , Yasha Wang , Junyi Gao , Liang Yao , Tianfan Fu , Ewen Harrison , Lequan Yu , Liantao Ma

While language Models store a massive amount of world knowledge implicitly in their parameters, even very large models often fail to encode information about rare entities and events, while incurring huge computational costs. Recently,…

Computation and Language · Computer Science 2022-10-21 Wenhu Chen , Hexiang Hu , Xi Chen , Pat Verga , William W. Cohen

Large Language Models (LLMs) have significantly advanced medical question-answering by leveraging extensive clinical data and medical literature. However, the rapid evolution of medical knowledge and the labor-intensive process of manually…

Computation and Language · Computer Science 2025-07-01 Mohammad Reza Rezaei , Reza Saadati Fard , Jayson L. Parker , Rahul G. Krishnan , Milad Lankarany