English
Related papers

Related papers: A Smart Multimodal Healthcare Copilot with Powerfu…

200 papers

Large language models (LLMs) have recently demonstrated their potential in clinical applications, providing valuable medical knowledge and advice. For example, a large dialog LLM like ChatGPT has successfully passed part of the US medical…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Sheng Wang , Zihao Zhao , Xi Ouyang , Qian Wang , Dinggang Shen

Medical vision-language models (VLMs) achieve strong performance in diagnostic reporting and image-text alignment, yet their underlying reasoning mechanisms remain fundamentally correlational, exhibiting reliance on superficial statistical…

Machine Learning · Computer Science 2026-01-27 Weiqin Yang , Haowen Xue , Qingyi Peng , Hexuan Hu , Qian Huang , Tingbo Zhang

The emergence of advanced reasoning capabilities in Large Language Models (LLMs) marks a transformative development in healthcare applications. Beyond merely expanding functional capabilities, these reasoning mechanisms enhance decision…

Artificial Intelligence · Computer Science 2025-08-27 Armin Berger , Sarthak Khanna , David Berghaus , Rafet Sifa

Safe deployment of Large Vision-Language Models (LVLMs) in radiology report generation requires not only accurate predictions but also clinically interpretable indicators of when outputs should be thoroughly reviewed, enabling selective…

Despite recent success in applying large language models (LLMs) to electronic health records (EHR), most systems focus primarily on assessment rather than treatment planning. We identify three critical limitations in current approaches:…

Large Vision-Language Models (LVLMs) have made remarkable strides in multimodal tasks such as visual question answering, visual grounding, and complex reasoning. However, they remain limited by static training data, susceptibility to…

Artificial Intelligence · Computer Science 2025-08-27 Chan-Wei Hu , Yueqi Wang , Shuo Xing , Chia-Ju Chen , Suofei Feng , Ryan Rossi , Zhengzhong Tu

Clinical Decision Support Systems (CDSSs) provide reasoning and inquiry guidance for physicians, yet they face notable challenges, including high maintenance costs and low generalization capability. Recently, Large Language Models (LLMs)…

Computation and Language · Computer Science 2026-04-24 Yue Guo , Fanfu Wang , Jianwei Lv , Xincheng Shi , Yuchen Li , Youya Wang , Yunsheng Zeng , Yujing Liu , Yunhao Qiao , Gen Li , Junfeng Wang , Bo Yuan

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in jointly understanding text, images, and videos, often evaluated via Visual Question Answering (VQA). However, even state-of-the-art MLLMs struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Alberto Compagnoni , Marco Morini , Sara Sarto , Federico Cocchi , Davide Caffagni , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Bridging clinical diagnostic reasoning with AI remains a central challenge in medical imaging. We introduce MedCLM, an automated pipeline that converts detection datasets into large-scale medical visual question answering (VQA) data with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Soo Yong Kim , Suin Cho , Vincent-Daniel Yun , Gyeongyeon Hwang

The rapid advancement of large language models (LLMs) has significantly impacted various domains, including healthcare and biomedicine. However, the phenomenon of hallucination, where LLMs generate outputs that deviate from factual accuracy…

Computation and Language · Computer Science 2024-08-27 Duy Khoa Pham , Bao Quoc Vo

Agentic Retrieval-Augmented Generation (Agentic RAG) has become a widely adopted paradigm for multi-hop question answering and complex knowledge reasoning, where retrieval and reasoning are interleaved at inference time. As reasoning…

Information Retrieval · Computer Science 2026-04-02 Shuguang Jiao , Chengkai Huang , Shuhan Qi , Xuan Wang , Yifan Li , Lina Yao

Large Language Models (LLMs) show promise in medicine but are prone to factual and logical errors, which is unacceptable in this high-stakes field. To address this, we introduce the "Haibu Mathematical-Medical Intelligent Agent" (MMIA), an…

Artificial Intelligence · Computer Science 2025-10-10 Yilun Zhang , Dexing Kong

While pioneering deep learning methods have made great strides in analyzing electronic health record (EHR) data, they often struggle to fully capture the semantics of diverse medical codes from limited data. The integration of external…

Machine Learning · Computer Science 2024-08-26 Zhihao Yu , Yujie Jin , Yongxin Xu , Xu Chu , Yasha Wang , Junfeng Zhao

The intricate nature of modern surgical care necessitates intelligent systems that can synthesize extensive patient records, support collaborative decision-making, and provide transparent, auditable reasoning across the entire perioperative…

Computation and Language · Computer Science 2026-05-29 Dongsheng Shi , Yue Li , Xin Yi , Yongyi Cui , Huawei Feng , Linlin Wang

Secure data management and effective data sharing have become paramount in the rapidly evolving healthcare landscape, especially with the growing integration of the Internet of Medical Things (IoMT). The rise of generative artificial…

Artificial Intelligence · Computer Science 2024-12-10 Cheng Su , Jinbo Wen , Jiawen Kang , Yonghua Wang , Yuanjia Su , Hudan Pan , Zishao Zhong , M. Shamim Hossain

Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. Retrieval-Augmented Generation (RAG) mitigates these issues by integrating external dynamic information for…

Retrieval-augmented Generation (RAG) has demonstrated potential in enhancing medical question-answering systems through the integration of large language models (LLMs) with external medical literature. LLMs can retrieve relevant medical…

Computation and Language · Computer Science 2025-10-29 Mengzhou Sun , Sendong Zhao , Jianyu Chen , Haochun Wang , Bin Qin

Advances in AI have introduced several strong models in computational pathology to usher it into the era of multi-modal diagnosis, analysis, and interpretation. However, the current pathology-specific visual language models still lack…

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Retrieval-Augmented Large Language Models (LLMs), which integrate external knowledge, have shown remarkable performance in medical domains, including clinical diagnosis. However, existing RAG methods often struggle to tailor retrieval…

Computation and Language · Computer Science 2025-10-16 Jiawei He , Mingyi Jia , Zhihao Jia , Junwen Duan , Yan Song , Jianxin Wang