English
Related papers

Related papers: AMANDA: Agentic Medical Knowledge Augmentation for…

200 papers

Long-horizon omnimodal question answering answers questions by reasoning over text, images, audio, and video. Despite recent progress on OmniLLMs, low-resource long audio-video QA still suffers from costly dense encoding, weak fine-grained…

Computation and Language · Computer Science 2026-03-31 Yifan Zhu , Xinyu Mu , Tao Feng , Zhonghong Ou , Yuning Gong , Haoran Luo

As a cornerstone of patient care, clinical decision-making significantly influences patient outcomes and can be enhanced by large language models (LLMs). Although LLMs have demonstrated remarkable performance, their application to visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Ji Young Byun , Young-Jin Park , Navid Azizan , Rama Chellappa

Medical visual question answering (Med-VQA) aims to answer clinically relevant questions grounded in medical images. However, existing multimodal large language models (MLLMs) often exhibit shortcut answering, producing plausible responses…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Zhisong Wang , Ziyang Chen , Zanting Ye , Hongze Zhu , Yefeng Zheng , Yong Xia

Multimodal Large Language Models (MLLMs) have demonstrated remarkable effectiveness in various general-domain scenarios, such as visual question answering and image captioning. Recently, researchers have increasingly focused on empowering…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yan Shu , Chi Liu , Robin Chen , Derek Li , Bryan Dai

The integration of Large Language Models (LLMs) into healthcare is constrained by knowledge limitations, hallucinations, and a disconnect from Evidence-Based Medicine (EBM). While Retrieval-Augmented Generation (RAG) offers a solution,…

Computation and Language · Computer Science 2026-02-03 Qiaoyu Zheng , Yuze Sun , Chaoyi Wu , Weike Zhao , Pengcheng Qiu , Yongguo Yu , Kun Sun , Jian Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie

Most reported gains on agentic-LLM clinical benchmarks are often attributed to prompt engineering, yet our results suggest that larger improvements can come from architectural and engine-level design. We present MDIA, a Multi-agent…

Artificial Intelligence · Computer Science 2026-05-26 Roberto Cruz , David Rey-Blanco

The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning, a cornerstone of clinical practice.…

Computation and Language · Computer Science 2025-08-04 Wenxuan Wang , Zizhan Ma , Meidan Ding , Shiyi Zheng , Shengyuan Liu , Jie Liu , Jiaming Ji , Wenting Chen , Xiang Li , Linlin Shen , Yixuan Yuan

With growing interest in recent years, medical visual question answering (Med-VQA) has rapidly evolved, with multimodal large language models (MLLMs) emerging as an alternative to classical model architectures. Specifically, their ability…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

We introduce Agentic Reasoning, a framework that enhances large language model (LLM) reasoning by integrating external tool-using agents. Agentic Reasoning dynamically leverages web search, code execution, and structured memory to address…

Artificial Intelligence · Computer Science 2025-07-16 Junde Wu , Jiayuan Zhu , Yuyuan Liu , Min Xu , Yueming Jin

Medical Visual Question Answering (MedVQA) enables natural language queries over medical images to support clinical decision-making and patient care. The MEDIQA-WV 2025 shared task addressed wound-care VQA, requiring systems to generate…

Computation and Language · Computer Science 2025-10-17 A H M Rezaul Karim , Ozlem Uzuner

Recently, large language model (LLM) based artificial intelligence (AI) systems have demonstrated remarkable capabilities in natural language understanding and generation. However, these models face a significant challenge when it comes to…

Recent advances in large language models (LLMs) have shown promising results in medical diagnosis, with some studies indicating superior performance compared to human physicians in specific scenarios. However, the diagnostic capabilities of…

Artificial Intelligence · Computer Science 2025-03-24 Zhoujian Sun , Ziyi Liu , Cheng Luo , Jiebin Chu , Zhengxing Huang

Personalized digital health support requires long-horizon, cross-dimensional reasoning over heterogeneous lifestyle signals, and recent advances in mobile sensing and large language models (LLMs) make such support increasingly feasible.…

Artificial Intelligence · Computer Science 2026-01-21 Ye Tian , Zihao Wang , Onat Gungor , Xiaoran Fan , Tajana Rosing

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky

Multimodal Large Language Models (MLLMs) in healthcare suffer from severe confirmation bias, often hallucinating visual details to support initial, potentially erroneous diagnostic hypotheses. Existing Chain-of-Thought (CoT) approaches lack…

Computation and Language · Computer Science 2026-04-14 Zhixiang Lu , Jionglong Su

Clinical Decision Support Systems (CDSSs) provide reasoning and inquiry guidance for physicians, yet they face notable challenges, including high maintenance costs and low generalization capability. Recently, Large Language Models (LLMs)…

Computation and Language · Computer Science 2026-04-24 Yue Guo , Fanfu Wang , Jianwei Lv , Xincheng Shi , Yuchen Li , Youya Wang , Yunsheng Zeng , Yujing Liu , Yunhao Qiao , Gen Li , Junfeng Wang , Bo Yuan

Recent artificial intelligence (AI) systems have reached milestones in "grand challenges" ranging from Go to protein-folding. The capability to retrieve medical knowledge, reason over it, and answer medical questions comparably to…

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Large Vision-Language Models (LVLMs) have achieved significant success in recent years, and they have been extended to the medical domain. Although demonstrating satisfactory performance on medical Visual Question Answering (VQA) tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Danfeng Guo , Demetri Terzopoulos

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce…

Artificial Intelligence · Computer Science 2025-12-29 Zelin Zang , Wenyi Gu , Siqi Ma , Dan Yang , Yue Shen , Zhu Zhang , Guohui Fan , Wing-Kuen Ling , Fuji Yang