English
Related papers

Related papers: A Smart Multimodal Healthcare Copilot with Powerfu…

200 papers

Large language models (LLMs) have shown promise in clinical diagnosis but remain limited by unreliable report generation, weak evidence grounding, and opaque reasoning. We propose MedCollab, an IBIS-guided multi-agent framework for…

Multiagent Systems · Computer Science 2026-05-27 Yuqi Zhan , Xinyue Wu , Tianyu Lin , Yutong Bao , Xiaoyu Wang , Weihao Cheng , Huangwei Chen , Feiwei Qin , Zhu Zhu

Large Language Models (LLMs), although powerful in general domains, often perform poorly on domain-specific tasks such as medical question answering (QA). In addition, LLMs tend to function as "black-boxes", making it challenging to modify…

Computation and Language · Computer Science 2024-08-19 Yucheng Shi , Shaochen Xu , Tianze Yang , Zhengliang Liu , Tianming Liu , Quanzheng Li , Xiang Li , Ninghao Liu

Leveraging Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG) for analyzing medical data, particularly Electrocardiogram (ECG), offers high accuracy and convenience. However, generating reliable, evidence-based results…

Machine Learning · Computer Science 2025-05-08 Jin Yu , JaeHo Park , TaeJun Park , Gyurin Kim , JiHyun Lee , Min Sung Lee , Joon-myoung Kwon , Jeong Min Son , Yong-Yeon Jo

This study addresses the critical need for enhanced situational awareness in autonomous driving (AD) by leveraging the contextual reasoning capabilities of large language models (LLMs). Unlike traditional perception systems that rely on…

Artificial Intelligence · Computer Science 2025-01-09 Xuewen Luo , Fan Ding , Fengze Yang , Yang Zhou , Junnyong Loo , Hwa Hui Tew , Chenxi Liu

Large Language Models (LLMs) have shown remarkable reasoning capabilities, while their practical applications are limited by severe factual hallucinations due to limitations in the timeliness, accuracy, and comprehensiveness of their…

Artificial Intelligence · Computer Science 2025-06-10 Xinyan Guan , Jiali Zeng , Fandong Meng , Chunlei Xin , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Jie Zhou

Deep learning methods face dual challenges of limited clinical samples and low inter-class differentiation among Diffuse Cystic Lung Diseases (DCLDs) in advancing Birt-Hogg-Dube syndrome (BHD) diagnosis via Computed Tomography (CT) imaging.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Haoqing Li , Jun Shi , Xianmeng Chen , Qiwei Jia , Rui Wang , Wei Wei , Hong An , Xiaowen Hu

Reliable interpretation of multimodal data in dentistry is essential for automated oral healthcare, yet current multimodal large language models (MLLMs) struggle to capture fine-grained dental visual details and lack sufficient reasoning…

Meta reasoning behaviors work as a skeleton to guide large language model (LLM) reasoning, thus help to improve reasoning performance. However, prior researches implement meta reasoning skeleton with manually designed structure, limiting…

Artificial Intelligence · Computer Science 2026-04-17 Ziying Zhang , Yaqing Wang , Quanming Yao

Medical Vision-Language Models (VLMs) hold immense promise for complex clinical tasks, but their reasoning capabilities are often constrained by text-only paradigms that fail to ground inferences in visual evidence. This limitation not only…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Zheng Jiang , Heng Guo , Chengyu Fang , Changchen Xiao , Xinyang Hu , Lifeng Sun , Minfeng Xu

In healthcare intelligence, the ability to fuse heterogeneous, multi-intent information from diverse clinical sources is fundamental to building reliable decision-making systems. Large Language Model (LLM)-driven information interaction…

Computation and Language · Computer Science 2025-07-04 Dingkang Yang , Jinjie Wei , Mingcheng Li , Jiyao Liu , Lihao Liu , Ming Hu , Junjun He , Yakun Ju , Wei Zhou , Yang Liu , Lihua Zhang

Multimodal large language models (MLLMs) have shown remarkable capabilities in cross-modal understanding and reasoning, offering new opportunities for intelligent assistive systems, yet existing systems still struggle with risk-aware…

Robotics · Computer Science 2026-04-08 Renjun Gao

Large language models (LLMs), particularly those with reasoning capabilities, have rapidly advanced in recent years, demonstrating significant potential across a wide range of applications. However, their deployment in healthcare,…

Artificial Intelligence · Computer Science 2025-02-27 Guoxin Wang , Minyu Gao , Shuai Yang , Ya Zhang , Lizhi He , Liang Huang , Hanlin Xiao , Yexuan Zhang , Wanyue Li , Lu Chen , Jintao Fei , Xin Li

Multimodal large language models (MLLMs) show remarkable potential for scientific reasoning, yet their performance in specialized domains such as microscopy remains limited by the scarcity of domain-specific training data and the difficulty…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Manyu Li , Ruian He , Chenxi Ma , Weimin Tan , Bo Yan

Retrieval-augmented generation combined with reinforcement learning has shown promise for grounding large language models in trustworthy medical evidence. However, existing methods rely on exact-match binary rewards, which in clinical…

Artificial Intelligence · Computer Science 2026-05-28 Yuwei Miao , Gen Li , Yunsheng Zeng , Xiandong Li , Yujin Wang , Siyu Chen , Luning Wang , Yunhao Qiao , Junfeng Wang , Jianwei Lv , Bo Yuan

Medical conversational AI (AI) plays a pivotal role in the development of safer and more effective medical dialogue systems. However, existing benchmarks and evaluation frameworks for assessing the information-gathering and diagnostic…

Computation and Language · Computer Science 2026-01-08 Lecheng Gong , Weimin Fang , Ting Yang , Dongjie Tao , Chunxiao Guo , Peng Wei , Bo Xie , Jinqun Guan , Zixiao Chen , Fang Shi , Jinjie Gu , Junwei Liu

Large language models (LLMs) have saturated standard medical benchmarks that test factual recall, yet their ability to perform higher-order reasoning, such as synthesizing evidence from multiple sources, remains critically under-explored.…

Computation and Language · Computer Science 2026-05-12 Huy Hoang Ha , Benoit Favre , Francois Portet

Large language models (LLMs) have had a significant impact on diverse research domains, including medicine and healthcare. However, the potential of LLMs as copilots in medical education remains underexplored. Current AI-assisted…

Artificial Intelligence · Computer Science 2024-08-27 Hao Wei , Jianing Qiu , Haibao Yu , Wu Yuan

Large language models (LLMs) are increasingly used for diagnostic tasks in medicine. In clinical practice, the correct diagnosis can rarely be immediately inferred from the initial patient presentation alone. Rather, reaching a diagnosis…

Artificial Intelligence · Computer Science 2026-02-20 Hui Min Wong , Philip Heesen , Pascal Janetzky , Martin Bendszus , Stefan Feuerriegel

Medicine is inherently multimodal and multitask, with diverse data modalities spanning text, imaging. However, most models in medical field are unimodal single tasks and lack good generalizability and explainability. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Lijian Xu , Hao Sun , Ziyu Ni , Hongsheng Li , Shaoting Zhang

The potential of Multimodal Large Language Models (MLLMs) in domain of medical imaging raise the demands of systematic and rigorous evaluation frameworks that are aligned with the real-world medical imaging practice. Existing practices that…

Computation and Language · Computer Science 2026-04-16 Zhijie Bao , Fangke Chen , Licheng Bao , Chenhui Zhang , Wei Chen , Jiajie Peng , Zhongyu Wei