English
Related papers

Related papers: Advancing Conversational Diagnostic AI with Multim…

200 papers

Interleaved multimodal comprehension and generation, enabling models to produce and interpret both images and text in arbitrary sequences, have become a pivotal area in multimodal learning. Despite significant advancements, the evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Peng Xia , Siwei Han , Shi Qiu , Yiyang Zhou , Zhaoyang Wang , Wenhao Zheng , Zhaorun Chen , Chenhang Cui , Mingyu Ding , Linjie Li , Lijuan Wang , Huaxiu Yao

Accurate disease prediction is vital for timely intervention, effective treatment, and reducing medical complications. While symbolic AI has been applied in healthcare, its adoption remains limited due to the effort required for…

Artificial Intelligence · Computer Science 2026-01-01 Ioanna Gemou , Evangelos Lamprou

Recent advancements in Large Language Models (LLMs) have demonstrated significant promise in clinical diagnosis. However, current models struggle to emulate the iterative, diagnostic hypothesis-driven reasoning of real clinical scenarios.…

Computation and Language · Computer Science 2026-01-06 Qipeng Wang , Rui Sheng , Yafei Li , Huamin Qu , Yushi Sun , Min Zhu

Clinical decision-making is inherently complex, often influenced by cognitive biases, incomplete information, and case ambiguity. Large Language Models (LLMs) have shown promise as tools for supporting clinical decision-making, yet their…

Machine Learning · Computer Science 2025-07-10 Burcu Sayin , Ipek Baris Schlicht , Ngoc Vo Hong , Sara Allievi , Jacopo Staiano , Pasquale Minervini , Andrea Passerini

Artificial Intelligence (AI) has become essential in modern healthcare, with large language models (LLMs) offering promising advances in clinical decision-making. Traditional model-based approaches, including those leveraging in-context…

Recent multimodal large language models (MLLMs) such as GPT-4o and Qwen3-Omni show strong perception but struggle in multi-speaker, dialogue-centric settings that demand agentic reasoning tracking who speaks, maintaining roles, and…

Large language models (LLMs) have enabled conversational robots to move beyond constrained dialogue toward free-form interaction. However, without context-specific adaptation, generic LLM outputs can be ineffective or inappropriate. This…

Human-Computer Interaction · Computer Science 2026-01-21 Shiye Cao , Jiwon Moon , Yifan Xu , Anqi Liu , Chien-Ming Huang

The 2022 World Mental Health Report calls for global mental health care reform, amid rising prevalence of issues like anxiety and depression that affect nearly one billion people worldwide. Traditional in-person therapy fails to meet this…

Computers and Society · Computer Science 2025-10-21 Xun Wei , Pukai Zhou , Zeyu Wang

The integration of voice-based AI agents in healthcare presents a transformative opportunity to bridge economic and accessibility gaps in digital health delivery. This paper explores the role of large language model (LLM)-powered voice…

Artificial Intelligence · Computer Science 2025-07-28 Bo Wen , Chen Wang , Qiwei Han , Raquel Norel , Julia Liu , Thaddeus Stappenbeck , Jeffrey L. Rogers

With the integration of multimodal large language models (MLLMs) into robotic systems and AI applications, embedding emotional intelligence (EI) capabilities is essential for enabling these models to perceive, interpret, and respond to…

Computation and Language · Computer Science 2026-04-28 He Hu , Lianzhong You , Hongbo Xu , Qianning Wang , Fei Richard Yu , Fei Ma , Zebang Cheng , Zheng Lian , Yucheng Zhou , Laizhong Cui

Despite strong performance in medical question-answering, the clinical adoption of Large Language Models (LLMs) is critically hampered by their opaque 'black-box' reasoning, limiting clinician trust. This challenge is compounded by the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chao Ding , Mouxiao Bian , Pengcheng Chen , Hongliang Zhang , Tianbin Li , Lihao Liu , Jiayuan Chen , Zhuoran Li , Yabei Zhong , Yongqi Liu , Haiqing Huang , Dongming Shan , Junjun He , Jie Xu

Large visual language models (VLMs) have shown strong multi-modal medical reasoning ability, but most operate as end-to-end black boxes, diverging from clinicians' evidence-based, staged workflows and hindering clinical accountability.…

Artificial Intelligence · Computer Science 2026-03-12 Yuexi Du , Jinglu Wang , Shujie Liu , Nicha C. Dvornek , Yan Lu

Recent advancements in medical Large Language Models (LLMs) have showcased their powerful reasoning and diagnostic capabilities. Despite their success, current unified multimodal medical LLMs face limitations in knowledge update costs,…

Computation and Language · Computer Science 2025-06-25 Yucheng Zhou , Lingran Song , Jianbing Shen

Language models excel at diagnostic assessments on curated medical case-studies and vignettes, performing on par with, or better than, clinical professionals. However, existing studies focus on complex scenarios with rich context making it…

Artificial Intelligence (AI) chatbots leveraging Large Language Models (LLMs) are gaining traction in healthcare for their potential to automate patient interactions and aid clinical decision-making. This study examines the reliability of…

Artificial Intelligence · Computer Science 2024-05-24 Ayesha Siddika Nipu , K M Sajjadul Islam , Praveen Madiraju

We present PULSE, a medical reasoning agent that combines a domain-tuned large language model with scientific literature retrieval to support diagnostic decision-making in complex real-world cases. To evaluate its capabilities, we curated a…

Computation and Language · Computer Science 2026-03-19 Zhongzhen Huang , Yan Ling , Hong Chen , Ye Feng , Li Wu , Linjie Mu , Shaoting Zhang , Xiaofan Zhang , Kun Qian , Xiaomu Li

There is widespread optimism that frontier Large Language Models (LLMs) and LLM-augmented systems have the potential to rapidly accelerate scientific discovery across disciplines. Today, many benchmarks exist to measure LLM knowledge and…

Enhancing interrogation capabilities in Traditional Chinese Medicine (TCM) diagnosis through multi-turn dialogues and knowledge graphs presents a significant challenge for modern AI systems. Current large language models (LLMs), despite…

Artificial Intelligence · Computer Science 2025-07-08 Zewen Sun , Ruoxiang Huang , Jiahe Feng , Rundong Kong , Yuqian Wang , Hengyu Liu , Ziqi Gong , Yuyuan Qin , Yingxue Wang , Yu Wang

Language assessment plays a crucial role in diagnosing and treating individuals with speech, language, and communication disorders caused by neurogenic conditions, whether developmental or acquired. However, current assessment methods are…

Computation and Language · Computer Science 2024-03-19 Charalambos Themistocleous

Artificial intelligence (AI) has gained significant attention in healthcare consultation due to its potential to improve clinical workflow and enhance medical communication. However, owing to the complex nature of medical information, large…

Computation and Language · Computer Science 2024-03-05 Xiaolan Chen , Ziwei Zhao , Weiyi Zhang , Pusheng Xu , Le Gao , Mingpu Xu , Yue Wu , Yinwen Li , Danli Shi , Mingguang He