English
Related papers

Related papers: Knowledge-Augmented Multimodal Clinical Rationale …

200 papers

With the recent progress of Large Language Models (LLMs), there is a growing interest in applying these models to solve complex and challenging problems. Modern LLMs, capable of processing long contexts and generating verbalized…

Computation and Language · Computer Science 2026-04-14 WonJin Yoon , Kangyu Zhu , Ian Bulovic , Autumn Sehy , Yanjun Gao , Dmitriy Dligach , Majid Afshar , Timothy A. Miller

Condition monitoring (CM) plays a crucial role in ensuring reliability and efficiency in the process industry. Although computerised maintenance systems effectively detect and classify faults, tasks like fault severity estimation, and…

Machine Learning · Computer Science 2025-06-12 Karl Löwenmark , Daniel Strömbergsson , Chang Liu , Marcus Liwicki , Fredrik Sandin

Recently, multimodal large language models (MLLMs) have been widely applied to reasoning tasks. However, they suffer from limited multi-rationale semantic modeling, insufficient logical robustness, and are susceptible to misleading…

Artificial Intelligence · Computer Science 2025-12-08 Chuang Yu , Jinmiao Zhao , Mingxuan Zhao , Yunpeng Liu , Xiujun Shu , Yuanhao Feng , Bo Wang , Xiangyu Yue

Recent studies have demonstrated that Large Language Models (LLMs) have strong mathematical reasoning abilities but rely on hundreds of billions of parameters. To tackle the challenge of poor reasoning in Small Language Models (SLMs),…

Computation and Language · Computer Science 2025-08-19 Xinhe Li , Jiajun Liu , Peng Wang

The deployment of large language models (LLMs) faces considerable challenges concerning resource constraints and inference efficiency. Recent research has increasingly focused on smaller, task-specific models enhanced by distilling…

Computation and Language · Computer Science 2024-09-20 Wei Wang , Zhaowei Li , Qi Xu , Yiqing Cai , Hang Song , Qi Qi , Ran Zhou , Zhida Huang , Tao Wang , Li Xiao

Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) in knowledge-intensive tasks such as those from medical domain. However, the sensitive nature of the medical…

Computation and Language · Computer Science 2024-11-15 Nghia Trung Ngo , Chien Van Nguyen , Franck Dernoncourt , Thien Huu Nguyen

The integration of Artificial Intelligence (AI), especially Large Language Models (LLMs), into the clinical diagnosis process offers significant potential to improve the efficiency and accessibility of medical care. While LLMs have shown…

Computation and Language · Computer Science 2024-10-15 Mingyu Derek Ma , Chenchen Ye , Yu Yan , Xiaoxuan Wang , Peipei Ping , Timothy S Chang , Wei Wang

Clinical Decision Support Systems (CDSSs) provide reasoning and inquiry guidance for physicians, yet they face notable challenges, including high maintenance costs and low generalization capability. Recently, Large Language Models (LLMs)…

Computation and Language · Computer Science 2026-04-24 Yue Guo , Fanfu Wang , Jianwei Lv , Xincheng Shi , Yuchen Li , Youya Wang , Yunsheng Zeng , Yujing Liu , Yunhao Qiao , Gen Li , Junfeng Wang , Bo Yuan

Scientific reasoning, the process through which humans apply logic, evidence, and critical thinking to explore and interpret scientific phenomena, is essential in advancing knowledge reasoning across diverse fields. However, despite…

Computation and Language · Computer Science 2026-04-21 Yibo Yan , Shen Wang , Jiahao Huo , Jingheng Ye , Zhendong Chu , Xuming Hu , Philip S. Yu , Carla Gomes , Bart Selman , Qingsong Wen

Clinical note generation aims to produce free-text summaries of a patient's condition and diagnostic process, with discharge instructions being a representative long-form example. While recent LLM-based methods pre-trained on general…

Computation and Language · Computer Science 2025-08-12 Lo Pang-Yun Ting , Chengshuai Zhao , Yu-Hua Zeng , Yuan Jee Lim , Kun-Ta Chuang , Huan Liu

Large language models (LLMs) offer new opportunities for constructing knowledge graphs (KGs) from unstructured clinical narratives. However, existing approaches often rely on structured inputs and lack robust validation of factual accuracy…

Artificial Intelligence · Computer Science 2026-01-06 Udiptaman Das , Krishnasai B. Atmakuri , Duy Ho , Chi Lee , Yugyung Lee

While large language models hold promise for complex medical applications, their development is hindered by the scarcity of high-quality reasoning data. To address this issue, existing approaches typically distill chain-of-thought reasoning…

Machine Learning · Computer Science 2026-04-14 Haolin Li , Shuyang Jiang , Ruipeng Zhang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

The recent surge in Multimodal Large Language Models (MLLMs) has showcased their remarkable potential for achieving generalized intelligence by integrating visual understanding into Large Language Models.Nevertheless, the sheer model size…

Computation and Language · Computer Science 2024-07-30 Shilin Xu , Xiangtai Li , Haobo Yuan , Lu Qi , Yunhai Tong , Ming-Hsuan Yang

Recent advancements in Large Language Models (LLMs) have demonstrated significant promise in clinical diagnosis. However, current models struggle to emulate the iterative, diagnostic hypothesis-driven reasoning of real clinical scenarios.…

Computation and Language · Computer Science 2026-01-06 Qipeng Wang , Rui Sheng , Yafei Li , Huamin Qu , Yushi Sun , Min Zhu

Understanding human intents from multimodal signals is critical for analyzing human behaviors and enhancing human-machine interactions in real-world scenarios. However, existing methods exhibit limitations in their modality-level reliance,…

Multimedia · Computer Science 2025-09-03 Qianrui Zhou , Hua Xu , Yifan Wang , Xinzhi Dong , Hanlei Zhang

Despite the wide adoption of Large Language Models (LLM)s, clinical decision support systems face a critical challenge: achieving high predictive accuracy while generating explanations aligned with the predictions. Current approaches suffer…

Artificial Intelligence · Computer Science 2026-05-07 H M Quamran Hasan , Housam Khalifa Bashier , Jiayi Dai , Mi-Young Kim , Randy Goebel

Retrieving visual and textual information from medical literature and hospital records can enhance diagnostic accuracy for clinical image interpretation. However, multimodal retrieval-augmented diagnosis is highly challenging. We explore a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Nir Mazor , Tom Hope

Despite strong performance in medical question-answering, the clinical adoption of Large Language Models (LLMs) is critically hampered by their opaque 'black-box' reasoning, limiting clinician trust. This challenge is compounded by the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chao Ding , Mouxiao Bian , Pengcheng Chen , Hongliang Zhang , Tianbin Li , Lihao Liu , Jiayuan Chen , Zhuoran Li , Yabei Zhong , Yongqi Liu , Haiqing Huang , Dongming Shan , Junjun He , Jie Xu

Medical Vision-Language Models (MedVLMs) excel at perception tasks but struggle with complex clinical reasoning required in real-world scenarios. While reinforcement learning (RL) has been explored to enhance reasoning capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Meidan Ding , Jipeng Zhang , Wenxuan Wang , Haiqin Zhong , Xiaoling Luo , Wenting Chen , Linlin Shen

Large language models (LLMs) have recently showcased remarkable capabilities, spanning a wide range of tasks and applications, including those in the medical domain. Models like GPT-4 excel in medical question answering but may face…

Computation and Language · Computer Science 2025-07-02 Bowen Wang , Jiuyang Chang , Yiming Qian , Guoxin Chen , Junhao Chen , Zhouqiang Jiang , Jiahao Zhang , Yuta Nakashima , Hajime Nagahara