English
Related papers

Related papers: MedTutor-R1: Socratic Personalized Medical Teachin…

200 papers

Multi-Modal Large Language Models (MLLMs), despite being successful, exhibit limited generality and often fall short when compared to specialized models. Recently, LLM-based agents have been developed to address these challenges by…

Computation and Language · Computer Science 2024-10-08 Binxu Li , Tiankai Yan , Yuanting Pan , Jie Luo , Ruiyang Ji , Jiayuan Ding , Zhe Xu , Shilong Liu , Haoyu Dong , Zihao Lin , Yixin Wang

Although multimodal large language models (MLLMs) excel in high-level vision-language reasoning, they lack inherent awareness of visual saliency, making it difficult to identify key visual elements. To bridge this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Long Li , Shuichen Ji , Ziyang Luo , Zhihui Li , Dingwen Zhang , Junwei Han , Nian Liu

Medical consultations are intrinsically speech-centric. However, most prior works focus on long-text-based interactions, which are cumbersome and patient-unfriendly. Recent advances in speech language models (SpeechLMs) have enabled more…

Computation and Language · Computer Science 2026-04-21 Sirry Chen , Jieyi Wang , Wei Chen , Zhongyu Wei

Large language models(LLMs) increasingly match expert performance on licensing examinations, yet routine clinical use remains limited because governance requires auditable reasoning, safety and ethics alignment, and resilience to…

Medical data poses a daunting challenge for AI algorithms: it exists in many different modalities, experiences frequent distribution shifts, and suffers from a scarcity of examples and labels. Recent advances, including transformers and…

Multimodal Large Language Models (MLLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored, especially in clinical anatomical surgical images. Anatomy understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Ziyang Song , Zelin Zang , Zuyao Chen , Xusheng Liang , Dong Yi , Jinlin Wu , Hongbin Liu , Jiebo Luo , Zhen. Lei

Surgical AI often involves multiple tasks within a single procedure, like phase recognition or assessing the Critical View of Safety in laparoscopic cholecystectomy. Traditional models, built for one task at a time, lack flexibility,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Soham Walimbe , Britty Baby , Vinkle Srivastav , Nicolas Padoy

With the rapid progress of artificial intelligence (AI) in multi-modal understanding, there is increasing potential for video comprehension technologies to support professional domains such as medical education. However, existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Shenxi Liu , Kan Li , Mingyang Zhao , Yuhang Tian , Bin Li , Shoujun Zhou , Hongliang Li , Fuxia Yang

Pedagogical Agents (PAs) show significant potential for boosting student engagement and learning outcomes by providing adaptive, on-demand support in educational contexts. However, existing PA solutions are often hampered by pre-scripted…

Human-Computer Interaction · Computer Science 2025-05-13 Eason Chen , Chenyu Lin , Yu-Kai Huang , Xinyi Tang , Aprille Xi , Jionghao Lin , Kenneth Koedinger

Multimodal large language models (MLLMs) have emerged as powerful tools for computational pathology, offering unprecedented opportunities to integrate pathological images with language context for comprehensive diagnostic analysis. These…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Zhe Xu , Ziyi Liu , Junlin Hou , Jiabo Ma , Cheng Jin , Yihui Wang , Zhixuan Chen , Zhengyu Zhang , Fuxiang Huang , Zhengrui Guo , Fengtao Zhou , Yingxue Xu , Xi Wang , Ronald Cheong Kin Chan , Li Liang , Hao Chen

Knowledge editing (KE) provides a scalable approach for updating factual knowledge in large language models without full retraining. While previous studies have demonstrated effectiveness in general domains and medical QA tasks, little…

Artificial Intelligence · Computer Science 2025-08-12 Shengtao Wen , Haodong Chen , Yadong Wang , Zhongying Pan , Xiang Chen , Yu Tian , Bo Qian , Dong Liang , Sheng-Jun Huang

Deploying multimodal large language models (MLLMs) for clinical summarization demands not only fluent generation but also transparency about where each statement originates-and a mechanism to flag when statements lack evidential support. We…

Computation and Language · Computer Science 2026-04-21 Qianqi Yan , Huy Nguyen , Sumana Srivatsa , Hari Bandi , Xin Eric Wang , Krishnaram Kenthapadi

Clinical diagnosis begins with doctor-patient interaction, during which physicians iteratively gather information, determine examination and refine differential diagnosis through patients' response. This dynamic clinical-reasoning process…

Computation and Language · Computer Science 2025-12-30 Yuqi Tang , Jing Yu , Zichang Su , Kehua Feng , Zhihui Zhu , Libin Wang , Lei Liang , Qiang Zhang , Keyan Ding , Huajun Chen

Complex visual reasoning remains a key challenge today. Typically, the challenge is tackled using methodologies such as Chain of Thought (COT) and visual instruction tuning. However, how to organically combine these two methodologies for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Wanpeng Hu , Haodi Liu , Lin Chen , Feng Zhou , Changming Xiao , Qi Yang , Changshui Zhang

Cross-Modal Retrieval (CMR) is an important research topic across multimodal computing and information retrieval, which takes one type of data as the query to retrieve relevant data of another type. It has been widely used in many…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Zhixiong Zeng , Wenji Mao

Human-centric visual tasks have attracted increasing research attention due to their widespread applications. In this paper, we aim to learn a general human representation from massive unlabeled human images which can benefit downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Weihua Chen , Xianzhe Xu , Jian Jia , Hao luo , Yaohua Wang , Fan Wang , Rong Jin , Xiuyu Sun

Multimodal large language models (MLLMs) have made significant strides, yet they face challenges in the medical domain due to limited specialized knowledge. While recent medical MLLMs demonstrate strong performance in lab settings, they…

Computation and Language · Computer Science 2024-10-22 Junda Wang , Yujan Ting , Eric Z. Chen , Hieu Tran , Hong Yu , Weijing Huang , Terrence Chen

Effective patient communication is pivotal in healthcare, yet traditional medical training often lacks exposure to diverse, challenging interpersonal dynamics. To bridge this gap, this study proposes the use of Large Language Models (LLMs)…

The growth of Massive Open Online Courses (MOOCs) presents significant challenges for personalized learning, where concept recommendation is crucial. Existing approaches typically rely on heterogeneous information networks or knowledge…

Information Retrieval · Computer Science 2025-11-27 Xiangrui Xiong , Yichuan Lu , Zifei Pan , Chang Sun

One-to-one tutoring is one of the most efficient methods of teaching. With the growing popularity of Large Language Models (LLMs), there have been efforts to create LLM based conversational tutors which can expand the benefits of one to one…

Human-Computer Interaction · Computer Science 2025-03-20 Romain Puech , Jakub Macina , Julia Chatain , Mrinmaya Sachan , Manu Kapur