English
Related papers

Related papers: Facial-Expression-Aware Prompting for Empathetic L…

200 papers

The analysis of students' emotions and behaviors is crucial for enhancing learning outcomes and personalizing educational experiences. Traditional methods often rely on intrusive visual and physiological data collection, posing privacy…

Computation and Language · Computer Science 2024-08-14 Kaito Tanaka , Benjamin Tan , Brian Wong

With the emergence of large language models (LLMs) as a powerful class of generative artificial intelligence (AI), their use in tutoring has become increasingly prominent. Prior works on LLM-based tutoring typically learn a single tutor…

Computation and Language · Computer Science 2026-02-10 Jaewook Lee , Alexander Scarlatos , Simon Woodhead , Andrew Lan

The detection of micro-expression Action Units (AUs) is a formidable challenge in affective computing, pivotal for decoding subtle, involuntary human emotions. While Large Language Models (LLMs) demonstrate profound reasoning abilities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zhishu Liu , Kaishen Yuan , Bo Zhao , Yong Xu , Zitong Yu

Intelligent Tutoring Systems (ITSs) can provide personalized and self-paced learning experience. The emergence of large language models (LLMs) further enables better human-machine interaction, and facilitates the development of…

Computation and Language · Computer Science 2025-05-29 Zhengyuan Liu , Stella Xin Yin , Geyu Lin , Nancy F. Chen

While Large Language Models (LLMs) have demonstrated remarkable fluency in educational dialogues, most generative tutors primarily operate through intuitive, single-pass generation. This reliance on fast thinking precludes a dedicated…

Artificial Intelligence · Computer Science 2026-03-31 Yuang Wei , Ruijia Li , Bo Jiang

Large language models have emerged as a promising approach towards achieving general-purpose AI agents. The thriving open-source LLM community has greatly accelerated the development of agents that support human-machine dialogue interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zhenfei Yin , Jiong Wang , Jianjian Cao , Zhelun Shi , Dingning Liu , Mukai Li , Lu Sheng , Lei Bai , Xiaoshui Huang , Zhiyong Wang , Jing Shao , Wanli Ouyang

Facial expression recognition (FER) is an important research topic in emotional artificial intelligence. In recent decades, researchers have made remarkable progress. However, current FER paradigms face challenges in generalization, lack…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Bohao Xing , Zitong Yu , Xin Liu , Kaishen Yuan , Qilang Ye , Weicheng Xie , Huanjing Yue , Jingyu Yang , Heikki Kälviäinen

Large Language Models (LLMs) have the potential to transform the way a dynamic curriculum can be delivered. However, educators face significant challenges in interacting with these models, particularly due to complex prompt engineering and…

Computers and Society · Computer Science 2025-06-16 Abdolali Faraji , Mohammadreza Tavakoli , Mohammad Moein , Mohammadreza Molavi , Gábor Kismihók

We present an Audio-Visual Language Model (AVLM) for expressive speech generation by integrating full-face visual cues into a pre-trained expressive speech model. We explore multiple visual encoders and multimodal fusion strategies during…

Computation and Language · Computer Science 2025-08-29 Weiting Tan , Jiachen Lian , Hirofumi Inaguma , Paden Tomasello , Philipp Koehn , Xutai Ma

Integrating Large Language Models (LLMs) into educational practice enables personalized learning by accommodating diverse learner behaviors. This study explored diverse learner profiles within a multi-agent, LLM-empowered learning…

Computers and Society · Computer Science 2025-10-13 Zhanxin Hao , Jianxiao Jiang , Jifan Yu , Zhiyuan Liu , Yu Zhang

The performance of ChatGPT\copyright{} and other LLMs has improved tremendously, and in online environments, they are increasingly likely to be used in a wide variety of situations, such as ChatBot on web pages, call center operations using…

Human-Computer Interaction · Computer Science 2025-02-19 Hiroki Tanioka , Tetsushi Ueta , Masahiko Sano

Students' academic emotions significantly influence their social behavior and learning performance. Traditional approaches to automatically and accurately analyze these emotions have predominantly relied on supervised machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Deliang Wang , Chao Yang , Gaowei Chen

Transformer models have significantly advanced the field of emotion recognition. However, there are still open challenges when exploring open-ended queries for Large Language Models (LLMs). Although current models offer good results,…

Most AI-based educational tools today adopt a one-on-one tutoring paradigm, pairing a single LLM with a single learner. Yet decades of learning science research suggest that multi-party interaction -- through peer modeling, co-construction,…

Human-Computer Interaction · Computer Science 2026-04-06 Harsh Kumar , Zi Kang , Mu , Jonathan Vincentius , Ashton Anderson

Recent research shows that greater numbers of people are turning to Large Language Models (LLMs) for emotional support, and that people rate LLM responses as more empathic than human-written responses. We suggest a reason for this success:…

Computation and Language · Computer Science 2026-04-10 Emma Gueorguieva , Hongli Zhan , Jina Suh , Javier Hernandez , Tatiana Lau , Junyi Jessy Li , Desmond C. Ong

Artificial intelligence has been applied in various aspects of online education to facilitate teaching and learning. However, few approaches has been made toward a complete AI-powered tutoring system. In this work, we explore the…

Human-Computer Interaction · Computer Science 2024-08-06 Yulin Chen , Ning Ding , Hai-Tao Zheng , Zhiyuan Liu , Maosong Sun , Bowen Zhou

Recent advances in Large Language Models (LLMs) have significantly improved natural language understanding and generation, enhancing Human-Computer Interaction (HCI). However, LLMs are limited to unimodal text processing and lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Chenxi Li

With the rapid advancement of mathematical reasoning capabilities in Large Language Models (LLMs), AI systems are increasingly being adopted in educational settings to support students' comprehension of problem-solving processes. However, a…

Computation and Language · Computer Science 2025-12-18 Jaewoo Park , Jungyang Park , Dongju Jang , Jiwan Chung , Byungwoo Yoo , Jaewoo Shin , Seonjoon Park , Taehyeong Kim , Youngjae Yu

The growing ubiquity of artificial intelligence (AI), in particular large language models (LLMs), has profoundly altered the way in which learners gain knowledge and interact with learning material, with many claiming that AI positively…

Artificial Intelligence · Computer Science 2025-07-18 Jarosław A. Chudziak , Adam Kostka

With generative AI advancing, empathy in human-AI interaction is essential. While prior work focuses on emotional reflection, emotional exploration, key to deeper engagement, remains overlooked. Existing LLMs rely on text which captures…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Jing-Han Chen , Bo-Hao Su , Ya-Tse Wu , Chi-Chun Lee