English
Related papers

Related papers: SAPIEN: Affective Virtual Agents Powered by Large …

200 papers

Technologies for enhancing well-being, healthcare vigilance and monitoring are on the rise. However, despite patient interest, such technologies suffer from low adoption. One hypothesis for this limited adoption is loss of human interaction…

Computation and Language · Computer Science 2021-11-30 Xinxin Yan , Ndapa Nakashole

Our goal in this paper is to establish a means for a dialogue platform to be able to cope with open domains considering the possible interaction between the embodied agent and humans. To this end we present an algorithm capable of…

Computation and Language · Computer Science 2012-07-19 Artur Ventura , Nuno Diegues , David Martins de Matos

Large Language Models (LLMs) have demonstrated remarkable capabilities in conversational tasks. Embodying an LLM as a virtual human allows users to engage in face-to-face social interactions in Virtual Reality. However, the influence of…

Human-Computer Interaction · Computer Science 2025-08-06 Leon O. H. Kroczek , Alexander May , Selina Hettenkofer , Andreas Ruider , Bernd Ludwig , Andreas Mühlberger

Due to the lack of human resources for mental health support, there is an increasing demand for employing conversational agents for support. Recent work has demonstrated the effectiveness of dialogue models in providing emotional support.…

Computation and Language · Computer Science 2023-05-30 Jiale Cheng , Sahand Sabour , Hao Sun , Zhuang Chen , Minlie Huang

Humanness is core to speech interface design. Yet little is known about how users conceptualise perceptions of humanness and how people define their interaction with speech interfaces through this. To map these perceptions n=21 participants…

Human-Computer Interaction · Computer Science 2019-07-30 Philip R. Doyle , Justin Edwards , Odile Dumbleton , Leigh Clark , Benjamin R. Cowan

Advances in machine intelligence have enabled conversational interfaces that have the potential to radically change the way humans interact with machines. However, even with the progress in the abilities of these agents, there remain…

Human-Computer Interaction · Computer Science 2019-10-17 Deepali Aneja , Rens Hoegen , Daniel McDuff , Mary Czerwinski

In order to create effective storytelling agents three fundamental questions must be answered: first, is a physically embodied agent preferable to a virtual agent or a voice-only narration? Second, does a human voice have an advantage over…

Robotics · Computer Science 2016-07-20 Sandra Costa , Alberto Brunete , Byung-Chull Bae , Nikolaos Mavridis

Large language models (LLMs) are poised to revolutionize the domain of online fashion retail, enhancing customer experience and discovery of fashion online. LLM-powered conversational agents introduce a new way of discovery by directly…

Information Retrieval · Computer Science 2024-08-20 Antonis Maronikolakis , Ana Peleteiro Ramallo , Weiwei Cheng , Thomas Kober

Spoken dialogue systems that assist users to solve complex tasks such as movie ticket booking have become an emerging research topic in artificial intelligence and natural language processing areas. With a well-designed dialogue system as…

Computation and Language · Computer Science 2021-09-01 Shang-Yu Su , Po-Wei Lin , Yun-Nung Chen

Automated dialogue systems are important applications of artificial intelligence, and traditional systems struggle to understand user emotions and provide empathetic feedback. This study integrates emotional intelligence technology into…

Artificial Intelligence · Computer Science 2024-04-30 Jin Wang , JinFei Wang , Shuying Dai , Jiqiang Yu , Keqin Li

Creating effective dialogue systems for mental health support requires high-quality multi-turn counseling dialogue data, yet collecting real counselor-client conversations presents significant challenges, including privacy concerns, high…

Computation and Language · Computer Science 2026-05-27 Huachuan Qiu , Zhenzhong Lan

With advances in generative AI, there is now potential for autonomous agents to manage daily tasks via natural language commands. However, current agents are primarily created and tested in simplified synthetic environments, leading to a…

Artificial Intelligence · Computer Science 2024-04-17 Shuyan Zhou , Frank F. Xu , Hao Zhu , Xuhui Zhou , Robert Lo , Abishek Sridhar , Xianyi Cheng , Tianyue Ou , Yonatan Bisk , Daniel Fried , Uri Alon , Graham Neubig

Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. These agents autonomously interact with digital systems or software applications…

Digital platforms shape how people communicate, deliberate, and form opinions. Studying these dynamics has become increasingly difficult due to restricted data access, ethical constraints on real-world experiments, and limitations of…

Human-Computer Interaction · Computer Science 2026-02-19 Emma Hoes , K. Jonathan Klueser , Fabrizio Gilardi

Effective human-agent interaction (HAI) relies on accurate and adaptive perception of human emotional states. While multimodal deep learning models - leveraging facial expressions, speech, and textual cues - offer high accuracy in emotion…

Machine Learning · Computer Science 2025-12-15 Matvey Nepomnyaschiy , Oleg Pereziabov , Anvar Tliamov , Stanislav Mikhailov , Ilya Afanasyev

A conversational agent (chatbot) is a piece of software that is able to communicate with humans using natural language. Modeling conversation is an important task in natural language processing and artificial intelligence. While chatbots…

Computation and Language · Computer Science 2019-08-26 Richard Csaky

Embodied conversational agents (ECAs) are increasingly more realistic and capable of dynamic conversations. In online surveys, anthropomorphic agents could help address issues like careless responding and satisficing, which originate from…

Human-Computer Interaction · Computer Science 2025-08-05 Matus Krajcovic , Peter Demcak , Eduard Kuric

Psychological counseling faces huge challenges due to the growing demand for mental health services and the shortage of trained professionals. Large language models (LLMs) have shown potential to assist psychological counseling, especially…

Artificial Intelligence · Computer Science 2025-07-28 Yigui Feng , Qinglin Wang , Ke Liu , Xinhai Chen , Bo Yang , Jie Liu

In VR interactions with embodied conversational agents, users' emotional intent is often conveyed more by how something is said than by what is said. However, most VR agent pipelines rely on speech-to-text processing, discarding prosodic…

Human-Computer Interaction · Computer Science 2026-03-11 SangYeop Jeong , Yeongseo Na , Seung Gyu Jeong , Jin-Woo Jeong , Seong-Eun Kim

Individuals are turning to increasingly anthropomorphic, general-purpose chatbots for AI companionship, rather than roleplay-specific platforms. However, not much is known about how individuals perceive and conduct their relationships with…