English
Related papers

Related papers: SAPIEN: Affective Virtual Agents Powered by Large …

200 papers

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

Computation and Language · Computer Science 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

In a previous publication, we introduced the core concepts of empathic agents as agents that use a combination of utility-based and rule-based approaches to resolve conflicts when interacting with other agents in their environment. In this…

Multiagent Systems · Computer Science 2018-12-13 Timotheus Kampik , Juan Carlos Nieves , Helena Lindgren

This study focuses on emotion-sensitive spoken dialogue in human-machine speech interaction. With the advancement of Large Language Models (LLMs), dialogue systems can handle multimodal data, including audio. Recent models have enhanced the…

Sound · Computer Science 2024-07-30 Hongfei Xue , Yuhao Liang , Bingshen Mu , Shiliang Zhang , Mengzhe Chen , Qian Chen , Lei Xie

Large language models and vision-language models (which we jointly call LMs) have transformed NLP and CV, demonstrating remarkable potential across various fields. However, their capabilities in affective analysis (i.e. sentiment analysis…

Computation and Language · Computer Science 2025-06-02 Zhiwei Liu , Lingfei Qian , Qianqian Xie , Jimin Huang , Kailai Yang , Sophia Ananiadou

The advent of large language models (LLMs) has enabled agents to represent virtual humans in societal simulations, facilitating diverse interactions within complex social systems. However, existing LLM-based agents exhibit severe…

Artificial Intelligence · Computer Science 2025-10-16 Qun Ma , Xiao Xue , Xuwen Zhang , Zihan Zhao , Yuwei Guo , Ming Zhang

The development of embodied agents that can communicate with humans in natural language has gained increasing interest over the last years, as it facilitates the diffusion of robotic platforms in human-populated environments. As a step…

Robotics · Computer Science 2024-04-16 Roberto Bigazzi , Marcella Cornia , Silvia Cascianelli , Lorenzo Baraldi , Rita Cucchiara

The massive population election simulation aims to model the preferences of specific groups in particular election scenarios. It has garnered significant attention for its potential to forecast real-world social trends. Traditional…

Computation and Language · Computer Science 2024-11-07 Xinnong Zhang , Jiayu Lin , Libo Sun , Weihong Qi , Yihang Yang , Yue Chen , Hanjia Lyu , Xinyi Mou , Siming Chen , Jiebo Luo , Xuanjing Huang , Shiping Tang , Zhongyu Wei

This paper presents a novel application of large language models (LLMs) to enhance user comprehension of privacy policies through an interactive dialogue agent. We demonstrate that LLMs significantly outperform traditional models in tasks…

Human-Computer Interaction · Computer Science 2024-10-17 Bolun Sun , Yifan Zhou , Haiyun Jiang

Agent-Based Modelling (ABM) has emerged as an essential tool for simulating social networks, encompassing diverse phenomena such as information dissemination, influence dynamics, and community formation. However, manually configuring varied…

Large Language Models (LLMs) have transformed agent-agent and human-agent interaction by enabling software, physical, and simulation agents to communicate and deliberate through natural language. Yet fluent language use does not by itself…

Multiagent Systems · Computer Science 2026-05-05 Önder Gürcan , Moharram Challenger

Designing and evaluating personalized and proactive assistant agents remains challenging due to the time, cost, and ethical concerns associated with human-in-the-loop experimentation. Existing Human-Computer Interaction (HCI) methods often…

Human-Computer Interaction · Computer Science 2025-11-25 Ziyi Xuan , Yiwen Wu , Xuhai Xu , Vinod Namboodiri , Mooi Choo Chuah , Yu Yang

Discussion and debate among Large Language Models (LLMs) have gained considerable attention due to their potential to enhance the reasoning ability of LLMs. Although natural language is an obvious choice for communication due to LLM's…

Computation and Language · Computer Science 2024-02-27 Chau Pham , Boyi Liu , Yingxiang Yang , Zhengyu Chen , Tianyi Liu , Jianbo Yuan , Bryan A. Plummer , Zhaoran Wang , Hongxia Yang

This paper introduces discourse_simulator, an open-source framework that combines LLMs with agent-based modelling. It offers a new way to simulate how public attitudes toward immigration change over time in response to salient events like…

Artificial Intelligence · Computer Science 2026-04-07 Deepak John Reji

Remarkable advancements in modern generative foundation models have enabled the development of sophisticated and highly capable autonomous agents that can observe their environment, invoke tools, and communicate with other agents to solve…

Human-Computer Interaction · Computer Science 2024-12-17 Gagan Bansal , Jennifer Wortman Vaughan , Saleema Amershi , Eric Horvitz , Adam Fourney , Hussein Mozannar , Victor Dibia , Daniel S. Weld

Social simulation is transforming traditional social science research by modeling human behavior through interactions between virtual individuals and their environments. With recent advances in large language models (LLMs), this approach…

With the surge in the development of large language models, embodied intelligence has attracted increasing attention. Nevertheless, prior works on embodied intelligence typically encode scene or historical memory in an unimodal manner,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yang Liu , Xinshuai Song , Kaixuan Jiang , Weixing Chen , Jingzhou Luo , Guanbin Li , Liang Lin

This paper analyses Conversational AI multi-agent interoperability frameworks and describes the novel architecture proposed by the Open Voice Interoperability initiative (Linux Foundation AI and DATA), also known briefly as OVON (Open Voice…

Artificial Intelligence · Computer Science 2024-07-30 Diego Gosmar , Deborah A. Dahl , Emmett Coin

Hallucinations remain a significant challenge in current Generative AI models, undermining trust in AI systems and their reliability. This study investigates how orchestrating multiple specialized Artificial Intelligent Agents can help…

Computation and Language · Computer Science 2025-01-27 Diego Gosmar , Deborah A. Dahl

This paper explores the integration of human-like emotions and ethical considerations into Large Language Models (LLMs). We first model eight fundamental human emotions, presented as opposing pairs, and employ collaborative LLMs to…

Computation and Language · Computer Science 2024-06-26 Edward Y. Chang

This paper proposes an agent-based approach toward a more natural interface between humans and machines. Large language models equipped with tools and the communication standard OPC UA are utilized to control machines in natural language.…

Human-Computer Interaction · Computer Science 2026-02-06 Bernd Hofmann , Niklas Piechulek , Sven Kreitlein , Joerg Franke , Patrick Bruendl