English
Related papers

Related papers: Large Language Models for Virtual Human Gesture Se…

200 papers

When engaging in conversations, dialogue agents in a virtual simulation environment may exhibit their own emotional states that are unrelated to the immediate conversational context, a phenomenon known as self-emotion. This study explores…

Multiagent Systems · Computer Science 2024-08-06 Qiang Zhang , Jason Naradowsky , Yusuke Miyao

In recent years, there has been a considerable amount of research in the Gesture Recognition domain, mainly owing to the technological advancements in Computer Vision. Various new applications have been conceptualised and developed in this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Kshitij Deshpande , Varad Mashalkar , Kaustubh Mhaisekar , Amaan Naikwadi , Archana Ghotkar

Generating full-body human gestures based on speech signals remains challenges on quality and speed. Existing approaches model different body regions such as body, legs and hands separately, which fail to capture the spatial interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Pinxin Liu , Luchuan Song , Junhua Huang , Haiyang Liu , Chenliang Xu

Simulating user interactions enables a more user-oriented evaluation of information retrieval (IR) systems. While user simulations are cost-efficient and reproducible, many approaches often lack fidelity regarding real user behavior. Most…

Information Retrieval · Computer Science 2024-01-29 Björn Engelmann , Timo Breuer , Jana Isabelle Friese , Philipp Schaer , Norbert Fuhr

Previous research in human gesture recognition has largely overlooked multi-person interactions, which are crucial for understanding the social context of naturally occurring gestures. This limitation in existing datasets presents a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Xu Cao , Pranav Virupaksha , Wenqi Jia , Bolin Lai , Fiona Ryan , Sangmin Lee , James M. Rehg

Human communication seamlessly integrates speech and bodily motion, where hand gestures naturally complement vocal prosody to express intent, emotion, and emphasis. While recent text-to-speech (TTS) systems have begun incorporating…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-23 Lokesh Kumar , Nirmesh Shah , Ashishkumar P. Gudmalwar , Pankaj Wasnik

Task-oriented conversational systems are essential for efficiently addressing diverse user needs, yet their development requires substantial amounts of high-quality conversational data that is challenging and costly to obtain. While large…

Information Retrieval · Computer Science 2025-11-06 Zhefan Wang , Ning Geng , Zhiqiang Guo , Weizhi Ma , Min Zhang

Generating realistic human motions that naturally respond to both spoken language and physical objects is crucial for interactive digital experiences. Current methods, however, address speech-driven gestures or object interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Sreehari Rajan , Kunal Bhosikar , Charu Sharma

Large language models encode knowledge in various domains and demonstrate the ability to understand visualizations. They may also capture visualization design knowledge and potentially help reduce the cost of formative studies. However, it…

Human-Computer Interaction · Computer Science 2025-05-13 Zekai Shao , Yi Shan , Yixuan He , Yuxuan Yao , Junhong Wang , Xiaolong , Zhang , Yu Zhang , Siming Chen

Emotions exert an immense influence over human behavior and cognition in both commonplace and high-stress tasks. Discussions of whether or how to integrate large language models (LLMs) into everyday life (e.g., acting as proxies for, or…

Artificial Intelligence · Computer Science 2025-08-21 Mattson Ogg , Chace Ashcraft , Ritwik Bose , Raphael Norman-Tenazas , Michael Wolmetz

In various work contexts, such as meeting scheduling, collaborating, and project planning, collective decision-making is essential but often challenging due to diverse individual preferences, varying work focuses, and power dynamics among…

Computation and Language · Computer Science 2025-08-13 Marios Papachristou , Longqi Yang , Chin-Chia Hsu

This study mainly explores the application of natural gesture recognition based on computer vision in human-computer interaction, aiming to improve the fluency and naturalness of human-computer interaction through gesture recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Fenghua Shao , Tong Zhang , Shang Gao , Qi Sun , Liuqingqing Yang

The autonomous decision-making process, which is increasingly applied to computer systems, requires that the choices made by these systems align with human values. In this context, systems must assess how well their decisions reflect human…

Computers and Society · Computer Science 2025-12-19 Eduardo de la Cruz Fernández , Marcelo Karanik , Sascha Ossowski

Precisely understanding users' contextual search intent has been an important challenge for conversational search. As conversational search sessions are much more diverse and long-tailed, existing methods trained on limited data still show…

Information Retrieval · Computer Science 2023-10-23 Kelong Mao , Zhicheng Dou , Fengran Mo , Jiewen Hou , Haonan Chen , Hongjin Qian

As Large Language Models (LLMs) have become integral to both research and daily operations, rigorous evaluation is crucial. This assessment is important not only for individual tasks but also for understanding their societal impact and…

Software Engineering · Computer Science 2024-04-02 Zeeshan Rasheed , Muhammad Waseem , Kari Systä , Pekka Abrahamsson

Large Language Models (LLMs) have recently emerged as powerful tools for natural language generation, with applications spanning from content creation to social simulations. Their ability to mimic human interactions raises both…

Computation and Language · Computer Science 2025-06-30 Daniele Cirulli , Giulio Cimini , Giovanni Palermo

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

The future of conversational agents will provide users with personalized information responses. However, a significant challenge in developing models is the lack of large-scale dialogue datasets that span multiple sessions and reflect…

Information Retrieval · Computer Science 2024-05-07 Hideaki Joko , Shubham Chatterjee , Andrew Ramsay , Arjen P. de Vries , Jeff Dalton , Faegheh Hasibi

Large Language Model (LLM) agents have been increasingly adopted as simulation tools to model humans in social science and role-playing applications. However, one fundamental question remains: can LLM agents really simulate human behavior?…

Artificial Intelligence · Computer Science 2024-11-04 Chengxing Xie , Canyu Chen , Feiran Jia , Ziyu Ye , Shiyang Lai , Kai Shu , Jindong Gu , Adel Bibi , Ziniu Hu , David Jurgens , James Evans , Philip Torr , Bernard Ghanem , Guohao Li

Traditionally, offline datasets have been used to evaluate task-oriented dialogue (TOD) models. These datasets lack context awareness, making them suboptimal benchmarks for conversational systems. In contrast, user-agents, which are…

Computation and Language · Computer Science 2024-11-18 Taaha Kazi , Ruiliang Lyu , Sizhe Zhou , Dilek Hakkani-Tur , Gokhan Tur