English
Related papers

Related papers: SimViews: An Interactive Multi-Agent System Simula…

200 papers

Immersive virtual reality (VR) offers affordances that may reduce cognitive complexity in binary reverse engineering (RE), enabling embodied and external cognition to augment the RE process through enhancing memory, hypothesis testing, and…

Human-Computer Interaction · Computer Science 2025-08-20 Dennis Brown , Samuel Mulder

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

Computation and Language · Computer Science 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

We present a virtual reality (VR) environment featuring conversational avatars powered by a locally-deployed LLM, integrated with automatic speech recognition (ASR), text-to-speech (TTS), and lip-syncing. Through a pilot study, we explored…

Human-Computer Interaction · Computer Science 2025-01-08 Mykola Maslych , Christian Pumarada , Amirpouya Ghasemaghaei , Joseph J. LaViola

Recent advances in multi-modal large language models (MLLMs) have enabled increasingly sophisticated autonomous visualization agents capable of translating user intentions into data visualizations. However, measuring progress and comparing…

Human-Computer Interaction · Computer Science 2025-09-19 Kuangshi Ai , Haichao Miao , Zhimin Li , Chaoli Wang , Shusen Liu

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Computation and Language · Computer Science 2025-08-08 Furui Cheng , Vilém Zouhar , Robin Shing Moon Chan , Daniel Fürst , Hendrik Strobelt , Mennatallah El-Assady

Natural language has long enabled human cooperation, but its lossy, ambiguous, and indirect nature limits the potential of collective intelligence. While machines are not subject to these constraints, most LLM-based multi-agent systems…

Machine Learning · Computer Science 2025-10-24 Yujia Zheng , Zhuokai Zhao , Zijian Li , Yaqi Xie , Mingze Gao , Lizhu Zhang , Kun Zhang

Large Language Models (LLMs) are increasingly used to power autonomous agents for complex, multi-step tasks. However, human-agent interaction remains pointwise and reactive: users approve or correct individual actions to mitigate immediate…

Human-Computer Interaction · Computer Science 2026-03-13 Gaole He , Brian Y. Lim

The integration of large language models (LLMs) into virtual reality (VR) environments has opened new pathways for creating more immersive and interactive digital humans. By leveraging the generative capabilities of LLMs alongside…

Large Language Models (LLMs) like ChatGPT offer potential support for autistic people, but this potential requires understanding the implicit perspectives these models might carry, including their biases and assumptions about autism. Moving…

Human-Computer Interaction · Computer Science 2026-01-23 Sohyeon Park , Jesus Armando Beltran , Aehong Min , Anamara Ritt-Olson , Gillian R. Hayes

We study the emergence of agency from scratch by using Large Language Model (LLM)-based agents. In previous studies of LLM-based agents, each agent's characteristics, including personality and memory, have traditionally been predefined. We…

Artificial Intelligence · Computer Science 2024-11-06 Ryosuke Takata , Atsushi Masumori , Takashi Ikegami

The proliferation of fake news in the digital age has raised critical concerns, particularly regarding its impact on societal trust and democratic processes. Diverging from conventional agent-based simulation approaches, this work…

Social and Information Networks · Computer Science 2024-10-21 Xinyi Li , Yu Xu , Yongfeng Zhang , Edward C. Malthouse

Fraud continues to proliferate online, from phishing and ransomware to impersonation scams. Yet automated prevention approaches adapt slowly and may not reliably protect users from falling prey to new scams. To better combat online scams,…

Human-Computer Interaction · Computer Science 2026-02-02 Owen Hoffman , Kangze Peng , Sajid Kamal , Zehua You , Sukrit Venkatagiri

Despite the rapid deployment of LLMs into classrooms, validating educational AI remains uniquely intractable: interventions act on developing learners whose cognitive and social trajectories are irreversibly shaped, while real-world trials…

A key challenge in transportation planning is that the collective preferences of heterogeneous travelers often diverge from the policies produced by model-driven decision tools. This misalignment frequently results in implementation delays…

Computers and Society · Computer Science 2025-10-29 Xiaoyu Yan , Tianxing Dai , Yu Marco Nie

We propose MADS (Multi-Agent Dialogue Simulation), a scalable framework for generating persuasive multi-turn dialogues via agent self-play. MADS employs three coordinated agents: User Agents designed to simulate diverse persona-driven…

Computation and Language · Computer Science 2025-10-14 Mingjin Li , Yu Liu , Huayi Liu , Xiang Ye , Chao Jiang , Hongguang Zhang , Yu Ruan

In an era where single large language models have dominated the landscape of artificial intelligence for years, multi-agent systems arise as new protagonists in conversational task-solving. While previous studies have showcased their…

Computation and Language · Computer Science 2024-11-04 Jonas Becker

Student simulation in online education is important to address dynamic learning behaviors of students with diverse backgrounds. Existing simulation models based on deep learning usually need massive training data, lacking prior knowledge in…

Computers and Society · Computer Science 2024-04-12 Songlin Xu , Xinyu Zhang , Lianhui Qin

Animating and simulating crowds using an agent-based approach is a well-established area where every agent in the crowd is individually controlled such that global human-like behaviour emerges. We observe that human navigation and movement…

Artificial Intelligence · Computer Science 2025-08-22 Yibo Liu , Liam Shatzel , Brandon Haworth , Teseo Schneider

Significant advancements have occurred in the application of Large Language Models (LLMs) for social simulations. Despite this, their abilities to perform teaming in task-oriented social events are underexplored. Such capabilities are…

Artificial Intelligence · Computer Science 2025-08-18 Yuan Li , Lichao Sun , Yixuan Zhang

Eye-hand coordinated interaction is becoming a mainstream interaction modality in Virtual Reality (VR) user interfaces.Current paradigms for this multimodal interaction require users to learn predefined gestures and memorize multiple…

Human-Computer Interaction · Computer Science 2026-03-03 Zhimin Wang , Chenyu Gu , Feng Lu