English
Related papers

Related papers: SimViews: An Interactive Multi-Agent System Simula…

200 papers

Story visualization is the transformation of narrative elements into image sequences. While existing research has primarily focused on visual contextual coherence, the deeper narrative essence of stories often remains overlooked. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Seungkwon Kim , GyuTae Park , Sangyeon Kim , Seung-Hun Nam

We report on a systematic, PRISMA-guided survey of research at the intersection of LLMs and visualization, with a particular focus on visio-verbal interaction -- where verbal and visual modalities converge to support data sense-making. The…

Human-Computer Interaction · Computer Science 2026-02-04 Mathis Brossier , Tobias Isenberg , Konrad Schönborn , Jonas Unger , Mario Romero , Johanna Björklund , Anders Ynnerman , Lonni Besançon

Recently, to comprehensively improve Vision Language Models (VLMs) for Visual Question Answering (VQA), several methods have been proposed to further reinforce the inference capabilities of VLMs to independently tackle VQA tasks rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Zeqing Wang , Wentao Wan , Qiqing Lao , Runmeng Chen , Minjie Lang , Xiao Wang , Keze Wang , Liang Lin

This study proposes a framework that employs personality prompting with Large Language Models to generate verbal and nonverbal behaviors for virtual agents based on personality traits. Focusing on extraversion, we evaluated the system in…

Human-Computer Interaction · Computer Science 2025-09-01 Bin Han , Deuksin Kwon , Spencer Lin , Kaleen Shrestha , Jonathan Gratch

This paper explores use of multiple large language model (LLM) agents to simulate complex, dynamic characters in dramatic scenarios. We introduce a drama machine framework that coordinates interactions between LLM agents playing different…

Computers and Society · Computer Science 2024-09-04 Liam Magee , Vanicka Arora , Gus Gollings , Norma Lam-Saw

We present AI-Gram, a fully deployed, continuously operating social platform where every participant is an autonomous LLM-driven agent generating and responding to visual content. Unlike prior multi-agent simulations, AI-Gram operates as a…

Artificial Intelligence · Computer Science 2026-05-05 Andrew Shin

Social network simulation plays a crucial role in addressing various challenges within social science. It offers extensive applications such as state prediction, phenomena explanation, and policy-making support, among others. In this work,…

Social and Information Networks · Computer Science 2025-06-05 Chen Gao , Xiaochong Lan , Zhihong Lu , Jinzhu Mao , Jinghua Piao , Huandong Wang , Depeng Jin , Yong Li

Web agents powered by Large Language Models (LLMs) have demonstrated remarkable abilities in planning and executing multi-step interactions within complex web-based environments, fulfilling a wide range of web navigation tasks. Despite…

Computation and Language · Computer Science 2024-02-26 Yang Deng , Xuan Zhang , Wenxuan Zhang , Yifei Yuan , See-Kiong Ng , Tat-Seng Chua

As Large Language Models (LLMs) continue to evolve, they are increasingly being employed in numerous studies to simulate societies and execute diverse social tasks. However, LLMs are susceptible to societal biases due to their exposure to…

Computation and Language · Computer Science 2024-10-04 Angana Borah , Rada Mihalcea

This paper presents BattleAgent, an emulation system that combines the Large Vision-Language Model and Multi-agent System. This novel system aims to simulate complex dynamic interactions among multiple agents, as well as between agents and…

Human-Computer Interaction · Computer Science 2024-04-25 Shuhang Lin , Wenyue Hua , Lingyao Li , Che-Jui Chang , Lizhou Fan , Jianchao Ji , Hang Hua , Mingyu Jin , Jiebo Luo , Yongfeng Zhang

Multi-agent role-playing has recently shown promise for studying social behavior with language agents, but existing simulations are mostly monolingual and fail to model cross-lingual interaction, an essential property of real societies. We…

Computation and Language · Computer Science 2025-12-09 Xuan Zhang , Wenxuan Zhang , Anxu Wang , See-Kiong Ng , Yang Deng

Agent-based social simulation provides a valuable methodology for predicting social information diffusion, yet existing approaches face two primary limitations. Traditional agent models often rely on rigid behavioral rules and lack semantic…

Computers and Society · Computer Science 2025-10-21 Xinyi Li , Zhiqiang Guo , Qinglang Guo , Hao Jin , Weizhi Ma , Min Zhang

Large language models (LLMs) and LLM-based agents are increasingly deployed as assistants in planning and decision making, yet most existing systems are implicitly optimized for a single-principal interaction paradigm, in which the model is…

Computation and Language · Computer Science 2026-04-29 Shu Yang , Shenzhe Zhu , Hao Zhu , José Ramón Enríquez , Di Wang , Alex Pentland , Michiel A. Bakker , Jiaxin Pei

Planning trips is a cognitively intensive task involving conflicting user preferences, dynamic external information, and multi-step temporal-spatial optimization. Traditional platforms often fall short - they provide static results, lack…

Multiagent Systems · Computer Science 2025-05-19 Binwen Liu , Jiexi Ge , Jiamin Wang

Can Multimodal Large Language Models (MLLMs), with capabilities in perception, recognition, understanding, and reasoning, function as independent assistants in art evaluation dialogues? Current MLLM evaluation methods, which rely on…

Human-Computer Interaction · Computer Science 2025-02-20 Chanjin Zheng , Zengyi Yu , Yilin Jiang , Mingzi Zhang , Xunuo Lu , Jing Jin , Liteng Gao

Agent-based modeling (ABM) offers powerful insights into complex systems, but its practical utility has been limited by computational constraints and simplistic agent behaviors, especially when simulating large populations. Recent…

Multiagent Systems · Computer Science 2024-11-12 Ayush Chopra , Shashank Kumar , Nurullah Giray-Kuru , Ramesh Raskar , Arnau Quera-Bofarull

Accurate visual understanding is imperative for advancing autonomous systems and intelligent robots. Despite the powerful capabilities of vision-language models (VLMs) in processing complex visual scenes, precisely recognizing obscured or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Huaxiang Zhang , Yaojia Mu , Guo-Niu Zhu , Zhongxue Gan

Robotic ultrasound systems can enhance medical diagnostics, but patient acceptance is a challenge. We propose a system combining an AI-powered conversational virtual agent with three mixed reality visualizations to improve trust and…

Human-Computer Interaction · Computer Science 2025-07-18 Tianyu Song , Felix Pabst , Ulrich Eck , Nassir Navab

LLM agents are increasingly used for social simulation, yet emotion is often treated as a transient cue, causing emotional amnesia and weak long-horizon continuity. We present Sentipolis, a framework for emotionally stateful agents that…

Artificial Intelligence · Computer Science 2026-04-22 Chiyuan Fu , Lyuhao Chen , Yunze Xiao , Weihao Xuan , Carlos Busso , Mona Diab

Large Language Models (LLMs) have demonstrated remarkable capabilities for reinforcement learning (RL) models, such as planning and reasoning capabilities. However, the problems of LLMs and RL model collaboration still need to be solved. In…

Computation and Language · Computer Science 2025-03-04 Shangding Gu