English
Related papers

Related papers: Generalist Virtual Agents: A Survey on Autonomous …

200 papers

Digital human generation has been studied for decades and supports a wide range of real-world applications. However, most existing systems are passively animated, relying on privileged state or scripted control, which limits scalability to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hang Ye , Xiaoxuan Ma , Fan Lu , Wayne Wu , Kwan-Yee Lin , Yizhou Wang

Long-horizon large language model (LLM) agents are fundamentally limited by context. As interactions become longer, tool descriptions, retrieved memories, and raw environmental feedback accumulate and push out the information needed for…

The real world unfolds along a single set of physics laws, yet human intelligence demonstrates a remarkable capacity to generalize experiences from this singular physical existence into a multiverse of games, each governed by entirely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Kuan Zhang , Dongchen Liu , Qiyue Zhao , Tianyu Xin , Yue Su , Haisheng Wang , Han Yin , Hongbo Ma , Peize Li , Tianjun Gu , Xiangnan Wu , Xinran Zhang , Yongxuan Li , Zirong Chen , Yiming Li

Understanding human behavior in built environments is critical for designing functional, user centered urban spaces. Traditional approaches, such as manual observations, surveys, and simplified simulations, often fail to capture the…

Artificial Intelligence · Computer Science 2024-12-30 Ariel Noyman , Kai Hu , Kent Larson

Graphical User Interface (GUI) agents offer cross-platform solutions for automating complex digital tasks, with significant potential to transform productivity workflows. However, their performance is often constrained by the scarcity of…

Artificial Intelligence · Computer Science 2025-04-16 Junlei Zhang , Zichen Ding , Chang Ma , Zijie Chen , Qiushi Sun , Zhenzhong Lan , Junxian He

Much research in artificial intelligence is concerned with the development of autonomous agents that can interact effectively with other agents. An important aspect of such agents is the ability to reason about the behaviours of other…

Artificial Intelligence · Computer Science 2018-02-12 Stefano V. Albrecht , Peter Stone

In this article we present the motivation and the core thesis towards the implementation of a Quantum Knowledge Seeking Agent (QKSA). QKSA is a general reinforcement learning agent that can be used to model classical and quantum dynamics.…

Quantum Physics · Physics 2021-07-06 Aritra Sarkar

We present a new approach for improving the friendliness and warmth of a virtual agent in an AR environment by generating appropriate movement characteristics. Our algorithm is based on a novel data-driven friendliness model that is…

Human-Computer Interaction · Computer Science 2019-07-02 Tanmay Randhavane , Aniket Bera , Kyra Kapsaskis , Kurt Gray , Dinesh Manocha

Designing and evaluating personalized and proactive assistant agents remains challenging due to the time, cost, and ethical concerns associated with human-in-the-loop experimentation. Existing Human-Computer Interaction (HCI) methods often…

Human-Computer Interaction · Computer Science 2025-11-25 Ziyi Xuan , Yiwen Wu , Xuhai Xu , Vinod Namboodiri , Mooi Choo Chuah , Yu Yang

Intelligent agents stand out as a potential path toward artificial general intelligence (AGI). Thus, researchers have dedicated significant effort to diverse implementations for them. Benefiting from recent progress in large language models…

Artificial Intelligence · Computer Science 2024-01-09 Yuheng Cheng , Ceyao Zhang , Zhengwen Zhang , Xiangrui Meng , Sirui Hong , Wenhao Li , Zihao Wang , Zekai Wang , Feng Yin , Junhua Zhao , Xiuqiang He

The creation of effective governance mechanisms for AI agents requires a deeper understanding of their core properties and how these properties relate to questions surrounding the deployment and operation of agents in the world. This paper…

Computers and Society · Computer Science 2025-05-01 Atoosa Kasirzadeh , Iason Gabriel

Visual analytics (VA) requires analysts to iteratively propose analysis tasks based on observations and execute tasks by creating visualizations and interactive exploration to gain insights. This process demands skills in programming, data…

Human-Computer Interaction · Computer Science 2025-06-24 Yuheng Zhao , Junjie Wang , Linbin Xiang , Xiaowen Zhang , Zifei Guo , Cagatay Turkay , Yu Zhang , Siming Chen

Interactive digital maps have revolutionized how people travel and learn about the world; however, they rely on pre-existing structured data in GIS databases (e.g., road networks, POI indices), limiting their ability to address geo-visual…

Human-Computer Interaction · Computer Science 2025-08-22 Jon E. Froehlich , Jared Hwang , Zeyu Wang , John S. O'Meara , Xia Su , William Huang , Yang Zhang , Alex Fiannaca , Philip Nelson , Shaun Kane

This paper introduces the concept of coexistence for embodied artificial agents and argues that it is a prerequisite for long-term, in-the-wild interaction with humans. Contemporary embodied artificial agents excel in static, predefined…

Machine Learning · Computer Science 2025-06-03 Hannah Kuehn , Joseph La Delfa , Miguel Vasco , Danica Kragic , Iolanda Leite

Digital Assistants (DAs) can support workers in the workplace and beyond. However, target user needs are not fully understood, and the functions that workers would ideally want a DA to support require further study. A richer understanding…

Nowadays, research on GUI agents is a hot topic in the AI community. However, current research focuses on GUI task automation, limiting the scope of applications in various GUI scenarios. In this paper, we propose a formalized and…

Artificial Intelligence · Computer Science 2024-12-25 Kangjia Zhao , Jiahui Song , Leigang Sha , Haozhan Shen , Zhi Chen , Tiancheng Zhao , Xiubo Liang , Jianwei Yin

Agent-based computing is an active field of research with the goal of building autonomous software of hardware entities. This task is often facilitated by the use of dedicated, specialized frameworks. For almost thirty years, many such…

Multiagent Systems · Computer Science 2023-08-30 Constantin-Valentin Pal , Florin Leon , Marcin Paprzycki , Maria Ganzha

Estimating the potential behavior of the surrounding human-driven vehicles is crucial for the safety of autonomous vehicles in a mixed traffic flow. Recent state-of-the-art achieved accurate prediction using deep neural networks. However,…

Artificial Intelligence · Computer Science 2024-03-12 Juanwu Lu , Wei Zhan , Masayoshi Tomizuka , Yeping Hu

With advances in generative AI, there is now potential for autonomous agents to manage daily tasks via natural language commands. However, current agents are primarily created and tested in simplified synthetic environments, leading to a…

Artificial Intelligence · Computer Science 2024-04-17 Shuyan Zhou , Frank F. Xu , Hao Zhu , Xuhui Zhou , Robert Lo , Abishek Sridhar , Xianyi Cheng , Tianyue Ou , Yonatan Bisk , Daniel Fried , Uri Alon , Graham Neubig