English
Related papers

Related papers: BEHAVIOR: Benchmark for Everyday Household Activit…

200 papers

As large language models (LLMs) evolve into autonomous agents capable of acting in open-ended environments, ensuring behavioral alignment with human values becomes a critical safety concern. Existing benchmarks, focused on static,…

Computation and Language · Computer Science 2026-03-10 Weixiang Zhao , Haozhen Li , Yanyan Zhao , xuda zhi , Yongbo Huang , Hao He , Bing Qin , Ting Liu

Agentic AI systems are rapidly advancing toward real-world applications, yet their readiness in complex and personalized environments remains insufficiently characterized. To address this gap, we introduce PersonalHomeBench, a benchmark for…

Artificial Intelligence · Computer Science 2026-05-15 Manasa Bharadwaj , Yolanda Liu , InJung Yang , Sungil Kim , Nikhil Verma , KoKeun Kim , Kevin Ferreira , YoungJoon Kim

Household tidying is an important application area, yet current benchmarks neither model user preferences nor support mobility, and they generalize poorly, making it hard to comprehensively assess integrated language-to-action capabilities.…

Robotics · Computer Science 2025-11-20 Xiaoquan Sun , Ruijian Zhang , Kang Pang , Bingchen Miao , Yuxiang Tan , Zhen Yang , Ming Li , Jiayu Chen

Scientists have traditionally limited the mechanisms of social cognition to one brain, but recent approaches claim that interaction also realizes cognitive work. Experiments under constrained virtual settings revealed that interaction…

Adaptation and Self-Organizing Systems · Physics 2014-01-17 Tom Froese , Hiroyuki Iizuka , Takashi Ikegami

Language User Interfaces (LUIs) could improve human-machine interaction for a wide variety of tasks, such as playing music, getting insights from databases, or instructing domestic robots. In contrast to traditional hand-crafted approaches,…

Computation and Language · Computer Science 2020-07-30 Harm de Vries , Dzmitry Bahdanau , Christopher Manning

Enabling embodied agents to complete complex human instructions from natural language is crucial to autonomous systems in household services. Conventional methods can only accomplish human instructions in the known environment where all…

Robotics · Computer Science 2025-07-03 Zhenyu Wu , Ziwei Wang , Xiuwei Xu , Hang Yin , Yinan Liang , Angyuan Ma , Jiwen Lu , Haibin Yan

Imitation learning benchmarks often lack sufficient variation between training and evaluation, limiting meaningful generalisation assessment. We introduce Labyrinth, a benchmarking environment designed to test generalisation with precise…

Machine Learning · Computer Science 2025-09-30 Nathan Gavenski , Odinaldo Rodrigues

In the pursuit of artificial general intelligence, our most significant measurement of progress is an agent's ability to achieve goals in a wide range of environments. Existing platforms for constructing such environments are typically…

Driven by recent advances in vision-language models (VLMs) and egocentric perception research, the emerging topic of an egocentric procedural AI assistant (EgoProceAssist) is introduced to step-by-step support daily procedural tasks in a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Junlong Li , Huaiyuan Xu , Sijie Cheng , Kejun Wu , Kim-Hui Yap , Lap-Pui Chau , Yi Wang

Lived experiences fundamentally shape how individuals interact with AI systems, influencing perceptions of safety, trust, and usability. While prior research has focused on developing techniques to emulate human preferences, and proposed…

Computers and Society · Computer Science 2025-08-12 Sanjana Gautam , Mohit Chandra , Ankolika De , Tatiana Chakravorti , Girik Malik , Munmun De Choudhury

AI design characteristics and human personality traits each impact the quality and outcomes of human-AI interactions. However, their relative and joint impacts are underexplored in imperfectly cooperative scenarios, where people and AI only…

Computation and Language · Computer Science 2026-04-20 Myke C. Cohen , Mingqian Zheng , Neel Bhandari , Hsien-Te Kao , Xuhui Zhou , Daniel Nguyen , Laura Cassani , Maarten Sap , Svitlana Volkova

Computational measurement of human behavior from video has recently become feasible due to major advances in AI. These advances now enable granular and precise quantification of facial expression, head movement, body action, and other…

With AsgardBench we aim to evaluate visually grounded, high-level action sequence generation and interactive planning, focusing specifically on plan adaptation during execution based on visual observations rather than navigation or…

Artificial Intelligence · Computer Science 2026-03-20 Andrea Tupini , Lars Liden , Reuben Tan , Yu Wang , Jianfeng Gao

Recent advances in high-fidelity virtual environments serve as one of the major driving forces for building intelligent embodied agents to perceive, reason and interact with the physical world. Typically, these environments remain unchanged…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Qinhong Zhou , Sunli Chen , Yisong Wang , Haozhe Xu , Weihua Du , Hongxin Zhang , Yilun Du , Joshua B. Tenenbaum , Chuang Gan

Benchmarking has long served as a foundational practice in machine learning and, increasingly, in modern AI systems such as large language models, where shared tasks, metrics, and leaderboards offer a common basis for measuring progress and…

Artificial Intelligence · Computer Science 2026-02-16 Philip Waggoner

Recent advancements in Graphical User Interface (GUI) agents have predominantly focused on training paradigms like supervised fine-tuning (SFT) and reinforcement learning (RL). However, the challenge of high-dynamic GUI environments remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Enqi Liu , Liyuan Pan , Zhi Gao , Yan Yang , Chenrui Shi , Yang Liu , Jingrong Wu , Qing Li

Embodied agents in household environments must plan under partial observation: they need to remember objects, track state changes, and recover when actions fail. Existing benchmarks only partially test this ability. Egocentric video…

Artificial Intelligence · Computer Science 2026-05-14 Qinchuan Cheng , Zhantao Gong , Pengzhan Sun , Angela Yao , Xulei Yang , Shijie Li

As AI becomes part of everyday learning, many courses teach students to use it mainly as a productivity tool: how to prompt, search, summarize, write, code, and use tools more efficiently. We argue that AI education also needs a setting in…

Artificial Intelligence · Computer Science 2026-05-22 Haiyang Shen , Jiuzheng Wang , Taian Guo , Mugeng Liu , Wenchun Jing , Chongyang Pan , Siqi Zhong , Zhiyang Chen , Weichen Bi , Yudong Han , Xiaoying Bai , Yun Ma

Long-horizon household tasks demand robust high-level planning and sustained reasoning capabilities, which are largely overlooked by existing embodied AI benchmarks that emphasize short-horizon navigation or manipulation and rely on fixed…

Artificial Intelligence · Computer Science 2026-05-19 Zilin Zhu , Longteng Guo , Yanghong Mei , Bowen Pang , Zongxun Zhang , Xingjian He , Ruyi Ji , Jing Liu