English
Related papers

Related papers: VisEscape: A Benchmark for Evaluating Exploration-…

200 papers

Language model agents excel in long-session planning and reasoning, but existing benchmarks primarily focus on goal-oriented tasks with explicit objectives, neglecting creative adaptation in unfamiliar environments. To address this, we…

Computation and Language · Computer Science 2025-05-27 Cheng Qian , Peixuan Han , Qinyu Luo , Bingxiang He , Xiusi Chen , Yuji Zhang , Hongyi Du , Jiarui Yao , Xiaocheng Yang , Denghui Zhang , Yunzhu Li , Heng Ji

The rapid advancing of Multimodal Large Language Models (MLLMs) has spurred interest in complex multimodal reasoning tasks in the real-world and virtual environment, which require coordinating multiple abilities, including visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Ziyue Wang , Yurui Dong , Fuwen Luo , Minyuan Ruan , Zhili Cheng , Chi Chen , Peng Li , Yang Liu

Serious games are gaining popularity as effective teaching and learning tools, providing engaging, interactive, and practical experiences for students. Gamified learning experiences, such as virtual escape rooms, have emerged as powerful…

Computers and Society · Computer Science 2026-01-19 Khondokar Fida Hasan , William Hughes , Adrita Rahman

Most existing spatial reasoning benchmarks focus on static or globally observable environments, failing to capture the challenges of long-horizon reasoning and memory utilization under partial observability and dynamic changes. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Pukun Zhao , Longxiang Wang , Miaowei Wang , Chen Chen , Fanqing Zhou , Haojian Huang

As virtual reality (VR) becomes more popular for intergenerational collaboration, there is still a significant gap in research regarding understanding the potential for reducing ageism. Our study aims to address this gap by analyzing ageism…

Human-Computer Interaction · Computer Science 2024-03-07 Ruotong Zou , Shuyu Yin , Tianqi Song , Peinuan Qin , Yi-Chieh Lee

LLM-based agents score well on search benchmarks, yet real users consistently find results unsatisfying, revealing a persistent evaluation-experience gap. We attribute this gap to existing benchmarks' reliance on over-specified queries,…

Computation and Language · Computer Science 2026-05-28 Xiaohongshu Inc

We challenge text-to-image models with generating escape room puzzle images that are visually appealing, logically solid, and intellectually stimulating. While base image models struggle with spatial relationships and affordance reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Mengyi Shan , Brian Curless , Ira Kemelmacher-Shlizerman , Steve Seitz

Efficient exploration is a long-standing problem in sensorimotor learning. Major advances have been demonstrated in noise-free, non-stochastic domains such as video games and simulation. However, most of these formulations either get stuck…

Machine Learning · Computer Science 2019-06-11 Deepak Pathak , Dhiraj Gandhi , Abhinav Gupta

Multimodal Large Language Models (MLLMs) have recently made rapid progress toward unified Omni models that integrate vision, language, and audio. However, existing environments largely focus on 2D or 3D visual context and vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yurui Dong , Ziyue Wang , Shuyun Lu , Dairu Liu , Xuechen Liu , Fuwen Luo , Peng Li , Yang Liu

Large vision-language models have recently demonstrated impressive performance in planning and control tasks, driving interest in their application to real-world robotics. However, deploying these models for reasoning in embodied contexts…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Karmesh Yadav , Yusuf Ali , Gunshi Gupta , Yarin Gal , Zsolt Kira

Cross-view spatial reasoning is essential for embodied AI, underpinning spatial understanding, mental simulation and planning in complex environments. Existing benchmarks primarily emphasize indoor or street settings, overlooking the unique…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Haotian Xu , Yue Hu , Zhengqiu Zhu , Chen Gao , Ziyou Wang , Junreng Rao , Wenhao Lu , Weishi Li , Quanjun Yin , Yong Li

This work investigates the reasoning and planning capabilities of foundation models and their scalability in complex, dynamic environments. We introduce PuzzlePlex, a benchmark designed to assess these capabilities through a diverse set of…

Artificial Intelligence · Computer Science 2025-10-09 Yitao Long , Yuru Jiang , Hongjun Liu , Yilun Zhao , Jingchen Sun , Yiqiu Shen , Chen Zhao , Arman Cohan , Dennis Shasha

Exploration is essential for general-purpose robotic learning, especially in open-ended environments where dense rewards, explicit goals, or task-specific supervision are scarce. Vision-language models (VLMs), with their semantic reasoning…

Robotics · Computer Science 2025-09-12 Seungjae Lee , Daniel Ekpo , Haowen Liu , Furong Huang , Abhinav Shrivastava , Jia-Bin Huang

In recent years, Virtual Reality (VR) has found its way into different fields besides pure entertainment. One of the topics that can benefit from the immersive experience of VR is education. Furthermore, using game-based approaches in…

Human-Computer Interaction · Computer Science 2024-07-09 Georg Arbesser-Rastburg , Saeed Safikhani , Matej Gustin , Christina Hopfe , Gerald Schweiger , Johanna Pirker

In the event of a fire emergency in the built environment, occupants face a range of evacuation decisions, including the choice of exits. An important question from the standpoint of evacuation safety is how evacuees make these choices and…

Human-Computer Interaction · Computer Science 2021-10-25 R Lovreglio , E Dillies , E Kuligowski , A Rahouti , M Haghani

Modern Vision-Language Models (VLMs) remain poorly characterized in multi-step visual interactions, particularly in how they integrate perception, memory, and action over long horizons. We introduce VisGym, a gymnasium of 17 environments…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Zirui Wang , Junyi Zhang , Jiaxin Ge , Long Lian , Letian Fu , Lisa Dunlap , Ken Goldberg , XuDong Wang , Ion Stoica , David M. Chan , Sewon Min , Joseph E. Gonzalez

Educational Escape Rooms (EER's), through their use of immersive storytelling and practical application of abstract concepts, present a novel new technique for engaging learners in a variety of subjects. However, there is a significant time…

Human-Computer Interaction · Computer Science 2024-08-16 John O'Connor

Traditional game-theoretic research for security applications primarily focuses on the allocation of external protection resources to defend targets. This work puts forward the study of a new class of games centered around strategically…

Computer Science and Game Theory · Computer Science 2024-10-29 Niclas Boehmer , Minbiao Han , Haifeng Xu , Milind Tambe

As LLM-based agents increasingly rely on external tools, it is important to evaluate their ability to sustain tool-grounded reasoning beyond familiar workflows and short-range interactions. We introduce AgentEscapeBench, an…

Artificial Intelligence · Computer Science 2026-05-21 Zhengkang Guo , Yiyang Li , Lin Qiu , Xiaohua Wang , Jingwen Xv , Dongyu Ru , Xiaoyu Li , Xiaoqing Zheng , Xuezhi Cao , Xunliang Cai

Scalable and effective exploration remains a key challenge in reinforcement learning (RL). While there are methods with optimality guarantees in the setting of discrete state and action spaces, these methods cannot be applied in…

Machine Learning · Computer Science 2017-01-30 Rein Houthooft , Xi Chen , Yan Duan , John Schulman , Filip De Turck , Pieter Abbeel
‹ Prev 1 2 3 10 Next ›