English
Related papers

Related papers: Go-Explore Complex 3D Game Environments for Automa…

200 papers

Geospatial reasoning requires solving image-grounded problems over the complex spatial structure of a scene. However, developing this capability is hindered by the cost of annotating a vast and combinatorial question space. We propose GeoX,…

Artificial Intelligence · Computer Science 2026-05-20 Kyeongjin Ahn , Seungeon Lee , Krishna P. Gummadi , Meeyoung Cha

Many puzzle video games, like Sokoban, involve moving some agent in a maze. The reachable locations are usually apparent for a human player, and the difficulty of the game is mainly related to performing actions on objects, such as pushing…

Artificial Intelligence · Computer Science 2023-10-03 Miquel Bofill , Cristina Borralleras , Joan Espasa , Mateu Villaret

This paper describes the design, implementation, and initial testing of a reusable platform for the creation of pervasive games with geo-localization services. We concentrate on role-playing games built by combining several types of simpler…

Human-Computer Interaction · Computer Science 2020-10-06 Laurent Prevost , Olivier Liechti , Michael J. Lyons

Exploration is a prerequisite for learning useful behaviors in sparse-reward, long-horizon tasks, particularly within 3D environments. Curiosity-driven reinforcement learning addresses this via intrinsic rewards derived from the mismatch…

Machine Learning · Computer Science 2026-05-22 Lily Goli , Justin Kerr , Daniele Reda , Alec Jacobson , Andrea Tagliasacchi , Angjoo Kanazawa

This paper proposes a paradigm shift for affective computing by viewing the affect modeling task as a reinforcement learning process. According to our proposed framework the context (environment) and the actions of an agent define the…

Machine Learning · Computer Science 2021-09-29 Matthew Barthet , Antonios Liapis , Georgios N. Yannakakis

This work introduces an automated testing approach that employs agents controlling game characters to detect potential bugs within a game level. Harnessing the power of Bayesian Optimization (BO) to execute sample-efficient search, the…

Artificial Intelligence · Computer Science 2025-08-19 Carlos Celemin

This paper looks into the problem of grasping unknown objects in a cluttered environment using 3D point cloud data obtained from a range or an RGBD sensor. The objective is to identify graspable regions and detect suitable grasp poses from…

Robotics · Computer Science 2018-07-30 Olyvia Kundu , Swagat Kumar

Games on graphs provide a natural and powerful model for reactive systems. In this paper, we consider generalized reachability objectives, defined as conjunctions of reachability objectives. We first prove that deciding the winner in such…

Computational Complexity · Computer Science 2012-02-06 Nathanaël Fijalkow , Florian Horn

With the rapid development of Large Vision Language Models, the focus of Graphical User Interface (GUI) agent tasks shifts from single-screen tasks to complex screen navigation challenges. However, real-world GUI environments, such as PC…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Haolong Yan , Yeqing Shen , Xin Huang , Jia Wang , Kaijun Tan , Zhixuan Liang , Hongxin Li , Zheng Ge , Osamu Yoshie , Si Li , Xiangyu Zhang , Daxin Jiang

Autonomous exploration of multi-floor buildings remains challenging for ground robots because conventional 2D and 2.5D maps cannot represent overlapping traversable surfaces such as stairs, ramps, and multiple reachable elevations. This…

Robotics · Computer Science 2026-05-25 Zhiwen Zhu , Jiaqi Chen , Xiangyi Huang , Meiqi Hu , Boyu Zhou

This paper deals with the problem of autonomous navigation of a mobile robot in an unknown 2D environment to fully explore the environment as efficiently as possible. We assume a terrestrial mobile robot equipped with a ranging sensor with…

Robotics · Computer Science 2020-07-21 Miroslav Kulich , Jiří Kubalík , Libor Přeučil

Pathfinding is a very popular area in computer game development. While two-dimensional (2D) pathfinding is widely applied in most of the popular game engines, little implementation of real three-dimensional (3D) pathfinding can be found.…

Artificial Intelligence · Computer Science 2018-06-20 Diptangshu Pandit

Achieving efficient and scalable exploration in complex domains poses a major challenge in reinforcement learning. While Bayesian and PAC-MDP approaches to the exploration problem offer strong formal guarantees, they are often impractical…

Artificial Intelligence · Computer Science 2015-11-23 Bradly C. Stadie , Sergey Levine , Pieter Abbeel

Autonomous scene exposure and exploration, especially in localization or communication-denied areas, useful for finding targets in unknown scenes, remains a challenging problem in computer navigation. In this work, we present a novel method…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Tom Avrech , Evgenii Zheltonozhskii , Chaim Baskin , Ehud Rivlin

Despite groundbreaking progress in reinforcement learning for robotics, gameplay, and other complex domains, major challenges remain in applying reinforcement learning to the evolving, open-world problems often found in critical application…

Autonomous exploration using unmanned aerial vehicles (UAVs) is essential for various tasks such as building inspections, rescue operations, deliveries, and warehousing. However, there are two main limitations to previous approaches: they…

Autonomous exploration is a fundamental capability that tightly integrates perception, planning, control, and motion execution. It plays a critical role in a wide range of applications, including indoor target search, mapping of extreme…

Robotics · Computer Science 2025-12-18 Kai Zhang , Shoubin Chen , Dong Li , Baiyang Zhang , Tao Huang , Zehao Wu , Jiasheng Chen , Bo Zhang

Multi-robot exploration is a field which tackles the challenge of exploring a previously unknown environment with a number of robots. This is especially relevant for search and rescue operations where time is essential. Current state of the…

Robotics · Computer Science 2023-04-11 Ingo Scheler , Robin Dietrich

Escape rooms present a unique cognitive challenge that demands exploration-driven planning: with the sole instruction to 'escape the room', players must actively search their environment, collecting information, and finding solutions…

Artificial Intelligence · Computer Science 2025-05-28 Seungwon Lim , Sungwoong Kim , Jihwan Yu , Sungjae Lee , Jiwan Chung , Youngjae Yu

Efficient exploration in complex environments remains a major challenge for reinforcement learning. We propose bootstrapped DQN, a simple algorithm that explores in a computationally and statistically efficient manner through use of…

Machine Learning · Computer Science 2016-07-05 Ian Osband , Charles Blundell , Alexander Pritzel , Benjamin Van Roy