English
Related papers

Related papers: Planning from Pixels in Environments with Combinat…

200 papers

We study combinatorial problems with real world applications such as machine scheduling, routing, and assignment. We propose a method that combines Reinforcement Learning (RL) and planning. This method can equally be applied to both the…

Machine Learning · Computer Science 2021-05-19 Joel Oren , Chana Ross , Maksym Lefarov , Felix Richter , Ayal Taitler , Zohar Feldman , Christian Daniel , Dotan Di Castro

Learning task-agnostic dynamics models in high-dimensional observation spaces can be challenging for model-based RL agents. We propose a novel way to learn latent world models by learning to predict sequences of future actions conditioned…

Machine Learning · Computer Science 2020-12-07 Keiran Paster , Sheila A. McIlraith , Jimmy Ba

We address planning and navigation in challenging 3D video games featuring maps with disconnected regions reachable by agents using special actions. In this setting, classical symbolic planners are not applicable or difficult to adapt. We…

Machine Learning · Computer Science 2021-12-23 Edward Beeching , Maxim Peter , Philippe Marcotte , Jilles Debangoye , Olivier Simonin , Joshua Romoff , Christian Wolf

Discovering physical laws directly from high-dimensional visual data is a long-standing human pursuit but remains a formidable challenge for machines, representing a fundamental goal of scientific intelligence. This task is inherently…

Computational Engineering, Finance, and Science · Computer Science 2026-02-24 Ruikun Li , Jun Yao , Yingfan Hua , Shixiang Tang , Biqing Qi , Bin Liu , Wanli Ouyang , Yan Lu

Motion planning framed as optimisation in structured latent spaces has recently emerged as competitive with traditional methods in terms of planning success while significantly outperforming them in terms of computational speed. However,…

Robotics · Computer Science 2023-03-07 Jun Yamada , Chia-Man Hung , Jack Collins , Ioannis Havoutis , Ingmar Posner

The tasks that an agent will need to solve often are not known during training. However, if the agent knows which properties of the environment are important then, after learning how its actions affect those properties, it may be able to…

Artificial Intelligence · Computer Science 2019-04-29 Amy Zhang , Adam Lerer , Sainbayar Sukhbaatar , Rob Fergus , Arthur Szlam

Multi-robot path planning is difficult due to the combinatorial explosion of the search space with every new robot added. Complete search of the combined state-space soon becomes intractable. In this paper we present a novel form of…

Artificial Intelligence · Computer Science 2011-11-02 Malcolm Ross Kinsella Ryan

Computational visual aesthetics has recently become an active research area. Existing state-of-art methods formulate this as a binary classification task where a given image is predicted to be beautiful or not. In many applications such as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Parag S. Chandakkar , Vijetha Gattupalli , Baoxin Li

Planning is a fundamental task in artificial intelligence that involves finding a sequence of actions that achieve a specified goal in a given environment. Large language models (LLMs) are increasingly used for applications that require…

Computation and Language · Computer Science 2024-05-24 Eran Hirsch , Guy Uziel , Ateret Anaby-Tavor

Recent developments in the field of model-based RL have proven successful in a range of environments, especially ones where planning is essential. However, such successes have been limited to deterministic fully-observed environments. We…

Machine Learning · Computer Science 2021-06-11 Sherjil Ozair , Yazhe Li , Ali Razavi , Ioannis Antonoglou , Aäron van den Oord , Oriol Vinyals

Modern image editing models produce realistic results but struggle with abstract, multi step instructions (e.g., ``make this advertisement more vegetarian-friendly''). Prior agent based methods decompose such tasks but rely on handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Anirudh Sundara Rajan , Krishna Kumar Singh , Yong Jae Lee

Visual planning methods are promising to handle complex settings where extracting the system state is challenging. However, none of the existing works tackles the case of multiple heterogeneous agents which are characterized by different…

Recent advancements in Large Language Models (LLMs) and their multimodal extensions (MLLMs) have substantially enhanced machine reasoning across diverse tasks. However, these models predominantly rely on pure text as the medium for both…

Machine Learning · Computer Science 2026-02-23 Yi Xu , Chengzu Li , Han Zhou , Xingchen Wan , Caiqi Zhang , Anna Korhonen , Ivan Vulić

Compact representations of objects is a common concept in computer science. Automated planning can be viewed as a case of this concept: a planning instance is a compact implicit representation of a graph and the problem is to find a path (a…

Artificial Intelligence · Computer Science 2014-01-24 Christer Bäckström , Peter Jonsson

Intelligent agents working in real-world environments must be able to learn about the environment and its capabilities which enable them to take actions to change to the state of the world to complete a complex multi-step task in a…

Artificial Intelligence · Computer Science 2025-02-06 Rajesh Mangannavar

Path planning in dynamic environments is a fundamental challenge in intelligent transportation and robotics, where obstacles and conditions change over time, introducing uncertainty and requiring continuous adaptation. While existing…

Robotics · Computer Science 2025-11-20 Jonas De Maeyer , Hossein Yarahmadi , Moharram Challenger

Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and natural language goals. While recent vision-language models (VLMs) excel at static perception tasks, they struggle with the…

Artificial Intelligence · Computer Science 2025-07-15 Di Wu , Jiaxin Fan , Junzhe Zang , Guanbo Wang , Wei Yin , Wenhao Li , Bo Jin

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

We train embodied neural networks to plan and navigate unseen complex 3D environments, emphasising real-world deployment. Rather than requiring prior knowledge of the agent or environment, the planner learns to model the state transitions…

Robotics · Computer Science 2022-06-03 Shu Ishida , João F. Henriques

Combinatorial games lead to several interesting, clean problems in algorithms and complexity theory, many of which remain open. The purpose of this paper is to provide an overview of the area to encourage further research. In particular, we…

Computational Complexity · Computer Science 2009-09-25 Erik D. Demaine , Robert A. Hearn