English
Related papers

Related papers: Evolutionary Planning in Latent Space

200 papers

Many real-world sequential decision making problems are partially observable by nature, and the environment model is typically unknown. Consequently, there is great need for reinforcement learning methods that can tackle such problems given…

Machine Learning · Computer Science 2018-06-08 Maximilian Igl , Luisa Zintgraf , Tuan Anh Le , Frank Wood , Shimon Whiteson

We propose to learn energy-based model (EBM) in the latent space of a generator model, so that the EBM serves as a prior model that stands on the top-down network of the generator model. Both the latent space EBM and the top-down network…

Machine Learning · Statistics 2020-10-30 Bo Pang , Tian Han , Erik Nijkamp , Song-Chun Zhu , Ying Nian Wu

Planning has been very successful for control tasks with known environment dynamics. To leverage planning in unknown environments, the agent needs to learn the dynamics from interactions with the world. However, learning dynamics models…

Machine Learning · Computer Science 2019-06-06 Danijar Hafner , Timothy Lillicrap , Ian Fischer , Ruben Villegas , David Ha , Honglak Lee , James Davidson

Probabilistic models with hierarchical-latent-variable structures provide state-of-the-art results amongst non-autoregressive, unsupervised density-based models. However, the most common approach to training such models based on Variational…

Machine Learning · Statistics 2020-10-09 Benoit Gaujac , Ilya Feige , David Barber

In this paper, we propose a novel Deep Reinforcement Learning approach to address the mapless navigation problem, in which the locomotion actions of a humanoid robot are taken online based on the knowledge encoded in learned models.…

Robotics · Computer Science 2021-08-10 Andre Brandenburger , Diego Rodriguez , Sven Behnke

A generative recurrent neural network is quickly trained in an unsupervised manner to model popular reinforcement learning environments through compressed spatio-temporal representations. The world model's extracted features are fed into…

Machine Learning · Computer Science 2018-09-07 David Ha , Jürgen Schmidhuber

Learning-based vehicle planning is receiving increasing attention with the emergence of diverse driving simulators and large-scale driving datasets. While offline reinforcement learning (RL) is well suited for these safety-critical tasks,…

Robotics · Computer Science 2023-11-20 Zenan Li , Fan Nie , Qiao Sun , Fang Da , Hang Zhao

Planning-based reinforcement learning has shown strong performance in tasks in discrete and low-dimensional continuous action spaces. However, planning usually brings significant computational overhead for decision-making, and scaling such…

Machine Learning · Computer Science 2023-01-25 Zhengyao Jiang , Tianjun Zhang , Michael Janner , Yueying Li , Tim Rocktäschel , Edward Grefenstette , Yuandong Tian

There is now significant historical data available on decision making in organizations, consisting of the decision problem, what decisions were made, and how desirable the outcomes were. Using this data, it is possible to learn a surrogate…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Olivier Francon , Santiago Gonzalez , Babak Hodjat , Elliot Meyerson , Risto Miikkulainen , Xin Qiu , Hormoz Shahrzad

Sample efficiency remains a fundamental issue of reinforcement learning. Model-based algorithms try to make better use of data by simulating the environment with a model. We propose a new neural network architecture for world models based…

Machine Learning · Computer Science 2021-03-03 Jan Robine , Tobias Uelwer , Stefan Harmeling

Learning-based methods have shown promising performance for accelerating motion planning, but mostly in the setting of static environments. For the more challenging problem of planning in dynamic environments, such as multi-arm assembly…

Robotics · Computer Science 2025-06-13 Ruipeng Zhang , Chenning Yu , Jingkai Chen , Chuchu Fan , Sicun Gao

Evolutionary artificial neural networks (EANNs) refer to a special class of artificial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. Evolutionary algorithms are used to adapt…

Artificial Intelligence · Computer Science 2016-11-17 Ajith Abraham

Enabling humanoid robots to exploit physical contact, rather than simply avoid collisions, is crucial for autonomy in unstructured environments. Traditional optimization-based planners struggle with contact complexity, while on-policy…

Motion planning with constraints is an important part of many real-world robotic systems. In this work, we study manifold learning methods to learn such constraints from data. We explore two methods for learning implicit constraint…

Model predictive control (MPC) with learned world models has emerged as a promising paradigm for embodied control, particularly for its ability to generalize zero-shot when deployed in new environments. However, learned world models often…

Multi-agent navigation in dynamic environments is of great industrial value when deploying a large scale fleet of robot to real-world applications. This paper proposes a decentralized partially observable multi-agent path planning with…

Robotics · Computer Science 2020-08-03 Zuxin Liu , Baiming Chen , Hongyi Zhou , Guru Koushik , Martial Hebert , Ding Zhao

Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this…

Machine Learning · Computer Science 2018-12-27 Xingxing Liang , Qi Wang , Yanghe Feng , Zhong Liu , Jincai Huang

Solving robotic navigation tasks via reinforcement learning (RL) is challenging due to their sparse reward and long decision horizon nature. However, in many navigation tasks, high-level (HL) task representations, like a rough floor plan,…

Robotics · Computer Science 2021-11-08 Jan Wöhlke , Felix Schmitt , Herke van Hoof

In this paper, we try to improve exploration in Blackbox methods, particularly Evolution strategies (ES), when applied to Reinforcement Learning (RL) problems where intermediate waypoints/subgoals are available. Since Evolutionary…

Robotics · Computer Science 2023-07-04 Kiran Lekkala , Laurent Itti

Many potential applications of reinforcement learning (RL) are stymied by the large numbers of samples required to learn an effective policy. This is especially true when applying RL to real-world control tasks, e.g. in the sciences or…

Machine Learning · Computer Science 2022-10-11 Viraj Mehta , Ian Char , Joseph Abbate , Rory Conlin , Mark D. Boyer , Stefano Ermon , Jeff Schneider , Willie Neiswanger