English
Related papers

Related papers: Learn A Flexible Exploration Model for Parameteriz…

200 papers

We study the problem of efficient exploration in order to learn an accurate model of an environment, modeled as a Markov decision process (MDP). Efficient exploration in this problem requires the agent to identify the regions in which…

High-speed online trajectory planning for UAVs poses a significant challenge due to the need for precise modeling of complex dynamics while also being constrained by computational limitations. This paper presents a multi-fidelity…

Robotics · Computer Science 2025-08-08 Gilhyun Ryou , Geoffrey Wang , Sertac Karaman

There is growing interest in reinforcement learning (RL) methods that leverage the simulator's derivatives to improve learning efficiency. While early gradient-based approaches have demonstrated superior performance compared to…

Robotics · Computer Science 2025-09-05 Joseph Amigo , Rooholla Khorrambakht , Elliot Chane-Sane , Nicolas Mansard , Ludovic Righetti

Reinforcement learning (RL) in episodic, factored Markov decision processes (FMDPs) is studied. We propose an algorithm called FMDP-BF, which leverages the factorization structure of FMDP. The regret of FMDP-BF is shown to be exponentially…

Machine Learning · Computer Science 2021-03-11 Xiaoyu Chen , Jiachen Hu , Lihong Li , Liwei Wang

Sampling-based motion planning is a well-established approach in autonomous driving, valued for its modularity and analytical tractability. In complex urban scenarios, however, uniform or heuristic sampling often produces many infeasible or…

Robotics · Computer Science 2026-03-24 Korbinian Moller , Roland Stroop , Mattia Piccinini , Alexander Langmann , Johannes Betz

Reinforcement Learning (RL) has shown remarkable progress in simulation environments, yet its application to real-world robotic tasks remains limited due to challenges in exploration and generalization. To address these issues, we introduce…

Artificial Intelligence · Computer Science 2024-10-18 Amisha Bhaskar , Zahiruddin Mahammad , Sachin R Jadhav , Pratap Tokekar

In this letter, we investigate learning forward dynamics models and multi-step prediction of state variables (long-term prediction) for contact-rich manipulation. The problems are formulated in the context of model-based reinforcement…

Robotics · Computer Science 2020-09-29 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Large language model (LLM) agents achieve impressive single-task performance but commonly exhibit repeated failures, inefficient exploration, and limited cross-task adaptability. Existing reflective strategies (e.g., Reflexion, ReAct)…

Artificial Intelligence · Computer Science 2025-09-09 Chunlong Wu , Ye Luo , Zhibo Qu , Min Wang

When learning to behave in a stochastic environment where safety is critical, such as driving a vehicle in traffic, it is natural for human drivers to plan fallback strategies as a backup to use if ever there is an unexpected change in the…

Machine Learning · Computer Science 2022-04-12 Ugo Lecerf , Christelle Yemdji-Tchassi , Sébastien Aubert , Pietro Michiardi

Reinforcement learning (RL) algorithms aim to learn optimal decisions in unknown environments through experience of taking actions and observing the rewards gained. In some cases, the environment is not influenced by the actions of the RL…

Model-free Reinforcement Learning (RL) generally suffers from poor sample complexity, mostly due to the need to exhaustively explore the state-action space to find well-performing policies. On the other hand, we postulate that expert…

Machine Learning · Computer Science 2023-09-13 Loris Di Natale , Bratislav Svetozarevic , Philipp Heer , Colin N. Jones

We present a map-less path planning algorithm based on Deep Reinforcement Learning (DRL) for mobile robots navigating in unknown environment that only relies on 40-dimensional raw laser data and odometry information. The planner is trained…

Robotics · Computer Science 2020-02-12 Nicolò Botteghi , Beril Sirmacek , Khaled A. A. Mustafa , Mannes Poel , Stefano Stramigioli

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

Artificial Intelligence · Computer Science 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

Robotics · Computer Science 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

An in-depth understanding of the particular environment is crucial in reinforcement learning (RL). To address this challenge, the decision-making process of a mobile collaborative robotic assistant modeled by the Markov decision process…

Machine Learning · Computer Science 2021-06-29 Mónika Farsang , Luca Szegletes

Non-differentiable controllers and rule-based policies are widely used for controlling real systems such as telecommunication networks and robots. Specifically, parameters of mobile network base station antennas can be dynamically…

Machine Learning · Computer Science 2023-09-12 Viktor Eriksson Möllerstedt , Alessio Russo , Maxime Bouton

Model-based reinforcement learning (MBRL) aims to learn a dynamic model to reduce the number of interactions with real-world environments. However, due to estimation error, rollouts in the learned model, especially those of long horizons,…

Machine Learning · Computer Science 2020-03-17 Yueh-Hua Wu , Ting-Han Fan , Peter J. Ramadge , Hao Su

Calibrating agent-based models (ABMs) in economics and finance typically involves a derivative-free search in a very large parameter space. In this work, we benchmark a number of search methods in the calibration of a well-known…

Machine Learning · Computer Science 2023-12-08 Aldo Glielmo , Marco Favorito , Debmallya Chanda , Domenico Delli Gatti

We consider un-discounted reinforcement learning (RL) in Markov decision processes (MDPs) under drifting non-stationarity, i.e., both the reward and state transition distributions are allowed to evolve over time, as long as their respective…

Machine Learning · Computer Science 2020-06-26 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

In this paper we consider the problem of how a reinforcement learning agent tasked with solving a set of related Markov decision processes can use knowledge acquired early in its lifetime to improve its ability to more rapidly solve novel,…

Artificial Intelligence · Computer Science 2019-02-26 Francisco M. Garcia , Bruno C. da Silva , Philip S. Thomas