English
Related papers

Related papers: Leveraging Forward Model Prediction Error for Lear…

200 papers

Data-driven model predictive control has two key advantages over model-free methods: a potential for improved sample efficiency through model learning, and better performance as computational budget for planning increases. However, it is…

Machine Learning · Computer Science 2022-07-21 Nicklas Hansen , Xiaolong Wang , Hao Su

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in…

Robotics · Computer Science 2025-06-05 Chengdong Wu , Sven Kirchner , Nils Purschke , Alois C. Knoll

In this paper, we propose a model-free adaptive learning solution for a model-following control problem. This approach employs policy iteration, to find an optimal adaptive control solution. It utilizes a moving finite-horizon of…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Mohammed I. Abouheaf , Hashim A. Hashim , Mohammad A. Mayyas , Kyriakos G. Vamvoudakis

Feedforward neural networks are widely used as universal predictive models to fit data distribution. Common gradient-based learning, however, suffers from many drawbacks making the training process ineffective and time-consuming.…

Machine Learning · Computer Science 2021-07-06 Grzegorz Dudek

Precise channel state knowledge is crucial in future wireless communication systems, which drives the need for accurate channel prediction without additional pilot overhead. While machine-learning (ML) methods for channel prediction show…

Information Theory · Computer Science 2025-02-26 Hwanjin Kim , Junil Choi , David J. Love

Revealing and analyzing the various properties of materials is an essential and critical issue in the development of materials, including batteries, semiconductors, catalysts, and pharmaceuticals. Traditionally, these properties have been…

Machine Learning · Computer Science 2023-08-21 Limin Wang , Masatoshi Hanai , Toyotaro Suzumura , Shun Takashige , Kenjiro Taura

Learning an accurate model of the environment is essential for model-based control tasks. Existing methods in robotic visuomotor control usually learn from data with heavily labelled actions, object entities or locations, which can be…

Robotics · Computer Science 2021-07-27 Haoqi Yuan , Ruihai Wu , Andrew Zhao , Haipeng Zhang , Zihan Ding , Hao Dong

Data-driven control offers a viable option for control scenarios where constructing a system model is expensive or time-consuming. Nonetheless, many of these algorithms are not entirely automated, often necessitating the adjustment of…

Systems and Control · Electrical Eng. & Systems 2024-03-22 Riccardo Busetto , Valentina Breschi , Federica Baracchi , Simone Formentin

Learning from demonstrations is a promising paradigm for transferring knowledge to robots. However, learning mobile manipulation tasks directly from a human teacher is a complex problem as it requires learning models of both the overall…

Robotics · Computer Science 2019-08-28 Tim Welschehold , Nichola Abdo , Christian Dornhege , Wolfram Burgard

Model fusion research aims to aggregate the knowledge of multiple individual models to enhance performance by combining their weights. In this work, we study the inverse problem: investigating whether model fusion can be used to reduce…

Computation and Language · Computer Science 2024-10-11 Kerem Zaman , Leshem Choshen , Shashank Srivastava

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics…

Robotics · Computer Science 2022-04-15 Spencer M. Richards , Navid Azizan , Jean-Jacques Slotine , Marco Pavone

Humans have internal models of robots (like their physical capabilities), the world (like what will happen next), and their tasks (like a preferred goal). However, human internal models are not always perfect: for example, it is easy to…

Robotics · Computer Science 2023-01-04 Ran Tian , Masayoshi Tomizuka , Anca Dragan , Andrea Bajcsy

Selective Prediction is the task of rejecting inputs a model would predict incorrectly on. This involves a trade-off between input space coverage (how many data points are accepted) and model utility (how good is the performance on accepted…

Heralded by the initial success in speech recognition and image classification, learning-based approaches with neural networks, commonly referred to as deep learning, have spread across various fields. A primitive form of a neural network…

Robotics · Computer Science 2024-09-02 Takuma Yoneda

The shortcomings of maximum likelihood estimation in the context of model-based reinforcement learning have been highlighted by an increasing number of papers. When the model class is misspecified or has a limited representational capacity,…

Machine Learning · Computer Science 2021-06-08 Evgenii Nikishin , Romina Abachi , Rishabh Agarwal , Pierre-Luc Bacon

In reinforcement learning, specifying reward functions that capture the intended task can be very challenging. Reward learning aims to address this issue by learning the reward function. However, a learned reward model may have a low error…

Machine Learning · Computer Science 2025-07-09 Lukas Fluri , Leon Lang , Alessandro Abate , Patrick Forré , David Krueger , Joar Skalse

Model-based reinforcement learning approaches leverage a forward dynamics model to support planning and decision making, which, however, may fail catastrophically if the model is inaccurate. Although there are several existing methods…

Machine Learning · Computer Science 2020-09-30 Hang Lai , Jian Shen , Weinan Zhang , Yong Yu

A Learning Model Predictive Controller (LMPC) for linear system in presented. The proposed controller is an extension of the LMPC [1] and it aims to decrease the computational burden. The control scheme is reference-free and is able to…

Optimization and Control · Mathematics 2019-10-31 Ugo Rosolia , Francesco Borrelli

When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a…

Machine Learning · Computer Science 2018-11-02 Kavosh Asadi , Evan Cater , Dipendra Misra , Michael L. Littman