English
Related papers

Related papers: Learning the MPC objective function from human pre…

200 papers

We present foundations for using Model Predictive Control (MPC) as a differentiable policy class for reinforcement learning in continuous state and action spaces. This provides one way of leveraging and combining the advantages of…

Machine Learning · Computer Science 2019-10-15 Brandon Amos , Ivan Dario Jimenez Rodriguez , Jacob Sacks , Byron Boots , J. Zico Kolter

We propose a model predictive control (MPC) scheme with sampled-data input which ensures output-reference tracking within prescribed error bounds for relative-degree-one systems. Hereby, we explicitly deduce bounds on the required maximal…

Optimization and Control · Mathematics 2024-03-28 Dario Dennstädt , Lukas Lanza , Karl Worthmann

Existing observational approaches for learning human preferences, such as inverse reinforcement learning, usually make strong assumptions about the observability of the human's environment. However, in reality, people make many important…

Machine Learning · Statistics 2021-10-29 Cassidy Laidlaw , Stuart Russell

In this work, we propose a novel learning-based model predictive control (MPC) framework for motion planning and control of urban self-driving. In this framework, instantaneous references and cost functions of online MPC are learned from…

Robotics · Computer Science 2024-02-29 Yubin Wang , Zengqi Peng , Yusen Xie , Yulin Li , Hakim Ghazzai , Jun Ma

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

Systems and Control · Computer Science 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad

In this paper, a multi-objective model-following control problem is solved using an observer-based adaptive learning scheme. The overall goal is to regulate the model-following error dynamics along with optimizing the dynamic variables of a…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Mohammed I. Abouheaf , Kyriakos G. Vamvoudakis , Mohammad A. Mayyas , Hashim A. Hashim

When tracking user-specific online activities, each user's preference is revealed in the form of choices and comparisons. For example, a user's purchase history is a record of her choices, i.e. which item was chosen among a subset of…

Machine Learning · Statistics 2019-01-01 Sahand Negahban , Sewoong Oh , Kiran K. Thekumparampil , Jiaming Xu

Many real-world decision processes are modeled by optimization problems whose defining parameters are unknown and must be inferred from observable data. The Predict-Then-Optimize framework uses machine learning models to predict unknown…

Machine Learning · Computer Science 2023-11-23 James Kotary , Vincenzo Di Vito , Jacob Christopher , Pascal Van Hentenryck , Ferdinando Fioretto

Automating the calibration of the parameters of a control policy by means of global optimization requires quantifying a closed-loop performance function. As this can be impractical in many situations, in this paper we suggest a…

Optimization and Control · Mathematics 2021-05-27 Mengjia Zhu , Alberto Bemporad , Dario Piga

This paper proposes a method for solving optimization problems in which the decision-maker cannot evaluate the objective function, but rather can only express a preference such as "this is better than that" between two candidate decision…

Machine Learning · Computer Science 2019-10-01 Alberto Bemporad , Dario Piga

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2022-02-18 Daniel Shin , Daniel S. Brown , Anca D. Dragan

In this paper, we propose a novel model predictive control (MPC) framework for output tracking that deals with partially unknown constraints. The MPC scheme optimizes over a learning and a backup trajectory. The learning trajectory aims to…

Optimization and Control · Mathematics 2022-05-10 Raffaele Soloperto , Ali Mesbah , Frank Allgöwer

Reward engineering is one of the key challenges in Reinforcement Learning (RL). Preference-based RL effectively addresses this issue by learning from human feedback. However, it is both time-consuming and expensive to collect human…

Machine Learning · Computer Science 2025-02-18 Runze Liu , Chenjia Bai , Jiafei Lyu , Shengjie Sun , Yali Du , Xiu Li

Trains are a corner stone of public transport and play an important role in daily life. A challenging task in train operation is to avoid skidding and sliding during fast changes of traction conditions, which can, for example, occur due to…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Michael Hauck , Patrick Schmidt , Alexander Kobelski , Stefan Streif

Human-in-the-loop aims to train an accurate prediction model with minimum cost by integrating human knowledge and experience. Humans can provide training data for machine learning applications and directly accomplish tasks that are hard for…

Machine Learning · Computer Science 2022-05-20 Xingjiao Wu , Luwei Xiao , Yixuan Sun , Junhang Zhang , Tianlong Ma , Liang He

Autonomously learning diverse behaviors without an extrinsic reward signal has been a problem of interest in reinforcement learning. However, the nature of learning in such mechanisms is unconstrained, often resulting in the accumulation of…

Machine Learning · Computer Science 2023-03-09 Maxence Hussonnois , Thommen George Karimpanal , Santu Rana

Robot navigation around humans can be a challenging problem since human movements are hard to predict. Stochastic model predictive control (MPC) can account for such uncertainties and approximately bound the probability of a collision to…

Robotics · Computer Science 2024-07-22 Yunfan Gao , Florian Messerer , Niels van Duijkeren , Moritz Diehl

Machine-learning approaches to algorithm-selection typically take data describing an instance as input. Input data can take the form of features derived from the instance description or fitness landscape, or can be a direct representation…

Machine Learning · Computer Science 2024-01-24 Quentin Renau , Emma Hart

Algorithmic machine teaching studies the interaction between a teacher and a learner where the teacher selects labeled examples aiming at teaching a target hypothesis. In a quest to lower teaching complexity and to achieve more natural…

Machine Learning · Computer Science 2019-10-25 Farnam Mansouri , Yuxin Chen , Ara Vartanian , Xiaojin Zhu , Adish Singla

Many real-world problems require trading off multiple competing objectives. However, these objectives are often in different units and/or scales, which can make it challenging for practitioners to express numerical preferences over…