English
Related papers

Related papers: Tailored neural networks for learning optimal valu…

200 papers

Model-free reinforcement learning has been successfully applied to a range of challenging problems, and has recently been extended to handle large neural network policies and value functions. However, the sample complexity of model-free…

Machine Learning · Computer Science 2016-03-03 Shixiang Gu , Timothy Lillicrap , Ilya Sutskever , Sergey Levine

Reinforcement learning (RL) has been successfully used in various simulations and computer games. Industry-related applications, such as autonomous mobile robot motion control, are somewhat challenging for RL up to date though. This paper…

Robotics · Computer Science 2021-08-25 Dmitrii Dobriborsci , Pavel Osinenko

Using deep neural nets as function approximator for reinforcement learning tasks have recently been shown to be very powerful for solving problems approaching real-world complexity. Using these results as a benchmark, we discuss the role…

Machine Learning · Computer Science 2016-01-21 Vincent François-Lavet , Raphael Fonteneau , Damien Ernst

Various factorization-based methods have been proposed to leverage second-order, or higher-order cross features for boosting the performance of predictive models. They generally enumerate all the cross features under a predefined maximum…

Machine Learning · Computer Science 2020-06-25 Weiyu Cheng , Yanyan Shen , Linpeng Huang

Convolutional neural networks (CNNs) have been employed along with Variational Monte Carlo methods for finding the ground state of quantum many-body spin systems with great success. In order to do so, however, a CNN with only linearly many…

Quantum Physics · Physics 2022-10-04 Yilong Ju , Shah Saad Alam , Jonathan Minoff , Fabio Anselmi , Han Pu , Ankit Patel

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

Optimization and Control · Mathematics 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

There is a growing desire in the field of reinforcement learning (and machine learning in general) to move from black-box models toward more "interpretable AI." We improve interpretability of reinforcement learning by increasing the utility…

Machine Learning · Computer Science 2019-07-03 Aaron M. Roth , Nicholay Topin , Pooyan Jamshidi , Manuela Veloso

Model-Free Reinforcement Learning (RL) algorithms either learn how to map states to expected rewards or search for policies that can maximize a certain performance function. Model-Based algorithms instead, aim to learn an approximation of…

Machine Learning · Computer Science 2024-11-19 Juan Cardenas-Cartagena , Massimiliano Falzari , Marco Zullich , Matthia Sabatelli

In recent years, the integration of Machine Learning (ML) models with Operation Research (OR) tools has gained popularity across diverse applications, including cancer treatment, algorithmic configuration, and chemical process optimization.…

Machine Learning · Computer Science 2023-07-17 Matteo Cacciola , Antonio Frangioni , Andrea Lodi

Reinforcement learning (RL) and model predictive control (MPC) offer complementary strengths, yet combining them at scale remains computationally challenging. We propose soft MPCritic, an RL-MPC framework that learns in (soft) value space…

Machine Learning · Computer Science 2026-04-03 Thomas Banker , Nathan P. Lawrence , Ali Mesbah

This paper introduces the QMDP-net, a neural network architecture for planning under partial observability. The QMDP-net combines the strengths of model-free learning and model-based planning. It is a recurrent policy network, but it…

Artificial Intelligence · Computer Science 2017-11-06 Peter Karkus , David Hsu , Wee Sun Lee

A supervised learning framework is proposed to approximate a model predictive controller (MPC) with reduced computational complexity and guarantees on stability and constraint satisfaction. The framework can be used for a wide class of…

Systems and Control · Computer Science 2018-06-13 Michael Hertneck , Johannes Köhler , Sebastian Trimpe , Frank Allgöwer

Organisms in nature have evolved to exhibit flexibility in face of changes to the environment and/or to themselves. Artificial neural networks (ANNs) have proven useful for controlling of artificial agents acting in environments. However,…

Machine Learning · Computer Science 2022-05-18 Joachim Winther Pedersen , Sebastian Risi

For safe and efficient planning and control in autonomous driving, we need a driving policy which can achieve desirable driving quality in long-term horizon with guaranteed safety and feasibility. Optimization-based approaches, such as…

Artificial Intelligence · Computer Science 2017-07-11 Liting Sun , Cheng Peng , Wei Zhan , Masayoshi Tomizuka

The optimal stopping problem is a category of decision problems with a specific constrained configuration. It is relevant to various real-world applications such as finance and management. To solve the optimal stopping problem,…

Computational Finance · Quantitative Finance 2022-08-02 Leonardo Kanashiro Felizardo , Elia Matsumoto , Emilio Del-Moral-Hernandez

Nonlinear model predictive control (NMPC) is typically restricted to short, finite horizons to limit the computational burden of online optimization. As a result, global planning frameworks are frequently necessary to avoid local minima…

Robotics · Computer Science 2025-06-11 Adam Polevoy , Mark Gonzales , Marin Kobilarov , Joseph Moore

Accurate value estimates are important for off-policy reinforcement learning. Algorithms based on temporal difference learning typically are prone to an over- or underestimation bias building up over time. In this paper, we propose a…

Machine Learning · Computer Science 2022-10-24 Nicolai Dorka , Tim Welschehold , Joschka Boedecker , Wolfram Burgard

Most chemical processes, such as distillation, absorption, extraction, and catalytic reactions, are extremely complex processes that are affected by multiple factors. The relationships between their input variables and output variables are…

Systems and Control · Electrical Eng. & Systems 2021-10-19 Li Sun , Fei Liang , Wutai Cui

Equivariant neural networks enforce symmetry within the structure of their convolutional layers, resulting in a substantial improvement in sample efficiency when learning an equivariant or invariant function. Such models are applicable to…

Robotics · Computer Science 2022-03-10 Dian Wang , Robin Walters , Robert Platt

Quality classification of wood boards is an essential task in the sawmill industry, which is still usually performed by human operators in small to median companies in developing countries. Machine learning algorithms have been successfully…

Machine Learning · Computer Science 2023-10-23 Mateus Roder , Leandro Aparecido Passos , João Paulo Papa , André Luis Debiaso Rossi