English
Related papers

Related papers: A comparison study of supervised learning techniqu…

200 papers

Function approximation is widely used in reinforcement learning to handle the computational difficulties associated with very large state spaces. However, function approximation introduces errors which may lead to instabilities when using…

Machine Learning · Computer Science 2022-12-15 Anna Winnicki , Joseph Lubars , Michael Livesay , R. Srikant

High-dimensional nonlinear systems pose considerable challenges for modeling and control across many domains, from fluid mechanics to advanced robotics. Such systems are typically approximated with reduced-order models, which often rely on…

Systems and Control · Electrical Eng. & Systems 2025-09-05 Hugo Buurmeijer , Luis A. Pabon , John Irvin Alora , Roshan S. Kaundinya , George Haller , Marco Pavone

Approximate solutions of partial differential equations (PDEs) obtained by neural networks are highly affected by hyper parameter settings. For instance, the model training strongly depends on loss function design, including the choice of…

Numerical Analysis · Mathematics 2025-03-13 Hee Jun Yang , Alexander Heinlein , Hyea Hyun Kim

The need for algorithms able to solve Reinforcement Learning (RL) problems with few trials has motivated the advent of model-based RL methods. The reported performance of model-based algorithms has dramatically increased within recent…

Machine Learning · Computer Science 2022-03-22 Giacomo Arcieri , David Wölfle , Eleni Chatzi

Recent advances in machine learning have shown promising results for financial prediction using large, over-parameterized models. This paper provides theoretical foundations and empirical validation for understanding when and how these…

Statistical Finance · Quantitative Finance 2025-07-08 Hasan Fallahgoul

We propose and discuss a new computational method for the numerical approximation of reachable sets for nonlinear control systems. It is based on the support vector machine algorithm and represents the set approximation as a sublevel set of…

Optimization and Control · Mathematics 2014-12-11 Martin Rasmussen , Janosch Rieger , Kevin Webster

Tensor networks are efficient representations of high-dimensional tensors which have been very successful for physics and mathematics applications. We demonstrate how algorithms for optimizing such networks can be adapted to supervised…

Machine Learning · Statistics 2017-05-22 E. Miles Stoudenmire , David J. Schwab

This paper is concerned with the problem of policy evaluation with linear function approximation in discounted infinite horizon Markov decision processes. We investigate the sample complexities required to guarantee a predefined estimation…

Machine Learning · Statistics 2024-05-03 Gen Li , Weichen Wu , Yuejie Chi , Cong Ma , Alessandro Rinaldo , Yuting Wei

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

We use deep sparsely connected neural networks to measure the complexity of a function class in $L^2(\mathbb R^d)$ by restricting connectivity and memory requirement for storing the neural networks. We also introduce representation system -…

Machine Learning · Computer Science 2021-08-17 Khay Boon Hong

Low-rank tensor approximation techniques attempt to mitigate the overwhelming complexity of linear algebra tasks arising from high-dimensional applications. In this work, we study the low-rank approximability of solutions to linear systems…

Numerical Analysis · Mathematics 2016-01-08 Daniel Kressner , André Uschmajew

Contrastive learning is a powerful framework for learning self-supervised representations that generalize well to downstream supervised tasks. We show that multiple existing contrastive learning methods can be reinterpreted as learning…

Machine Learning · Computer Science 2023-02-16 Daniel D. Johnson , Ayoub El Hanchi , Chris J. Maddison

Research in machine learning has polarized into two general approaches for regression tasks: Transductive methods construct estimates directly from available data but are usually problem unspecific. Inductive methods can be much more…

Machine Learning · Computer Science 2023-05-19 Mathieu Chalvidal , Thomas Serre , Rufin VanRullen

Recent literature has proposed approaches that learn control policies with high performance while maintaining safety guarantees. Synthesizing Hamilton-Jacobi (HJ) reachable sets has become an effective tool for verifying safety and…

Systems and Control · Electrical Eng. & Systems 2024-08-23 Milan Ganai , Sicun Gao , Sylvia Herbert

Trial-and-error based reinforcement learning (RL) has seen rapid advancements in recent times, especially with the advent of deep neural networks. However, the majority of autonomous RL algorithms require a large number of interactions with…

Systems and Control · Computer Science 2018-02-23 Sanket Kamthe , Marc Peter Deisenroth

Measurement and estimation of parameters are essential for science and engineering, where one of the main quests is to find systematic schemes that can achieve high precision. While conventional schemes for quantum parameter estimation…

Quantum Physics · Physics 2021-04-29 Han Xu , Junning Li , Liqiang Liu , Yu Wang , Haidong Yuan , Xin Wang

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

We establish an algorithm to learn feedback maps from data for a class of robust model predictive control (MPC) problems. The algorithm accounts for the approximation errors due to the learning directly at the synthesis stage, ensuring…

Optimization and Control · Mathematics 2025-10-16 Siddhartha Ganguly , Shubham Gupta , Debasish Chatterjee

Simulation is a useful tool in situations where training data for machine learning models is costly to annotate or even hard to acquire. In this work, we propose a reinforcement learning-based method for automatically adjusting the…

Machine Learning · Computer Science 2019-05-15 Nataniel Ruiz , Samuel Schulter , Manmohan Chandraker

High dimensional classification has been highlighted for last two decades and much research has been conducted in order to circumvent challenges encountered in high dimensions. While existing methods have focused mainly on developing…

Methodology · Statistics 2022-11-16 Seungchul Baek