English
Related papers

Related papers: Recursive Regression with Neural Networks: Approxi…

200 papers

This paper introduces OptimizedDP, a high-performance software library for several common grid-based dynamic programming (DP) algorithms used in control theory and robotics. Specifically, OptimizedDP provides functions to numerically solve…

Systems and Control · Electrical Eng. & Systems 2025-11-21 Minh Bui , Hanyang Hu , Chong He , Michael Lu , George Giovanis , Arrvindh Shriraman , Mo Chen

Solving partial differential equations (PDEs) is a central task in scientific computing. Recently, neural network approximation of PDEs has received increasing attention due to its flexible meshless discretization and its potential for…

Machine Learning · Statistics 2024-03-18 Kejun Tang , Jiayu Zhai , Xiaoliang Wan , Chao Yang

We consider a deterministic optimal control problem with a maximum running cost functional, in a finite horizon context, and propose deep neural network approximations for Bellman's dynamic programming principle, corresponding also to some…

Optimization and Control · Mathematics 2022-10-11 Olivier Bokanowski , Xavier Warin , Averil Prost

This paper proposes a new family of algorithms for training neural networks (NNs). These are based on recent developments in the field of non-convex optimization, going under the general name of successive convex approximation (SCA)…

Machine Learning · Statistics 2017-06-16 Simone Scardapane , Paolo Di Lorenzo

In this paper we introduce an iterative Jacobi algorithm for solving distributed model predictive control (DMPC) problems, with linear coupled dynamics and convex coupled constraints. The algorithm guarantees stability and persistent…

Optimization and Control · Mathematics 2008-09-23 Dang Doan , Tamas Keviczky , Ion Necoara , Moritz Diehl

The Heston model is a well-known two-dimensional financial model. Because the Heston model contains implicit parameters that cannot be determined directly from real market data, calibrating the parameters to real market data is challenging.…

Optimization and Control · Mathematics 2023-10-16 Anna Clevenhaus , Claudia Totzeck , Matthias Ehrhardt

The paper suggests a method of recovering missing values for sequences, including sequences with a multidimensional index, based on optimal approximation by processes featuring spectrum degeneracy. The problem is considered in the pathwise…

Information Theory · Computer Science 2017-10-31 Nikolai Dokuchaev

Approximate solutions of partial differential equations (PDEs) obtained by neural networks are highly affected by hyper parameter settings. For instance, the model training strongly depends on loss function design, including the choice of…

Numerical Analysis · Mathematics 2025-03-13 Hee Jun Yang , Alexander Heinlein , Hyea Hyun Kim

We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate…

Probability · Mathematics 2020-06-08 Côme Huré , Huyên Pham , Xavier Warin

One of the most challenging issues in applied mathematics is to develop and analyze algorithms which are able to approximately compute solutions of high-dimensional nonlinear partial differential equations (PDEs). In particular, it is very…

Hamilton-Jacobi reachability (HJR) provides a value function that encodes the set of states from which a system with bounded control inputs can reach or avoid a target despite any bounded disturbance, and the corresponding robust, optimal…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Will Sharpless , Yat Tin Chow , Sylvia Herbert

We consider the problem of minimizing the sum of two convex functions: one is the average of a large number of smooth component functions, and the other is a general convex function that admits a simple proximal mapping. We assume the whole…

Optimization and Control · Mathematics 2014-03-20 Lin Xiao , Tong Zhang

Non-autonomous differential equations are crucial for modeling systems influenced by external signals, yet fitting these models to data becomes particularly challenging when the signals change abruptly. To address this problem, we propose a…

Machine Learning · Computer Science 2025-07-10 Hyeontae Jo , Krešimir Josić , Jae Kyoung Kim

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

Approximate dynamic programming is a popular method for solving large Markov decision processes. This paper describes a new class of approximate dynamic programming (ADP) methods- distributionally robust ADP-that address the curse of…

Machine Learning · Statistics 2012-05-22 Marek Petrik

Solving partial differential equations (PDEs) within the framework of probabilistic numerics offers a principled approach to quantifying epistemic uncertainty arising from discretization. By leveraging Gaussian process regression and…

Machine Learning · Statistics 2025-08-18 Akshay Thakur , Sawan Kumar , Matthew Zahr , Souvik Chakraborty

This article introduces an algorithm for implicit High Dimensional Model Representation (HDMR) of the Bellman equation. This approximation technique reduces memory demands of the algorithm considerably. Moreover, we show that HDMR enables…

Optimization and Control · Mathematics 2012-10-03 Miroslav Pištěk

Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this work, we propose and…

Machine Learning · Statistics 2024-09-09 Haoyu Jiang , Jason Xu

Machine learning, as a tool to learn and model complicated (non)linear relationships between input and output data sets, has shown preliminary success in some HPC problems. Using machine learning, scientists are able to augment existing…

Performance · Computer Science 2018-12-19 Wenqian Dong , Anzheng Guolu , Dong Li

This paper proposes an algorithmic framework for solving parametric optimization problems which we call adjoint-based predictor-corrector sequential convex programming. After presenting the algorithm, we prove a contraction estimate that…

Optimization and Control · Mathematics 2011-09-14 Q. Tran Dinh , C. Savorgnan , M. Diehl