English
Related papers

Related papers: Approximate Dynamic Programming based on High Dime…

200 papers

Low-rank matrix approximation is one of the central concepts in machine learning, with applications in dimension reduction, de-noising, multivariate statistical methodology, and many more. A recent extension to LRMA is called low-rank…

Machine Learning · Statistics 2021-09-24 Elena Tuzhilina , Trevor Hastie

We consider a framework for the construction of iterative schemes for operator equations that combine low-rank approximation in tensor formats and adaptive approximation in a basis. Under fairly general assumptions, we obtain a rigorous…

Numerical Analysis · Mathematics 2014-03-17 Markus Bachmayr , Wolfgang Dahmen

We study computationally and statistically efficient Reinforcement Learning algorithms for the linear Bellman Complete setting. This setting uses linear function approximation to capture value functions and unifies existing models like…

Machine Learning · Computer Science 2025-03-04 Runzhe Wu , Ayush Sekhari , Akshay Krishnamurthy , Wen Sun

Recent development of Deep Reinforcement Learning (DRL) has demonstrated superior performance of neural networks in solving challenging problems with large or even continuous state spaces. One specific approach is to deploy neural networks…

Machine Learning · Computer Science 2022-03-15 Martin Gottwald , Sven Gronauer , Hao Shen , Klaus Diepold

We consider the uniform approximation of the smallest eigenvalue of a large parameter-dependent Hermitian matrix by that of a smaller counterpart obtained through projections. The projection subspaces are constructed iteratively by means of…

Numerical Analysis · Mathematics 2026-01-16 Mattia Manucci , Emre Mengi , Nicola Guglielmi

Latent variable models represent a useful tool for the analysis of complex data when the constructs of interest are not observable. A problem related to these models is that the integrals involved in the likelihood function cannot be solved…

Methodology · Statistics 2015-03-05 Silvia Bianconcini , Silvia Cagnone , Dimitris Rizopoulos

The Hadamard decomposition is a powerful technique for data analysis and matrix compression, which decomposes a given matrix into the element-wise product of two or more low-rank matrices. In this paper, we develop an efficient algorithm to…

Machine Learning · Computer Science 2025-04-23 Samuel Wertz , Arnaud Vandaele , Nicolas Gillis

Approximate dynamic programming is a popular method for solving large Markov decision processes. This paper describes a new class of approximate dynamic programming (ADP) methods- distributionally robust ADP-that address the curse of…

Machine Learning · Statistics 2012-05-22 Marek Petrik

Markov decision problems are most commonly solved via dynamic programming. Another approach is Bellman residual minimization, which directly minimizes the squared Bellman residual objective function. However, compared to dynamic…

Machine Learning · Computer Science 2026-04-28 Donghwan Lee , Hyukjun Yang

Linear mixed models (LMMs) are used extensively to model dependecies of observations in linear regression and are used extensively in many application areas. Parameter estimation for LMMs can be computationally prohibitive on big data.…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Kimberly Roche , Xiang Zhou , Sayan Mukherjee

Model order reduction (MOR) has long been a mainstream strategy to accelerate large-scale transient circuit simulation. Dynamic Mode Decomposition (DMD) represents a novel data-driven characterization method, extracting dominant dynamical…

Signal Processing · Electrical Eng. & Systems 2025-08-06 Na Liu , Chengliang Dai , Qiuyue Wu , Qiuqi Li , Guoxiong Cai

Sparse polynomial approximation has become indispensable for approximating smooth, high- or infinite-dimensional functions from limited samples. This is a key task in computational science and engineering, e.g., surrogate modelling in…

Numerical Analysis · Mathematics 2023-11-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

The problem of sparse approximation and the closely related compressed sensing have received tremendous attention in the past decade. Primarily studied from the viewpoint of applied harmonic analysis and signal processing, there have been…

Information Theory · Computer Science 2018-10-23 Ali Çivril

Motion planning and control problems are embedded and essential in almost all robotics applications. These problems are often formulated as stochastic optimal control problems and solved using dynamic programming algorithms. Unfortunately,…

Robotics · Computer Science 2018-01-12 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

An important yet challenging problem in numerical linear algebra is finding a principal submatrix with maximum determinant from a given symmetric positive semidefinite matrix. This problem arises in experimental design, statistics, and…

Optimization and Control · Mathematics 2026-05-26 Hao Hu , Stefan Sremac , Hugo J. Woerdeman , Henry Wolkowicz

The Trust Region Subproblem is a fundamental optimization problem that takes a pivotal role in Trust Region Methods. However, the problem, and variants of it, also arise in quite a few other applications. In this article, we present a…

Optimization and Control · Mathematics 2022-08-19 Uria Mor , Boris Shustin , Haim Avron

This work proposes a model-reduction approach for the material point method on nonlinear manifolds. Our technique approximates the $\textit{kinematics}$ by approximating the deformation map using an implicit neural representation that…

Machine Learning · Computer Science 2023-02-13 Peter Yichen Chen , Maurizio M. Chiaramonte , Eitan Grinspun , Kevin Carlberg

Tensor methods are among the most prominent tools for the numerical solution of high-dimensional problems where functions of multiple variables have to be approximated. These methods exploit the tensor structure of function spaces and apply…

Numerical Analysis · Mathematics 2021-02-01 Anthony Nouy

Update formulas for the Hessian approximations in quasi-Newton methods such as BFGS can be derived as analytical solutions to certain nearest-matrix problems. In this article, we propose a similar idea for deriving new limited memory…

Optimization and Control · Mathematics 2024-03-06 Erik Berglund , Mikael Johansson

To sidestep the curse of dimensionality when computing solutions to Hamilton-Jacobi-Bellman partial differential equations (HJB PDE), we propose an algorithm that leverages a neural network to approximate the value function. We show that…

Machine Learning · Computer Science 2017-03-28 Frank Jiang , Glen Chou , Mo Chen , Claire J. Tomlin