English
Related papers

Related papers: Approximate Dynamic Programming based on High Dime…

200 papers

In this work, we present a trust-region optimization framework that employs Hermite kernel surrogate models. The method targets optimization problems with computationally demanding objective functions, for which direct optimization is often…

Numerical Analysis · Mathematics 2025-07-03 Sven Ullmann , Tobias Ehring , Robin Herkert , Bernard Haasdonk

Differentially private algorithms for answering sets of predicate counting queries on a sensitive database have many applications. Organizations that collect individual-level data, such as statistical agencies and medical institutions, use…

Databases · Computer Science 2018-08-13 Ryan McKenna , Gerome Miklau , Michael Hay , Ashwin Machanavajjhala

We present Stochastic Dynamic Mode Decomposition (SDMD), a novel data-driven framework for approximating the Koopman semigroup in stochastic dynamical systems. Unlike existing methods, SDMD explicitly incorporates sampling time into its…

Dynamical Systems · Mathematics 2025-08-20 Yuanchao Xu , Kaidi Shao , Isao Ishikawa , Yuka Hashimoto , Nikos Logothetis , Zhongwei Shen

In this paper, we present a discretization algorithm for finite horizon risk constrained dynamic programming algorithm in [Chow_Pavone_13]. Although in a theoretical standpoint, Bellman's recursion provides a systematic way to find optimal…

Optimization and Control · Mathematics 2015-01-12 Yin-Lam Chow , Marco Pavone

This work develops a novel set of algorithms, alternating Gradient Descent (GD) and minimization for MRI (altGDmin-MRI1 and altGDmin-MRI2), for accelerated dynamic MRI by assuming an approximate low-rank (LR) model on the matrix formed by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-13 Silpa Babu , Sajan Goud Lingala , Namrata Vaswani

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

Dynamic Mode Decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of non-linear systems from experimental datasets. Recently, several attempts have extended DMD to the context of low-rank approximations. This…

Machine Learning · Statistics 2018-05-18 Patrick Héas , Cédric Herzet

This paper puts forth a novel bi-linear modeling framework for data recovery via manifold-learning and sparse-approximation arguments and considers its application to dynamic magnetic-resonance imaging (dMRI). Each temporal-domain MR image…

Image and Video Processing · Electrical Eng. & Systems 2020-02-28 Gaurav N. Shetty , Konstantinos Slavakis , Abhishek Bose , Ukash Nakarmi , Gesualdo Scutari , Leslie Ying

Machine learning (ML) problems are often posed as highly nonlinear and nonconvex unconstrained optimization problems. Methods for solving ML problems based on stochastic gradient descent are easily scaled for very large problems but may…

Numerical Analysis · Mathematics 2019-05-24 Jennifer B. Erway , Joshua Griffin , Roummel F. Marcia , Riadh Omheni

Under investigation is the problem of finding the best approximation of a function in a Hilbert space subject to convex constraints and prescribed nonlinear transformations. We show that in many instances these prescriptions can be…

Functional Analysis · Mathematics 2021-06-17 Patrick L. Combettes , Zev C. Woodstock

This paper describes a method for learning low-dimensional approximations of nonlinear dynamical systems, based on neural-network approximations of the underlying Koopman operator. Extended Dynamic Mode Decomposition (EDMD) provides a…

Dynamical Systems · Mathematics 2019-01-17 Samuel E. Otto , Clarence W. Rowley

We consider trust-region methods for solving optimization problems where the objective is the sum of a smooth, nonconvex function and a nonsmooth, convex regularizer. We extend the global convergence theory of such methods to include…

Optimization and Control · Mathematics 2025-01-10 Minh N. Dao , Hung M. Phan , Lindon Roberts

Regularized Markov Decision Processes serve as models of sequential decision making under uncertainty wherein the decision maker has limited information processing capacity and/or aversion to model ambiguity. With functional approximation,…

Artificial Intelligence · Computer Science 2025-02-11 Jiachen Xi , Alfredo Garcia , Petar Momcilovic

An implicit neural representation (INR) is a neural network that approximates a spatiotemporal function. Many memory-intensive visualization tasks, including modern 4D CT scanning methods, represent data natively as INRs. While INRs are…

Machine Learning · Computer Science 2025-12-03 Jennifer Zvonek , Andrew Gillette

This work provides closed-form solutions and minimum achievable errors for a large class of low-rank approximation problems in Hilbert spaces. The proposed theorem generalizes to the case of bounded linear operators the previous results…

Machine Learning · Statistics 2023-01-09 Patrick Heas , Cedric Herzet

Many statistical estimators for high-dimensional linear regression are M-estimators, formed through minimizing a data-dependent square loss function plus a regularizer. This work considers a new class of estimators implicitly defined…

Statistics Theory · Mathematics 2022-02-15 Peng Zhao , Yun Yang , Qiao-Chu He

We propose a new modified primal-dual proximal best approximation method for solving convex not necessarily differentiable optimization problems. The novelty of the method relies on introducing memory by taking into account iterates…

Optimization and Control · Mathematics 2018-04-18 Ewa M. Bednarczuk , Anna Jezierska , Krzysztof E. Rutkowski

We propose a novel algorithmic framework for distributional reinforcement learning, based on learning finite-dimensional mean embeddings of return distributions. We derive several new algorithms for dynamic programming and…

This paper presents a novel non-linear model reduction method: Probabilistic Manifold Decomposition (PMD), which provides a powerful framework for constructing non-intrusive reduced-order models (ROMs) by embedding a high-dimensional system…

Numerical Analysis · Mathematics 2026-01-09 Jiaming Guo , Dunhui Xiao

The majority of methods used to compute approximations to the Hamilton-Jacobi-Isaacs partial differential equation (HJI PDE) rely on the discretization of the state space to perform dynamic programming updates. This type of approach is…

Machine Learning · Computer Science 2019-04-15 Vicenç Rubies-Royo , Claire Tomlin