English
Related papers

Related papers: High-Dimensional Stochastic Design Optimization by…

200 papers

Motion planning and control problems are embedded and essential in almost all robotics applications. These problems are often formulated as stochastic optimal control problems and solved using dynamic programming algorithms. Unfortunately,…

Robotics · Computer Science 2018-01-12 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

A key step in reverse engineering neural networks is to decompose them into simpler parts that can be studied in relative isolation. Linear parameter decomposition -- a framework that has been proposed to resolve several issues with current…

Machine Learning · Computer Science 2025-09-05 Lucius Bushnaq , Dan Braun , Lee Sharkey

Following the recently developed algorithms for fully probabilistic control design for general dynamic stochastic systems [15], [18], this paper presents the solution to the probabilistic dual heuristic programming (DHP) adaptive critic…

Optimization and Control · Mathematics 2018-01-09 Randa Herzallah

We propose a scalable method for computing global solutions of nonlinear, high-dimensional dynamic stochastic economic models. First, within a time iteration framework, we approximate economic policy functions using an adaptive,…

General Economics · Economics 2022-02-15 Aryan Eftekhari , Simon Scheidegger

Dynamic mode decomposition (DMD) has recently become a popular tool for the non-intrusive analysis of dynamical systems. Exploiting Proper Orthogonal Decomposition (POD) as a dimensionality reduction technique, DMD is able to approximate a…

Numerical Analysis · Mathematics 2024-01-17 Francesco Andreuzzi , Nicola Demo , Gianluigi Rozza

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

Physical models with uncertain inputs are commonly represented as parametric partial differential equations (PDEs). That is, PDEs with inputs that are expressed as functions of parameters with an associated probability distribution.…

Numerical Analysis · Mathematics 2023-05-15 Benjamin M. Kent , Catherine E. Powell , David J. Silvester , Małgorzata J. Zimoń

We introduce the optimized dynamic mode decomposition algorithm for constructing an adaptive and computationally efficient reduced order model and forecasting tool for global atmospheric chemistry dynamics. By exploiting a low-dimensional…

Machine Learning · Computer Science 2024-04-22 Meghana Velegar , Christoph Keller , J. Nathan Kutz

This paper presents a novel algorithm that leverages Stochastic Gradient Descent strategies in conjunction with Random Features to augment the scalability of Conic Particle Gradient Descent (CPGD) specifically tailored for solving sparse…

Optimization and Control · Mathematics 2025-09-05 Yohann De Castro , Sébastien Gadat , Clément Marteau

Efficiently estimating system dynamics from data is essential for minimizing data collection costs and improving model performance. This work addresses the challenge of designing future control inputs to maximize information gain, thereby…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Joshua Ott , Mykel J. Kochenderfer , Stephen Boyd

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

Dynamic mode decomposition (DMD) has become a powerful data-driven method for analyzing the spatiotemporal dynamics of complex, high-dimensional systems. However, conventional DMD methods are limited to matrix-based formulations, which…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Ziqin He , Mengqi Hu , Yifei Lou , Can Chen

Motivation: The high dimensionality of genomic data calls for the development of specific classification methodologies, especially to prevent over-optimistic predictions. This challenge can be tackled by compression and variable selection,…

Methodology · Statistics 2021-04-10 G. Durif , L. Modolo , J. Michaelsson , J. E. Mold , S. Lambert-Lacroix , F. Picard

Dynamic Mode Decomposition (DMD) is an unsupervised machine learning method that has attracted considerable attention in recent years owing to its equation-free structure, ability to easily identify coherent spatio-temporal structures in…

Machine Learning · Computer Science 2022-02-16 Alex Viguerie , Gabriel F. Barros , Malú Grave , Alessandro Reali , Alvaro L. G. A. Coutinho

Multidimensional scaling (MDS) is a popular dimensionality reduction techniques that has been widely used for network visualization and cooperative localization. However, the traditional stress minimization formulation of MDS necessitates…

Optimization and Control · Mathematics 2016-12-22 Ketan Rajawat , Sandeep Kumar

This dissertation explores block decomposable methods for large-scale optimization problems. It focuses on alternating direction method of multipliers (ADMM) schemes and block coordinate descent (BCD) methods. Specifically, it introduces a…

Optimization and Control · Mathematics 2026-01-15 Leandro Farias Maia

Stochastic dual dynamic programming (SDDP) is a state-of-the-art method for solving multi-stage stochastic optimization, widely used for modeling real-world process optimization tasks. Unfortunately, SDDP has a worst-case complexity that…

Machine Learning · Computer Science 2021-12-03 Hanjun Dai , Yuan Xue , Zia Syed , Dale Schuurmans , Bo Dai

Presence of a high-dimensional stochastic parameter space with discontinuities poses major computational challenges in analyzing and quantifying the effects of the uncertainties in a physical system. In this paper, we propose a stochastic…

Numerical Analysis · Mathematics 2018-08-01 Anindya Bhaduri , Yanyan He , Michael D. Shields , Lori Graham-Brady , Robert M. Kirby

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

Estimation of parameters is a crucial part of model development. When models are deterministic, one can minimise the fitting error; for stochastic systems one must be more careful. Broadly parameterisation methods for stochastic dynamical…

Statistics Theory · Mathematics 2018-04-12 Asbjørn N. Riseth , Jake P. Taylor-King