English
Related papers

Related papers: Model order reduction for stochastic dynamical sys…

200 papers

Our main objective in this paper is to develop a second-order stochastic numerical method which generalizes the well-known deterministic TR-BDF2 scheme. Since most stochastic techniques used for approximating the solution of a stochastic…

Numerical Analysis · Mathematics 2026-02-12 Tomás Caraballo , Macarena Gómez-Mármol , Ignacio Roldán

Stochastic differential equations (SDEs) are a ubiquitous modeling framework that finds applications in physics, biology, engineering, social science, and finance. Due to the availability of large-scale data sets, there is growing interest…

Machine Learning · Statistics 2025-03-04 Ziheng Guo , James Greene , Ming Zhong

This paper investigates the stochastic distributed nonconvex optimization problem of minimizing a global cost function formed by the summation of $n$ local cost functions. We solve such a problem by involving zeroth-order (ZO) information…

Optimization and Control · Mathematics 2021-10-15 Shengjun Zhang , Yunlong Dong , Dong Xie , Lisha Yao , Colleen P. Bailey , Shengli Fu

We introduce StoDCuP (Stochastic Dynamic Cutting Plane), an extension of the Stochastic Dual Dynamic Programming (SDDP) algorithm to solve multistage stochastic convex optimization problems. At each iteration, the algorithm builds lower…

Optimization and Control · Mathematics 2021-04-08 Vincent Guigues , Renato Monteiro

We use direct statistical simulation (DSS) to find the low-order statistics of the well-known dynamical system, the Lorenz63 model. Instead of accumulating statistics from numerical simulation of the dynamical systems, we solve the…

Statistical Mechanics · Physics 2022-04-08 Kuan Li , J. B. Marston , Saloni Saxena , Steven M. Tobias

A stable numerical solution of the steady Stokes problem requires compatibility between the choice of velocity and pressure approximation that has traditionally proven problematic for meshless methods. In this work, we present a…

Numerical Analysis · Mathematics 2016-11-15 Nathaniel Trask , Martin Maxey , Xiaozhe Hu

Dissipative partial differential equations that exhibit chaotic dynamics tend to evolve to attractors that exist on finite-dimensional manifolds. We present a data-driven reduced order modeling method that capitalizes on this fact by…

Machine Learning · Computer Science 2022-07-20 Alec J. Linot , Michael D. Graham

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

This paper considers decentralized dynamic optimization problems where nodes of a network try to minimize a sequence of time-varying objective functions in a real-time scheme. At each time slot, nodes have access to different summands of an…

Optimization and Control · Mathematics 2016-03-29 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

In this paper, we consider multi-stage stochastic optimization problems with convex objectives and conic constraints at each stage. We present a new stochastic first-order method, namely the dynamic stochastic approximation (DSA) algorithm,…

Optimization and Control · Mathematics 2019-08-22 Guanghui Lan , Zhiqiang Zhou

This paper presents a structure-exploiting nonlinear model reduction method for systems with general nonlinearities. First, the nonlinear model is lifted to a model with more structure via variable transformations and the introduction of…

Numerical Analysis · Computer Science 2019-07-30 Boris Kramer , Karen Willcox

Given a nonsmooth, nonconvex minimization problem, we consider algorithms that iteratively sample and minimize stochastic convex models of the objective function. Assuming that the one-sided approximation quality and the variation of the…

Optimization and Control · Mathematics 2018-07-03 Damek Davis , Dmitriy Drusvyatskiy , Kellie J. MacPhee

This work focuses on steady and unsteady Navier-Stokes equations in a reduced order modeling framework. The methodology proposed is based on a Proper Orthogonal Decomposition within a levelset geometry description and the problems of…

Numerical Analysis · Mathematics 2023-08-08 Efthymios N. Karatzas , Monica Nonino , Francesco Ballarin , Gianluigi Rozza

In this paper, we propose a distributed stochastic second-order proximal method that enables agents in a network to cooperatively minimize the sum of their local loss functions without any centralized coordination. The proposed algorithm,…

Optimization and Control · Mathematics 2022-11-22 Chenyang Qiu , Shanying Zhu , Zichong Ou , Jie Lu

Block coordinate descent methods and stochastic subgradient methods have been extensively studied in optimization and machine learning. By combining randomized block sampling with stochastic subgradient methods based on dual averaging, we…

Optimization and Control · Mathematics 2015-09-16 Qi Deng , Guanghui Lan , Anand Rangarajan

Our work is part of the close link between continuous-time dissipative dynamical systems and optimization algorithms, and more precisely here, in the stochastic setting. We aim to study stochastic convex minimization problems through the…

Optimization and Control · Mathematics 2025-02-21 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch , Peter Ochs

We consider model order reduction based on proper orthogonal decomposition (POD) for unsteady incompressible Navier-Stokes problems, assuming that the snapshots are given by spatially adapted finite element solutions. We propose two…

Numerical Analysis · Mathematics 2019-08-02 Carmen Gräßle , Michael Hinze , Jens Lang , Sebastian Ullmann

Soft robots offer remarkable adaptability and safety advantages over rigid robots, but modeling their complex, nonlinear dynamics remains challenging. Strain-based models have recently emerged as a promising candidate to describe such…

Derivative-free optimization has become an important technique used in machine learning for optimizing black-box models. To conduct updates without explicitly computing gradient, most current approaches iteratively sample a random search…

Machine Learning · Statistics 2018-08-03 Liu Liu , Minhao Cheng , Cho-Jui Hsieh , Dacheng Tao

Dynamic programming algorithms have been successfully applied to propositional stochastic planning problems by using compact representations, in particular algebraic decision diagrams, to capture domain dynamics and value functions. Work on…

Artificial Intelligence · Computer Science 2014-01-17 Saket Joshi , Roni Khardon