English
Related papers

Related papers: Optimization based model order reduction for stoch…

200 papers

Real-life parallel machine scheduling problems can be characterized by: (i) limited information about the exact task duration at scheduling time, and (ii) an opportunity to reschedule the remaining tasks each time a task processing is…

Optimization and Control · Mathematics 2023-11-22 Izack Cohen , Krzysztof Postek , Shimrit Shtern

In this work we propose tailored model order reduction for varying boundary optimal control problems governed by parametric partial differential equations. With varying boundary control, we mean that a specific parameter changes where the…

Numerical Analysis · Mathematics 2024-01-22 Maria Strazzullo , Fabio Vicini

A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learning problems such as regression and classification. The…

Machine Learning · Computer Science 2019-04-08 Craig Wilson , Yuheng Bu , Venugopal Veeravalli

This paper presents an H2-optimal model order reduction (MOR) method for linear systems with quadratic outputs based on Riemannian optimization. The H2-optimal MOR is formulated as an optimization problem in which the optimization variables…

Optimization and Control · Mathematics 2026-05-12 Xiaolong Wang , Chenglong Liu

The aim in model order reduction is to approximate an input-output map described by a large-scale dynamical system with a low-dimensional and cheaper-to-evaluate reduced order model. While high fidelity can be achieved by a variety of…

Dynamical Systems · Mathematics 2023-01-04 Björn Liljegren-Sailer

We present a numerical algorithm that allows the approximation of optimal controls for stochastic reaction-diffusion equations with additive noise by first reducing the problem to controls of feedback form and then approximating the…

Optimization and Control · Mathematics 2023-09-15 Wilhelm Stannat , Alexander Vogler , Lukas Wessels

A classical reduced order model for dynamical problems involves spatial reduction of the problem size. However, temporal reduction accompanied by the spatial reduction can further reduce the problem size without losing accuracy much, which…

Numerical Analysis · Mathematics 2019-10-04 Youngsoo Choi , Peter Brown , Bill Arrighi , Robert Anderson

Stochastic convex optimization algorithms are the most popular way to train machine learning models on large-scale data. Scaling up the training process of these models is crucial, but the most popular algorithm, Stochastic Gradient Descent…

Machine Learning · Statistics 2018-10-30 Ashok Cutkosky , Robert Busa-Fekete

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

Many relevant problems in the area of systems and control, such as controller synthesis, observer design and model reduction, can be viewed as optimization problems involving dynamical systems: for instance, maximizing performance in the…

Optimization and Control · Mathematics 2023-11-15 Pascal Den Boef , Jos Maubach , Wil Schilders , Nathan van de Wouw

In this paper, we consider model order reduction for bilinear systems with non-zero initial conditions. We discuss choices of Gramians for both the homogeneous and the inhomogeneous parts of the system individually and prove how these…

Numerical Analysis · Mathematics 2022-05-19 Martin Redmann , Igor Pontes Duff

We develop a machine learning algorithm to infer the emergent stochastic equation governing the evolution of an order parameter of a many-body system. We train our neural network to independently learn the directed force acting on the order…

Disordered Systems and Neural Networks · Physics 2024-12-10 Francesco Carnazza , Federico Carollo , Sabine Andergassen , Georg Martius , Miriam Klopotek , Igor Lesanovsky

Kernel embeddings of distributions have recently gained significant attention in the machine learning community as a data-driven technique for representing probability distributions. Broadly, these techniques enable efficient computation of…

Optimization and Control · Mathematics 2021-03-25 Adam J. Thorpe , Meeko M. K. Oishi

An adaptive direct collocation method is developed for solving optimal control problems constrained by parabolic partial differential equations. The partial differential equation is first reformulated in a variational setting, where the…

Optimization and Control · Mathematics 2026-03-18 Alexander M. Davies , Sara Pollock , Miriam E. Dennis , Anil V. Rao

We address the design and synthesis of optimal control strategies for high-dimensional stochastic dynamical systems. Such systems may be deterministic nonlinear systems evolving from random initial states, or systems driven by random…

Numerical Analysis · Mathematics 2020-08-26 Panos Lambrianides , Qi Gong , Daniele Venturi

This paper proposes the first-ever algorithmic framework for tuning hyper-parameters of stochastic optimization algorithm based on reinforcement learning. Hyper-parameters impose significant influences on the performance of stochastic…

Machine Learning · Computer Science 2020-03-11 Haotian Zhang , Jianyong Sun , Zongben Xu

We introduce reduced order methods as an efficient strategy to solve parametrized non-linear and time dependent optimal flow control problems governed by partial differential equations. Indeed, the optimal control problems require a huge…

Numerical Analysis · Mathematics 2023-08-08 Maria Strazzullo , Zakia Zainib , Francesco Ballarin , Gianluigi Rozza

This paper considers stochastic-constrained stochastic optimization where the stochastic constraint is to satisfy that the expectation of a random function is below a certain threshold. In particular, we study the setting where data samples…

Optimization and Control · Mathematics 2026-01-27 Yeongjong Kim , Dabeen Lee

Many engineering processes can be accurately modelled using partial differential equations (PDEs), but high dimensionality and non-convexity of the resulting systems pose limitations on their efficient optimisation. In this work, a model…

Optimization and Control · Mathematics 2024-10-17 Min Tao , Panagiotis Petsagkourakis , Jie Li , Constantinos Theodoropoulos

We study realizable continual linear regression under random task orderings, a common setting for developing continual learning theory. In this setup, the worst-case expected loss after $k$ learning iterations admits a lower bound of…

Machine Learning · Computer Science 2025-10-28 Ran Levinstein , Amit Attia , Matan Schliserman , Uri Sherman , Tomer Koren , Daniel Soudry , Itay Evron