English
Related papers

Related papers: Algorithms and analyses for stochastic optimizatio…

200 papers

In this paper, we study the problem of how to optimally steer the state covariance of a general continuous-time linear stochastic system over a finite time interval subject to additive noise. Optimality here means reaching a target state…

Systems and Control · Electrical Eng. & Systems 2023-02-16 Fengjiao Liu , Panagiotis Tsiotras

This paper presents and demonstrates a stochastic logic time delay reservoir design in FPGA hardware. The reservoir network approach is analyzed using a number of metrics, such as kernel quality, generalization rank, performance on simple…

Neural and Evolutionary Computing · Computer Science 2018-09-17 Lisa Loomis , Nathan McDonald , Cory Merkel

The European Union's climate targets challenge the building sector to reduce energy use while ensuring comfort. Ventilation systems play an important role in achieving these goals. During system planning, the primary focus tends to lie on…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Julius H. P. Breuer , Peter F. Pelz

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

We show that asymptotically, completely asynchronous stochastic gradient procedures achieve optimal (even to constant factors) convergence rates for the solution of convex optimization problems under nearly the same conditions required for…

Optimization and Control · Mathematics 2015-08-05 John C. Duchi , Sorathan Chaturapruek , Christopher Ré

This work proposes a framework, embedded within the Performance Estimation framework (PEP), for obtaining worst-case performance guarantees on stochastic first-order methods. Given a first-order method, a function class, and a noise model…

Optimization and Control · Mathematics 2026-01-05 Anne Rubbens , Sébastien Colla , Julien M. Hendrickx

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general…

Machine Learning · Statistics 2012-12-04 Xun Huan , Youssef M. Marzouk

We study a class of stochastic optimal design problems for elliptic partial differential equations in divergence form, where the coefficients represent mixtures of two conducting materials. The objective is to minimize a generalized risk…

Optimization and Control · Mathematics 2026-02-24 Amal Alphonse , Petar Kunštek , Marko Vrdoljak

First-order stochastic methods are the state-of-the-art in large-scale machine learning optimization owing to efficient per-iteration complexity. Second-order methods, while able to provide faster convergence, have been much less explored…

Machine Learning · Statistics 2017-12-01 Naman Agarwal , Brian Bullins , Elad Hazan

Aerodynamic shape optimization has established itself as a valuable tool in the engineering design process to achieve highly efficient results. A central aspect for such approaches is the mapping from the design parameters which encode the…

Computational Engineering, Finance, and Science · Computer Science 2019-10-17 Jakub Kmec , Sebastian Schmitt

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

Numerical Analysis · Mathematics 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond

This paper presents a computationally efficient method for the optimal design of silica aerogel porous material systems, balancing thermal insulation performance with mechanical stability under stress concentrations. The proposed approach…

Computational Engineering, Finance, and Science · Computer Science 2025-04-03 Pratyush Kumar Singh , Danial Faghihi

We study how to safely control nonlinear control-affine systems that are corrupted with bounded non-stochastic noise, i.e., noise that is unknown a priori and that is not necessarily governed by a stochastic model. We focus on safety…

Systems and Control · Electrical Eng. & Systems 2024-12-11 Hongyu Zhou , Yichen Song , Vasileios Tzoumas

In many real-world applications, optimization problems evolve continuously over time and are often subject to stochastic noise. We consider a stochastic time-varying optimization problem in which the objective function $f(x;t)$ changes…

Optimization and Control · Mathematics 2025-12-18 Tomoya Kamijima , Naoki Marumo , Akiko Takeda

We developed a parallel Bayesian optimization algorithm for large eddy simulations. These simulations challenge optimization methods because they take hours or days to compute, and their objective function contains noise as turbulent…

Fluid Dynamics · Physics 2014-11-04 Chaitanya Talnikar , Patrick Blonigan , Julien Bodart , Qiqi Wang

In this paper, we propose a new model reduction technique for linear stochastic systems that builds upon knowledge filtering and utilizes optimal Kalman filtering techniques. This new technique will reduce the dimension of the noise…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Maico Hendrikus Wilhelmus Engelaar , Licio Romao , Yulong Gao , Mircea Lazar , Alessandro Abate , Sofie Haesaert

This paper reports a reduced-order modeling framework of bladed disks on a rotating shaft to simulate the vibration signature of faults like cracks in different components aiming towards simulated data-driven machine learning. We have…

Computational Engineering, Finance, and Science · Computer Science 2022-08-24 Divya Shyam Singh , Atul Agrawal , D. Roy Mahapatra

In analyzing and assessing the condition of dynamical systems, it is necessary to account for nonlinearity. Recent advances in computation have rendered previously computationally infeasible analyses readily executable on common computer…

Computational Engineering, Finance, and Science · Computer Science 2021-09-24 Thomas Simpson , Nikolaos Dervilis , Eleni Chatzi

Stochastic optimization is a vital field in the realm of mathematical optimization, finding applications in diverse areas ranging from operations research to machine learning. In this paper, we introduce a novel first-order optimization…

Optimization and Control · Mathematics 2024-09-17 Vladimir Solodkin , Savelii Chezhegov , Ruslan Nazikov , Aleksandr Beznosikov , Alexander Gasnikov

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang