English
Related papers

Related papers: Algorithms and analyses for stochastic optimizatio…

200 papers

Tiering is an essential technique for building large-scale information retrieval systems. While the selection of documents for high priority tiers critically impacts the efficiency of tiering, past work focuses on optimizing it with respect…

Information Retrieval · Computer Science 2020-05-19 Hyokun Yun , Michael Froh , Roshan Makhijani , Brian Luc , Alex Smola , Trishul Chilimbi

This research concerns design optimization problems involving numerous design parameters and large computational models. These problems generally consist in non-convex constrained optimization problems in large and sometimes complex search…

Optimization and Control · Mathematics 2024-12-20 A. Batou

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

We extend the single-stage stellarator coil design approach for quasi-symmetry on axis from [Giuliani et al, 2020] to additionally take into account coil manufacturing errors. By modeling coil errors independently from the coil…

Optimization and Control · Mathematics 2022-05-18 Florian Wechsung , Andrew Giuliani , Matt Landreman , Antoine Cerfon , Georg Stadler

Model predictive controllers use dynamics models to solve constrained optimal control problems. However, computational requirements for real-time control have limited their use to systems with low-dimensional models. Nevertheless,…

Systems and Control · Electrical Eng. & Systems 2024-10-30 Joseph Lorenzetti , Andrew McClellan , Charbel Farhat , Marco Pavone

Turbulent dynamical systems characterized by both a high-dimensional phase space and a large number of instabilities are ubiquitous among many complex systems in science and engineering. The existence of a strange attractor in the turbulent…

Fluid Dynamics · Physics 2018-02-23 Andrew J. Majda , Di Qi

Modern optimisation algorithms are often metaheuristic, and they are very promising in solving NP-hard optimization problems. In this paper, we show how to use the recently developed Firefly Algorithm to solve nonlinear design problems. For…

Optimization and Control · Mathematics 2012-03-30 Xin-She Yang

Aircraft design optimization traditionally relies on computationally expensive simulation techniques such as Finite Element Method (FEM) and Finite Volume Method (FVM), which, while accurate, can significantly slow down the design iteration…

Machine Learning · Computer Science 2026-03-03 Apurba Sarker

Noise is a part of data whether the data is from measurement, experiment or ... A few techniques are suggested for noise reduction to improve the data quality in recent years some of which are based on wavelet, orthogonalization and neural…

Computational Engineering, Finance, and Science · Computer Science 2023-08-02 Negin Bagherpour , Abbas Mohammadiyan

In this paper we propose a modified version of the simulated annealing algorithm for solving a stochastic global optimization problem. More precisely, we address the problem of finding a global minimizer of a function with noisy…

Machine Learning · Statistics 2017-03-02 Clément Bouttier , Ioana Gavra

In this paper, we study pooling downstream beds across specialties in a stochastic operating room planning problem. The main sources of uncertainty are stochastic surgical durations and patients' lengths of stay. We developed a two-stage…

Optimization and Control · Mathematics 2026-02-18 Arian Andam , Hossein Hashemi Doulabi

In transonic turbine stages, complex interactions between trailing edge shocks from nozzle guide vanes and rotor blades generate unsteady wall pressure fields, impacting rotor aerodynamic performance and structural integrity. While…

The problem of monotone submodular maximization has been studied extensively due to its wide range of applications. However, there are cases where one can only access the objective function in a distorted or noisy form because of the…

Data Structures and Algorithms · Computer Science 2022-10-24 Lingxiao Huang , Yuyi Wang , Chunxue Yang , Huanjian Zhou

In this paper, we propose the coarse-to-fine optimization for the task of speech enhancement. Cosine similarity loss [1] has proven to be an effective metric to measure similarity of speech signals. However, due to the large variance of the…

Sound · Computer Science 2019-08-23 Jian Yao , Ahmad Al-Dahle

This paper offers a methodological contribution at the intersection of machine learning and operations research. Namely, we propose a methodology to quickly predict tactical solutions to a given operational problem. In this context, the…

Machine Learning · Computer Science 2022-06-10 Eric Larsen , Sébastien Lachapelle , Yoshua Bengio , Emma Frejinger , Simon Lacoste-Julien , Andrea Lodi

Heavy-tailed stochastic gradient noise, commonly observed in transformer models, can destabilize the optimization process. Recent works mainly focus on developing and understanding approaches to address heavy-tailed noise in the centralized…

Machine Learning · Computer Science 2026-02-23 Junfei Sun , Dixi Yao , Xuchen Gong , Tahseen Rabbani , Manzil Zaheer , Tian Li

We consider the problem of asynchronous stochastic optimization, where an optimization algorithm makes updates based on stale stochastic gradients of the objective that are subject to an arbitrary (possibly adversarial) sequence of delays.…

Optimization and Control · Mathematics 2025-06-23 Amit Attia , Ofir Gaash , Tomer Koren

In this paper, we propose and analyze a trust-region model-based algorithm for solving unconstrained stochastic optimization problems. Our framework utilizes random models of an objective function $f(x)$, obtained from stochastic…

Optimization and Control · Mathematics 2016-09-26 Ruobing Chen , Matt Menickelly , Katya Scheinberg

Motivated by emerging applications in machine learning, we consider an optimization problem in a general form where the gradient of the objective function is available through a biased stochastic oracle. We assume a bias-control parameter…

Optimization and Control · Mathematics 2026-02-10 Yin Liu , Sam Davanloo Tajbakhsh

Model mismatch and process noise are two frequently occurring phenomena that can drastically affect the performance of model predictive control (MPC) in practical applications. We propose a principled way to tune the cost function and the…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Riccardo Zuliani , Efe C. Balta , John Lygeros