English
Related papers

Related papers: Stable Bayesian Optimisation via Direct Stability …

200 papers

The method of stable random projections is a tool for efficiently computing the $l_\alpha$ distances using low memory, where $0<\alpha \leq 2$ is a tuning parameter. The method boils down to a statistical estimation task and various…

Machine Learning · Computer Science 2008-12-18 Ping Li

In this short note we will provide a sufficient and necessary condition to have uniqueness of the location of the maximum of a stochastic process over an interval. The result will also express the mean value of the location in terms of the…

Probability · Mathematics 2013-05-03 Leandro P. R. Pimentel

We consider Bayesian optimization of the output of a network of functions, where each function takes as input the output of its parent nodes, and where the network takes significant time to evaluate. Such problems arise, for example, in…

Machine Learning · Computer Science 2022-01-03 Raul Astudillo , Peter I. Frazier

Long-term reservoir management often uses bounds on the reservoir level, between which the operator can work. However, these bounds are not always kept up-to-date with the latest knowledge about the reservoir drainage area, and thus become…

Optimization and Control · Mathematics 2018-01-29 Thibaut Cuvelier , Pierre Archambeau , Benjamin Dewals , Quentin Louveaux

Many machine learning models require a training procedure based on running stochastic gradient descent. A key element for the efficiency of those algorithms is the choice of the learning rate schedule. While finding good learning rates…

Machine Learning · Statistics 2020-06-26 Victor Picheny , Vincent Dutordoir , Artem Artemev , Nicolas Durrande

The aim of this paper is to address optimality of stochastic control strategies via dynamic programming subject to total variation distance ambiguity on the conditional distribution of the controlled process. We formulate the stochastic…

Optimization and Control · Mathematics 2014-02-06 Ioannis Tzortzis , Charalambos D. Charalambous , Themistoklis Charalambous

We consider the problem of optimizing the steady state of a dynamical system in closed loop. Conventionally, the design of feedback optimization control laws assumes that the system is stationary. However, in reality, the dynamics of the…

Optimization and Control · Mathematics 2020-05-11 Sandeep Menta , Adrian Hauswirth , Saverio Bolognani , Gabriela Hug , Florian Dörfler

Max-stable processes provide natural models for the modelling of spatial extreme values observed at a set of spatial sites. Full likelihood inference for max-stable data is, however, complicated by the form of the likelihood function as it…

Methodology · Statistics 2022-12-15 Patrik Andersson , Alexander Engberg

Bayesian optimization has emerged as a highly effective tool for the safe online optimization of systems, due to its high sample efficiency and noise robustness. To further enhance its efficiency, reduced physical models of the system can…

Machine Learning · Computer Science 2024-06-18 Jannis O. Lübsen , Christian Hespe , Annika Eichler

Motivation: Many biochemical pathways are known, but the numerous parameters required to correctly explore the dynamics of the pathways are not known. For this reason, algorithms that can make inferences by looking at the topology of a…

Molecular Networks · Quantitative Biology 2009-07-23 Deepak Chandran , Herbert M. Sauro

Bayesian Optimization is an effective method for searching the global maxima of an objective function especially if the function is unknown. The process comprises of using a surrogate function and choosing an acquisition function followed…

Machine Learning · Computer Science 2021-11-10 Ashish Anil Pawar , Ujwal Warbhe

Likelihood functions evaluated using particle filters are typically noisy, computationally expensive, and non-differentiable due to Monte Carlo variability. These characteristics make conventional optimization methods difficult to apply…

Methodology · Statistics 2026-01-13 Genshiro Kitagawa

In multivariate or spatial extremes, inference for max-stable processes observed at a large collection of locations is among the most challenging problems in computational statistics, and current approaches typically rely on less expensive…

Computation · Statistics 2015-08-20 Stefano Castruccio , Raphaël Huser , Marc Genton

We consider discrete-time infinite horizon deterministic optimal control problems with nonnegative cost per stage, and a destination that is cost-free and absorbing. The classical linear-quadratic regulator problem is a special case. Our…

Optimization and Control · Mathematics 2017-12-20 Dimitri P. Bertsekas

We study the optimization of the stable marriage problem. All individuals attempt to optimize their own satisfaction, subject to mutually conflicting constraints. We find that the stable solutions are generally not the globally best…

Condensed Matter · Physics 2009-10-30 M. J. Omero , M. Dzierzawa , M. Marsili , Y. -C. Zhang

Stability is an important aspect of a classification procedure because unstable predictions can potentially reduce users' trust in a classification system and also harm the reproducibility of scientific conclusions. The major goal of our…

Machine Learning · Statistics 2017-01-23 Will Wei Sun , Guang Cheng , Yufeng Liu

The process of calibrating computer models of natural phenomena is essential for applications in the physical sciences, where plenty of domain knowledge can be embedded into simulations and then calibrated against real observations. Current…

Machine Learning · Computer Science 2025-01-20 Rafael Oliveira , Dino Sejdinovic , David Howard , Edwin V. Bonilla

Bayesian filtering approximates the true underlying behavior of a time-varying system by inverting an explicit generative model to convert noisy measurements into state estimates. This process typically requires either storage, inversion,…

Machine Learning · Computer Science 2023-11-20 Gianluca M. Bencomo , Jake C. Snell , Thomas L. Griffiths

We show how to perform full likelihood inference for max-stable multivariate distributions or processes based on a stochastic Expectation-Maximisation algorithm, which combines statistical and computational efficiency in high-dimensions.…

Methodology · Statistics 2018-07-17 Raphaël Huser , Clément Dombry , Mathieu Ribatet , Marc G. Genton

An optimal control for a dynamical system optimizes a certain objective function. Here we consider the construction of an optimal control for a stochastic dynamical system with a random structure, Poisson perturbations and random jumps,…

Optimization and Control · Mathematics 2023-01-24 Taras Lukashiv , Yuliia Litvinchuk , Igor Malyk , Anna Golebiewska , Petr V. Nazarov