English
Related papers

Related papers: Minimizing Upper Confidence Bounds: A Data-Driven …

200 papers

We propose a new method to approximate the posterior distribution of probabilistic programs by means of computing guaranteed bounds. The starting point of our work is an interval-based trace semantics for a recursive, higher-order…

Programming Languages · Computer Science 2022-06-07 Raven Beutner , Luke Ong , Fabian Zaiser

The paper considers the problem of global optimization in the setup of stochastic process bandits. We introduce an UCB algorithm which builds a cascade of discretization trees based on generic chaining in order to render possible his…

Machine Learning · Statistics 2016-02-22 Emile Contal , Nicolas Vayatis

Upper Confidence Bound (UCB) is arguably the most commonly used method for linear multi-arm bandit problems. While conceptually and computationally simple, this method highly relies on the confidence bounds, failing to strike the optimal…

Machine Learning · Computer Science 2020-06-05 Kaige Yang , Laura Toni

Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with…

Machine Learning · Statistics 2026-03-24 Wanrong Zhu , Zhipeng Lou , Ziyang Wei , Wei Biao Wu

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

Machine Learning · Computer Science 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

Confidence bounds are an essential tool for rigorously quantifying the uncertainty of predictions. They are a core component in many sequential learning and decision-making algorithms, with tighter confidence bounds giving rise to…

Machine Learning · Statistics 2024-11-12 Hamish Flynn , David Reeb

This work presents a new Distributionally Robust Optimization approach, using $p$-Wasserstein metrics, to analyze a stochastic program in a general context. The ambiguity set in this approach depends on the decision variable and is…

Optimization and Control · Mathematics 2023-03-08 Diego Fonseca , Mauricio Junca

Approximate Bayesian computing is a powerful likelihood-free method that has grown increasingly popular since early applications in population genetics. However, complications arise in the theoretical justification for Bayesian inference…

Computation · Statistics 2018-12-03 Suzanne Thornton , Wentao Li , Min-ge Xie

Two-stage stochastic optimization is a framework for modeling uncertainty, where we have a probability distribution over possible realizations of the data, called scenarios, and decisions are taken in two stages: we make first-stage…

Data Structures and Algorithms · Computer Science 2023-10-25 Andre Linhares , Chaitanya Swamy

Stochastic constraints, which incorporate both deterministic parameters and random variables, extend classical deterministic constraints by explicitly accounting for uncertainty. These constraints are increasingly prevalent in data science,…

Logic in Computer Science · Computer Science 2026-04-21 Xiakun Li , Hao Wu , Bican Xia , Tengshun Yang , Naijun Zhan

Topology optimization under uncertainty (TOuU) often defines objectives and constraints by statistical moments of geometric and physical quantities of interest. Most traditional TOuU methods use gradient-based optimization algorithms and…

Optimization and Control · Mathematics 2019-11-05 Subhayan De , Jerrad Hampton , Kurt Maute , Alireza Doostan

Providing safety guarantees for stochastic dynamical systems is a central problem in various fields, including control theory, machine learning, and robotics. Existing methods either employ Stochastic Barrier Functions (SBFs) or rely on…

Systems and Control · Electrical Eng. & Systems 2025-05-27 Luca Laurenti , Morteza Lahijanian

In this paper, we study stochastic optimization of areas under precision-recall curves (AUPRC), which is widely used for combating imbalanced classification tasks. Although a few methods have been proposed for maximizing AUPRC, stochastic…

Machine Learning · Computer Science 2022-03-07 Guanghui Wang , Ming Yang , Lijun Zhang , Tianbao Yang

We introduce two data-driven procedures for optimal estimation and inference in nonparametric models using instrumental variables. The first is a data-driven choice of sieve dimension for a popular class of sieve two-stage least squares…

Econometrics · Economics 2024-01-09 Xiaohong Chen , Timothy Christensen , Sid Kankanala

We consider what we call the offline-to-online learning setting, focusing on stochastic finite-armed bandit problems. In offline-to-online learning, a learner starts with offline data collected from interactions with an unknown environment…

Machine Learning · Computer Science 2025-03-11 Flore Sentenac , Ilbin Lee , Csaba Szepesvari

We consider finite horizon reach-avoid problems for discrete time stochastic systems. Our goal is to construct upper bound functions for the reach-avoid probability by means of tractable convex optimization problems. We achieve this by…

Optimization and Control · Mathematics 2015-06-11 Nikolaos Kariotoglou , Maryam Kamgarpour , Tyler H. Summers , John Lygeros

Distributional ambiguity sets provide quantifiable ways to characterize the uncertainty about the true probability distribution of random variables of interest. This makes them a key element in data-driven robust optimization by exploiting…

Optimization and Control · Mathematics 2019-09-26 Dimitris Boskos , Jorge Cortés , Sonia Martínez

We propose a data-driven technique to automatically learn contextual uncertainty sets in robust optimization, resulting in excellent worst-case and average-case performance while also guaranteeing constraint satisfaction. Our method…

Optimization and Control · Mathematics 2025-06-25 Irina Wang , Bart Van Parys , Bartolomeo Stellato

In this paper, we develop efficient randomized algorithms for estimating probabilistic robustness margin and constructing robustness degradation curve for uncertain dynamic systems. One remarkable feature of these algorithms is their…

Optimization and Control · Mathematics 2008-05-13 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

Stochastic dominance serves as a general framework for modeling a broad spectrum of decision preferences under uncertainty, with risk aversion as one notable example, as it naturally captures the intrinsic structure of the underlying…

Machine Learning · Computer Science 2026-01-06 Shicong Cen , Jincheng Mei , Hanjun Dai , Dale Schuurmans , Yuejie Chi , Bo Dai