English
Related papers

Related papers: Minimizing Upper Confidence Bounds: A Data-Driven …

200 papers

We propose a novel data-driven stochastic model predictive control framework for uncertain linear systems with noisy output measurements. Our approach leverages multi-step predictors to efficiently propagate uncertainty, ensuring chance…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Haldun Balim , Andrea Carron , Melanie N. Zeilinger , Johannes Köhler

In this work, we consider the fundamental problem of deriving quantitative bounds on the probability that a given assertion is violated in a probabilistic program. We provide automated algorithms that obtain both lower and upper bounds on…

Programming Languages · Computer Science 2020-12-02 Jinyi Wang , Yican Sun , Hongfei Fu , Krishnendu Chatterjee , Amir Kafshdar Goharshady

We present a powerful general framework for designing data-dependent optimization algorithms, building upon and unifying recent techniques in adaptive regularization, optimistic gradient predictions, and problem-dependent randomization. We…

Machine Learning · Statistics 2015-10-14 Mehryar Mohri , Scott Yang

In complex real-world settings, optimization is challenged by the presence of diverse models of differing fidelity. In many optimization problems, a single model is treated as the most accurate representation of the underlying system, while…

Machine Learning · Statistics 2026-05-07 Danielle F. Morey , Giulia Pedrielli , Cherry Y. Wakayama , Zelda B. Zabinsky

Computational capability often falls short when confronted with massive data, posing a common challenge in establishing a statistical model or statistical inference method dealing with big data. While subsampling techniques have been…

Methodology · Statistics 2024-10-31 Yixiao Ruan , Zan Li , Zhaohui Li , Dennis K. J. Lin , Qingpei Hu , Dan Yu

A/B testing refers to the task of determining the best option among two alternatives that yield random outcomes. We provide distribution-dependent lower bounds for the performance of A/B testing that improve over the results currently…

Statistics Theory · Mathematics 2015-02-25 Emilie Kaufmann , Olivier Cappé , Aurélien Garivier

Approximate Bayesian computation (ABC) is one of the most popular "likelihood-free" methods. These methods have been applied in a wide range of fields by providing solutions to intractable likelihood problems in which exact Bayesian…

Methodology · Statistics 2025-04-08 Chaya Weerasinghe , David T. Frazier , Ruben Loaiza-Maya , Christopher Drovandi

Stochastic gradient descent (SGD) or stochastic approximation has been widely used in model training and stochastic optimization. While there is a huge literature on analyzing its convergence, inference on the obtained solutions from SGD…

Machine Learning · Statistics 2026-04-01 Henry Lam , Zitong Wang

Stochastic estimators are fundamental to large-scale optimization, where population quantities must be inferred from noisy oracle observations. Although influential methods such as momentum, SPIDER, STORM, and PAGE have been highly…

Machine Learning · Computer Science 2026-05-18 Zhankun Luo , Antesh Upadhyay , M. Berk Sahin , Sang Bin Moon , Anuran Makur , Abolfazl Hashemi

During recent years the interest of optimization and machine learning communities in high-probability convergence of stochastic optimization methods has been growing. One of the main reasons for this is that high-probability complexity…

Two non-intrusive uncertainty propagation approaches are proposed for the performance analysis of engineering systems described by expensive-to-evaluate deterministic computer models with parameters defined as interval variables. These…

Signal Processing · Electrical Eng. & Systems 2022-02-15 Alice Cicirello , Filippo Giunta

Objectives: Estimation of areas under receiver operating characteristic curves (AUCs) and their differences is a key task in diagnostic studies. We aimed to derive, evaluate, and implement simple sample size formulas for such studies with a…

Methodology · Statistics 2022-08-03 Di Shu , Guangyong Zou

This paper proposes strategies for designing a system whose computational model is subject to aleatory and epistemic uncertainty. Aleatory variables, which are caused by randomness in physical parameters, are draws from a possibly unknown…

Methodology · Statistics 2026-02-18 Luis G. Crespo

Assortment optimization is a fundamental challenge in modern retail and recommendation systems, where the goal is to select a subset of products that maximizes expected revenue under complex customer choice behaviors. While recent advances…

Machine Learning · Statistics 2026-03-11 Miao Lu , Yuxuan Han , Han Zhong , Zhengyuan Zhou , Jose Blanchet

We analyze a simple randomized subgradient method for approximating solutions to stochastic systems of convex functional constraints, the only input to the algorithm being the size of minibatches. By introducing a new notion of what is…

Optimization and Control · Mathematics 2021-08-30 James Renegar , Song Zhou

We consider a multi-period stochastic control problem where the multivariate driving stochastic factor of the system has known marginal distributions but uncertain dependence structure. To solve the problem, we propose to implement the…

Optimization and Control · Mathematics 2022-09-13 Erhan Bayraktar , Tao Chen

A large class of stochastic programs involve optimizing an expectation taken with respect to an underlying distribution that is unknown in practice. One popular approach to addressing the distributional uncertainty, known as the…

Optimization and Control · Mathematics 2017-08-30 Di Wu , Helin Zhu , Enlu Zhou

We study a fundamental stochastic selection problem involving $n$ independent random variables, each of which can be queried at some cost. Given a tolerance level $\delta$, the goal is to find a value that is $\delta$-approximately minimum…

Data Structures and Algorithms · Computer Science 2025-04-25 Hessa Al-Thani , Viswanath Nagarajan

We present a stochastic constrained output-feedback data-driven predictive control scheme for linear time-invariant systems subject to bounded additive disturbances. The approach uses data-driven predictors based on an extension of Willems'…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Johannes Teutsch , Sebastian Kerz , Dirk Wollherr , Marion Leibold

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

Machine Learning · Computer Science 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun