English
Related papers

Related papers: Sequential online subsampling for thinning experim…

200 papers

We study the task of high-dimensional entangled mean estimation in the subset-of-signals model. Specifically, given $N$ independent random points $x_1,\ldots,x_N$ in $\mathbb{R}^D$ and a parameter $\alpha \in (0, 1)$ such that each $x_i$ is…

Data Structures and Algorithms · Computer Science 2025-01-10 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Thanasis Pittas

This paper investigates the problem of tracking solutions of stochastic optimization problems with time-varying costs that depend on random variables with decision-dependent distributions. In this context, we propose the use of an online…

Optimization and Control · Mathematics 2021-10-29 Killian Wood , Gianluca Bianchin , Emiliano Dall'Anese

We propose a new approach to solve optimal stopping problems via simulation. Working within the backward dynamic programming/Snell envelope framework, we augment the methodology of Longstaff-Schwartz that focuses on approximating the…

Computational Finance · Quantitative Finance 2015-09-04 Robert B. Gramacy , Mike Ludkovski

Optimal designs are usually model-dependent and likely to be sub-optimal if the postulated model is not correctly specified. In practice, it is common that a researcher has a list of candidate models at hand and a design has to be found…

Statistics Theory · Mathematics 2023-03-29 Mingyao Ai , Holger Dette , Zhengfu Liu , Jun Yu

This work considers the problem of selective-sampling for best-arm identification. Given a set of potential options $\mathcal{Z}\subset\mathbb{R}^d$, a learner aims to compute with probability greater than $1-\delta$, $\arg\max_{z\in…

Machine Learning · Computer Science 2021-11-03 Romain Camilleri , Zhihan Xiong , Maryam Fazel , Lalit Jain , Kevin Jamieson

Data collection costs can vary widely across variables in data science tasks. Two-phase designs can be employed to save data collection costs. This paper considers the two-phase studies where inexpensive variables are collected for all…

Methodology · Statistics 2025-12-04 Ruoyu Wang , Qihua Wang , Wang Miao

Given a sequence of independent random variables with a common continuous distribution, we consider the online decision problem where one seeks to minimize the expected value of the time that is needed to complete the selection of a…

Probability · Mathematics 2016-09-05 Alessandro Arlotto , Elchanan Mossel , J. Michael Steele

We study the optimal design problems where the goal is to choose a set of linear measurements to obtain the most accurate estimate of an unknown vector in $d$ dimensions. We study the $A$-optimal design variant where the objective is to…

Data Structures and Algorithms · Computer Science 2018-07-18 Aleksandar Nikolov , Mohit Singh , Uthaipon Tao Tantipongpipat

Constrained stochastic nonlinear optimization problems have attracted significant attention for their ability to model complex real-world scenarios in physics, economics, and biology. As datasets continue to grow, online inference methods…

Machine Learning · Statistics 2025-05-27 Xinchen Du , Wanrong Zhu , Wei Biao Wu , Sen Na

The quality of numerical reconstructions for unknown parameters in inverse problems depends fundamentally on the selection of experimental data. To ensure a robust reconstruction, it is crucial to select data that are sensitive to the…

Numerical Analysis · Mathematics 2026-04-14 Kathrin Hellmuth , Christian Klingenberg , Qin Li

For biological experiments aiming at calibrating models with unknown parameters, a good experimental design is crucial, especially for those subject to various constraints, such as financial limitations, time consumption and physical…

Applications · Statistics 2014-07-22 Xiao Lin , Gabriel Terejanu

Design of experiments is a fundamental topic in applied statistics with a long history. Yet its application is often limited by the complexity and costliness of constructing experimental designs, which involve searching a high-dimensional…

Methodology · Statistics 2022-03-29 Matthew T. Pratola , C. Devon Lin , Peter F. Craigmile

Let $(Y,X_1,...,X_m)$ be a random vector. It is desired to predict $Y$ based on $(X_1,...,X_m)$. Examples of prediction methods are regression, classification using logistic regression or separating hyperplanes, and so on. We consider the…

Statistics Theory · Mathematics 2007-06-13 Eitan Greenshtein

As stakeholders and policy makers increasingly rely upon quantitative predictions from advanced computational models, a problem of fundamental importance is the quantification and reduction of uncertainties in both model inputs and output…

Numerical Analysis · Mathematics 2016-01-26 Scott Walsh

We develop a novel iterative algorithm for locally optimal experimental design under constraints, like budget or performance constraints. It is an adaptive discretization algorithm. In every iteration, a discretized version of the…

Optimization and Control · Mathematics 2026-04-21 Jochen Schmid , Philipp Seufert , Jan Schwientek , Tobias Seidel , Karl-Heinz Küfer

We propose an extended method for experiment design in nonlinear state space models. The proposed input design technique optimizes a scalar cost function of the information matrix, by computing the optimal stationary probability mass…

Optimization and Control · Mathematics 2015-09-03 Patricio E. Valenzuela , Johan Dahlin , Cristian R. Rojas , Thomas B. Schön

Stochastic optimization naturally arises in machine learning. Efficient algorithms with provable guarantees, however, are still largely missing, when the objective function is nonconvex and the data points are dependent. This paper studies…

Machine Learning · Computer Science 2018-10-02 Minshuo Chen , Lin Yang , Mengdi Wang , Tuo Zhao

We consider the problem where an active Decision-Maker (DM) is tasked to identify the true hypothesis using as few samples as possible while maintaining accuracy. The DM collects samples according to its determined actions and knows the…

Information Theory · Computer Science 2025-10-01 George Vershinin , Asaf Cohen , Omer Gurewitz

In optimal experimental design, the objective is to select a limited set of experiments that maximizes information about unknown model parameters based on factor levels. This work addresses the generalized D-optimal design problem, allowing…

Data Structures and Algorithms · Computer Science 2024-11-05 Aditya Pillai , Gabriel Ponte , Marcia Fampa , Jon Lee , and Mohit Singh , Weijun Xie

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

Optimization and Control · Mathematics 2020-10-01 Iman Shames , Farhad Farokhi