English
Related papers

Related papers: Sequential online subsampling for thinning experim…

200 papers

While experimental design often focuses on selecting the single best alternative from a finite set (e.g., in ranking and selection or best-arm identification), many pure-exploration problems pursue richer goals. Given a specific goal,…

Machine Learning · Statistics 2025-05-28 Chao Qin , Wei You

High dimensional data reduction techniques are provided by using partial least squares within deep learning. Our framework provides a nonlinear extension of PLS together with a disciplined approach to feature selection and architecture…

Methodology · Statistics 2021-06-29 Nicholas Polson , Vadim Sokolov , Jianeng Xu

This paper is concerned with the following problem: given an upper bound of the state-space dimension and lag of a linear time-invariant system, design a sequence of inputs so that the system dynamics can be recovered from the resulting…

Optimization and Control · Mathematics 2024-07-18 M. Kanat Camlibel , Henk J. van Waarde , Paolo Rapisarda

This paper describes three methods for carrying out non-asymptotic inference on partially identified parameters that are solutions to a class of optimization problems. Applications in which the optimization problems arise include estimation…

Methodology · Statistics 2022-12-02 Joel L. Horowitz , Sokbae Lee

Iterative trajectory optimization techniques for non-linear dynamical systems are among the most powerful and sample-efficient methods of model-based reinforcement learning and approximate optimal control. By leveraging time-variant local…

Systems and Control · Electrical Eng. & Systems 2019-08-01 Onur Celik , Hany Abdulsamad , Jan Peters

We prove two lower bounds for the complexity of non-log-concave sampling within the framework of Balasubramanian et al. (2022), who introduced the use of Fisher information (FI) bounds as a notion of approximate first-order stationarity in…

Machine Learning · Statistics 2022-10-07 Sinho Chewi , Patrik Gerber , Holden Lee , Chen Lu

We formulate a novel approach to solve a class of stochastic problems, referred to as data-consistent inverse (DCI) problems, which involve the characterization of a probability measure on the parameters of a computational model whose…

Numerical Analysis · Mathematics 2024-04-19 Kirana Bergstrom , Troy Butler , Tim Wildey

In offline model-based optimization, we strive to maximize a black-box objective function by only leveraging a static dataset of designs and their scores. This problem setting arises in numerous fields including the design of materials,…

Computational Engineering, Finance, and Science · Computer Science 2023-03-07 Can Chen , Yingxue Zhang , Jie Fu , Xue Liu , Mark Coates

The increasing recognition of the association between adverse human health conditions and many environmental substances as well as processes has led to the need to monitor them. An important problem that arises in environmental statistics…

Applications · Statistics 2020-02-05 Yu Wang , Nhu D. Le , James V. Zidek

Estimation frameworks for statistical inference are preferred to hypothesis testing when quantifying uncertainty and precise estimation are more valuable than binary decisions about statistical significance. Study design for…

Methodology · Statistics 2025-10-29 Luke Hagar , Nathaniel T. Stevens

Compressed sensing applied to magnetic resonance imaging (MRI) allows to reduce the scanning time by enabling images to be reconstructed from highly undersampled data. In this paper, we tackle the problem of designing a sampling mask for an…

Image and Video Processing · Electrical Eng. & Systems 2020-03-17 Thomas Sanchez , Baran Gözcü , Ruud B. van Heeswijk , Armin Eftekhari , Efe Ilıcak , Tolga Çukur , Volkan Cevher

We consider the setting of vector valued non-linear dynamical systems $X_{t+1} = \phi(A^* X_t) + \eta_t$, where $\eta_t$ is unbiased noise and $\phi : \mathbb{R} \to \mathbb{R}$ is a known link function that satisfies certain {\em…

Machine Learning · Computer Science 2021-12-03 Prateek Jain , Suhas S Kowshik , Dheeraj Nagaraj , Praneeth Netrapalli

The design of multiple experiments is commonly undertaken via suboptimal strategies, such as batch (open-loop) design that omits feedback or greedy (myopic) design that does not account for future effects. This paper introduces new…

Methodology · Statistics 2016-04-29 Xun Huan , Youssef M. Marzouk

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

We study sample average approximations (SAA) of chance constrained programs. SAA methods typically approximate the actual distribution in the chance constraint using an empirical distribution constructed from random samples assumed to be…

Optimization and Control · Mathematics 2022-05-13 Shuhao Yan , Francesca Parise , Eilyan Bitar

We propose an algorithm for an optimal adaptive selection of points from the design domain of input random variables that are needed for an accurate estimation of failure probability and the determination of the boundary between safe and…

Computational Engineering, Finance, and Science · Computer Science 2023-06-30 Aleksei Gerasimov , Miroslav Vořechovský

In this article, recent results about point processes are used in sampling theory. Precisely, we define and study a new class of sampling designs: determinantal sampling designs. The law of such designs is known, and there exists a simple…

Methodology · Statistics 2025-08-27 Vincent Loonis , Xavier Mary

Contextual online decision-making problems with constraints appear in a wide range of real-world applications, such as adaptive experimental design under safety constraints, personalized recommendation with resource limits, and dynamic…

Machine Learning · Statistics 2025-05-23 Haichen Hu , David Simchi-Levi , Navid Azizan

This work presents a new algorithm for empirical risk minimization. The algorithm bridges the gap between first- and second-order methods by computing a search direction that uses a second-order-type update in one subspace, coupled with a…

Optimization and Control · Mathematics 2020-06-09 Majid Jahani , Mohammadreza Nazari , Rachael Tappenden , Albert S. Berahas , Martin Takáč

We propose a general methodology of sequential locally optimal design of experiments for explicit or implicit nonlinear models, as they abound in chemical engineering and, in particular, in vapor-liquid equilibrium modeling. As a sequential…

Optimization and Control · Mathematics 2024-03-15 Martin Bubel , Jochen Schmid , Volodymyr Kozachynskyi , Erik Esche , Michael Bortz