English
Related papers

Related papers: Computing optimal experimental designs on finite s…

200 papers

Data flow analysis and optimization is considered for homogeneous rectangular mesh networks. We propose a flow matrix equation which allows a closed-form characterization of the nature of the minimal time solution, speedup and a simple…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-30 Junwei Zhang , Yang Liu , Li Shi , Thomas G. Robertazzi

We study infinite-horizon Discounted Markov Decision Processes (DMDPs) under a generative model. Motivated by the Algorithm with Advice framework Mitzenmacher and Vassilvitskii 2022, we propose a novel framework to investigate how a…

Machine Learning · Computer Science 2025-02-24 Lixing Lyu , Jiashuo Jiang , Wang Chi Cheung

Matching mechanisms play a central role in operations management across diverse fields including education, healthcare, and online platforms. However, experimentally comparing a new matching algorithm against a status quo presents some…

Methodology · Statistics 2026-01-30 Chonghuan Wang

Recent works have proposed optimal subsampling algorithms to improve computational efficiency in large datasets and to design validation studies in the presence of measurement error. Existing approaches generally fall into two categories:…

Methodology · Statistics 2025-12-25 Jasper B. Yang , Thomas Lumley , Bryan E. Shepherd , Pamela A. Shaw

Existing analyses of optimization in deep learning are either continuous, focusing on (variants of) gradient flow, or discrete, directly treating (variants of) gradient descent. Gradient flow is amenable to theoretical analysis, but is…

Machine Learning · Computer Science 2021-12-30 Omer Elkabetz , Nadav Cohen

In this paper we provide a thorough, rigorous theoretical framework to assess optimality guarantees of sampling-based algorithms for drift control systems: systems that, loosely speaking, can not stop instantaneously due to momentum. We…

Robotics · Computer Science 2015-10-28 Edward Schmerling , Lucas Janson , Marco Pavone

We present a unified deterministic approach for experimental design problems using the method of interlacing polynomials. Our framework recovers the best-known approximation guarantees for the well-studied D/A/E-design problems with simple…

Data Structures and Algorithms · Computer Science 2024-10-16 Lap Chi Lau , Robert Wang , Hong Zhou

The last decade witnessed an explosion in the availability of data for operations research applications. Motivated by this growing availability, we propose a novel schema for utilizing data to design uncertainty sets for robust optimization…

Optimization and Control · Mathematics 2014-11-25 Dimitris Bertsimas , Vishal Gupta , Nathan Kallus

A natural optimization model that formulates many online resource allocation and revenue management problems is the online linear program (LP) in which the constraint matrix is revealed column by column along with the corresponding…

Data Structures and Algorithms · Computer Science 2014-04-10 Shipra Agrawal , Zizhuo Wang , Yinyu Ye

The need for fast and robust optimization algorithms are of critical importance in all areas of machine learning. This paper treats the task of designing optimization algorithms as an optimal control problem. Using regret as a metric for an…

Machine Learning · Computer Science 2021-01-21 Philippe Casgrain , Anastasis Kratsios

Optimal experimental design is a classic topic in statistics, with many well-studied problems, applications, and solutions. The design problem we study is the placement of sensors to monitor spatiotemporal processes, explicitly accounting…

Methodology · Statistics 2026-01-05 Daniel Waxman , Fernando Llorente , Katia Lamer , Petar M. Djurić

For a process governed by a linear Ito stochastic differential equation of the form dX(t)=[a(t)+b(t)X(t)]dt + \sigma(t)dW(t) we prove an existence of optimal sampling designs with strictly increasing sampling times. We derive an asymptotic…

Statistics Theory · Mathematics 2013-07-11 V. Lacko

We present a logical framework to represent and reason about stochastic optimization problems based on probability answer set programming. This is established by allowing probability optimization aggregates, e.g., minimum and maximum in the…

Artificial Intelligence · Computer Science 2013-04-15 Emad Saad

Nonlinear regression models addressing both efficacy and toxicity outcomes are increasingly used in dose-finding trials, such as in pharmaceutical drug development. However, research on related experimental design problems for corresponding…

Methodology · Statistics 2016-01-06 Holger Dette , Katrin Kettelhake , Kirsten Schorning , Weng Kee Wong , Frank Bretz

We present a novel methodology for convex optimization algorithm design using ideas from electric RLC circuits. Given an optimization problem, the first stage of the methodology is to design an appropriate electric circuit whose…

Optimization and Control · Mathematics 2025-01-22 Stephen P. Boyd , Tetiana Parshakova , Ernest K. Ryu , Jaewook J. Suh

Complete reliance on the fitted model in response surface experiments is risky and relaxing this assumption, whether out of necessity or intentionally, requires an experimenter to account for multiple conflicting objectives. This work…

Methodology · Statistics 2023-06-16 Olga Egorova , Steven G. Gilmour

We analyze the convergence of gradient-based optimization algorithms that base their updates on delayed stochastic gradient information. The main application of our results is to the development of gradient-based distributed optimization…

Optimization and Control · Mathematics 2011-05-02 Alekh Agarwal , John C. Duchi

In this article a new algorithm for the design of stationary input sequences for system identification is presented. The stationary input signal is generated by optimizing an approximation of a scalar function of the information matrix,…

Optimization and Control · Mathematics 2013-10-18 Patricio E. Valenzuela , Cristian R. Rojas , Håkan Hjalmarsson

Logarithms of determinants of large positive definite matrices appear ubiquitously in machine learning applications including Gaussian graphical and Gaussian process models, partition functions of discrete graphical models, minimum-volume…

Data Structures and Algorithms · Computer Science 2015-03-24 Insu Han , Dmitry Malioutov , Jinwoo Shin

In this work, we present data stream algorithms to compute optimal splits for decision tree learning. In particular, given a data stream of observations \(x_i\) and their corresponding labels \(y_i\), without the i.i.d. assumption, the…

Data Structures and Algorithms · Computer Science 2025-04-18 Huy Pham , Hoang Ta , Hoa T. Vu