English
Related papers

Related papers: A-optimal Designs under Generalized Linear Models

200 papers

Most systems and learning algorithms optimize average performance or average loss -- one reason being computational complexity. However, many objectives of practical interest are more complex than simply average loss. This arises, for…

Machine Learning · Computer Science 2018-06-05 Daniel Alabi , Nicole Immorlica , Adam Tauman Kalai

We consider the problem of obtaining D-optimal designs for factorial experiments with a binary response and $k$ qualitative factors each at two levels. We obtain a characterization for a design to be locally D-optimal. Based on this…

Statistics Theory · Mathematics 2015-03-19 Jie Yang , Abhyuday Mandal , Dibyen Majumdar

Change point estimation is often formulated as a search for the maximum of a gain function describing improved fits when segmenting the data. Searching through all candidates requires $O(n)$ evaluations of the gain function for an interval…

Methodology · Statistics 2024-11-22 Solt Kovács , Housen Li , Lorenz Haubner , Axel Munk , Peter Bühlmann

We consider the problem of designing experiments for investigating particle in-flight properties in thermal spraying. Observations are available on an extensive design for an initial day and thereafter in limited number for any particular…

Applications · Statistics 2013-12-17 Holger Dette , Laura Hoyden , Sonja Kuhnt , Kirsten Schorning

Datasets with sheer volume have been generated from fields including computer vision, medical imageology, and astronomy whose large-scale and high-dimensional properties hamper the implementation of classical statistical models. To tackle…

Statistics Theory · Mathematics 2023-05-30 Hang Yu , Zhenxing Dou , Zhiwei Chen , Xiaomeng Yan

Many existing methods for constructing optimal split-plot designs, such as D-optimal designs, only focus on minimizing the variances and covariances of the estimation for the fitted model. However, the underlying true model is usually…

Computation · Statistics 2016-08-02 Chang-Yun Lin

$\renewcommand{\Re}{\mathbb{R}}$ We develop a general randomized technique for solving "implic it" linear programming problems, where the collection of constraints are defined implicitly by an underlying ground set of elements. In many…

Computational Geometry · Computer Science 2021-12-24 Timothy M. Chan , Sariel Har-Peled , Mitchell Jones

The first investigation is made of designs for screening experiments where the response variable is approximated by a generalised linear model. A Bayesian information capacity criterion is defined for the selection of designs that are…

Methodology · Statistics 2016-10-27 David C. Woods , James M. McGree , Susan M. Lewis

Bayesian optimal experimental design is a sub-field of statistics focused on developing methods to make efficient use of experimental resources. Any potential design is evaluated in terms of a utility function, such as the (theoretically…

Machine Learning · Computer Science 2022-10-21 Noble Kennamer , Steven Walton , Alexander Ihler

Randomized experiments have been the gold standard for assessing the effectiveness of a treatment or policy. The classical complete randomization approach assigns treatments based on a prespecified probability and may lead to inefficient…

Methodology · Statistics 2023-10-26 Waverly Wei , Xinwei Ma , Jingshen Wang

To fix the 'bias in, bias out' problem in fair machine learning, it is important to steer feature distributions of data or internal representations of Large Language Models (LLMs) to ideal ones that guarantee group-fair outcomes. Previous…

Machine Learning · Computer Science 2025-10-27 Mohit Sharma , Amit Jayant Deshpande , Chiranjib Bhattacharyya , Rajiv Ratn Shah

Linear-parametric optimization, where multiple objectives are combined into a single objective using linear combinations with parameters as coefficients, has numerous links to other fields in optimization and a wide range of application…

Optimization and Control · Mathematics 2025-01-22 Levin Nemesch , Stefan Ruzika , Clemens Thielen , Alina Wittmann

A conditional sampling oracle for a probability distribution D returns samples from the conditional distribution of D restricted to a specified subset of the domain. A recent line of work (Chakraborty et al. 2013 and Cannone et al. 2014)…

Data Structures and Algorithms · Computer Science 2016-08-18 Themistoklis Gouleakis , Christos Tzamos , Manolis Zampetakis

We describe an algorithm that, given any full-rank matrix A having fewer rows than columns, can rapidly compute the orthogonal projection of any vector onto the null space of A, as well as the orthogonal projection onto the row space of A,…

Numerical Analysis · Computer Science 2011-05-26 Vladimir Rokhlin , Mark Tygert

Algorithms often have tunable parameters that impact performance metrics such as runtime and solution quality. For many algorithms used in practice, no parameter settings admit meaningful worst-case bounds, so the parameters are made…

Machine Learning · Computer Science 2021-04-27 Maria-Florina Balcan , Dan DeBlasio , Travis Dick , Carl Kingsford , Tuomas Sandholm , Ellen Vitercik

Unmeasured or latent variables are often the cause of correlations between multivariate measurements, which are studied in a variety of fields such as psychology, ecology, and medicine. For Gaussian measurements, there are classical tools…

Machine Learning · Computer Science 2022-01-28 Łukasz Kidziński , Francis K. C. Hui , David I. Warton , Trevor Hastie

Generalized linear models (GLMs) arise in high-dimensional machine learning, statistics, communications and signal processing. In this paper we analyze GLMs when the data matrix is random, as relevant in problems such as compressed sensing,…

Information Theory · Computer Science 2019-04-01 Jean Barbier , Florent Krzakala , Nicolas Macris , Léo Miolane , Lenka Zdeborová

In this paper, we propose a stochastic search algorithm for solving general optimization problems with little structure. The algorithm iteratively finds high quality solutions by randomly sampling candidate solutions from a parameterized…

Optimization and Control · Mathematics 2013-01-08 Enlu Zhou , Jiaqiao Hu

We present a unified deterministic approach for experimental design problems using the method of interlacing polynomials. Our framework recovers the best-known approximation guarantees for the well-studied D/A/E-design problems with simple…

Data Structures and Algorithms · Computer Science 2024-10-16 Lap Chi Lau , Robert Wang , Hong Zhou

We show how combinatorial optimisation algorithms can be applied to the problem of identifying c-optimal experimental designs when there may be correlation between and within experimental units and evaluate the performance of relevant…

Computation · Statistics 2023-02-24 Samuel I Watson , Yi Pan