English

Approximation Algorithms for D-optimal Design

Machine Learning 2024-12-06 v3 Data Structures and Algorithms

Abstract

Experimental design is a classical statistics problem and its aim is to estimate an unknown mm-dimensional vector β\beta from linear measurements where a Gaussian noise is introduced in each measurement. For the combinatorial experimental design problem, the goal is to pick kk out of the given nn experiments so as to make the most accurate estimate of the unknown parameters, denoted as β^\hat{\beta}. In this paper, we will study one of the most robust measures of error estimation - DD-optimality criterion, which corresponds to minimizing the volume of the confidence ellipsoid for the estimation error ββ^\beta-\hat{\beta}. The problem gives rise to two natural variants depending on whether repetitions of experiments are allowed or not. We first propose an approximation algorithm with a 1e\frac1e-approximation for the DD-optimal design problem with and without repetitions, giving the first constant factor approximation for the problem. We then analyze another sampling approximation algorithm and prove that it is (1ϵ)(1-\epsilon)-approximation if k4mϵ+12ϵ2log(1ϵ)k\geq \frac{4m}{\epsilon}+\frac{12}{\epsilon^2}\log(\frac{1}{\epsilon}) for any ϵ(0,1)\epsilon \in (0,1). Finally, for DD-optimal design with repetitions, we study a different algorithm proposed by literature and show that it can improve this asymptotic approximation ratio.

Keywords

Cite

@article{arxiv.1802.08372,
  title  = {Approximation Algorithms for D-optimal Design},
  author = {Mohit Singh and Weijun Xie},
  journal= {arXiv preprint arXiv:1802.08372},
  year   = {2024}
}

Comments

34 pages, accepted by Mathematics of Operations Research