English
Related papers

Related papers: Weighted least-squares approximation with determin…

200 papers

We study the following basic machine learning task: Given a fixed set of $d$-dimensional input points for a linear regression problem, we wish to predict a hidden response value for each of the points. We can only afford to attain the…

Machine Learning · Computer Science 2018-06-07 Michał Dereziński , Manfred K. Warmuth

Determinantal point processes (DPPs) are an important concept in random matrix theory and combinatorics. They have also recently attracted interest in the study of numerical methods for machine learning, as they offer an elegant "missing…

Machine Learning · Computer Science 2018-04-18 Philipp Hennig , Roman Garnett

This paper addresses the problem of approximating an unknown function from point evaluations. When obtaining these point evaluations is costly, minimising the required sample size becomes crucial, and it is unreasonable to reserve a…

Numerical Analysis · Mathematics 2025-11-06 Nando Hegemann , Anthony Nouy , Philipp Trunschke

Determinantal Point Processes (DPPs) are popular models for point processes with repulsion. They appear in numerous contexts, from physics to graph theory, and display appealing theoretical properties. On the more practical side of things,…

Statistics Theory · Mathematics 2018-08-22 Simon Barthelmé , Pierre-Olivier Amblard , Nicolas Tremblay

We analyze the accuracy of the discrete least-squares approximation of a function $u$ in multivariate polynomial spaces $\mathbb{P}_\Lambda:={\rm span} \{y\mapsto y^\nu \,: \, \nu\in \Lambda\}$ with $\Lambda\subset \mathbb{N}_0^d$ over the…

Numerical Analysis · Mathematics 2016-10-25 Albert Cohen , Giovanni Migliorati , Fabio Nobile

We study the optimal design problems where the goal is to choose a set of linear measurements to obtain the most accurate estimate of an unknown vector in $d$ dimensions. We study the $A$-optimal design variant where the objective is to…

Data Structures and Algorithms · Computer Science 2018-07-18 Aleksandar Nikolov , Mohit Singh , Uthaipon Tao Tantipongpipat

We study the approximation of a square-integrable function from a finite number of evaluations on a random set of nodes according to a well-chosen distribution. This is particularly relevant when the function is assumed to belong to a…

Machine Learning · Statistics 2024-11-13 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

In this work, we discuss the problem of approximating a multivariate function by discrete least squares projection onto a polynomial space using a specially designed deterministic point set. The independent variables of the function are…

Numerical Analysis · Mathematics 2014-01-07 Tao Zhou , Akil Narayan , Zhiqiang Xu

We propose a randomized lattice algorithm for approximating multivariate periodic functions over the $d$-dimensional unit cube from the weighted Korobov space with mixed smoothness $\alpha > 1/2$ and product weights…

Numerical Analysis · Mathematics 2025-08-26 Mou Cai , Takashi Goda , Yoshihito Kazashi

A determinantal point process (DPP) is an elegant model that assigns a probability to every subset of a collection of $n$ items. While conventionally a DPP is parameterized by a symmetric kernel matrix, removing this symmetry constraint,…

Machine Learning · Computer Science 2022-07-04 Insu Han , Mike Gartrell , Elvis Dohmatob , Amin Karbasi

We exploit the idea to use the maximal-entropy method, successfully tested in information theory and statistical thermodynamics, to determine approximating function's coefficients and squared errors' weights simultaneously as output of one…

Numerical Analysis · Mathematics 2021-03-04 Domenico Giordano , Felice Iavernaro

We consider $L^2$-approximation on weighted reproducing kernel Hilbert spaces of functions depending on infinitely many variables. We focus on unrestricted linear information, admitting evaluations of arbitrary continuous linear…

Numerical Analysis · Mathematics 2026-01-13 Kumar Harsha , Michael Gnewuch , Marcin Wnuk

Determinantal point processes (DPPs) are random point processes well-suited for modeling repulsion. In machine learning, the focus of DPP-based models has been on diverse subset selection from a discrete and finite base set. This discrete…

Machine Learning · Statistics 2013-11-14 Raja Hafiz Affandi , Emily B. Fox , Ben Taskar

A determinantal point process (DPP) is a probabilistic model of set diversity compactly parameterized by a positive semi-definite kernel matrix. To fit a DPP to a given task, we would like to learn the entries of its kernel matrix by…

Machine Learning · Statistics 2014-11-06 Jennifer Gillenwater , Alex Kulesza , Emily Fox , Ben Taskar

A determinantal point process (DPP) on a collection of $M$ items is a model, parameterized by a symmetric kernel matrix, that assigns a probability to every subset of those items. Recent work shows that removing the kernel symmetry…

Machine Learning · Computer Science 2022-04-21 Insu Han , Mike Gartrell , Jennifer Gillenwater , Elvis Dohmatob , Amin Karbasi

Continuous determinantal point processes (DPPs) are a class of repulsive point processes on $\mathbb{R}^d$ with many statistical applications. Although an explicit expression of their density is known, it is too complicated to be used…

Statistics Theory · Mathematics 2022-01-24 Arnaud Poinas , Frédéric Lavancier

Mirror descent value iteration (MDVI), an abstraction of Kullback-Leibler (KL) and entropy-regularized reinforcement learning (RL), has served as the basis for recent high-performing practical RL algorithms. However, despite the use of…

We propose and analyze a weighted greedy scheme for computing deterministic sample configurations in multidimensional space for performing least-squares polynomial approximations on $L^2$ spaces weighted by a probability density function.…

Numerical Analysis · Mathematics 2017-08-07 Ling Guo , Akil Narayan , Liang Yan , Tao Zhou

Determinantal Point Processes (DPPs) provide an elegant and versatile way to sample sets of items that balance the point-wise quality with the set-wise diversity of selected items. For this reason, they have gained prominence in many…

Machine Learning · Statistics 2019-01-09 Zelda Mariet , Yaniv Ovadia , Jasper Snoek

It is known that for a $\rho$-weighted $L_q$-approximation of single variable functions $f$ with the $r$th derivatives in a $\psi$-weighted $L_p$ space, the minimal error of approximations that use $n$ samples of $f$ is proportional to…

Numerical Analysis · Mathematics 2019-07-10 P. Kritzer , F. Pillichshammer , L. Plaskota , G. W. Wasilkowski