English
Related papers

Related papers: A unified minimax result for restricted parameter …

200 papers

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered. Kernels and their associated Hilbert spaces are the main formalism employed herein along with an observational model where…

Machine Learning · Computer Science 2022-09-13 Paul Scharnhorst , Emilio T. Maddalena , Yuning Jiang , Colin N. Jones

The inverse covariance matrix provides considerable insight for understanding statistical models in the multivariate setting. In particular, when the distribution over variables is assumed to be multivariate normal, the sparsity pattern in…

Machine Learning · Statistics 2017-10-20 Addison Hu , Sahand Negahban

Algorithms typically come with tunable parameters that have a considerable impact on the computational resources they consume. Too often, practitioners must hand-tune the parameters, a tedious and error-prone task. A recent line of research…

Machine Learning · Computer Science 2020-11-24 Maria-Florina Balcan , Tuomas Sandholm , Ellen Vitercik

We develop refinements of the Levenshtein bound in $q$-ary Hamming spaces by taking into account the discrete nature of the distances versus the continuous behavior of certain parameters used by Levenshtein. The first relevant cases are…

Information Theory · Computer Science 2018-01-09 Peter Boyvalenkov , Danyo Danev , Maya Stoyanova

We introduce several classes of set-valued maps with generalized convexity. We obtain minimax theorems for set-valued maps which satisfy the introduced properties and are not continuous, by using a fixed point theorem for weakly naturally…

Optimization and Control · Mathematics 2015-10-09 Monica Patriche

We show that localisation microscopy of multiple weak, incoherent point sources with possibly different intensities in one spatial dimension is equivalent to estimating the amplitudes of a classical mixture of coherent states of a simple…

Quantum Physics · Physics 2020-02-17 Evangelia Bisketzi , Dominic Branford , Animesh Datta

Matrix completion algorithms recover a low rank matrix from a small fraction of the entries, each entry contaminated with additive errors. In practice, the singular vectors and singular values of the low rank matrix play a pivotal role for…

Methodology · Statistics 2016-05-03 Juhee Cho , Donggyu Kim , Karl Rohe

Structured prediction can be considered as a generalization of many standard supervised learning tasks, and is usually thought as a simultaneous prediction of multiple labels. One standard approach is to maximize a score function on the…

Machine Learning · Computer Science 2021-02-19 Kevin Bello , Asish Ghoshal , Jean Honorio

The field of machine have seen rising applications of equivariance criterion. However, there is no systematic way to justify its usage, including why it works, whether there is an optimal solution and if so, what form it carries. In this…

Statistics Theory · Mathematics 2025-09-23 Daowei Wang , Mian Wu , Haojin Zhou

The spectra of random feature matrices provide essential information on the conditioning of the linear system used in random feature regression problems and are thus connected to the consistency and generalization of random feature models.…

Machine Learning · Statistics 2022-12-13 Zhijun Chen , Hayden Schaeffer , Rachel Ward

We discuss the asymptotic behaviour of models of lattice polygons, mainly on the square lattice. In particular, we focus on limiting area laws in the uniform perimeter ensemble where, for fixed perimeter, each polygon of a given area occurs…

Mathematical Physics · Physics 2014-12-22 Christoph Richard

We study shortest paths and their distances on a subset of a Euclidean space, and their approximation by their equivalents in a neighborhood graph defined on a sample from that subset. In particular, we recover and extend the results of…

Computational Geometry · Computer Science 2018-10-26 Ery Arias-Castro , Thibaut Le Gouic

We develop improved rearrangement algorithms to find the dependence structure that minimizes a convex function of the sum of dependent variables with given margins. We propose a new multivariate dependence measure, which can assess the…

Computation · Statistics 2016-07-14 Carole Bernard , Don McLeish

Probe-level microarray data are usually stored in matrices, where the row and column correspond to array and probe, respectively. Scientists routinely summarize each array by a single index as the expression level of each probe set (gene).…

Applications · Statistics 2010-09-30 Xingdong Feng , Xuming He

We study the optimality of the minimax risk of truncated series estimators for symmetric convex polytopes. We show that the optimal truncated series estimator is within $O(\log m)$ factor of the optimal if the polytope is defined by $m$…

Statistics Theory · Mathematics 2012-01-13 Adel Javanmard , Li Zhang

In two-phase image segmentation, convex relaxation has allowed global minimisers to be computed for a variety of data fitting terms. Many efficient approaches exist to compute a solution quickly. However, we consider whether the nature of…

Numerical Analysis · Mathematics 2018-08-01 Jack Spencer

Linear convergence of first-order methods is typically characterized by global optimization conditions whose constants reflect worst-case geometry of the ambient space. In high-dimensional or structured problems, these global constants can…

Optimization and Control · Mathematics 2026-04-21 Faris Chaudhry , Anthea Monod , Keisuke Yano

This paper addresses challenges in flexibly modeling multimodal data that lie on constrained spaces. Such data are commonly found in spatial applications, such as climatology and criminology, where measurements are restricted to a…

Computation · Statistics 2019-12-03 Putu Ayu Sudyanti , Vinayak Rao

We study the addition of shape constraints (SC) and their consideration during the parameter identification step of symbolic regression (SR). SC serve as a means to introduce prior knowledge about the shape of the otherwise unknown model…

Machine Learning · Computer Science 2024-08-07 Viktor Martinek , Julia Reuter , Ophelia Frotscher , Sanaz Mostaghim , Markus Richter , Roland Herzog

We want to reconstruct a signal based on inhomogeneous data (the amount of data can vary strongly), using the model of regression with a random design. Our aim is to understand the consequences of inhomogeneity on the accuracy of estimation…

Statistics Theory · Mathematics 2016-08-16 Stéphane Gaiffas