English
Related papers

Related papers: Low rank estimation of smooth kernels on graphs

200 papers

We propose a unified framework for estimating low-rank matrices through nonconvex optimization based on gradient descent algorithm. Our framework is quite general and can be applied to both noisy and noiseless observations. In the general…

Machine Learning · Statistics 2016-10-18 Lingxiao Wang , Xiao Zhang , Quanquan Gu

Comparing multivariate yield quality distributions across spatially referenced agricultural fields is complicated by two pervasive features: non-normality and spatial autocorrelation. Classical procedures such as ANOVA, MANOVA, and standard…

Methodology · Statistics 2026-03-03 Marco Mandap

We introduce the first graph kernels for metric graphs via tropical algebraic geometry. In contrast to conventional graph kernels based on graph combinatorics such as nodes, edges, and subgraphs, our metric graph kernels are purely based on…

Machine Learning · Computer Science 2026-01-30 Yueqi Cao , Anthea Monod

The $L\_2$-minimax risk in Sobolev classes of densities with non-integer smoothness index is shown to have an analog form to that in integer Sobolev classes. To this end, the notion of Sobolev classes is generalized to fractional…

Statistics Theory · Mathematics 2007-06-13 Clementine Dalelane

The Connected Vertex Cover problem, where the goal is to compute a minimum set of vertices in a given graph which forms a vertex cover and induces a connected subgraph, is a fundamental combinatorial problem and has received extensive…

Data Structures and Algorithms · Computer Science 2020-04-30 Diptapriyo Majumdar , M. S. Ramanujan , Saket Saurabh

In this paper, we are interested in learning the underlying graph structure behind training data. Solving this basic problem is essential to carry out any graph signal processing or machine learning task. To realize this, we assume that the…

Machine Learning · Computer Science 2018-05-08 Sundeep Prabhakar Chepuri , Sijia Liu , Geert Leus , Alfred O. Hero

Learning rates for least-squares regression are typically expressed in terms of $L_2$-norms. In this paper we extend these rates to norms stronger than the $L_2$-norm without requiring the regression function to be contained in the…

Machine Learning · Statistics 2020-10-27 Simon Fischer , Ingo Steinwart

In the context of statistical supervised learning, the noiseless linear model assumes that there exists a deterministic linear relation $Y = \langle \theta_*, X \rangle$ between the random output $Y$ and the random feature vector $\Phi(U)$,…

Machine Learning · Computer Science 2020-10-28 Raphaël Berthier , Francis Bach , Pierre Gaillard

In this article, we consider the problem of testing whether two latent position random graphs are correlated. We propose a test statistic based on the kernel method and introduce the estimation procedure based on the spectral decomposition…

Methodology · Statistics 2023-03-21 Xiaoyi Wen , Junhui Wang , Liping Zhu

We prove rates of convergence in the statistical sense for kernel-based least squares regression using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is directly related…

Statistics Theory · Mathematics 2010-09-30 Gilles Blanchard , Nicole Kraemer

We consider in this paper the multivariate regression problem, when the target regression matrix $A$ is close to a low rank matrix. Our primary interest in on the practical case where the variance of the noise is unknown. Our main…

Statistics Theory · Mathematics 2011-06-24 Christophe Giraud

A kernel based procedure for correcting experimental data for distortions due to the finite resolution and limited detector acceptance is presented. The unfolding problem is known to be an ill-posed problem that can not be solved without…

Data Analysis, Statistics and Probability · Physics 2012-09-19 N. D. Gagunashvili , M. Schmelling

We introduce a new regression problem which we call the Sum-Based Hierarchical Smoothing problem. Given a directed acyclic graph and a non-negative value, called target value, for each vertex in the graph, we wish to find non-negative…

Data Structures and Algorithms · Computer Science 2011-08-09 Siavosh Benabbas , Hyun Chul Lee , Joel Oren , Yuli Ye

We study the following two fixed-cardinality optimization problems (a maximization and a minimization variant). For a fixed $\alpha$ between zero and one we are given a graph and two numbers $k \in \mathbb{N}$ and $t \in \mathbb{Q}$. The…

Data Structures and Algorithms · Computer Science 2022-10-20 Tomohiro Koana , Christian Komusiewicz , André Nichterlein , Frank Sommer

The nonnegative rank of a nonnegative matrix is the minimum number of nonnegative rank-one factors needed to reconstruct it exactly. The problem of determining this rank and computing the corresponding nonnegative factors is difficult;…

Optimization and Control · Mathematics 2012-08-30 Nicolas Gillis , François Glineur

For the past 30 years or so, machine learning has stimulated a great deal of research in the study of approximation capabilities (expressive power) of a multitude of processes, such as approximation by shallow or deep neural networks,…

Machine Learning · Computer Science 2025-01-07 Hrushikesh Mhaskar

We construct a kernel density estimator on symmetric spaces of non-compact type and establish an upper bound for its convergence rate, analogous to the minimax rate for classical kernel density estimators on Euclidean space. Symmetric…

Statistics Theory · Mathematics 2022-06-30 Dena Marie Asta

We propose a spherical kernel for efficient graph convolution of 3D point clouds. Our metric-based kernels systematically quantize the local 3D space to identify distinctive geometric relationships in the data. Similar to the regular grid…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Huan Lei , Naveed Akhtar , Ajmal Mian

This paper tackles the problem of selecting among several linear estimators in non-parametric regression; this includes model selection for linear regression, the choice of a regularization parameter in kernel ridge regression, spline…

Statistics Theory · Mathematics 2011-09-15 Sylvain Arlot , Francis Bach

A vertex ranking of a graph is an assignment of ranks (or colors) to the vertices of the graph, in such a way that any simple path connecting two vertices of equal rank, must contain a vertex of a higher rank. In this paper we study a…

Combinatorics · Mathematics 2016-09-21 Ilan Karpas , Ofer Neiman , Shakhar Smorodinsky