English
Related papers

Related papers: Estimating a smooth function on a large graph by B…

200 papers

In this paper we study the statistical properties of Laplacian smoothing, a graph-based approach to nonparametric regression. Under standard regularity conditions, we establish upper bounds on the error of the Laplacian smoothing estimator…

Statistics Theory · Mathematics 2021-06-04 Alden Green , Sivaraman Balakrishnan , Ryan J. Tibshirani

We provide a theoretical analysis of the representation learning problem aimed at learning the latent variables (design matrix) $\Theta$ of observations $Y$ with the knowledge of the coefficient matrix $X$. The design matrix is learned…

Machine Learning · Computer Science 2019-02-12 Kaige Yang , Xiaowen Dong , Laura Toni

We present a Bayesian perspective on quantifying the uncertainty of graph signals estimated or reconstructed from imperfect observations. We show that many conventional methods of graph signal estimation, reconstruction and imputation, can…

Signal Processing · Electrical Eng. & Systems 2025-05-22 Lennard Rompelberg , Michael T. Schaub

We consider the problem of estimating a smooth functional of an unknown signal with discontinuity from Gaussian observations. The signal is a known function that depends on an unknown parameter. This problem is closely related to the famous…

Statistics Theory · Mathematics 2011-12-19 Farida Enikeeva

Existing approaches to analyzing the asymptotics of graph Laplacians typically assume a well-behaved kernel function with smoothness assumptions. We remove the smoothness assumption and generalize the analysis of graph Laplacians to include…

Machine Learning · Statistics 2011-01-31 Daniel Ting , Ling Huang , Michael Jordan

We tackle the network topology inference problem by utilizing Laplacian constrained Gaussian graphical models, which recast the task as estimating a precision matrix in the form of a graph Laplacian. Recent research \cite{ying2020nonconvex}…

Machine Learning · Computer Science 2023-09-06 Jiaxi Ying , Xi Han , Rui Zhou , Xiwen Wang , Hing Cheung So

Laplacian regularized stratified models (LRSM) are models that utilize the explicit or implicit network structure of the sub-problems as defined by the categorical features called strata (e.g., age, region, time, forecast horizon, etc.),…

Machine Learning · Statistics 2023-05-05 Ziheng Cheng , Junzi Zhang , Akshay Agrawal , Stephen Boyd

This paper presents a novel Bayesian strategy for the estimation of smooth signals corrupted by Gaussian noise. The method assumes a smooth evolution of a succession of continuous signals that can have a numerical or an analytical…

Applications · Statistics 2016-02-12 Abderrahim Halimi , Gerald S. Buller , Steve McLaughlin , Paul Honeine

We consider Bayesian optimization of the output of a network of functions, where each function takes as input the output of its parent nodes, and where the network takes significant time to evaluate. Such problems arise, for example, in…

Machine Learning · Computer Science 2022-01-03 Raul Astudillo , Peter I. Frazier

A regularized optimization problem over a large unstructured graph is studied, where the regularization term is tied to the graph geometry. Typical regularization examples include the total variation and the Laplacian regularizations over…

Optimization and Control · Mathematics 2017-12-20 Adil Salim , Pascal Bianchi , Walid Hachem

How to obtain a graph from data samples is an important problem in graph signal processing. One way to formulate this graph learning problem is based on Gaussian maximum likelihood estimation, possibly under particular topology constraints.…

Signal Processing · Electrical Eng. & Systems 2017-11-02 Keng-Shih Lu , Antonio Ortega

Current methods for regularization in machine learning require quite specific model assumptions (e.g. a kernel shape) that are not derived from prior knowledge about the application, but must be imposed merely to make the method work. We…

Machine Learning · Statistics 2022-11-01 Matthias Wieler

Multiple generalized additive models (GAMs) are a type of distributional regression wherein parameters of probability distributions depend on predictors through smooth functions, with selection of the degree of smoothness via $L_2$…

Machine Learning · Statistics 2018-09-26 Yousra El-Bachir , Anthony C. Davison

Bi-stochastic normalization provides an alternative normalization of graph Laplacians in graph-based data analysis and can be computed efficiently by Sinkhorn-Knopp (SK) iterations. This paper proves the convergence of bi-stochastically…

Statistics Theory · Mathematics 2024-07-19 Xiuyuan Cheng , Boris Landa

Given a weighted graph with $N$ vertices, consider a real-valued regression problem in a semi-supervised setting, where one observes $n$ labeled vertices, and the task is to label the remaining ones. We present a theoretical study of…

Machine Learning · Computer Science 2016-03-03 Ahmed El Alaoui , Xiang Cheng , Aaditya Ramdas , Martin J. Wainwright , Michael I. Jordan

Let $\mathbf{x}_j = \mathbf{\theta} + \mathbf{\epsilon}_j$, $j=1,\dots,n$ be i.i.d. copies of a Gaussian random vector $\mathbf{x}\sim\mathcal{N}(\mathbf{\theta},\mathbf{\Sigma})$ with unknown mean $\mathbf{\theta} \in \mathbb{R}^d$ and…

Statistics Theory · Mathematics 2020-12-23 Fan Zhou , Ping Li

Many imaging problems require solving an inverse problem that is ill-conditioned or ill-posed. Imaging methods typically address this difficulty by regularising the estimation problem to make it well-posed. This often requires setting the…

Methodology · Statistics 2020-08-17 Ana F. Vidal , Valentin De Bortoli , Marcelo Pereyra , Alain Durmus

This paper proposes the estimation of a smooth graphon model for network data analysis using principles of the EM algorithm. The approach considers both variability with respect to ordering the nodes of a network and smooth estimation of…

Methodology · Statistics 2021-09-16 Benjamin Sischka , Göran Kauermann

This paper investigates the use of methods from partial differential equations and the Calculus of variations to study learning problems that are regularized using graph Laplacians. Graph Laplacians are a powerful, flexible method for…

Machine Learning · Statistics 2020-06-30 Nicolas Garcia Trillos , Ryan Murray

We investigate a variational method for ill-posed problems, named $\texttt{graphLa+}\Psi$, which embeds a graph Laplacian operator in the regularization term. The novelty of this method lies in constructing the graph Laplacian based on a…

Numerical Analysis · Mathematics 2024-10-22 Davide Bianchi , Davide Evangelista , Stefano Aleotti , Marco Donatelli , Elena Loli Piccolomini , Wenbin Li