English
Related papers

Related papers: Rates of Convergence for Regression with the Graph…

200 papers

In this work, we address the solution of both linear and nonlinear ill-posed inverse problems by developing a novel graph-based regularization framework, where the regularization term is formulated through an iteratively updated graph…

Numerical Analysis · Mathematics 2026-01-21 Harshit Bajpai , Ankik Kumar Giri

Semi-supervised Laplacian regularization, a standard graph-based approach for learning from both labelled and unlabelled data, was recently demonstrated to have an insignificant high dimensional learning efficiency with respect to…

Machine Learning · Computer Science 2020-06-16 Xiaoyi Mai , Romain Couillet

This paper investigates the use of methods from partial differential equations and the Calculus of variations to study learning problems that are regularized using graph Laplacians. Graph Laplacians are a powerful, flexible method for…

Machine Learning · Statistics 2020-06-30 Nicolas Garcia Trillos , Ryan Murray

Time-varying graph signal recovery has been widely used in many applications, including climate change, environmental hazard monitoring, and epidemic studies. It is crucial to choose appropriate regularizations to describe the…

Signal Processing · Electrical Eng. & Systems 2024-05-17 Weihong Guo , Yifei Lou , Jing Qin , Ming Yan

We study a Bayesian approach to estimating a smooth function in the context of regression or classification problems on large graphs. We derive theoretical results that show how asymptotically optimal Bayesian regularization can be achieved…

Statistics Theory · Mathematics 2017-03-07 Alisa Kirichenko , Harry van Zanten

The common graph Laplacian regularizer is well-established in semi-supervised learning and spectral dimensionality reduction. However, as a first-order regularizer, it can lead to degenerate functions in high-dimensional manifolds. The…

Computer Vision and Pattern Recognition · Computer Science 2016-02-12 Kwang In Kim , James Tompkin , Hanspeter Pfister , Christian Theobalt

We investigate a variational method for ill-posed problems, named $\texttt{graphLa+}\Psi$, which embeds a graph Laplacian operator in the regularization term. The novelty of this method lies in constructing the graph Laplacian based on a…

Numerical Analysis · Mathematics 2024-10-22 Davide Bianchi , Davide Evangelista , Stefano Aleotti , Marco Donatelli , Elena Loli Piccolomini , Wenbin Li

We consider the problem of learning a sparse graph under the Laplacian constrained Gaussian graphical models. This problem can be formulated as a penalized maximum likelihood estimation of the Laplacian constrained precision matrix. Like in…

Machine Learning · Computer Science 2023-09-06 Jiaxi Ying , José Vinícius de M. Cardoso , Daniel P. Palomar

Multilayer graphs are appealing mathematical tools for modeling multiple types of relationship in the data. In this paper, we aim at analyzing multilayer graphs by properly combining the information provided by individual layers, while…

Machine Learning · Computer Science 2020-10-30 Mireille El Gheche , Pascal Frossard

We propose a supervised learning approach for predicting an underlying graph from a set of graph signals. Our approach is based on linear regression. In the linear regression model, we predict edge-weights of a graph as the output, given a…

Information Theory · Computer Science 2018-11-06 Arun Venkitaraman , Hermina Petric Maretic , Saikat Chatterjee , Pascal Frossard

The performance of traditional graph Laplacian methods for semi-supervised learning degrades substantially as the ratio of labeled to unlabeled data decreases, due to a degeneracy in the graph Laplacian. Several approaches have been…

Analysis of PDEs · Mathematics 2019-04-03 Jeff Calder , Dejan Slepcev

Bi-stochastic normalization provides an alternative normalization of graph Laplacians in graph-based data analysis and can be computed efficiently by Sinkhorn-Knopp (SK) iterations. This paper proves the convergence of bi-stochastically…

Statistics Theory · Mathematics 2024-07-19 Xiuyuan Cheng , Boris Landa

This paper considers a high-dimensional linear regression problem where there are complex correlation structures among predictors. We propose a graph-constrained regularization procedure, named Sparse Laplacian Shrinkage with the Graphical…

Methodology · Statistics 2019-04-10 Yuehan Yang , Siwei Xia , Hu Yang

In this article, we improve extreme learning machines for regression tasks using a graph signal processing based regularization. We assume that the target signal for prediction or regression is a graph signal. With this assumption, we use…

Machine Learning · Statistics 2018-03-14 Arun Venkitaraman , Saikat Chatterjee , Peter Händel

Sparse models for high-dimensional linear regression and machine learning have received substantial attention over the past two decades. Model selection, or determining which features or covariates are the best explanatory variables, is…

Machine Learning · Statistics 2019-10-15 Yuan Li , Benjamin Mark , Garvesh Raskutti , Rebecca Willett , Hyebin Song , David Neiman

In this paper we study the statistical properties of Laplacian smoothing, a graph-based approach to nonparametric regression. Under standard regularity conditions, we establish upper bounds on the error of the Laplacian smoothing estimator…

Statistics Theory · Mathematics 2021-06-04 Alden Green , Sivaraman Balakrishnan , Ryan J. Tibshirani

Recent developments in deep learning have revolutionized the paradigm of image restoration. However, its applications on real image denoising are still limited, due to its sensitivity to training data and the complex nature of real image…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Jin Zeng , Jiahao Pang , Wenxiu Sun , Gene Cheung

In real-world applications, perfect labels are rarely available, making it challenging to develop robust machine learning algorithms that can handle noisy labels. Recent methods have focused on filtering noise based on the discrepancy…

Machine Learning · Computer Science 2023-08-01 Mingcai Chen , Yuntao Du , Wei Tang , Baoming Zhang , Hao Cheng , Shuwei Qian , Chongjun Wang

High-dimensional data often exhibit dependencies among variables that violate the isotropic-noise assumption under which principal component analysis (PCA) is optimal. For cases where the noise is not independent and identically distributed…

Machine Learning · Computer Science 2026-01-16 Antonio Briola , Marwin Schmidt , Fabio Caccioli , Carlos Ros Perez , James Singleton , Christian Michler , Tomaso Aste

High-dimensional regression often suffers from heavy-tailed noise and outliers, which can severely undermine the reliability of least-squares based methods. To improve robustness, we adopt a non-smooth Wilcoxon score based rank objective…

Machine Learning · Statistics 2026-01-29 Meixia Lin , Meijiao Shi , Yunhai Xiao , Qian Zhang
‹ Prev 1 2 3 10 Next ›