English
Related papers

Related papers: Asymptotic behavior of $\ell_p$-based Laplacian re…

200 papers

We apply concepts from manifold regularization to develop new regularization techniques for training locally stable deep neural networks. Our regularizers are based on a sparsification of the graph Laplacian which holds with high…

Machine Learning · Statistics 2020-09-24 Charles Jin , Martin Rinard

We propose a supervised learning approach for predicting an underlying graph from a set of graph signals. Our approach is based on linear regression. In the linear regression model, we predict edge-weights of a graph as the output, given a…

Information Theory · Computer Science 2018-11-06 Arun Venkitaraman , Hermina Petric Maretic , Saikat Chatterjee , Pascal Frossard

We explore the ability of overparameterized shallow neural networks to learn Lipschitz regression functions with and without label noise when trained by Gradient Descent (GD). To avoid the problem that in the presence of noisy labels,…

Machine Learning · Computer Science 2023-01-02 Ilja Kuzborskij , Csaba Szepesvári

This paper investigates the use of methods from partial differential equations and the Calculus of variations to study learning problems that are regularized using graph Laplacians. Graph Laplacians are a powerful, flexible method for…

Machine Learning · Statistics 2020-06-30 Nicolas Garcia Trillos , Ryan Murray

We develop a generalized optimization framework for graph-based semi-supervised learning. The framework gives as particular cases the Standard Laplacian, Normalized Laplacian and PageRank based methods. We have also provided new…

Networking and Internet Architecture · Computer Science 2011-10-20 Konstantin Avrachenkov , Paulo Gonçalves , Alexey Mishenin , Marina Sokol

In this paper we study the $L^p$ boundary value problems for $\mathcal{L}(u)=0$ in $\mathbb{R}^{d+1}_+$, where $\mathcal{L}=-\text{div}(A\nabla)$ is a second order elliptic operator with real and symmetric coefficients. Assume that $A$ is…

Analysis of PDEs · Mathematics 2009-08-18 Carlos E. Kenig , Zhongwei Shen

The aim of this paper is to propose a novel framework to infer the sheaf Laplacian, including the topology of a graph and the restriction maps, from a set of data observed over the nodes of a graph. The proposed method is based on sheaf…

Signal Processing · Electrical Eng. & Systems 2025-02-03 Leonardo Di Nino , Sergio Barbarossa , Paolo Di Lorenzo

Unsupervised and self-supervised learning approaches have become a crucial tool to learn representations for downstream prediction tasks. While these approaches are widely used in practice and achieve impressive empirical gains, their…

Machine Learning · Computer Science 2020-10-23 Siddhant Garg , Yingyu Liang

Recent results show that estimates defined by over-parametrized deep neural networks learned by applying gradient descent to a regularized empirical $L_2$ risk are universally consistent and achieve good rates of convergence. In this paper,…

Machine Learning · Statistics 2023-11-27 Selina Drews , Michael Kohler

We present a simple, yet effective, approach to Semi-Supervised Learning. Our approach is based on estimating density-based distances (DBD) using a shortest path calculation on a graph. These Graph-DBD estimates can then be used in any…

Machine Learning · Computer Science 2012-02-20 Avleen S. Bijral , Nathan Ratliff , Nathan Srebro

In this paper, we consider the problem of $\ell_{p}$ norm linear regression, which has several applications such as in sparse recovery, data clustering, and semi-supervised learning. The problem, even though convex, does not enjoy a…

Machine Learning · Computer Science 2021-10-26 R. Jyothi , P. Babu

Lipschitz learning is a graph-based semi-supervised learning method where one extends labels from a labeled to an unlabeled data set by solving the infinity Laplace equation on a weighted graph. In this work we prove uniform convergence…

Numerical Analysis · Mathematics 2023-01-31 Leon Bungert , Jeff Calder , Tim Roith

Graph Semi-Supervised learning is an important data analysis tool, where given a graph and a set of labeled nodes, the aim is to infer the labels to the remaining unlabeled nodes. In this paper, we start by considering an optimization-based…

Machine Learning · Computer Science 2023-09-26 Sara Venturini , Andrea Cristofari , Francesco Rinaldi , Francesco Tudisco

This short note aims at (re)proving that the symmetrically normalized graph Laplacian $L=\Id - D^{-1/2}WD^{-1/2}$ (from a graph defined from a Gaussian weighting kernel on a sampled smooth manifold) converges towards the continuous Manifold…

Differential Geometry · Mathematics 2011-01-10 Laurent Jacques

This paper presents a novel L1-norm semi-supervised learning algorithm for robust image analysis by giving new L1-norm formulation of Laplacian regularization which is the key step of graph-based semi-supervised learning. Since our L1-norm…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Zhiwu Lu , Yuxin Peng

In this work we propose a graph-based learning framework to train models with provable robustness to adversarial perturbations. In contrast to regularization-based approaches, we formulate the adversarially robust learning problem as one of…

Machine Learning · Computer Science 2020-10-26 Vishaal Krishnan , Abed AlRahman Al Makdah , Fabio Pasqualetti

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

Regularizing neural networks is important for anticipating model behavior in regions of the data space that are not well represented. In this work, we propose a regularization technique for enforcing a level of smoothness in the mapping…

Machine Learning · Computer Science 2025-03-05 Ali Hasan , Haoming Yang , Yuting Ng , Vahid Tarokh

We prove upper bounds on the $L^p$ norms of eigenfunctions of the discrete Laplacian on regular graphs. We then apply these ideas to study the $L^p$ norms of joint eigenfunctions of the Laplacian and an averaging operator over a finite…

Spectral Theory · Mathematics 2017-10-31 Shimon Brooks , Etienne Le Masson

Semi-supervised learning, i.e. jointly learning from labeled and unlabeled samples, is an active research topic due to its key role on relaxing human supervision. In the context of image classification, recent advances to learn from…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness