English
Related papers

Related papers: Graph Laplacian assisted regularization method und…

200 papers

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

Artificial Intelligence · Computer Science 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent

We introduce a graph renormalization procedure based on the coarse-grained Laplacian, which generates reduced-complexity representations for characteristic scales identified through the spectral gap. This method retains both diffusion…

Statistical Mechanics · Physics 2024-11-20 M. Schmidt , F. Caccioli , T. Aste

Capturing complex high-order interactions among data is an important task in many scenarios. A common way to model high-order interactions is to use hypergraphs whose topology can be mathematically represented by tensors. Existing methods…

Machine Learning · Computer Science 2021-02-22 Ruyuan Qu , Jiaqi He , Hui Feng , Chongbin Xu , Bo Hu

Regularization is a powerful technique for extracting useful information from noisy data. Typically, it is implemented by adding some sort of norm constraint to an objective function and then exactly optimizing the modified objective…

Data Structures and Algorithms · Computer Science 2011-04-28 Michael W. Mahoney , Lorenzo Orecchia

Graphs are fundamental mathematical structures used in various fields to represent data, signals and processes. In this paper, we propose a novel framework for learning/estimating graphs from data. The proposed framework includes (i)…

Machine Learning · Computer Science 2017-07-07 Hilmi E. Egilmez , Eduardo Pavez , Antonio Ortega

Many imaging problems require solving an inverse problem that is ill-conditioned or ill-posed. Imaging methods typically address this difficulty by regularising the estimation problem to make it well-posed. This often requires setting the…

Methodology · Statistics 2020-08-17 Ana F. Vidal , Valentin De Bortoli , Marcelo Pereyra , Alain Durmus

The aim of this paper is to propose a novel framework to infer the sheaf Laplacian, including the topology of a graph and the restriction maps, from a set of data observed over the nodes of a graph. The proposed method is based on sheaf…

Signal Processing · Electrical Eng. & Systems 2025-02-03 Leonardo Di Nino , Sergio Barbarossa , Paolo Di Lorenzo

The graph Laplacian regularization term is usually used in semi-supervised representation learning to provide graph structure information for a model $f(X)$. However, with the recent popularity of graph neural networks (GNNs), directly…

Machine Learning · Computer Science 2020-12-22 Han Yang , Kaili Ma , James Cheng

Graph signal processing (GSP) is a prominent framework for analyzing signals on non-Euclidean domains. The graph Fourier transform (GFT) uses the combinatorial graph Laplacian matrix to reveal the spectral decomposition of signals in the…

Machine Learning · Computer Science 2024-06-13 Changhao Shi , Gal Mishne

In the graph signal processing (GSP) literature, it has been shown that signal-dependent graph Laplacian regularizer (GLR) can efficiently promote piecewise constant (PWC) signal reconstruction for various image restoration tasks. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-06-21 Fei Chen , Gene Cheung , Xue Zhang

Graph-based semi-supervised learning is one of the most popular methods in machine learning. Some of its theoretical properties such as bounds for the generalization error and the convergence of the graph Laplacian regularizer have been…

Machine Learning · Statistics 2019-04-12 Chengan Du , Yunpeng Zhao , Feng Wang

The choice of a suitable regularization parameter is an important part of most regularization methods for inverse problems. In the absence of reliable estimates of the noise level, heuristic parameter choice rules can be used to accomplish…

Numerical Analysis · Mathematics 2022-05-23 Simon Hubmer , Ekaterina Sherina , Stefan Kindermann , Kemal Raik

We propose a kernel regression method to predict a target signal lying over a graph when an input observation is given. The input and the output could be two different physical quantities. In particular, the input may not be a graph signal…

Information Theory · Computer Science 2019-08-02 Arun Venkitaraman , Saikat Chatterjee , Peter Händel

The linear functional strategy for the regularization of inverse problems is considered. For selecting the regularization parameter therein, we propose the heuristic quasi-optimality principle and some modifications including the smoothness…

Numerical Analysis · Mathematics 2018-05-23 Stefan Kindermann , Sergiy Pereverzyev , Andrey Pilipenko

The performance of traditional graph Laplacian methods for semi-supervised learning degrades substantially as the ratio of labeled to unlabeled data decreases, due to a degeneracy in the graph Laplacian. Several approaches have been…

Analysis of PDEs · Mathematics 2019-04-03 Jeff Calder , Dejan Slepcev

Many Machine Learning algorithms are formulated as regularized optimization problems, but their performance hinges on a regularization parameter that needs to be calibrated to each application at hand. In this paper, we propose a general…

Machine Learning · Statistics 2021-03-31 Mike Laszkiewicz , Asja Fischer , Johannes Lederer

In a stochastic noise setting the Lepskij balancing principle for choosing the regularization parameter in the regularization of inverse problems is depending on a parameter $\tau$ which in the currently known proofs is depending on the…

Numerical Analysis · Mathematics 2010-08-05 Frank Bauer

This paper presents a bias-variance tradeoff of graph Laplacian regularizer, which is widely used in graph signal processing and semi-supervised learning tasks. The scaling law of the optimal regularization parameter is specified in terms…

Machine Learning · Statistics 2017-08-02 Pin-Yu Chen , Sijia Liu

How to obtain a graph from data samples is an important problem in graph signal processing. One way to formulate this graph learning problem is based on Gaussian maximum likelihood estimation, possibly under particular topology constraints.…

Signal Processing · Electrical Eng. & Systems 2017-11-02 Keng-Shih Lu , Antonio Ortega

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations…

Optimization and Control · Mathematics 2012-10-10 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo