English
Related papers

Related papers: Appropriate kernels for Divisive Normalization exp…

200 papers

We investigate iterated compositions of weighted sums of Gaussian kernels and provide an interpretation of the construction that shows some similarities with the architectures of deep neural networks. On the theoretical side, we show that…

Machine Learning · Statistics 2016-12-05 Ingo Steinwart , Philipp Thomann , Nico Schmid

Deep kernel processes are a recently introduced class of deep Bayesian models that have the flexibility of neural networks, but work entirely with Gram matrices. They operate by alternately sampling a Gram matrix from a distribution over…

Machine Learning · Statistics 2023-05-25 Sebastian Ober , Ben Anson , Edward Milsom , Laurence Aitchison

A recent series of theoretical works showed that the dynamics of neural networks with a certain initialisation are well-captured by kernel methods. Concurrent empirical work demonstrated that kernel methods can come close to the performance…

Machine Learning · Computer Science 2021-06-11 Maria Refinetti , Sebastian Goldt , Florent Krzakala , Lenka Zdeborová

This paper presents a new insight into improving the performance of Stochastic Neighbour Embedding (t-SNE) by using Isolation kernel instead of Gaussian kernel. Isolation kernel outperforms Gaussian kernel in two aspects. First, the use of…

Machine Learning · Computer Science 2024-01-30 Ye Zhu , Kai Ming Ting

Dual-tree wavelet decompositions have recently gained much popularity, mainly due to their ability to provide an accurate directional analysis of images combined with a reduced redundancy. When the decomposition of a random process is…

Statistics Theory · Mathematics 2011-08-30 Caroline Chaux , Jean-Christophe Pesquet , Laurent Duval

We consider the problem of learning regression functions from pairwise data when there exists prior knowledge that the relation to be learned is symmetric or anti-symmetric. Such prior knowledge is commonly enforced by symmetrizing or…

Machine Learning · Computer Science 2015-06-22 Tapio Pahikkala , Markus Viljanen , Antti Airola , Willem Waegeman

Bayesian analysis has become an indispensable tool across many different cosmological fields including the study of gravitational waves, the Cosmic Microwave Background and the 21-cm signal from the Cosmic Dawn among other phenomena. The…

Instrumentation and Methods for Astrophysics · Physics 2023-12-19 Harry T. J. Bevins , William J. Handley , Pablo Lemos , Peter H. Sims , Eloy de Lera Acedo , Anastasia Fialkov , Justin Alsing

A new image denoising algorithm to deal with the additive Gaussian white noise model is given. Like the non-local means method, the filter is based on the weighted average of the observations in a neighborhood, with weights depending on the…

Other Statistics · Statistics 2011-11-04 Qiyu Jin , Ion Grama , Quansheng Liu

Most graph kernels are an instance of the class of $\mathcal{R}$-Convolution kernels, which measure the similarity of objects by comparing their substructures. Despite their empirical success, most graph kernels use a naive aggregation of…

Machine Learning · Computer Science 2019-10-31 Matteo Togninalli , Elisabetta Ghisu , Felipe Llinares-López , Bastian Rieck , Karsten Borgwardt

We propose a method for fusing stereo disparity estimation with movement-induced prior information. Instead of independent inference frame-by-frame, we formulate the problem as a non-parametric learning task in terms of a temporal Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Yuxin Hou , Muhammad Kamran Janjua , Juho Kannala , Arno Solin

This note is devoted to an analysis of the so-called peeling algorithm in wavelet denoising. Assuming that the wavelet coefficients of the signal can be modeled by generalized Gaussian random variables, we compute a critical thresholding…

Statistics Theory · Mathematics 2009-11-23 Céline Lacaux , Aurélie Muller , Radu Ranta , Samy Tindel

We propose a bilateral filter with a locally controlled domain kernel for directional edge-preserving smoothing. Traditional bilateral filters use a range kernel, which is responsible for edge preservation, and a fixed domain kernel that…

Computer Vision and Pattern Recognition · Computer Science 2015-08-24 Manasij Venkatesh , Chandra Sekhar Seelamantula

Dense pixelwise prediction such as semantic segmentation is an up-to-date challenge for deep convolutional neural networks (CNNs). Many state-of-the-art approaches either tackle the loss of high-resolution information due to pooling in the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Lingni Ma , Jörg Stückler , Tao Wu , Daniel Cremers

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach

Most of the classical denoising methods restore clear results by selecting and averaging pixels in the noisy input. Instead of relying on hand-crafted selecting and averaging strategies, we propose to explicitly learn this process with deep…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Xiangyu Xu , Muchen Li , Wenxiu Sun

Statistical physics approaches can be used to derive accurate predictions for the performance of inference methods learning from potentially noisy data, as quantified by the learning curve defined as the average error versus number of…

Machine Learning · Statistics 2012-11-07 Matthew J. Urry , Peter Sollich

In this article we investigate the effects of conformal transformations on kernel functions used in Support Vector Machines. Our focus lies in the task of text document categorization, which involves assigning each document to a particular…

Machine Learning · Computer Science 2024-06-04 Ioana Rădulescu , Alexandra Băicoianu , Adela Mihai

Data-driven discovery of "hidden physics" -- i.e., machine learning of differential equation models underlying observed data -- has recently been approached by embedding the discovery problem into a Gaussian Process regression of spatial…

Machine Learning · Computer Science 2019-08-05 Mamikon Gulian , Maziar Raissi , Paris Perdikaris , George Karniadakis

We establish a general form of explicit, input-dependent, measure-valued warpings for learning nonstationary kernels. While stationary kernels are ubiquitous and simple to use, they struggle to adapt to functions that vary in smoothness…

Machine Learning · Computer Science 2020-10-12 Anthony Tompkins , Rafael Oliveira , Fabio Ramos

This work studies the problem of estimating a two-dimensional superposition of point sources or spikes from samples of their convolution with a Gaussian kernel. Our results show that minimizing a continuous counterpart of the $\ell_1$ norm…

Numerical Analysis · Mathematics 2020-08-05 Joseph McDonald , Brett Bernstein , Carlos Fernandez-Granda