English
Related papers

Related papers: Deep kernel learning for integral measurements

200 papers

In this article, a novel approach to learning a complex function which can be written as the system of linear equations is introduced. This learning is grounded upon the observation that solving the system of linear equations by a…

Machine Learning · Computer Science 2018-10-23 Kar-Ann Toh

Standard infinite-width limits of neural networks sacrifice the ability for intermediate layers to learn representations from data. Recent work (A theory of representation learning gives a deep generalisation of kernel methods, Yang et al.…

Machine Learning · Statistics 2024-02-27 Edward Milsom , Ben Anson , Laurence Aitchison

Kernel fusion is a popular and effective approach for combining multiple features that characterize different aspects of data. Traditional approaches for Multiple Kernel Learning (MKL) attempt to learn the parameters for combining the…

Bayesian methods in machine learning, such as Gaussian processes, have great advantages com-pared to other techniques. In particular, they provide estimates of the uncertainty associated with a prediction. Extending the Bayesian approach to…

Quantum Physics · Physics 2019-05-20 Zhikuan Zhao , Alejandro Pozas-Kerstjens , Patrick Rebentrost , Peter Wittek

Inspired by a growing interest in analyzing network data, we study the problem of node classification on graphs, focusing on approaches based on kernel machines. Conventionally, kernel machines are linear classifiers in the implicit feature…

Machine Learning · Statistics 2010-01-25 Xiao Tang , Mu Zhu

This paper addresses distributed learning of a complex object for multiple networked robots based on distributed optimization and kernel-based support vector machine. In order to overcome a fundamental limitation of polynomial kernels…

Robotics · Computer Science 2024-12-17 Toshiyuki Oshima , Junya Yamauchi , Tatsuya Ibuki , Michio Seto , Takeshi Hatanaka

Inducing point Gaussian process approximations are often considered a gold standard in uncertainty estimation since they retain many of the properties of the exact GP and scale to large datasets. A major drawback is that they have…

Machine Learning · Computer Science 2022-03-08 Joost van Amersfoort , Lewis Smith , Andrew Jesson , Oscar Key , Yarin Gal

We define deep kernel processes in which positive definite Gram matrices are progressively transformed by nonlinear kernel functions and by sampling from (inverse) Wishart distributions. Remarkably, we find that deep Gaussian processes…

Machine Learning · Statistics 2021-06-01 Laurence Aitchison , Adam X. Yang , Sebastian W. Ober

Deep learning is one of the new and important branches in machine learning. Deep learning refers to a set of algorithms that solve various problems such as images and texts by using various machine learning algorithms in multi-layer neural…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Yang Li , Sangwhan Cha

Neural networks and Gaussian processes are complementary in their strengths and weaknesses. Having a better understanding of their relationship comes with the promise to make each method benefit from the strengths of the other. In this…

Neural networks with at least two hidden layers are called deep networks. Recent developments in AI and computer programming in general has led to development of tools such as Tensorflow, Keras, NumPy etc. making it easier to model and draw…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Ruthvik Vaila , Denver Lloyd , Kevin Tetz

Deep learning refers to the shining branch of machine learning that is based on learning levels of representations. Convolutional Neural Networks (CNN) is one kind of deep neural network. It can study concurrently. In this article, we gave…

Computer Vision and Pattern Recognition · Computer Science 2015-06-05 Tianyi Liu , Shuangsang Fang , Yuehui Zhao , Peng Wang , Jun Zhang

In this paper we introduce the deep kernelized autoencoder, a neural network model that allows an explicit approximation of (i) the mapping from an input space to an arbitrary, user-specified kernel space and (ii) the back-projection from…

Machine Learning · Statistics 2017-02-09 Michael Kampffmeyer , Sigurd Løkse , Filippo Maria Bianchi , Robert Jenssen , Lorenzo Livi

Deep learning, in general, focuses on training a neural network from large labeled datasets. Yet, in many cases there is value in training a network just from the input at hand. This is particularly relevant in many signal and image…

Machine Learning · Computer Science 2024-04-09 Tom Tirer , Raja Giryes , Se Young Chun , Yonina C. Eldar

Scaling analysis, in which one infers scaling exponents and a scaling function in a scaling law from given data, is a powerful tool for determining universal properties of critical phenomena in many fields of science. However, there are…

Statistical Mechanics · Physics 2015-07-08 Kenji Harada

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

Today, intelligent systems that offer artificial intelligence capabilities often rely on machine learning. Machine learning describes the capacity of systems to learn from problem-specific training data to automate the process of analytical…

Artificial Intelligence · Computer Science 2021-04-15 Christian Janiesch , Patrick Zschech , Kai Heinrich

The successes of modern deep machine learning methods are founded on their ability to transform inputs across multiple layers to build good high-level representations. It is therefore critical to understand this process of representation…

Machine Learning · Statistics 2023-05-26 Adam X. Yang , Maxime Robeyns , Edward Milsom , Ben Anson , Nandi Schoots , Laurence Aitchison

The Gaussian kernel plays a central role in machine learning, uncertainty quantification and scattered data approximation, but has received relatively little attention from a numerical analysis standpoint. The basic problem of finding an…

Numerical Analysis · Mathematics 2021-04-02 Toni Karvonen , Chris J. Oates , Mark Girolami

We introduce the loss kernel, an interpretability method for measuring similarity between data points according to a trained neural network. The kernel is the covariance matrix of per-sample losses computed under a distribution of…

Machine Learning · Computer Science 2025-10-01 Maxwell Adam , Zach Furman , Jesse Hoogland