English
Related papers

Related papers: Equivariant Learning of Stochastic Fields: Gaussia…

200 papers

Many time series are effectively generated by a combination of deterministic continuous flows along with discrete jumps sparked by stochastic events. However, we usually do not have the equation of motion describing the flows, or how they…

Machine Learning · Computer Science 2020-01-09 Junteng Jia , Austin R. Benson

We study learning problems in which the conditional distribution of the output given the input varies as a function of additional task variables. In varying-coefficient models with Gaussian process priors, a Gaussian process generates the…

Machine Learning · Computer Science 2015-10-15 Matthias Bussas , Christoph Sawade , Tobias Scheffer , Niels Landwehr

Gaussian Processes (GPs) provide a convenient framework for specifying function-space priors, making them a natural choice for modeling uncertainty. In contrast, Bayesian Neural Networks (BNNs) offer greater scalability and extendability…

Machine Learning · Computer Science 2025-06-12 Marcin Sendera , Amin Sorkhei , Tomasz Kuśmierczyk

We marry ideas from deep neural networks and approximate Bayesian inference to derive a generalised class of deep, directed generative models, endowed with a new algorithm for scalable inference and learning. Our algorithm introduces a…

Machine Learning · Statistics 2014-06-02 Danilo Jimenez Rezende , Shakir Mohamed , Daan Wierstra

Neural processes (NPs) aim to stochastically complete unseen data points based on a given context dataset. NPs essentially leverage a given dataset as a context representation to derive a suitable identifier for a novel task. To improve the…

Machine Learning · Computer Science 2022-04-13 Mingyu Kim , Kyeongryeol Go , Se-Young Yun

We propose a novel Bayesian nonparametric method to learn translation-invariant relationships on non-Euclidean domains. The resulting graph convolutional Gaussian processes can be applied to problems in machine learning for which the input…

Machine Learning · Computer Science 2019-05-15 Ian Walker , Ben Glocker

We study the notions of differentiating and non-differentiating sigma-fields in the general framework of (possibly drifted) Gaussian processes, and characterize their invariance properties under equivalent changes of probability measure. As…

Probability · Mathematics 2016-08-14 Sébastien Darses , Ivan Nourdin , Giovanni Peccati

We introduce Graph Neural Processes (GNP), inspired by the recent work in conditional and latent neural processes. A Graph Neural Process is defined as a Conditional Neural Process that operates on arbitrary graph data. It takes features of…

Machine Learning · Computer Science 2019-10-03 Andrew Carr , David Wingate

Machine learning techniques not only offer efficient tools for modelling dynamical systems from data, but can also be employed as frontline investigative instruments for the underlying physics. Nontrivial information about the original…

Data Analysis, Statistics and Probability · Physics 2021-02-24 Francesco Borra , Marco Baldovin

We study pathwise invariances of centred random fields that can be controlled through the covariance. A result involving composition operators is obtained in second-order settings, and we show that various path properties including…

Statistics Theory · Mathematics 2013-08-07 David Ginsbourger , Olivier Roustant , Nicolas Durrande

Equivariant machine learning is an approach for designing deep learning models that respect the symmetries of the problem, with the aim of reducing model complexity and improving generalization. In this paper, we focus on an extension of…

Machine Learning · Computer Science 2024-12-10 Ya-Wei Eileen Lin , Ronen Talmon , Ron Levie

In recent years, there has been an intense debate about how learning in biological neural networks (BNNs) differs from learning in artificial neural networks. It is often argued that the updating of connections in the brain relies only on…

Neurons and Cognition · Quantitative Biology 2024-04-11 Sören Christensen , Jan Kallsen

We consider a neural network with adapting synapses whose dynamics can be analitically computed. The model is made of $N$ neurons and each of them is connected to $K$ input neurons chosen at random in the network. The synapses are…

Disordered Systems and Neural Networks · Physics 2009-10-30 G. Lattanzi , G. Nardulli , G. Pasquariello , S. Stramaglia

Equivariant neural networks enforce symmetry within the structure of their convolutional layers, resulting in a substantial improvement in sample efficiency when learning an equivariant or invariant function. Such models are applicable to…

Robotics · Computer Science 2022-03-10 Dian Wang , Robin Walters , Robert Platt

These days we live in a world with a permanent electromagnetic field. This raises many questions about our health and the deployment of new equipment. The problem is that these fields remain difficult to visualize easily, which only some…

Signal Processing · Electrical Eng. & Systems 2022-03-04 Angesom Ataklity Tesfay , Laurent Clavier

Spatial prediction problems often use Gaussian process models, which can be computationally burdensome in high dimensions. Specification of an appropriate covariance function for the model can be challenging when complex non-stationarities…

Methodology · Statistics 2024-09-13 Qi Wang , Paul A. Parker , Robert B. Lund

Recurrent neural networks (RNNs) have shown promising performance for language modeling. However, traditional training of RNNs using back-propagation through time often suffers from overfitting. One reason for this is that stochastic…

Computation and Language · Computer Science 2017-04-25 Zhe Gan , Chunyuan Li , Changyou Chen , Yunchen Pu , Qinliang Su , Lawrence Carin

Inference in Gaussian process (GP) models is computationally challenging for large data, and often difficult to approximate with a small number of inducing points. We explore an alternative approximation that employs stochastic inference…

Machine Learning · Statistics 2019-05-28 Jiaxin Shi , Mohammad Emtiyaz Khan , Jun Zhu

This paper presents a novel framework for non-linear equivariant neural network layers on homogeneous spaces. The seminal work of Cohen et al. on equivariant $G$-CNNs on homogeneous spaces characterized the representation theory of such…

Machine Learning · Computer Science 2025-04-30 Elias Nyholm , Oscar Carlsson , Maurice Weiler , Daniel Persson

Learning continuous-time stochastic dynamics is a fundamental and essential problem in modeling sporadic time series, whose observations are irregular and sparse in both time and dimension. For a given system whose latent states and…

Machine Learning · Computer Science 2021-04-30 Yingru Liu , Yucheng Xing , Xuewen Yang , Xin Wang , Jing Shi , Di Jin , Zhaoyue Chen