English
Related papers

Related papers: A Gaussian Process perspective on Convolutional Ne…

200 papers

We present diffusion-convolutional neural networks (DCNNs), a new model for graph-structured data. Through the introduction of a diffusion-convolution operation, we show how diffusion-based representations can be learned from…

Machine Learning · Computer Science 2016-07-11 James Atwood , Don Towsley

Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low-dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to…

Machine Learning · Computer Science 2021-03-30 Mehrnaz Najafi , Philip S. Yu

Neural-net-induced Gaussian process (NNGP) regression inherits both the high expressivity of deep neural networks (deep NNs) as well as the uncertainty quantification property of Gaussian processes (GPs). We generalize the current NNGP to…

Machine Learning · Computer Science 2019-03-27 Guofei Pang , Liu Yang , George Em Karniadakis

Artificial Neural Networks are connectionist systems that perform a given task by learning on examples without having prior knowledge about the task. This is done by finding an optimal point estimate for the weights in every node.…

Machine Learning · Computer Science 2019-01-10 Kumar Shridhar , Felix Laumann , Marcus Liwicki

Convolutional Neural Networks (Convnets) have achieved good results in a range of computer vision tasks the recent years. Though given a lot of attention, visualizing the learned representations to interpret Convnets, still remains a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-24 David Malmgren-Hansen , Allan Aasbjerg Nielsen , Rasmus Engholm

Causal discovery and inference from observational data is an essential problem in statistics posing both modeling and computational challenges. These are typically addressed by imposing strict assumptions on the joint distribution such as…

Machine Learning · Statistics 2024-02-20 Enrico Giudice , Jack Kuipers , Giusi Moffa

Study of neural networks with infinite width is important for better understanding of the neural network in practical application. In this work, we derive the equivalence of the deep, infinite-width maxout network and the Gaussian process…

Machine Learning · Statistics 2022-08-29 Libin Liang , Ye Tian , Ge Cheng

We introduce a convolutional neural network that operates directly on graphs. These networks allow end-to-end learning of prediction pipelines whose inputs are graphs of arbitrary size and shape. The architecture we present generalizes…

One goal in Bayesian machine learning is to encode prior knowledge into prior distributions, to model data efficiently. We consider prior knowledge from systems of linear partial differential equations together with their boundary…

Machine Learning · Computer Science 2021-02-16 Markus Lange-Hegermann

Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters…

Signal Processing · Electrical Eng. & Systems 2019-01-30 Fernando Gama , Antonio G. Marques , Geert Leus , Alejandro Ribeiro

Convolutional neural networks (CNNs) were inspired by early findings in the study of biological vision. They have since become successful tools in computer vision and state-of-the-art models of both neural activity and behavior on visual…

Neurons and Cognition · Quantitative Biology 2020-02-11 Grace W. Lindsay

We consider a graphical model where a multivariate normal vector is associated with each node of the underlying graph and estimate the graphical structure. We minimize a loss function obtained by regressing the vector at each node on those…

Machine Learning · Statistics 2017-09-19 Xingqi Du , Subhashis Ghosal

Neural networks have achieved remarkable performance across various problem domains, but their widespread applicability is hindered by inherent limitations such as overconfidence in predictions, lack of interpretability, and vulnerability…

Machine Learning · Statistics 2023-09-29 Julyan Arbel , Konstantinos Pitas , Mariia Vladimirova , Vincent Fortuin

We introduce the Convolutional Conditional Neural Process (ConvCNP), a new member of the Neural Process family that models translation equivariance in the data. Translation equivariance is an important inductive bias for many learning…

Integrating measurements and historical data can enhance control systems through learning-based techniques, but ensuring performance and safety is challenging. Robust model predictive control strategies, like stochastic model predictive…

Systems and Control · Electrical Eng. & Systems 2023-03-28 J. Pohlodek , H. Alsmeier , B. Morabito , C. Schlauch , A. Savchenko , R. Findeisen

Convolutional Neural Networks demonstrate high performance on ImageNet Large-Scale Visual Recognition Challenges contest. Nevertheless, the published results only show the overall performance for all image classes. There is no further…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Mingming Wang

We propose a data-efficient Gaussian process-based Bayesian approach to the semi-supervised learning problem on graphs. The proposed model shows extremely competitive performance when compared to the state-of-the-art graph neural networks…

Machine Learning · Computer Science 2018-10-15 Yin Cheng Ng , Nicolo Colombo , Ricardo Silva

Research on Poisson regression analysis for dependent data has been developed rapidly in the last decade. One of difficult problems in a multivariate case is how to construct a cross-correlation structure and at the meantime make sure that…

Methodology · Statistics 2017-10-05 A'yunin Sofro , Jian Qing Shi , Chunzheng Cao

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

To reduce the curse of dimensionality for Gaussian processes (GP), they can be decomposed into a Gaussian Process Network (GPN) of coupled subprocesses with lower dimensionality. In some cases, intermediate observations are available within…

Machine Learning · Computer Science 2025-02-20 Saksham Kiroriwal , Julius Pfrommer , Jürgen Beyerer