English
Related papers

Related papers: BRUNO: A Deep Recurrent Model for Exchangeable Dat…

200 papers

In statistics and machine learning, detecting dependencies in datasets is a central challenge. We propose a novel neural network model for supervised graph structure learning, i.e., the process of learning a mapping between observational…

Machine Learning · Statistics 2024-02-14 Philipp Froehlich , Heinz Koeppl

Bayesian neural network models (BNN) have re-surged in recent years due to the advancement of scalable computations and its utility in solving complex prediction problems in a wide variety of applications. Despite the popularity and…

Machine Learning · Statistics 2020-11-20 Shrijita Bhattacharya , Zihuan Liu , Tapabrata Maiti

High-dimensional deep neural network representations of images and concepts can be aligned to predict human annotations of diverse stimuli. However, such alignment requires the costly collection of behavioral responses, such that, in…

Artificial Intelligence · Computer Science 2023-06-09 Yangyang Yu , Jordan W. Suchow

Mechanistic models of single-neuron dynamics have been extensively studied in computational neuroscience. However, identifying which models can quantitatively reproduce empirically measured data has been challenging. We propose to overcome…

In the low-data regime, it is difficult to train good supervised models from scratch. Instead practitioners turn to pre-trained models, leveraging transfer learning. Ensembling is an empirically and theoretically appealing way to construct…

Machine Learning · Computer Science 2020-10-20 Basil Mustafa , Carlos Riquelme , Joan Puigcerver , André Susano Pinto , Daniel Keysers , Neil Houlsby

Exponential random graph models are an important tool in the statistical analysis of data. However, Bayesian parameter estimation for these models is extremely challenging, since evaluation of the posterior distribution typically involves…

Computation · Statistics 2017-05-05 Lampros Bouranis , Nial Friel , Florian Maire

Deep learning has demonstrated the power of detailed modeling of complex high-order (multivariate) interactions in data. For some learning tasks there is power in learning models that are not only Deep but also Broad. By Broad, we mean…

Machine Learning · Computer Science 2015-09-07 Nayyar A. Zaidi , Geoffrey I. Webb , Mark J. Carman , Francois Petitjean

Causal learning from data has received much attention recently. Bayesian networks can be used to capture causal relationships. There, one recovers a weighted directed acyclic graph in which random variables are represented by vertices, and…

Machine Learning · Computer Science 2026-01-06 Pavel Rytir , Ales Wodecki , Georgios Korpas , Jakub Marecek

Given the ever-increasing computational costs of modern machine learning models, we need to find new ways to reuse such expert models and thus tap into the resources that have been invested in their creation. Recent work suggests that the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Robin Rombach , Patrick Esser , Björn Ommer

Learning models that can handle distribution shifts is a key challenge in domain generalization. Invariance learning, an approach that focuses on identifying features invariant across environments, improves model generalization by capturing…

Machine Learning · Statistics 2026-05-11 Yiran Jia , Jelena Bradic

This paper reviews recent developments in statistical structure learning; namely, Bayesian model reduction. Bayesian model reduction is a method for rapidly computing the evidence and parameters of probabilistic models that differ only in…

Methodology · Statistics 2019-10-15 Karl Friston , Thomas Parr , Peter Zeidman

This paper develops forecasting methodology and application of new classes of dynamic models for time series of non-negative counts. Novel univariate models synthesise dynamic generalized linear models for binary and conditionally Poisson…

Methodology · Statistics 2022-06-07 Lindsay Berry , Mike West

Directed graphs occur throughout statistical modeling of networks, and exchangeability is a natural assumption when the ordering of vertices does not matter. There is a deep structural theory for exchangeable undirected graphs, which…

Statistics Theory · Mathematics 2016-12-19 Diana Cai , Nathanael Ackerman , Cameron Freer

Deep learning is envisioned to play a key role in the design of future wireless receivers. A popular approach to design learning-aided receivers combines deep neural networks (DNNs) with traditional model-based receiver algorithms,…

Information Theory · Computer Science 2024-10-22 Tomer Raviv , Sangwoo Park , Osvaldo Simeone , Nir Shlezinger

We introduce a new, rigorously-formulated Bayesian meta-learning algorithm that learns a probability distribution of model parameter prior for few-shot learning. The proposed algorithm employs a gradient-based variational inference to infer…

Machine Learning · Computer Science 2022-03-21 Cuong Nguyen , Thanh-Toan Do , Gustavo Carneiro

Increasingly complex applications involve large datasets in combination with non-linear and high dimensional mathematical models. In this context, statistical inference is a challenging issue that calls for pragmatic approaches that take…

Data Analysis, Statistics and Probability · Physics 2013-01-31 Andreas Raue , Clemens Kreutz , Fabian Joachim Theis , Jens Timmer

An important aspect of Bayesian model selection is how to deal with huge model spaces, since exhaustive enumeration of all the models entertained is unfeasible and inferences have to be based on the very small proportion of models visited.…

Methodology · Statistics 2011-01-25 Gonzalo Garcia-Donato , Miguel Angel Martinez-Beneito

Graphical models are widely used to make inferences concerning interplay in multivariate systems. In many applications, data are collected from multiple related but nonidentical units whose underlying networks may differ but are likely to…

Methodology · Statistics 2014-12-04 Chris J. Oates , Jim Korkola , Joe W. Gray , Sach Mukherjee

A variety of machine learning tasks---e.g., matrix factorization, topic modelling, and feature allocation---can be viewed as learning the parameters of a probability distribution over bipartite graphs. Recently, a new class of models for…

Machine Learning · Statistics 2017-12-07 Victor Veitch , Ekansh Sharma , Zacharie Naulet , Daniel M. Roy

Deep neural networks have achieved impressive results on a wide variety of tasks. However, quantifying uncertainty in the network's output is a challenging task. Bayesian models offer a mathematical framework to reason about model…

Machine Learning · Computer Science 2019-05-28 Manikanta Srikar Yellapragada , Chandra Prakash Konkimalla