English
Related papers

Related papers: Inference for max-linear Bayesian networks with no…

200 papers

We propose a new method to estimate a root-directed spanning tree from extreme data. A prominent example is a river network, to be discovered from extreme flow measured at a set of stations. Our new algorithm utilizes qualitative aspects of…

Machine Learning · Statistics 2023-12-29 Ngoc Mai Tran , Johannes Buck , Claudia Klüppelberg

The noisy-or and its generalization noisy-max have been utilized to reduce the complexity of knowledge acquisition. In this paper, we present a new representation of noisy-max that allows for efficient inference in general Bayesian…

Artificial Intelligence · Computer Science 2013-01-30 Masami Takikawa , Bruce D'Ambrosio

We present new Bayesian Last Layer neural network models in the setting of multivariate regression under heteroscedastic noise, and propose EM algorithms for parameter learning. Bayesian modeling of a neural network's final layer has the…

Machine Learning · Statistics 2026-02-02 Han Wang , Eiji Kawasaki , Guillaume Damblin , Geoffrey Daniel

Modeling the associations between real world entities from their multivariate cross-sectional profiles can provide cues into the concerted working of these entities as a system. Several techniques have been proposed for deciphering these…

Machine Learning · Computer Science 2025-01-07 Radha Nagarajan , Marco Scutari

The normalized maximized likelihood (NML) provides the minimax regret solution in universal data compression, gambling, and prediction, and it plays an essential role in the minimum description length (MDL) method of statistical modeling…

Information Theory · Computer Science 2014-01-29 Andrew Barron , Teemu Roos , Kazuho Watanabe

We present a discriminative nonparametric latent feature relational model (LFRM) for link prediction to automatically infer the dimensionality of latent features. Under the generic RegBayes (regularized Bayesian inference) framework, we…

Machine Learning · Computer Science 2015-12-08 Bei Chen , Ning Chen , Jun Zhu , Jiaming Song , Bo Zhang

In this paper, we aim to design and analyze distributed Bayesian estimation algorithms for sensor networks. The challenges we address are to (i) derive a distributed provably-correct algorithm in the functional space of probability…

Machine Learning · Computer Science 2025-03-25 Parth Paritosh , Nikolay Atanasov , Sonia Martinez

Machine learning models have achieved human-level performance on various tasks. This success comes at a high cost of computation and storage overhead, which makes machine learning algorithms difficult to deploy on edge devices. Typically,…

Machine Learning · Computer Science 2021-11-12 Giuseppina Carannante , Dimah Dera , Ghulam Rasool , Nidhal C. Bouaynaya

We address numerical differentiation under coarse, non-uniform sampling and Gaussian noise. A maximum-likelihood estimator with $L_2$-norm constraint on a higher-order derivative is obtained, yielding spline-based solution. We introduce a…

Methodology · Statistics 2025-07-31 Konstantin E. Avrachenkov , Leonid B. Freidovich

We reinterpret multiplicative noise in neural networks as auxiliary random variables that augment the approximate posterior in a variational setting for Bayesian neural networks. We show that through this interpretation it is both efficient…

Machine Learning · Statistics 2017-06-14 Christos Louizos , Max Welling

The aim of this work is to enable inference of deep networks that retain high accuracy for the least possible model complexity, with the latter deduced from the data during inference. To this end, we revisit deep networks that comprise…

Machine Learning · Computer Science 2019-05-07 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

As Bayesian networks are applied to larger and more complex problem domains, search for flexible modeling and more efficient inference methods is an ongoing effort. Multiply sectioned Bayesian networks (MSBNs) extend the HUGIN inference for…

Artificial Intelligence · Computer Science 2013-01-30 Yanping Xiang , Finn Verner Jensen

Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainties by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have…

Machine Learning · Statistics 2021-12-17 Sujay Thakur , Cooper Lorsung , Yaniv Yacoby , Finale Doshi-Velez , Weiwei Pan

Inputs to machine learning models can have associated noise or uncertainties, but they are often ignored and not modelled. It is unknown if Bayesian Neural Networks and their approximations are able to consider uncertainty in their inputs.…

Machine Learning · Computer Science 2025-01-15 Matias Valdenegro-Toro , Marco Zullich

We provide a comprehensive review of causal dependence through a max-linear structural equation model. Such models express each node variable as a max-linear function of its parental node variables in a directed acyclic graph and some…

Risk Management · Quantitative Finance 2025-09-29 Claudia Klüppelberg , Mario Krali

Modern neural networks tend to be overconfident on unseen, noisy or incorrectly labelled data and do not produce meaningful uncertainty measures. Bayesian deep learning aims to address this shortcoming with variational approximations (such…

Machine Learning · Statistics 2018-05-28 Nick Pawlowski , Andrew Brock , Matthew C. H. Lee , Martin Rajchl , Ben Glocker

Generative Artificial Intelligence (GenAI) models, with their powerful feature learning capabilities, have been applied in many fields. In mobile wireless communications, GenAI can dynamically optimize the network to enhance the user…

Signal Processing · Electrical Eng. & Systems 2025-08-27 Changyuan Zhao , Jiacheng Wang , Ruichen Zhang , Dusit Niyato , Dong In Kim , Hongyang Du

A major problem for the learning of Bayesian networks (BNs) is the exponential number of parameters needed for conditional probability tables. Recent research reduces this complexity by modeling local structure in the probability tables. We…

Artificial Intelligence · Computer Science 2013-01-30 Julian R. Neil , Chris S. Wallace , Kevin B. Korb

We study the problem of learning classification functions from noiseless training samples, under the assumption that the decision boundary is of a certain regularity. We establish universal lower bounds for this estimation problem, for…

Functional Analysis · Mathematics 2021-12-28 Philipp Petersen , Felix Voigtlaender

A distributed consensus algorithm for estimating the maximum value of the initial measurements in a sensor network with communication noise is proposed. In the absence of communication noise, max estimation can be done by updating the state…

Systems and Control · Computer Science 2016-02-04 Sai Zhang , Cihan Tepedelenlioglu , Mahesh K. Banavar , Andreas Spanias