English
Related papers

Related papers: The Factored Frontier Algorithm for Approximate In…

200 papers

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

We introduce efficient $(1+\varepsilon)$-approximation algorithms for the binary matrix factorization (BMF) problem, where the inputs are a matrix $\mathbf{A}\in\{0,1\}^{n\times d}$, a rank parameter $k>0$, as well as an accuracy parameter…

Data Structures and Algorithms · Computer Science 2023-06-06 Ameya Velingker , Maximilian Vötsch , David P. Woodruff , Samson Zhou

Currently, it is hard to reap the benefits of deep learning for Bayesian methods, which allow the explicit specification of prior knowledge and accurately capture model uncertainty. We present Prior-Data Fitted Networks (PFNs). PFNs…

Machine Learning · Computer Science 2024-08-14 Samuel Müller , Noah Hollmann , Sebastian Pineda Arango , Josif Grabocka , Frank Hutter

Due to the intractable nature of exact lifted inference, research has recently focused on the discovery of accurate and efficient approximate inference algorithms in Statistical Relational Models (SRMs), such as Lifted First-Order Belief…

Artificial Intelligence · Computer Science 2016-07-01 David Smith , Parag Singla , Vibhav Gogate

Addressing the interpretability problem of NMF on Boolean data, Boolean Matrix Factorization (BMF) uses Boolean algebra to decompose the input into low-rank Boolean factor matrices. These matrices are highly interpretable and very useful in…

Machine Learning · Computer Science 2023-07-18 Sebastian Dalleiger , Jilles Vreeken

A novel approach to Boolean matrix factorization (BMF) is presented. Instead of solving the BMF problem directly, this approach solves a nonnegative optimization problem with the constraint over an auxiliary matrix whose Boolean structure…

Data Structures and Algorithms · Computer Science 2021-08-27 Duc P. Truong , Erik Skau , Derek Desantis , Boian Alexandrov

When belief propagation (BP) converges, it does so to a stationary point of the Bethe free energy $F$, and is often strikingly accurate. However, it may converge only to a local optimum or may not converge at all. An algorithm was recently…

Machine Learning · Computer Science 2014-01-03 Adrian Weller , Tony Jebara

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

Motivated by non-linear, non-Gaussian, distributed multi-sensor/agent navigation and tracking applications, we propose a multi-rate consensus/fusion based framework for distributed implementation of the particle filter (CF/DPF). The CF/DPF…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-06 Arash Mohammadi , Amir Asif

In the current work, a number of algorithms are developed and compared for the numerical solution of periodic (quasi-static) linear elastic mechanical boundary-value problems (BVPs) based on two different discretizations of Fourier series.…

Computational Engineering, Finance, and Science · Computer Science 2020-09-09 M. Khorrami , J. R. Mianroodi , P. Shanthraj , B. Svendsen

In order to integrate uncertainty estimates into deep time-series modelling, Kalman Filters (KFs) (Kalman et al., 1960) have been integrated with deep learning models, however, such approaches typically rely on approximate inference…

Machine Learning · Computer Science 2019-05-20 Philipp Becker , Harit Pandya , Gregor Gebhardt , Cheng Zhao , James Taylor , Gerhard Neumann

Probabilistic generative neural networks are useful for many applications, such as image classification, speech recognition and occlusion removal. However, the power budget for hardware implementations of neural networks can be extremely…

Neural and Evolutionary Computing · Computer Science 2017-05-09 Xiaojing Xu , Srinjoy Das , Ken Kreutz-Delgado

Feedforward neural networks with error backpropagation (FFBP) are widely applied to pattern recognition. One general problem encountered with this type of neural networks is the uncertainty, whether the minimization procedure has converged…

High Energy Physics - Experiment · Physics 2010-11-01 Ralph Sinkus

Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propagation rule that is…

Machine Learning · Computer Science 2019-08-26 Dong Liu , Nima N. Moghadam , Lars K. Rasmussen , Jinliang Huang , Saikat Chatterjee

Although many real-world stochastic planning problems are more naturally formulated by hybrid models with both discrete and continuous variables, current state-of-the-art methods cannot adequately address these problems. We present the…

Artificial Intelligence · Computer Science 2012-07-19 Carlos E. Guestrin , Milos Hauskrecht , Branislav Kveton

In this paper, we provide a distributed frequency offset estimation algorithm based on a variant of belief propagation (BP). Each agent in the network pre-compensates its carrier frequency individually so that there is no frequency offset…

Information Theory · Computer Science 2018-02-13 Jian Du , Shaodan Ma

Matrix factorization is a very common machine learning technique in recommender systems. Bayesian Matrix Factorization (BMF) algorithms would be attractive because of their ability to quantify uncertainty in their predictions and avoid…

Machine Learning · Computer Science 2020-04-15 Tom Vander Aa , Xiangju Qin , Paul Blomstedt , Roel Wuyts , Wilfried Verachtert , Samuel Kaski

We address the problem of uncertainty propagation in the discrete Fourier transform by modeling the fast Fourier transform as a factor graph. Building on this representation, we propose an efficient framework for approximate Bayesian…

Machine Learning · Computer Science 2025-06-09 Luca Schmid , Charlotte Muth , Laurent Schmalen

Particle filtering is a Bayesian inference method and a fundamental tool in state estimation for dynamic systems, but its effectiveness is often limited by the constraints of the initial prior distribution, a phenomenon we define as the…

Machine Learning · Statistics 2025-01-31 Yiwei Shi , Jingyu Hu , Yu Zhang , Mengyue Yang , Weinan Zhang , Cunjia Liu , Weiru Liu

Distributed inference/estimation in Bayesian framework in the context of sensor networks has recently received much attention due to its broad applicability. The variational Bayesian (VB) algorithm is a technique for approximating…

Machine Learning · Statistics 2020-11-30 Junhao Hua , Chunguang Li