English
Related papers

Related papers: The Factored Frontier Algorithm for Approximate In…

200 papers

Boolean matrix factorization (BMF) approximates a given binary input matrix as the product of two smaller binary factors. Unlike binary matrix factorization based on standard arithmetic, BMF employs the Boolean OR and AND operations for the…

Information Retrieval · Computer Science 2025-12-05 Christos Kolomvakis , Thomas Bobille , Arnaud Vandaele , Nicolas Gillis

Gaussian Mixture Models (GMMs) commonly arise in communication systems, particularly in bilinear joint estimation and detection problems. Although the product of GMMs is still a GMM, as the number of factors increases, the number of…

Signal Processing · Electrical Eng. & Systems 2026-02-04 Zilu Zhao , Dirk Slock

We propose a hierarchy for approximate inference based on the Dobrushin, Lanford, Ruelle (DLR) equations. This hierarchy includes existing algorithms, such as belief propagation, and also motivates novel algorithms such as factorized…

Machine Learning · Computer Science 2015-03-20 Michal Rosen-Zvi , Michael I. Jordan , Alan Yuille

In this paper, we consider Hybrid Mixed Networks (HMN) which are Hybrid Bayesian Networks that allow discrete deterministic information to be modeled explicitly in the form of constraints. We present two approximate inference algorithms for…

Artificial Intelligence · Computer Science 2012-07-09 Vibhav Gogate , Rina Dechter

Learned neural solvers have successfully been used to solve combinatorial optimization and decision problems. More general counting variants of these problems, however, are still largely solved with hand-crafted solvers. To bridge this gap,…

Machine Learning · Computer Science 2020-07-02 Jonathan Kuck , Shuvam Chakraborty , Hao Tang , Rachel Luo , Jiaming Song , Ashish Sabharwal , Stefano Ermon

Coordinate ascent variational inference is an important algorithm for inference in probabilistic models, but it is slow because it updates only a single variable at a time. Block coordinate methods perform inference faster by updating…

Machine Learning · Computer Science 2018-05-21 Neal Lawton , Aram Galstyan , Greg Ver Steeg

Boolean Matrix Factorization (BMF) aims to find an approximation of a given binary matrix as the Boolean product of two low-rank binary matrices. Binary data is ubiquitous in many fields, and representing data by binary matrices is common…

Machine Learning · Computer Science 2022-07-26 Fedor Fomin , Fahad Panolan , Anurag Patil , Adil Tanveer

Reinforcement learning (RL) in episodic, factored Markov decision processes (FMDPs) is studied. We propose an algorithm called FMDP-BF, which leverages the factorization structure of FMDP. The regret of FMDP-BF is shown to be exponentially…

Machine Learning · Computer Science 2021-03-11 Xiaoyu Chen , Jiachen Hu , Lihong Li , Liwei Wang

A new search algorithm for solving distributed constraint optimization problems (DisCOPs) is presented. Agents assign variables sequentially and compute bounds on partial assignments asynchronously. The asynchronous bounds computation is…

Artificial Intelligence · Computer Science 2014-01-16 Amir Gershman , Amnon Meisels , Roie Zivan

Deep Learning's outstanding track record across several domains has stemmed from the use of error backpropagation (BP). Several studies, however, have shown that it is impossible to execute BP in a real brain. Also, BP still serves as an…

Machine Learning · Computer Science 2021-06-11 Swaroop Mishra , Anjana Arunkumar

We present Neural Bayesian Filtering (NBF), an algorithm for maintaining distributions over hidden states, called beliefs, in partially observable systems. NBF is trained to find a good latent representation of the beliefs induced by a…

Graph generation aims to sample discrete node and edge attributes while satisfying coupled structural constraints. Diffusion models for graphs often adopt largely factorized forward-noising, and many flow-matching methods start from…

Machine Learning · Computer Science 2026-02-02 Yida Xiong , Jiameng Chen , Xiuwen Gong , Jia Wu , Shirui Pan , Wenbin Hu

We propose a general algorithm for approximating nonstandard Bayesian posterior distributions. The algorithm minimizes the Kullback-Leibler divergence of an approximating distribution to the intractable posterior distribution. Our method…

Computation · Statistics 2014-07-29 Tim Salimans , David A. Knowles

Bayesian inference typically requires the computation of an approximation to the posterior distribution. An important requirement for an approximate Bayesian inference algorithm is to output high-accuracy posterior mean and uncertainty…

Statistics Theory · Mathematics 2018-10-03 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

This paper presents a new deterministic approximation technique in Bayesian networks. This method, "Expectation Propagation", unifies two previous techniques: assumed-density filtering, an extension of the Kalman filter, and loopy belief…

Artificial Intelligence · Computer Science 2013-01-14 Thomas P. Minka

Boolean matrix factorisation aims to decompose a binary data matrix into an approximate Boolean product of two low rank, binary matrices: one containing meaningful patterns, the other quantifying how the observations can be expressed as a…

Machine Learning · Statistics 2017-02-28 Tammo Rukat , Chris C. Holmes , Michalis K. Titsias , Christopher Yau

Deep generative models have gained recent traction in accelerated MRI reconstruction. Diffusion priors are particularly promising given their representational fidelity. Instead of the target transformation from undersampled to fully-sampled…

Image and Video Processing · Electrical Eng. & Systems 2023-12-19 Muhammad U. Mirza , Onat Dalmaz , Hasan A. Bedel , Gokberk Elmas , Yilmaz Korkmaz , Alper Gungor , Salman UH Dar , Tolga Çukur

Adapting Foundation Models (FMs) for downstream tasks through Federated Learning (FL) emerges a promising strategy for protecting data privacy and valuable FMs. Existing methods fine-tune FM by allocating sub-FM to clients in FL, however,…

Machine Learning · Computer Science 2024-04-30 Zhaopeng Peng , Xiaoliang Fan , Yufan Chen , Zheng Wang , Shirui Pan , Chenglu Wen , Ruisheng Zhang , Cheng Wang

Decision-focused learning (DFL) offers an end-to-end approach to the predict-then-optimize (PO) framework by training predictive models directly on decision loss (DL), enhancing decision-making performance within PO contexts. However, the…

Machine Learning · Computer Science 2025-04-15 Jiaqi Yang , Enming Liang , Zicheng Su , Zhichao Zou , Peng Zhen , Jiecheng Guo , Wanjing Ma , Kun An

Modern probabilistic regressors often remain overconfident under distribution shift. Functional Distribution Networks (FDN) place input-conditioned distributions over network weights, producing predictive mixtures whose dispersion adapts to…

Machine Learning · Computer Science 2026-02-03 Omer Haq