English
Related papers

Related papers: Neural Network Approximators for Marginal MAP in P…

200 papers

In several multiobjective decision problems Pairwise Comparison Matrices (PCM) are applied to evaluate the decision variants. The problem that arises very often is the inconsistency of a given PCM. In such a situation it is important to…

Optimization and Control · Mathematics 2024-12-10 Marcin Anholcer , Janos Fülöp

Much effort has been directed at algorithms for obtaining the highest probability configuration in a probabilistic random field model known as the maximum a posteriori (MAP) inference problem. In many situations, one could benefit from…

Artificial Intelligence · Computer Science 2012-10-19 Dhruv Batra

We present the first near optimal approximation schemes for the maximum weighted (uncapacitated or capacitated) $b$--matching problems for non-bipartite graphs that run in time (near) linear in the number of edges. For any…

Data Structures and Algorithms · Computer Science 2018-06-19 Kook Jin Ahn , Sudipto Guha

Deep neural networks enjoy a powerful representation and have proven effective in a number of applications. However, recent advances show that deep neural networks are vulnerable to adversarial attacks incurred by the so-called adversarial…

Machine Learning · Computer Science 2019-11-21 Lirong He , Ziyi Guo , Kaizhu Huang , Zenglin Xu

Behavioral experiments on humans and animals suggest that the brain performs probabilistic inference to interpret its environment. Here we present a new general-purpose, biologically-plausible neural implementation of approximate inference.…

Neurons and Cognition · Quantitative Biology 2016-05-24 Rajkumar Vasudeva Raju , Xaq Pitkow

Sparse structure learning in high-dimensional Gaussian graphical models is an important problem in multivariate statistical signal processing; since the sparsity pattern naturally encodes the conditional independence relationship among…

Methodology · Statistics 2023-09-26 Ksheera Sagar , Jyotishka Datta , Sayantan Banerjee , Anindya Bhadra

Probabilistic Circuits (PCs) are a promising avenue for probabilistic modeling. They combine advantages of probabilistic graphical models (PGMs) with those of neural networks (NNs). Crucially, however, they are tractable probabilistic…

Machine Learning · Computer Science 2021-06-07 Anji Liu , Guy Van den Broeck

Recently, machine learning, particularly message-passing graph neural networks (MPNNs), has gained traction in enhancing exact optimization algorithms. For example, MPNNs speed up solving mixed-integer optimization problems by imitating…

Machine Learning · Computer Science 2023-10-17 Chendi Qian , Didier Chételat , Christopher Morris

Probabilistic inference is a fundamental task in modern machine learning. Recent advances in tensor network (TN) contraction algorithms have enabled the development of better exact inference methods. However, many common inference tasks in…

Machine Learning · Computer Science 2024-09-10 Martin Roa-Villescas , Xuanzhao Gao , Sander Stuijk , Henk Corporaal , Jin-Guo Liu

Discrete optimization is a central problem in artificial intelligence. The optimization of the aggregated cost of a network of cost functions arises in a variety of problems including (W)CSP, DCOP, as well as optimization in stochastic…

Artificial Intelligence · Computer Science 2018-01-12 Ferdinando Fioretto , Enrico Pontelli , William Yeoh , Rina Dechter

Model Predictive Control (MPC) is a method to control nonlinear systems with guaranteed stability and constraint satisfaction but suffers from high computation times. Approximate MPC (AMPC) with neural networks (NNs) has emerged to address…

Systems and Control · Electrical Eng. & Systems 2024-09-24 Henrik Hose , Alexander Gräfe , Sebastian Trimpe

Probabilistic Circuits (PCs) are tractable representations of probability distributions allowing for exact and efficient computation of likelihoods and marginals. Recent advancements have improved the scalability of PCs either by leveraging…

Machine Learning · Computer Science 2025-06-17 Honghua Zhang , Meihua Dang , Benjie Wang , Stefano Ermon , Nanyun Peng , Guy Van den Broeck

Efficiently finding the maximum a posteriori (MAP) configuration of a graphical model is an important problem which is often implemented using message passing algorithms. The optimality of such algorithms is only well established for…

Artificial Intelligence · Computer Science 2012-05-14 Tony S. Jebara

Scalable high-quality MAP inference in arbitrary-order Markov Random Fields (MRFs) remains challenging. Approximate message-passing methods are often efficient but can degrade on dense or high-order instances, while exact solvers such as…

Machine Learning · Computer Science 2026-05-08 Yaomin Wang , Chaolong Ying , Xiaodong Luo , Tianshu Yu

Mixed-integer linear programming (MILP) is widely employed for modeling combinatorial optimization problems. In practice, similar MILP instances with only coefficient variations are routinely solved, and machine learning (ML) algorithms are…

Optimization and Control · Mathematics 2023-03-07 Qingyu Han , Linxin Yang , Qian Chen , Xiang Zhou , Dong Zhang , Akang Wang , Ruoyu Sun , Xiaodong Luo

We propose a novel approximate inference algorithm that approximates a target distribution by amortising the dynamics of a user-selected MCMC sampler. The idea is to initialise MCMC using samples from an approximation network, apply the…

Machine Learning · Statistics 2017-05-23 Yingzhen Li , Richard E. Turner , Qiang Liu

We propose a new method for low-rank approximation of Moore-Penrose pseudoinverses (MPPs) of large-scale matrices using tensor networks. The computed pseudoinverses can be useful for solving or preconditioning of large-scale overdetermined…

Numerical Analysis · Mathematics 2016-07-06 Namgil Lee , Andrzej Cichocki

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

We consider the structured-output prediction problem through probabilistic approaches and generalize the "perturb-and-MAP" framework to more challenging weighted Hamming losses, which are crucial in applications. While in principle our…

Machine Learning · Statistics 2018-11-22 Tatiana Shpakova , Francis Bach , Anton Osokin

Probabilistic generative neural networks are useful for many applications, such as image classification, speech recognition and occlusion removal. However, the power budget for hardware implementations of neural networks can be extremely…

Neural and Evolutionary Computing · Computer Science 2017-05-09 Xiaojing Xu , Srinjoy Das , Ken Kreutz-Delgado