English
Related papers

Related papers: Perturb-and-max-product: Sampling and learning in …

200 papers

We study the problem of learning associative memory -- a system which is able to retrieve a remembered pattern based on its distorted or incomplete version. Attractor networks provide a sound model of associative memory: patterns are stored…

Machine Learning · Statistics 2021-04-21 Sergey Bartunov , Jack W Rae , Simon Osindero , Timothy P Lillicrap

Predictive models are highly advanced in understanding the mechanisms of brain function. Recent advances in machine learning further underscore the power of prediction for optimal representation in learning. However, there remains a gap in…

Machine Learning · Computer Science 2025-05-22 Xingsi Dong , Xiangyuan Peng , Si Wu

Sum-product networks (SPNs) are a class of probabilistic graphical models that allow tractable marginal inference. However, the maximum a posteriori (MAP) inference in SPNs is NP-hard. We investigate MAP inference in SPNs from both…

Artificial Intelligence · Computer Science 2017-11-21 Jun Mei , Yong Jiang , Kewei Tu

We present a sampling-based Model Predictive Control (MPC) method that implements Model Predictive Path Integral (MPPI) as an \emph{Ising machine}, suitable for novel forms of probabilistic computing. By expressing the control problem as a…

Systems and Control · Electrical Eng. & Systems 2025-12-18 Lorin Werthen-Brabants , Pieter Simoens

Determinantal Point Processes (DPPs) are a family of probabilistic models that have a repulsive behavior, and lend themselves naturally to many tasks in machine learning where returning a diverse set of objects is important. While there are…

Statistics Theory · Mathematics 2017-03-03 John Urschel , Victor-Emmanuel Brunel , Ankur Moitra , Philippe Rigollet

We study the problem of posterior sampling in discrete-state spaces using discrete diffusion models. While posterior sampling methods for continuous diffusion models have achieved remarkable progress, analogous methods for discrete…

Machine Learning · Computer Science 2025-11-04 Wenda Chu , Zihui Wu , Yifan Chen , Yang Song , Yisong Yue

Many Bayesian statistical inference problems come down to computing a maximum a-posteriori (MAP) assignment of latent variables. Yet, standard methods for estimating the MAP assignment do not have a finite time guarantee that the algorithm…

Machine Learning · Statistics 2024-10-31 Harsh Vardhan Dubey , Ji Ah Lee , Patrick Flaherty

Autonomous aerial vehicles necessitate control strategies that balance computational efficiency with robust performance in dynamic operational environments. This paper proposes a model predictive control (MPC) framework for aerial platforms…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Tayyab Manzoor , Yasir Ali , Yuanqing Xia , Lijie You , Yan Wang

Group-based sparsity models are proven instrumental in linear regression problems for recovering signals from much fewer measurements than standard compressive sensing. The main promise of these models is the recovery of "interpretable"…

Machine Learning · Computer Science 2015-03-05 Luca Baldassarre , Nirav Bhan , Volkan Cevher , Anastasios Kyrillidis , Siddhartha Satpathi

The performances of a new data processing technique, namely the Empirical Mode Decomposition, are evaluated on a fully developed turbulent velocity signal perturbed by a numerical forcing which mimics a long-period flapping. First, we…

Fluid Dynamics · Physics 2015-05-20 Nicolas Mazellier , Fabrice Foucher

Current state-of-the-art generative models map noise to data distributions by matching flows or scores. A key limitation of these models is their inability to readily integrate available partial observations and additional priors. In…

The power-expected-posterior (PEP) prior provides an objective, automatic, consistent and parsimonious model selection procedure. At the same time it resolves the conceptual and computational problems due to the use of imaginary data.…

Methodology · Statistics 2017-10-02 Dimitris Fouskakis , Ioannis Ntzoufras , Konstantinos Perrakis

In this paper, we study sampling from a posterior derived from a neural network. We propose a new probabilistic model consisting of adding noise at every pre- and post-activation in the network, arguing that the resulting posterior can be…

Machine Learning · Computer Science 2024-07-22 Giovanni Piccioli , Emanuele Troiani , Lenka Zdeborová

Generative Recommendation (GR) has recently transitioned from atomic item-indexing to Semantic ID (SID)-based frameworks to capture intrinsic item relationships and enhance generalization. However, the adoption of high-granularity SIDs…

Information Retrieval · Computer Science 2026-04-08 Tianyu Zhan , Kairui Fu , Chengfei Lv , Zheqi Lv , Shengyu Zhang

RBM-MPC is a computationally efficient variant of Model Predictive Control (MPC) in which the Random Batch Method (RBM) is used to speed up the finite-horizon optimal control problems at each iteration. In this paper, stability and…

Optimization and Control · Mathematics 2024-03-08 Daniël Veldman , Alexandra Borkowski , Enrique Zuazua

A robust model predictive control (MPC) method is presented for linear, time-invariant systems affected by bounded additive disturbances. The main contribution is the offline design of a disturbance-affine feedback gain whereby the…

Systems and Control · Electrical Eng. & Systems 2022-11-16 Anilkumar Parsi , Panagiotis Anagnostaras , Andrea Iannelli , Roy S. Smith

Determinantal point processes (DPPs) are random point processes well-suited for modeling repulsion. In machine learning, the focus of DPP-based models has been on diverse subset selection from a discrete and finite base set. This discrete…

Machine Learning · Statistics 2013-11-14 Raja Hafiz Affandi , Emily B. Fox , Ben Taskar

Energy-based models are popular in machine learning due to the elegance of their formulation and their relationship to statistical physics. Among these, the Restricted Boltzmann Machine (RBM), and its staple training algorithm contrastive…

Machine Learning · Computer Science 2015-04-09 Daniel Jiwoong Im , Ethan Buchman , Graham W. Taylor

We introduce the Generalized Energy Based Model (GEBM) for generative modelling. These models combine two trained components: a base distribution (generally an implicit model), which can learn the support of data with low intrinsic…

Machine Learning · Statistics 2021-12-22 Michael Arbel , Liang Zhou , Arthur Gretton

Sampling-based methods are widely adopted solutions for robot motion planning. The methods are straightforward to implement, effective in practice for many robotic systems. It is often possible to prove that they have desirable properties,…

Robotics · Computer Science 2022-11-16 Troy McMahon , Aravind Sivaramakrishnan , Edgar Granados , Kostas E. Bekris