English
Related papers

Related papers: Perturb-and-max-product: Sampling and learning in …

200 papers

We present a Gibbs sampling solution to the map-making problem for CMB measurements, building on existing destriping methodology. Gibbs sampling breaks the computationally heavy destriping problem into two separate steps; noise filtering…

We develop a learning-based framework for constructing shrinking disturbance-invariant tubes under state- and input-dependent uncertainty, intended as a building block for tube Model Predictive Control (MPC), and certify safety via a…

Systems and Control · Electrical Eng. & Systems 2026-01-19 Abdelrahman Ramadan , Sidney Givigi

We present a compartmentalized approach to finding the maximum a-posteriori (MAP) estimate of a latent time series that obeys a dynamic stochastic model and is observed through noisy measurements. We specifically consider modern signal…

Optimization and Control · Mathematics 2018-10-15 Gabriel Schamberg , Demba Ba , Todd P. Coleman

We present a novel approach to enhance the performance of sampling-based Model Predictive Control (MPC) in constrained optimization by leveraging products of experts. Our methodology divides the main problem into two components: one focused…

Robotics · Computer Science 2026-01-16 Amirreza Razmjoo , Teng Xue , Suhan Shetty , Sylvain Calinon

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal point processes and…

Machine Learning · Computer Science 2018-07-10 Alkis Gotovos , Hamed Hassani , Andreas Krause , Stefanie Jegelka

Diffusion models optimized via variational inference (VI) have emerged as a promising tool for generating samples from unnormalized target densities. These models create samples by simulating a stochastic differential equation, starting…

Machine Learning · Computer Science 2025-03-04 Denis Blessing , Xiaogang Jia , Gerhard Neumann

Learning uncertain dynamics models using Gaussian process~(GP) regression has been demonstrated to enable high-performance and safety-aware control strategies for challenging real-world applications. Yet, for computational tractability,…

Optimization and Control · Mathematics 2024-09-17 Manish Prajapat , Amon Lahr , Johannes Köhler , Andreas Krause , Melanie N. Zeilinger

We propose Parallelised Diffeomorphic Sampling-based Motion Planning (PDMP). PDMP is a novel parallelised framework that uses bijective and differentiable mappings, or diffeomorphisms, to transform sampling distributions of sampling-based…

Robotics · Computer Science 2021-09-24 Tin Lai , Weiming Zhi , Tucker Hermans , Fabio Ramos

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

Maximum likelihood (ML) learning for energy-based models (EBMs) is challenging, partly due to non-convergence of Markov chain Monte Carlo.Several variations of ML learning have been proposed, but existing methods all fail to achieve both…

Machine Learning · Statistics 2023-04-24 Xinwei Zhang , Zhiqiang Tan , Zhijian Ou

The performance of Maximum a posteriori (MAP) estimation is studied analytically for binary symmetric multi-channel Hidden Markov processes. We reduce the estimation problem to a 1D Ising spin model and define order parameters that…

Statistical Mechanics · Physics 2015-06-11 Avik Halder , Ansuman Adhikary

Sampling-based motion planning (SBMP) algorithms are renowned for their robust global search capabilities. However, the inherent randomness in their sampling mechanisms often result in inconsistent path quality and limited search…

Robotics · Computer Science 2024-10-27 Lei Zhuang , Jingdong Zhao , Yuntao Li , Zichun Xu , Liangliang Zhao , Hong Liu

Energy-based models (EBMs) are a simple yet powerful framework for generative modeling. They are based on a trainable energy function which defines an associated Gibbs measure, and they can be trained and sampled from via well-established…

Machine Learning · Computer Science 2021-05-06 Carles Domingo-Enrich , Alberto Bietti , Eric Vanden-Eijnden , Joan Bruna

The Dirichlet process mixture (DPM) is a ubiquitous, flexible Bayesian nonparametric statistical model. However, full probabilistic inference in this model is analytically intractable, so that computationally intensive techniques such as…

Machine Learning · Statistics 2014-11-05 Yordan P. Raykov , Alexis Boukouvalas , Max A. Little

Most recent machine learning research focuses on developing new classifiers for the sake of improving classification accuracy. With many well-performing state-of-the-art classifiers available, there is a growing need for understanding…

Machine Learning · Computer Science 2020-09-30 Jaehoon Koo , Diego Klabjan , Jean Utke

Energy-Based Models (EBMs) have proven to be a highly effective approach for modelling densities on finite-dimensional spaces. Their ability to incorporate domain-specific choices and constraints into the structure of the model through…

Machine Learning · Computer Science 2023-02-24 Jen Ning Lim , Sebastian Vollmer , Lorenz Wolf , Andrew Duncan

In this paper we relate the partition function to the max-statistics of random variables. In particular, we provide a novel framework for approximating and bounding the partition function using MAP inference on randomly perturbed models. As…

Machine Learning · Computer Science 2012-07-03 Tamir Hazan , Tommi Jaakkola

Sampling-based Motion Planners (SMPs) have become increasingly popular as they provide collision-free path solutions regardless of obstacle geometry in a given environment. However, their computational complexity increases significantly…

Robotics · Computer Science 2018-09-28 Ahmed H. Qureshi , Michael C. Yip

Disordered molecular systems such as amorphous catalysts, organic thin films, electrolyte solutions, and water are at the cutting edge of computational exploration today. Traditional simulations of such systems at length-scales relevant to…

Mesoscale and Nanoscale Physics · Physics 2023-09-06 Ata Madanchi , Michael Kilgour , Frederik Zysk , Thomas D. Kühne , Lena Simine

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the…

Machine Learning · Computer Science 2020-06-11 Quentin Berthet , Mathieu Blondel , Olivier Teboul , Marco Cuturi , Jean-Philippe Vert , Francis Bach