English
Related papers

Related papers: Understanding the dynamics of message passing algo…

200 papers

Many automated system analysis techniques (e.g., model checking, model-based testing) rely on first obtaining a model of the system under analysis. System modeling is often done manually, which is often considered as a hindrance to adopt…

Software Engineering · Computer Science 2019-11-22 Jingyi Wang , Jun Sun , Qixia Yuan , Jun Pang

In physics we often use very simple models to describe systems with many degrees of freedom, but it is not clear why or how this success can be transferred to the more complex biological context. We consider models for the joint…

Neurons and Cognition · Quantitative Biology 2024-12-06 Luisa Ramirez , William Bialek , Stephanie E. Palmer , David J. Schwab

The inferential model (IM) framework provides valid prior-free probabilistic inference by focusing on predicting unobserved auxiliary variables. But, efficient IM-based inference can be challenging when the auxiliary variable is of higher…

Statistics Theory · Mathematics 2015-01-20 Ryan Martin , Chuanhai Liu

When an expert operates a perilous dynamic system, ideal constraint information is tacitly contained in their demonstrated trajectories and controls. The likelihood of these demonstrations can be computed, given the system dynamics and task…

Systems and Control · Electrical Eng. & Systems 2021-02-26 David L. McPherson , Kaylene C. Stocking , S. Shankar Sastry

We develop a message-passing algorithm for noisy matrix completion problems based on matrix factorization. The algorithm is derived by approximating message distributions of belief propagation with Gaussian distributions that share the same…

Machine Learning · Statistics 2021-10-27 Koki Okajima , Yoshiyuki Kabashima

This technical note considers the sampling of outcomes that provide the greatest amount of information about the structure of underlying world models. This generalisation furnishes a principled approach to structure learning under a…

Neurons and Cognition · Quantitative Biology 2025-12-25 Karl Friston , Lancelot Da Costa , Alexander Tschantz , Conor Heins , Christopher Buckley , Tim Verbelen , Thomas Parr

We study the problem of efficient exploration in order to learn an accurate model of an environment, modeled as a Markov decision process (MDP). Efficient exploration in this problem requires the agent to identify the regions in which…

Improved mean-field technics are a central theme of statistical physics methods applied to inference and learning. We revisit here some of these methods using high-temperature expansions for disordered systems initiated by Plefka, Georges…

Disordered Systems and Neural Networks · Physics 2020-06-11 Antoine Maillard , Laura Foini , Alejandro Lage Castellanos , Florent Krzakala , Marc Mézard , Lenka Zdeborová

We explore the probabilistic foundations of shared control in complex dynamic environments. In order to do this, we formulate shared control as a random process and describe the joint distribution that governs its behavior. For…

Robotics · Computer Science 2015-08-10 Pete Trautman

We model messaging activities as a hierarchical doubly stochastic point process with three main levels, and develop an iterative algorithm for inferring actors' relative latent positions from a stream of messaging activity data. Each of the…

Machine Learning · Statistics 2013-04-26 Nam H. Lee , Jordan Yoder , Minh Tang , Carey E Priebe

The aim of this paper is to show how free probability theory sheds light on spectral properties of deformed matricial models and provides a unified understanding of various asymptotic phenomena such as spectral measure description,…

Probability · Mathematics 2016-07-20 M Capitaine , C Donati-Martin

We introduce a methodology for seeking conservation laws within a Hamiltonian dynamical system, which we term ``neural deflation''. Inspired by deflation methods for steady states of dynamical systems, we propose to {iteratively} train a…

Pattern Formation and Solitons · Physics 2023-03-29 Wei Zhu , Hong-Kun Zhang , P. G. Kevrekidis

This paper develops a rigorous probabilistic framework that extends denoising diffusion models to the setting of noncommutative random variables. Building on Voiculescu's theory of free entropy and free Fisher information, we formulate…

Probability · Mathematics 2025-11-04 Swagatam Das

Social dynamics is concerned primarily with interactions among individuals and the resulting group behaviors, modeling the temporal evolution of social systems via the interactions of individuals within these systems. In particular, the…

Machine Learning · Statistics 2016-11-08 Zhen Xu , Wen Dong , Sargur Srihari

Active inference is a normative framework for explaining behaviour under the free energy principle -- a theory of self-organisation originating in neuroscience. It specifies neuronal dynamics for state-estimation in terms of a descent on…

Neurons and Cognition · Quantitative Biology 2021-10-26 Lancelot Da Costa , Thomas Parr , Biswa Sengupta , Karl Friston

Modeling the complex interactions of systems of particles or agents is a fundamental scientific and mathematical problem that is studied in diverse fields, ranging from physics and biology, to economics and machine learning. In this work,…

Machine Learning · Statistics 2020-10-09 Jason Miller , Sui Tang , Ming Zhong , Mauro Maggioni

We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms for learning a…

Machine Learning · Computer Science 2023-07-11 Davin Choo , Yuval Dagan , Constantinos Daskalakis , Anthimos Vardis Kandiros

All reinforcement learning algorithms must handle the trade-off between exploration and exploitation. Many state-of-the-art deep reinforcement learning methods use noise in the action selection, such as Gaussian noise in policy gradient…

Machine Learning · Computer Science 2018-04-05 Trevor Barron , Oliver Obst , Heni Ben Amor

Advanced inference techniques allow one to reconstruct the pattern of interaction from high dimensional data sets. We focus here on the statistical properties of inferred models and argue that inference procedures are likely to yield models…

Data Analysis, Statistics and Probability · Physics 2013-10-09 Iacopo Mastromatteo , Matteo Marsili

This paper shows the existence of independent random matching of a large (continuum) population in both static and dynamic systems, which has been popular in the economics and genetics literatures. We construct a joint agent-probability…

Probability · Mathematics 2007-05-23 Darrell Duffie , Yeneng Sun
‹ Prev 1 8 9 10 Next ›