English
Related papers

Related papers: Targeted free energy estimation via learned mappin…

200 papers

Data association, the reasoning over correspondence between targets and measurements, is a problem of fundamental importance in target tracking. Recently, belief propagation (BP) has emerged as a promising method for estimating the marginal…

Artificial Intelligence · Computer Science 2018-01-25 Jason L. Williams , Roslyn A. Lau

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

We present a method for determining the free energy dependence on a selected number of collective variables using an adaptive bias. The formalism provides a unified description which has metadynamics and canonical sampling as limiting…

Statistical Mechanics · Physics 2008-03-31 Alessandro Barducci , Giovanni Bussi , Michele Parrinello

We present a message passing approach to Expected Free Energy (EFE) minimization on factor graphs, based on the theory introduced in arXiv:2504.14898. By reformulating EFE minimization as Variational Free Energy minimization with epistemic…

Artificial Intelligence · Computer Science 2026-03-03 Wouter W. L. Nuijten , Mykola Lukashchuk , Thijs van de Laar , Bert de Vries

In distributed and federated learning, heterogeneity across data sources remains a major obstacle to effective model aggregation and convergence. We focus on feature heterogeneity and introduce energy distance as a sensitive measure for…

Machine Learning · Statistics 2025-01-28 Mengchen Fan , Baocheng Geng , Roman Shterenberg , Joseph A. Casey , Zhong Chen , Keren Li

Exact free energy minimization is a convex optimization problem that is usually approximated with stochastic sampling methods. Deterministic approximations have been less successful because many desirable properties have been difficult to…

Computational Physics · Physics 2016-03-17 Jonathan E. Moussa

Predicting student success or failure is vital for timely interventions and personalized support. Early failure prediction is particularly crucial, yet limited data availability in the early stages poses challenges, one of the possible…

Computers and Society · Computer Science 2025-05-13 Ikram Gagaoua , Armelle Brun , Anne Boyer

Federated edge learning (FEEL) is a promising distributed learning technique for next-generation wireless networks. FEEL preserves the user's privacy, reduces the communication costs, and exploits the unprecedented capabilities of edge…

Machine Learning · Computer Science 2021-04-13 Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Aiman Erbad

Variational inference in probabilistic graphical models aims to approximate fundamental quantities such as marginal distributions and the partition function. Popular approaches are the Bethe approximation, tree-reweighted, and other types…

Machine Learning · Statistics 2025-02-06 Harald Leisenberger , Franz Pernkopf

The minimum free-energy path (MFEP) is the most probable route of the nucleation process on the multidimensional free-energy surface. In this study, the phase-field equation is used as a mathematical tool to deduce the minimum free-energy…

Materials Science · Physics 2015-05-13 Masao Iwamatsu

Improved EM strategies, based on the idea of efficient data augmentation (Meng and van Dyk 1997, 1998), are presented for ML estimation of mixture proportions. The resulting algorithms inherit the simplicity, ease of implementation, and…

Computation · Statistics 2010-02-22 Yaming Yu

This paper presents a novel decision-focused framework integrating the physical energy storage model into machine learning pipelines. Motivated by the model predictive control for energy storage, our end-to-end method incorporates the prior…

Systems and Control · Electrical Eng. & Systems 2024-12-06 Ming Yi , Saud Alghumayjan , Bolun Xu

The goal to decarbonize the energy sector has led to increased research in modeling and optimizing multi-energy systems. One of the most promising techniques for modeling (multi-)energy optimization problems is mixed-integer programming…

Optimization and Control · Mathematics 2025-05-21 Stephanie Riedmüller , Annika Buchholz , Janina Zittel

Estimating free energy differences, an important problem in computational drug discovery and in a wide range of other application areas, commonly involves a computationally intensive process of sampling a family of high-dimensional…

Planning effective interventions in biological systems requires treatment-effect models that adapt to unseen biological contexts by identifying their specific underlying mechanisms. Yet single-cell perturbation datasets span only a handful…

Machine Learning · Computer Science 2026-05-08 Marvin Sextro , Weronika Kłos , Gabriel Dernbach

We introduce a new procedure to construct weight factors, which flatten the probability density of the overlap with respect to some pre-defined reference configuration. This allows one to overcome free energy barriers in the overlap…

Statistical Mechanics · Physics 2009-11-10 B. A. Berg , H. Noguchi , Y. Okamoto

The Free Energy Principle (FEP) is a theoretical framework for describing how (intelligent) systems self-organise into coherent, stable structures by minimising a free energy functional. Active Inference (AIF) is a corollary of the FEP that…

Artificial Intelligence · Computer Science 2023-10-17 Magnus Koudahl , Thijs van de Laar , Bert de Vries

Thermodynamic phase transitions, a central concept in physics and chemistry, are typically controlled by an interplay of enthalpic and entropic contributions. In most cases, the estimation of the enthalpy in simulations is straightforward…

Soft Condensed Matter · Physics 2025-10-30 Yamin Ben-Shimon , Barak Hirshberg , Yohai Bar-Sinai

The free energy principle (FEP) states that any dynamical system can be interpreted as performing Bayesian inference upon its surrounding environment. In this work, we examine in depth the assumptions required to derive the FEP in the…

Neurons and Cognition · Quantitative Biology 2022-05-23 Miguel Aguilera , Beren Millidge , Alexander Tschantz , Christopher L. Buckley

The embedding-based representation learning is commonly used in deep learning recommendation models to map the raw sparse features to dense vectors. The traditional embedding manner that assigns a uniform size to all features has two…

Machine Learning · Computer Science 2021-03-12 Siyi Liu , Chen Gao , Yihong Chen , Depeng Jin , Yong Li