English
Related papers

Related papers: Principles of frugal inference and control

200 papers

Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here we propose an information-theoretic formalization of bounded rational decision-making…

Statistics Theory · Mathematics 2015-06-04 Pedro A. Ortega , Daniel A. Braun

We study an optimal process control problem with multiple assignable causes. The process is initially in-control but is subject to random transition to one of multiple out-of-control states due to assignable causes. The objective is to find…

Optimization and Control · Mathematics 2012-12-12 Jue Wang , Chi-Guhn Lee

Flexible, goal-directed behavior is a fundamental aspect of human life. Based on the free energy minimization principle, the theory of active inference formalizes the generation of such behavior from a computational neuroscience…

Artificial Intelligence · Computer Science 2022-08-03 Fedor Scholz , Christian Gumbsch , Sebastian Otte , Martin V. Butz

Although many investigators affirm a desire to build reasoning systems that behave consistently with the axiomatic basis defined by probability theory and utility theory, limited resources for engineering and computation can make a complete…

Artificial Intelligence · Computer Science 2013-04-11 Eric J. Horvitz

Partially Observable Markov Decision Processes (POMDPs) are a natural and general model in reinforcement learning that take into account the agent's uncertainty about its current state. In the literature on POMDPs, it is customary to assume…

Machine Learning · Computer Science 2022-03-24 Noah Golowich , Ankur Moitra , Dhruv Rohatgi

Active inference, a corollary of the free energy principle, is a formal way of describing the behavior of certain kinds of random dynamical systems that have the appearance of sentience. In this chapter, we describe how active inference…

Machine Learning · Statistics 2021-10-11 Noor Sajid , Lancelot Da Costa , Thomas Parr , Karl Friston

In Passive POMDPs actions do not affect the world state, but still incur costs. When the agent is bounded by information-processing constraints, it can only keep an approximation of the belief. We present a variational principle for the…

Machine Learning · Computer Science 2012-07-03 Roy Fox , Naftali Tishby

This work develops a novel power control framework for energy-efficient power control in wireless networks. The proposed method is a new branch-and-bound procedure based on problem-specific bounds for energy-efficiency maximization that…

Information Theory · Computer Science 2020-07-13 Bho Matthiesen , Alessio Zappone , Karl-L. Besser , Eduard A. Jorswieck , Merouane Debbah

Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data…

Machine Learning · Statistics 2016-03-11 Panagiotis Tsilifis , Roger G. Ghanem , Paris Hajali

The energy cost of computation has emerged as a central challenge at the intersection of physics and computer science. Recent advances in statistical physics -- particularly in stochastic thermodynamics -- enable precise characterizations…

Statistical Mechanics · Physics 2025-10-07 Jinghao Lyu , Kyle J. Ray , James P. Crutchfield

In this paper, we consider a self-triggered formulation of model predictive control. In this variant, the controller decides at the current sampling instant itself when the next sample should be taken and the optimization problem be solved…

Systems and Control · Electrical Eng. & Systems 2020-05-11 Stefan Wildhagen , Colin N. Jones , Frank Allgöwer

Despite being recognized as neurobiologically plausible, active inference faces difficulties when employed to simulate intelligent behaviour in complex environments due to its computational cost and the difficulty of specifying an…

Machine Learning · Computer Science 2024-06-12 Aswin Paul , Noor Sajid , Lancelot Da Costa , Adeel Razi

Continuous control and planning remains a major challenge in robotics and machine learning. Neuroscience offers the possibility of learning from animal brains that implement highly successful controllers, but it is unclear how to relate an…

Artificial Intelligence · Computer Science 2019-08-14 Saurabh Daptardar , Paul Schrater , Xaq Pitkow

Deregulated energy markets, demand forecasting, and the continuously increasing share of renewable energy sources call---among others---for a structured consideration of uncertainties in optimal power flow problems. The main challenge is to…

Optimization and Control · Mathematics 2018-08-24 Tillmann Mühlpfordt , Timm Faulwasser , Veit Hagenmeyer

The Free Energy Principle (FEP) states that under suitable conditions of weak coupling, random dynamical systems with sufficient degrees of freedom will behave so as to minimize an upper bound, formalized as a variational free energy, on…

Quantum Physics · Physics 2022-07-21 Chris Fields , Karl Friston , James F. Glazebrook , Michael Levin

Online decision making under uncertainty in partially observable domains, also known as Belief Space Planning, is a fundamental problem in robotics and Artificial Intelligence. Due to an abundance of plausible future unravelings,…

Artificial Intelligence · Computer Science 2023-02-15 Andrey Zhitnikov , Vadim Indelman

Reliable high-fidelity quantum state transformation has always been considered as an inseparable part of quantum information processing. In this regard, Pontryagin maximum principle has proved to play an important role to achieve the…

Quantum Physics · Physics 2023-02-21 Nahid Binandeh Dehaghani , A. Pedro Aguiar

Discrete-time stochastic optimal control remains a challenging problem for general, nonlinear systems under significant uncertainty, with practical solvers typically relying on the certainty equivalence assumption, replanning and/or…

Systems and Control · Electrical Eng. & Systems 2021-03-12 Joe Watson , Jan Peters

This paper introduces a novel concept, fuzzy-logic-based model predictive control (FLMPC), along with a multi-robot control approach for exploring unknown environments and locating targets. Traditional model predictive control (MPC) methods…

Robotics · Computer Science 2025-03-28 Filip Surma , Anahita Jamshidnejad

Organisms are nonequilibrium, stationary systems self-organized via spontaneous symmetry breaking and undergoing metabolic cycles with broken detailed balance in the environment. The thermodynamic free-energy principle describes an…

Neurons and Cognition · Quantitative Biology 2022-11-24 Chang Sub Kim