English
Related papers

Related papers: Entropy production bounds for systems running comp…

200 papers

We study the problem of entropy calibration, which asks whether a language model's entropy over generations matches its log loss on human text. Past work found that models are miscalibrated, with entropy per step increasing as generations…

Computation and Language · Computer Science 2026-01-14 Steven Cao , Gregory Valiant , Percy Liang

On a fine grained scale the Gibbs entropy of an isolated system remains constant throughout its dynamical evolution. This is a consequence of Liouville's theorem for Hamiltonian systems and appears to contradict the second law of…

Statistical Mechanics · Physics 2017-07-05 Renato Pakter , Yan Levin

We perform a study on quantum entropy production, different kinds of correlations, and their interplay in the driven Caldeira-Leggett model of quantum Brownian motion. The model, taken with a large but finite number of bath modes, is…

Quantum Physics · Physics 2021-11-24 Alessandra Colla , Heinz-Peter Breuer

Model predictive control (MPC) is capable of controlling nonlinear systems with guaranteed constraint satisfaction and stability. However, MPC requires solving optimization problems online periodically, which often exceeds the local…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Alexander Gräfe , Sebastian Trimpe

In this paper, we propose a novel model predictive control (MPC) framework for output tracking that deals with partially unknown constraints. The MPC scheme optimizes over a learning and a backup trajectory. The learning trajectory aims to…

Optimization and Control · Mathematics 2022-05-10 Raffaele Soloperto , Ali Mesbah , Frank Allgöwer

We study the inherent space requirements of shared storage algorithms in asynchronous fault-prone systems. Previous works use codes to achieve a better storage cost than the well-known replication approach. However, a closer look reveals…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-21 Alexander Spiegelman , Yuval Cassuto , Gregory Chockler , Idit Keidar

Optimizing pump operations is a challenging task for real-time management of water distribution systems (WDSs). With suitable pump scheduling, pumping costs can be significantly reduced. In this research, a novel economic model predictive…

Systems and Control · Electrical Eng. & Systems 2021-05-06 Ye Wang , Kevin Too Yok , Wenyan Wu , Angus R. Simpson , Erik Weyer , Chris Manzie

Within an inherently classical perspective, there is always an unavoidable energy cost associated with the information deletion and this common lore is at the heart of the Landauer's conjecture that does not impose, per se, any relevant…

Quantum Physics · Physics 2025-07-15 Massimo Giovannini

In hybrid Model Predictive Control (MPC), a Mixed-Integer Quadratic Program (MIQP) is solved at each sampling time to compute the optimal control action. Although these optimizations are generally very demanding, in MPC we expect…

Systems and Control · Electrical Eng. & Systems 2020-04-01 Tobia Marcucci , Russ Tedrake

Entropy is a fundamental concept from Thermodynamics and it can be used to study models on context of Creation Cold Dark Matter (CCDM). From conditions on the first ($\dot{S}\geq0$)\footnote{Throughout the present work we will use dots to…

General Relativity and Quantum Cosmology · Physics 2020-12-02 R. Valentim , J. F. Jesus

The laws of thermodynamics apply to biophysical systems on the nanoscale as described by the framework of stochastic thermodynamics. This theory provides universal, exact relations for quantities like work, which have been verified in…

Statistical Mechanics · Physics 2024-09-26 Julius Degünther , Jann van der Meer , Udo Seifert

The expressions for entropy production, free energy, and entropy extraction rates are derived for a Brownian particle that walks in an underdamped medium. Our analysis indicates that as long as the system is driven out of equilibrium, it…

Statistical Mechanics · Physics 2021-02-18 Mesfin Asfaw Taye

The application of principles of thermodynamics and statistical mechanics to economic systems is considered in a broad historical perspective, extending from prehistoric times to the present day. The hypothesis of maximum entropy production…

Statistical Mechanics · Physics 2007-05-23 Alastair D. Jenkins

We observe an infinite sequence of independent identically distributed random variables $X_1,X_2,\ldots$ drawn from an unknown distribution $p$ over $[n]$, and our goal is to estimate the entropy $H(p)=-\mathbb{E}[\log p(X)]$ within an…

Information Theory · Computer Science 2025-04-24 Tomer Berg , Or Ordentlich , Ofer Shayevitz

We discuss the validity of close-to-equilibrium entropy production principles in the context of linear electrical circuits. Both the minimum and the maximum entropy production principle are understood within dynamical fluctuation theory.…

Statistical Mechanics · Physics 2015-05-14 Stijn Bruers , Christian Maes , Karel Netocny

Model predictive control (MPC) is an optimization-based control strategy with broad industrial adoption. Unfortunately, the required computation time to solve the receding-horizon MPC optimization problem can become prohibitively large for…

Systems and Control · Electrical Eng. & Systems 2024-10-24 S. A. N. Nouwens , B. de Jager , M. M. Paulides , W. P. M. H. Heemels

In stochastic thermodynamics, the entropy production of a thermodynamic system is defined by the irreversibility measured by the logarithm of the ratio of the path probabilities in the forward and reverse processes. We derive the relation…

Statistical Mechanics · Physics 2018-03-14 Hyun-Myung Chun , Jae Dong Noh

Industrial embedded systems are typically used to execute simple control algorithms due to their low computational resources. Despite these limitations, the implementation of advanced control techniques such as Model Predictive Control…

Systems and Control · Electrical Eng. & Systems 2025-11-06 Victor Gracia , Pablo Krupa , Filiberto Fele , Teodoro Alamo

There is a relation between the irreversibility of thermodynamic processes as expressed by the breaking of time-reversal symmetry, and the entropy production in such processes. We explain on an elementary mathematical level the relations…

Statistical Mechanics · Physics 2007-05-23 C. Maes , K. Netocny

Real continuous submodular functions, as a generalization of the corresponding discrete notion to the continuous domain, gained considerable attention recently. The analog notion for entropy functions requires additional properties: a real…

Optimization and Control · Mathematics 2021-02-12 Laszlo Csirmaz