English
Related papers

Related papers: Energy--Information Trade-off Induces Continuous a…

200 papers

The increase and rapid growth of data produced by scientific instruments, the Internet of Things (IoT), and social media is causing data transfer performance and resource consumption to garner much attention in the research community. The…

Performance · Computer Science 2023-09-29 Hasibul Jamil , Lavone Rodolph , Jacob Goldverg , Tevfik Kosar

We consider a real-time monitoring system where a source node (with energy limitations) aims to keep the information status at a destination node as fresh as possible by scheduling status update transmissions over a set of channels. The…

Networking and Internet Architecture · Computer Science 2025-09-24 Mohamed A. Abd-Elmagid , Ming Shi , Eylem Ekici , Ness B. Shroff

A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations,…

Statistical Mechanics · Physics 2012-10-09 Susanne Still , David A. Sivak , Anthony J. Bell , Gavin E. Crooks

Temporal gates play a significant role in modern recurrent-based neural encoders, enabling fine-grained control over recursive compositional operations over time. In recurrent models such as the long short-term memory (LSTM), temporal gates…

Computation and Language · Computer Science 2017-11-22 Yi Tay , Luu Anh Tuan , Siu Cheung Hui

Predictive coding (PC) is an influential theory in computational neuroscience, which argues that the cortex forms unsupervised world models by implementing a hierarchical process of prediction error minimization. PC networks (PCNs) are…

Neural and Evolutionary Computing · Computer Science 2022-08-05 Beren Millidge , Yuhang Song , Tommaso Salvatori , Thomas Lukasiewicz , Rafal Bogacz

In this work, we consider a multiuser cooperative wireless network where the energy-constrained sources have independent information to transmit to a common destination, which is assumed to be externally powered and responsible for…

Information Theory · Computer Science 2015-06-18 Guilherme Luiz Moritz , João Luiz Rebelatto , Richard Demo Souza , Bartolomeu F. Uchôa-Filho , Yonghui Li

Simultaneous wireless information and power transfer (SWIPT) provides a promising solution for enabling perpetual wireless networks. As energy efficiency (EE) is an im- portant evaluation of system performance, this thesis studies…

Information Theory · Computer Science 2015-04-10 Shiyang Leng

We provide a phenomenological theory for topological transitions in restructuring networks. In this statistical mechanical approach energy is assigned to the different network topologies and temperature is used as a quantity referring to…

Statistical Mechanics · Physics 2016-08-31 Gergely Palla , Imre Derenyi , Illes Farkas , Tamas Vicsek

Transformers process tokens in parallel but are temporally shallow: at position $t$, each layer attends to key-value pairs computed based on the previous layer, yielding a depth capped by the number of layers. Recurrent models offer…

Machine Learning · Computer Science 2026-04-24 Costin-Andrei Oncescu , Depen Morwani , Samy Jelassi , Alexandru Meterez , Mujin Kwun , Sham Kakade

Energy storage resources must consider both price uncertainties and their physical operating characteristics when participating in wholesale electricity markets. This is a challenging problem as electricity prices are highly volatile, and…

Machine Learning · Computer Science 2023-06-02 Yousuf Baker , Ningkun Zheng , Bolun Xu

Model-based offline reinforcement learning is brittle under distribution shift: policy improvement drives rollouts into state--action regions weakly supported by the dataset, where compounding model error yields severe value overestimation.…

Machine Learning · Computer Science 2026-02-04 Zeyu Fang , Zuyuan Zhang , Mahdi Imani , Tian Lan

Deep energy-based models are powerful, but pose challenges for learning and inference (Belanger and McCallum, 2016). Tu and Gimpel (2018) developed an efficient framework for energy-based models by training "inference networks" to…

Computation and Language · Computer Science 2020-10-13 Lifu Tu , Richard Yuanzhe Pang , Kevin Gimpel

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in generative modeling. Fueled by its flexibility in the formulation and strong modeling power of the latent space, recent works built…

Machine Learning · Computer Science 2023-10-06 Peiyu Yu , Sirui Xie , Xiaojian Ma , Baoxiong Jia , Bo Pang , Ruiqi Gao , Yixin Zhu , Song-Chun Zhu , Ying Nian Wu

This paper investigates the optimal co-design of logical and continuous controls for switched linear systems governed by controlled logical switching dynamics. Unlike traditional switched systems with arbitrary or state-dependent switching,…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Xiao Zhang , Min Meng , Changxi Li , Ka-Fai Cedric Yiu

This paper studies the optimal output-feedback control of a linear time-invariant system where a stochastic event-based scheduler triggers the communication between the sensor and the controller. The primary goal of the use of this type of…

Systems and Control · Computer Science 2017-08-10 Burak Demirel , Alex S. Leong , Vijay Gupta , Daniel E. Quevedo

In contemporary power systems, energy consumption prediction plays a crucial role in maintaining grid stability and resource allocation enabling power companies to minimize energy waste and avoid overloading the grid. While there are…

Machine Learning · Computer Science 2025-03-20 Aayam Bansal , Keertan Balaji , Zeus Lalani

Deeply-learned planning methods are often based on learning representations that are optimized for unrelated tasks. For example, they might be trained on reconstructing the environment. These representations are then combined with predictor…

Machine Learning · Computer Science 2021-03-18 Hlynur Davíð Hlynsson , Merlin Schüler , Robin Schiewer , Tobias Glasmachers , Laurenz Wiskott

The ongoing energy transition drives the development of decentralised renewable energy sources, which are heterogeneous and weather-dependent, complicating their integration into energy systems. This study tackles this issue by introducing…

Machine Learning · Computer Science 2024-07-01 Marine Cauz , Adrien Bolland , Nicolas Wyrsch , Christophe Ballif

Pronounced variability due to the growth of renewable energy sources, flexible loads, and distributed generation is challenging residential distribution systems. This context, motivates well fast, efficient, and robust reactive power…

Systems and Control · Electrical Eng. & Systems 2019-10-31 Qiuling Yang , Alireza Sadeghi , Gang Wang , Georgios B. Giannakis , Jian Sun

Reduction of wireless network energy consumption is becoming increasingly important to reduce environmental footprint and operational costs. A key concept to achieve it is the use of lean transmission techniques that dynamically…

Information Theory · Computer Science 2023-09-06 François Rottenberg