English
Related papers

Related papers: Entropy-optimal Generalized Token Bucket Regulator

200 papers

Balanced and efficient information flow is essential for optimizing language generation models. In this work, we propose Entropy-UID, a new token selection method that balances entropy and Uniform Information Density (UID) principles for…

Computation and Language · Computer Science 2025-02-21 Xinpeng Shou

We consider a communication network over which transmissions must fulfill the so-called token bucket traffic specification, with a rollout (i.e., predictive) controller that both schedules transmissions and computes the corresponding…

Systems and Control · Electrical Eng. & Systems 2020-05-11 Florian Jaumann , Stefan Wildhagen , Frank Allgöwer

In this paper, we explore a scenario where a sender provides an information policy and a receiver, upon observing a realization of this policy, decides whether to take a particular action, such as making a purchase. The sender's objective…

Numerical Analysis · Mathematics 2024-12-13 Jorge Justiniano , Andreas Kleiner , Benny Moldovanu , Martin Rumpf , Philipp Strack

Boolean network models of strongly connected modules are capable of capturing the high regulatory complexity of many biological gene regulatory circuits. We study numerically the previously introduced basin entropy, a parameter for the…

Disordered Systems and Neural Networks · Physics 2009-11-13 P. Krawitz , I. Shmulevich

The phenomenon of entropy concentration provides strong support for the maximum entropy method, MaxEnt, for inferring a probability vector from information in the form of constraints. Here we extend this phenomenon, in a discrete setting,…

Information Theory · Computer Science 2021-01-11 Kostas N. Oikonomou

We propose that chaotic Glass networks (a class of piecewise-linear Ordinary Differential Equations) are good candidates for the design of true random number generators. A Glass network design has the advantage of involving only standard…

Dynamical Systems · Mathematics 2025-02-14 Benjamin W. Wild , Roderick Edwards

We put forth a new computational notion of entropy, measuring the (in)feasibility of sampling high-entropy strings that are consistent with a given generator. Specifically, the i'th output block of a generator G has accessible entropy at…

Cryptography and Security · Computer Science 2021-08-24 Iftach Haitner , Omer Reingold , Salil Vadhan , Hoeteck Wee

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

For a closed-loop control system with a digital channel between the sensor and the controller, the notion of invariance entropy quantifies the smallest average rate of information transmission above which a given compact subset of the state…

Systems and Control · Electrical Eng. & Systems 2020-04-13 Mahendra Singh Tomar , Christoph Kawan , Pushpak Jagtap , Majid Zamani

Subword tokenization is a key part of many NLP pipelines. However, little is known about why some tokenizer and hyperparameter combinations lead to better downstream model performance than others. We propose that good tokenizers lead to…

Computation and Language · Computer Science 2023-06-30 Vilém Zouhar , Clara Meister , Juan Luis Gastaldi , Li Du , Mrinmaya Sachan , Ryan Cotterell

We construct the generalized entropy optimized by a given arbitrary statistical distribution with a finite linear expectation value of a random quantity of interest. This offers, via the maximum entropy principle, a unified basis for a…

Statistical Mechanics · Physics 2009-11-07 Sumiyoshi Abe

We show that the principle of maximum entropy, a variational method appearing in statistical inference, statistical physics, and the analysis of stochastic dynamical systems, admits a geometric description from gauge theory. Using the…

Mathematical Physics · Physics 2023-01-05 Dalton A R Sakthivadivel

For a closed-loop control system with a digital channel between the sensor and the controller, the notion of invariance entropy quantifies the smallest average rate of information above which a given compact subset of the state space can be…

Optimization and Control · Mathematics 2021-11-19 Mahendra Singh Tomar , Christoph Kawan , Majid Zamani

Some quantum algorithms have "quantum speedups": improved time complexity as compared with the best-known classical algorithms for solving the same tasks. Can we understand what fuels these speedups from an entropic perspective? Information…

Quantum Physics · Physics 2024-11-07 Jason Pollack , Dylan VanAllen

The entropy accumulation theorem, and its subsequent generalized version, is a powerful tool in the security analysis of many device-dependent and device-independent cryptography protocols. However, it has the drawback that the finite-size…

Quantum Physics · Physics 2025-12-22 Amir Arqand , Thomas A. Hahn , Ernest Y. -Z. Tan

The information processing capacity of a complex dynamical system is reflected in the partitioning of its state space into disjoint basins of attraction, with state trajectories in each basin flowing towards their corresponding attractor.…

Disordered Systems and Neural Networks · Physics 2007-05-23 Peter Krawitz , Ilya Shmulevich

In this paper we consider upper and lower constraining users' service rates in a slotted, cross-layer scheduler context. Such schedulers often cannot guarantee these bounds, despite the usefulness in adhering to Quality of Service (QoS)…

Networking and Internet Architecture · Computer Science 2019-11-28 Jeremy Van den Eynde , Chris Blondia

In this paper, we apply the information theory to provide an approximate expression of the steady-state probability distribution for blockchain systems. We achieve this goal by maximizing an entropy function subject to specific constraints.…

Information Theory · Computer Science 2023-09-12 Quan-Lin Li , Yaqian Ma , Jing-Yu Ma , Yan-Xia Chang

In this paper, we investigate the quantization of the output of a binary input discrete memoryless channel that maximizing the mutual information between the input and the quantized output under an entropy-constrained of the quantized…

Information Theory · Computer Science 2020-01-08 Thuan Nguyen , Thinh Nguyen

The entropy regularization is inspired by information entropy from machine learning and the ideas of exploration and exploitation in reinforcement learning, which appears in the control problem to design an approximating algorithm for the…

Optimization and Control · Mathematics 2024-11-21 Ziyue Chen , Qi Zhang
‹ Prev 1 2 3 10 Next ›