Related papers: Entropy of Sharp Restart
Reasoning models often outperform smaller models but at 3--5$\times$ higher cost and added latency. We present entropy-guided refinement: a lightweight, test-time loop that uses token-level uncertainty to trigger a single, targeted…
We study a finite-inventory risk-sensitive market making problem in which a dealer controls bid and ask quotes, faces Brownian midprice risk, and receives liquidity-taking orders through point processes with quote-dependent intensities. The…
For discrete-time stochastic processes, there is a close connection between return/waiting times and entropy. Such a connection cannot be straightforwardly extended to the continuous-time setting. Contrarily to the discrete-time case one…
Betweenness centrality ranks the importance of nodes by their participation in all shortest paths of the network. Therefore computing exact betweenness values is impractical in large networks. For static networks, approximation based on…
An information theory description of finite systems explicitly evolving in time is presented for classical as well as quantum mechanics. We impose a variational principle on the Shannon entropy at a given time while the constraints are set…
Information theory on a time-discrete setting in the framework of time series analysis is generalized to the time-continuous case. Considerations of the Roessler and Lorenz dynamics as well as the Ornstein-Uhlenbeck process yield for…
In this paper we demonstrate a simple heuristic adaptive restart technique that can dramatically improve the convergence rate of accelerated gradient schemes. The analysis of the technique relies on the observation that these schemes…
In the past few years, stochastic resetting has become a subject of immense interest. Most of the theoretical studies so far focused on instantaneous resetting which is, however, a major impediment to practical realization or experimental…
By periodically returning a search process to a known or random state, random resetting possesses the potential to unveil new trajectories, sidestep potential obstacles, and consequently enhance the efficiency of locating desired targets.…
In this paper we analyze the effects of stochastic resetting on an encounter-based model of an unbiased run-and-tumble particle (RTP) confined to the half-line $[0,\infty)$ with a partially absorbing wall at $x=0$. The RTP tumbles at a…
This paper investigates the entropy production rate and time-reversibility for general jump diffusions (L\'{e}vy processes) on $\mathbb{R}^n$. We first formulate the entropy production rate and explore its associated thermodynamic relations…
In this paper we consider a stochastic process that may experience random reset events which bring suddenly the system to the starting value and analyze the relevant statistical magnitudes. We focus our attention on monotonous…
A fundamental and intrinsic property of any device or natural system is its relaxation time relax, which is the time it takes to return to equilibrium after the sudden change of a control parameter [1]. Reducing $tau$ relax , is frequently…
Maximal repetition of a string is the maximal length of a repeated substring. This paper investigates maximal repetition of strings drawn from stochastic processes. Strengthening previous results, two new bounds for the almost sure growth…
The effects of a stochastic reset, to its initial configuration, is studied in the exactly solvable one-dimensional coagulation-diffusion process. A finite resetting rate leads to a modified non-equilibrium stationary state. If in addition…
Estimating the entropy based on data is one of the prototypical problems in distribution property testing and estimation. For estimating the Shannon entropy of a distribution on $S$ elements with independent samples, [Paninski2004] showed…
In this paper we show that the existence of a primarily discrete space-time may be a fruitful assumption from which we may develop a new approach of statistical thermodynamics in pre-relativistic conditions. The discreetness of space-time…
We investigate the statistics of recurrences to finite size intervals for chaotic dynamical systems. We find that the typical distribution presents an exponential decay for almost all recurrence times except for a few short times affected…
It is by now well known that the Boltzmann-Gibbs (BG) entropy $S_{BG}=-k\sum_{i=1}^W p_i \ln p_i$ can be usefully generalized into the entropy $S_q=k (1-\sum_{i=1}^Wp_i^{q}) / (q-1)$ ($q\in \mathcal{R}; S_1=S_{BG}$). Microscopic dynamics…
The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…