English
Related papers

Related papers: Asymptotic Equipartition Property of Output when R…

200 papers

Symbolic relative entropy, an efficient nonlinear complexity parameter measuring probabilistic divergences of symbolic sequences, is proposed in our nonlinear dynamics analysis of heart rates considering equal states. Equalities are not…

Quantitative Methods · Quantitative Biology 2019-01-29 Wenpo Yao Wenli Yao , Jun Wang

Entropy production (EP) is a central measure in nonequilibrium thermodynamics, as it can quantify the irreversibility of a process as well as its energy dissipation in special cases. Using the time-reversal asymmetry in a system's path…

Statistical Mechanics · Physics 2022-04-26 Dong-Kyum Kim , Sangyun Lee , Hawoong Jeong

This paper investigates the symbol error probability~(SEP) of point-to-point massive multiple-input multiple-output (MIMO) systems using equally likely PAM, PSK, and square QAM signallings in the presence of transmitter correlation. The…

Information Theory · Computer Science 2019-01-03 Zheng Dong , Jian-Kang Zhang , He Chen

Estimating the dissipation, or the entropy production rate (EPR), can provide insights into the underlying mechanisms of nonequilibrium driven processes. Experimentally, however, only partial information can be accessed, and the ability to…

Statistical Mechanics · Physics 2022-12-29 Uri Kapustin , Aishani Ghosal , Gili Bisker

This paper provides an analysis of the tradeoff between asymptotic bias (suboptimality with unlimited data) and overfitting (additional suboptimality due to limited data) in the context of reinforcement learning with partial observability.…

Machine Learning · Statistics 2019-02-07 Vincent Francois-Lavet , Guillaume Rabusseau , Joelle Pineau , Damien Ernst , Raphael Fonteneau

We study periodic review stochastic inventory control in the data-driven setting where the retailer makes ordering decisions based only on historical demand observations without any knowledge of the probability distribution of the demand.…

Statistics Theory · Mathematics 2021-11-05 Xun Zhang , Zhisheng Ye , William B. Haskell

Typical random codes (TRC) in a communication scenario of source coding with side information at the decoder is the main subject of this work. We study the semi-deterministic code ensemble, which is a certain variant of the ordinary random…

Information Theory · Computer Science 2021-01-29 Ran Tamir , Neri Merhav

In this paper we continue our earlier investigations into the asymptotic behaviour of infinite systems of coupled differential equations. Under the mild assumption that the so-called characteristic function of our system is completely…

Functional Analysis · Mathematics 2020-10-01 Lassi Paunonen , David Seifert

In spectrum-sharing cognitive radio systems, the transmit power of secondary users has to be very low due to the restrictions on the tolerable interference power dictated by primary users. In order to extend the coverage area of secondary…

Information Theory · Computer Science 2013-11-22 Minghua Xia , Sonia Aïssa

Permutations of correlated sequences of random variables appear naturally in a variety of applications such as graph matching and asynchronous communications. In this paper, the asymptotic statistical behavior of such permuted sequences is…

Information Theory · Computer Science 2020-01-22 Farhad Shirani , Siddharth Garg , Elza Erkip

We analyze a simple network where a source and a receiver are connected by a line of erasure channels of different reliabilities. Recent prior work has shown that random linear network coding can achieve the min-cut capacity and therefore…

Information Theory · Computer Science 2009-10-22 Theodoros K. Dikaliotis , Alexandros G. Dimakis , Tracey Ho , Michelle Effros

We extend a recent synchronization analysis of exact finite-state sources to nonexact sources for which synchronization occurs only asymptotically. Although the proof methods are quite different, the primary results remain the same. We find…

Chaotic Dynamics · Physics 2015-05-20 Nicholas F. Travers , James P. Crutchfield

Asymptotic properties, both consistency and weak convergence, of estimators arising in a general class of dynamic recurrent event models are presented. The class of models take into account the impact of interventions after each event…

Statistics Theory · Mathematics 2019-11-19 Edsel A. Pena

We prove that the consumption functions in optimal savings problems are asymptotically linear if the marginal utility is regularly varying. We also analytically characterize the asymptotic marginal propensities to consume (MPCs) out of…

General Economics · Economics 2021-10-26 Qingyin Ma , Alexis Akira Toda

A well-known stochastic model for intermittent fluctuations in physical systems is investigated. The model is given by a super-position of uncorrelated exponential pulses, and the degree of pulse overlap is interpreted as an intermittency…

Plasma Physics · Physics 2018-01-17 Audun Theodorsen , Odd Erik Garcia

Bounds on the entropy of patterns of sequences generated by independently identically distributed (i.i.d.) sources are derived. A pattern is a sequence of indices that contains all consecutive integer indices in increasing order of first…

Information Theory · Computer Science 2007-07-13 Gil I. Shamir

Current performance bounds for randomized iterative methods are often considered tight under per-iteration analyses, yet they are notoriously loose in practice. We derive asymptotic performance bounds that narrow this theory-practice gap,…

Numerical Analysis · Mathematics 2026-03-19 Alireza Entezari , Arunava Banerjee

High complexity models are notorious in machine learning for overfitting, a phenomenon in which models well represent data but fail to generalize an underlying data generating process. A typical procedure for circumventing overfitting…

Machine Learning · Statistics 2025-03-11 James Schmidt

This paper addresses the asymptotic behavior of a particular type of information-plus-noise-type matrices, where the column and row number of the matrices are large and of the same order, while signals are diverged and time delays of the…

Information Theory · Computer Science 2019-03-11 Guanping Lu , Jinsong Wu , Robert C. Qiu

Existing training criteria in automatic speech recognition(ASR) permit the model to freely explore more than one time alignments between the feature and label sequences. In this paper, we use entropy to measure a model's uncertainty, i.e.…

Computation and Language · Computer Science 2022-12-26 Ehsan Variani , Ke Wu , David Rybach , Cyril Allauzen , Michael Riley