English
Related papers

Related papers: Lossy Asymptotic Equipartition property for Hierar…

200 papers

This paper discusses asymptotic distributions of various estimators of the underlying parameters in some regression models with long memory (LM) Gaussian design and nonparametric heteroscedastic LM moving average errors. In the simple…

Statistics Theory · Mathematics 2008-12-18 Hongwen Guo , Hira L. Koul

We ask the question whether entropy accumulates, in the sense that the operationally relevant total uncertainty about an $n$-partite system $A = (A_1, \ldots A_n)$ corresponds to the sum of the entropies of its parts $A_i$. The Asymptotic…

Quantum Physics · Physics 2022-10-05 Frederic Dupuis , Omar Fawzi , Renato Renner

Much work in the study of large deviations for random graph models is focused on the dense regime where the theory of graphons has emerged as a principal tool. These tools do not give a good approach to large deviation problems for random…

Probability · Mathematics 2020-07-07 Shankar Bhamidi , Amarjit Budhiraja , Paul Dupuis , Ruoyu Wu

We introduce a model of a totally asymmetric simple exclusion process (TASEP) on a tree network where the aggregate hopping rate is constant from level to level. With this choice for hopping rates the model shows the same phase diagram as…

Statistical Mechanics · Physics 2013-11-12 Peter Mottishaw , Bartlomiej Waclaw , Martin R. Evans

We present a transmission line theory of exceptional points of degeneracy (EPD) in coupled-mode guiding structures, i.e., a theory that illustrates the characteristics of coupled electromagnetic modes under a special dispersion degeneracy…

Optics · Physics 2017-09-15 Mohamed A. K. Othman , Filippo Capolino

In this paper, we examine applications of the theory of operator-valued processes to algebraic methods in probability theory. We show a central limit theorem for general conservation operator processes. Utilizing this, we analyze the…

Probability · Mathematics 2025-11-04 Ryosuke Sato

Measuring the complexity of tree structures can be beneficial in areas that use tree data structures for storage, communication, and processing purposes. This complexity can then be used to compress tree data structures to their…

Information Theory · Computer Science 2023-09-19 Amirmohammad Farzaneh , Mihai-Alin Badiu , Justin P. Coon

Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…

Machine Learning · Statistics 2024-12-04 Wuyue Yang , Liangrong Peng , Guojie Li , Liu Hong

The hierarchical and recursive expressive capability of rooted trees is applicable to represent statistical models in various areas, such as data compression, image processing, and machine learning. On the other hand, such hierarchical…

Machine Learning · Computer Science 2022-01-25 Yuta Nakahara , Shota Saito , Akira Kamatsuka , Toshiyasu Matsushima

A word-valued source $\mathbf{Y} = Y_1,Y_2,...$ is discrete random process that is formed by sequentially encoding the symbols of a random process $\mathbf{X} = X_1,X_2,...$ with codewords from a codebook $\mathscr{C}$. These processes…

Information Theory · Computer Science 2009-04-27 Roy Timo , Kim Blackmore , Leif Hanlen

This paper develops a general asymptotic theory of local polynomial (LP) regression for spatial data observed at irregularly spaced locations in a sampling region $R_n \subset \mathbb{R}^d$. We adopt a stochastic sampling design that can…

Statistics Theory · Mathematics 2023-12-27 Daisuke Kurisu , Yasumasa Matsuda

Cross-entropy loss is the standard metric used to train classification models in deep learning and gradient boosting. It is well-known that this loss function fails to account for similarities between the different values of the target. We…

Machine Learning · Statistics 2022-06-16 Brian Lucena

We investigate the concept of an asymptotic e-process, which is a doubly-indexed stochastic process $(E_{m,n})_{m,n\in\mathbb{N}}$ that possesses, asymptotically for an approximation index $m\to\infty$, the properties of an e-process along…

Statistics Theory · Mathematics 2026-05-25 Pierre-François Massiani , Sebastian Schulze , Mattes Mollenhauer

This paper provides a mixture modeling framework using the bivariate generalized exponential distribution. We study different properties of this mixture distribution. Hierarchical EM algorithm is developed for finding the estimates of the…

Computation · Statistics 2018-04-03 Arabin Kumar Dey , Debasis Kundu , Tumati Kiran Kumar

In this paper we study the asymptotic theory for samples problem based on the functional empirical process (fep), this new method is called general samples problem. We suggest this method to develop the full theory of estimation of means,…

Methodology · Statistics 2025-08-12 Abdoulaye Camara , Adja Mbarka Fall , Moumouni Diallo , Gane Samb Lo

This paper presents a model of asymmetric bifurcating autoregressive process with random coefficients. We couple this model with a Galton Watson tree to take into account possibly missing observations. We propose least-squares estimators…

Probability · Mathematics 2013-04-18 Benoîte de Saporta , Anne Gégout-Petit , Laurence Marsalle

The maximum entropy principle (MEP) is one of the most prominent methods to investigate and model complex systems. Despite its popularity, the standard form of the MEP can only generate Boltzmann-Gibbs distributions, which are ill-suited…

Statistical Mechanics · Physics 2022-03-30 Pablo A. Morales , Fernando E. Rosas

An asymptotic scaling theory is presented using the conceptual basis of trapping-free subspace (i.e., orthogonal subspace) to establish the generic mechanism of optimal efficiency of excitation energy transfer (EET) in light-harvesting…

Quantum Physics · Physics 2013-05-16 Jianlan Wu , Jianshu Cao , Robert J. Silbey

We consider distributed detection problems over adaptive networks, where dispersed agents learn continually from streaming data by means of local interactions. The simultaneous requirements of adaptation and cooperation are achieved by…

Multiagent Systems · Computer Science 2016-01-27 Vincenzo Matta , Paolo Braca , Stefano Marano , Ali H. Sayed

We present an algorithm for arc reversal in Bayesian networks with tree-structured conditional probability tables, and consider some of its advantages, especially for the simulation of dynamic probabilistic networks. In particular, the…

Artificial Intelligence · Computer Science 2013-02-08 Adrian Y. W. Cheuk , Craig Boutilier