English
Related papers

Related papers: On the Information Dimension of Multivariate Gauss…

200 papers

The concept of Shannon entropy of random variables was generalized to measurable functions in general, and to simple functions with finite values in particular. It is shown that the information measure of a function is related to the time…

Information Theory · Computer Science 2017-01-25 Guo Zhao

Fine regularity of stochastic processes is usually measured in a local way by local H\"older exponents and in a global way by fractal dimensions. Following a previous work of Adler, we connect these two concepts for multiparameter Gaussian…

Probability · Mathematics 2012-06-05 Erick Herbin , Benjamin Arras , Geoffroy Barruel

Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…

Machine Learning · Statistics 2024-10-30 Valero Laparra , J. Emmanuel Johnson , Gustau Camps-Valls , Raul Santos-Rodríguez , Jesus Malo

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li

Understanding the loss of information in spectral analytics is a crucial first step towards finding root causes for failures and uncertainties using spectral data in artificial intelligence models built from modern complex data science…

Data Analysis, Statistics and Probability · Physics 2025-03-28 A. Schelle , H. Lüling

Gaussian processes constitute a very powerful and well-understood method for non-parametric regression and classification. In the classical framework, the training data consists of deterministic vector-valued inputs and the corresponding…

Systems and Control · Computer Science 2018-09-26 Maxim Dolgov , Uwe D. Hanebeck

In the present paper we propose a new stochastic diffusion process with drift proportional to the Weibull density function defined as X $\epsilon$ = x, dX t = $\gamma$ t (1 - t $\gamma$+1) - t $\gamma$ X t dt + $\sigma$X t dB t , t…

Statistics Theory · Mathematics 2015-02-26 H Elotma

Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or…

Statistical Mechanics · Physics 2020-01-29 R. Chétrite , M. L. Rosinberg , T. Sagawa , G. Tarjus

Fourier methods are fundamental tools to analyze random fields. Statistical structures of homogeneous Gaussian random fields are completely characterized by the power spectrum. In non-Gaussian random fields, polyspectra, higher-order…

Astrophysics · Physics 2009-11-11 Takahiko Matsubara

We study variational principles for metric mean dimension. First we prove that in the variational principle of Lindenstrauss and Tsukamoto it suffices to take supremum over ergodic measures. Second we derive a variational principle for…

Dynamical Systems · Mathematics 2022-02-04 Yonatan Gutman , Adam Śpiewak

This article is presented new method of description information systems in abstract 4-dimensional pseudo-Euclidean information space (4-DPIES) with using special relativity (SR) methods. This purpose core postulates of existence 4-DPIES are…

Information Theory · Computer Science 2011-11-10 O. I. Shro

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms,…

Methodology · Statistics 2017-08-21 Luca Faes , Daniele Marinazzo , Sebastiano Stramaglia

We study a single server FIFO queue that offers general service. Each of n customers enter the queue at random time epochs that are inde- pendent and identically distributed. We call this the random scattering traffic model, and the…

Probability · Mathematics 2017-08-21 Peter W. Glynn , Harsha Honnappa

We propose R\'enyi information generating function and discuss its properties. A connection between the R\'enyi information generating function and the diversity index is proposed for discrete type random variables. The relation between the…

Statistics Theory · Mathematics 2025-02-25 Shital Saha , Suchandan Kayal , N. Balakrishnan

In this paper, we consider projection estimates for L\'evy densities in high-frequency setup. We give a unified treatment for different sets of basis functions and focus on the asymptotic properties of the maximal deviation distribution for…

Probability · Mathematics 2016-01-18 Valentin Konakov , Vladimir Panov

Increasingly larger data sets of processes in space and time ask for statistical models and methods that can cope with such data. We show that the solution of a stochastic advection-diffusion partial differential equation provides a…

Methodology · Statistics 2016-02-18 Fabio Sigrist , Hans R. Künsch , Werner A. Stahel

Elliptically-contoured distributions (ECD) play a significant role, in computer vision, image processing, radar, and biomedical signal processing. Maximum likelihood. estimation (MLE) of ECD leads to a system of non-linear equations,…

Signal Processing · Electrical Eng. & Systems 2020-11-06 Jialun Zhou , Salem Said , Yannick Berthoumieu

Using the formalism of information theory, we analyze the mechanism of information transduction in a simple one-step signaling cascade S$\rightarrow$X representing the gene regulatory network. Approximating the signaling channel to be…

Molecular Networks · Quantitative Biology 2018-11-14 Mintu Nandi , Ayan Biswas , Suman K Banik , Pinaki Chaudhury

Statistical divergences are important tools in data analysis, information theory, and statistical physics, and there exist well known inequalities on their bounds. However, in many circumstances involving temporal evolution, one needs…

Data Analysis, Statistics and Probability · Physics 2025-03-25 Jan Karbowski

It is well known that semantic and structural features of the generated images emerge at different times during the reverse dynamics of diffusion, a phenomenon that has been connected to physical phase transitions in magnets and other…

Machine Learning · Statistics 2025-06-13 Florian Handke , Félix Koulischer , Gabriel Raya , Luca Ambrogioni