English
Related papers

Related papers: Kullback-Leibler and Renormalized Entropy: Applica…

200 papers

We introduce the telescopic relative entropy (TRE), which is a new regularisation of the relative entropy related to smoothing, to overcome the problem that the relative entropy between pure states is either zero or infinity and therefore…

Mathematical Physics · Physics 2011-04-28 Koenraad M. R. Audenaert

Multiscale inherent fuzzy entropy is an objective measurement of electroencephalography (EEG) complexity, reflecting the habituation of brain systems. Entropy dynamics are generally believed to reflect the ability of the brain to adapt to a…

Signal Processing · Electrical Eng. & Systems 2019-05-28 Zehong Cao , Weiping Ding , Yu-Kai Wang , Farookh Khadeer Hussain , Adel Al-Jumaily , Chin-Teng Lin

Trajectory Inference (TI) seeks to recover latent dynamical processes from snapshot data, where only independent samples from time-indexed marginals are observed. In applications such as single-cell genomics, destructive measurements make…

Machine Learning · Computer Science 2026-04-23 Chao Wang , Luca Nepote , Giulio Franzese , Pietro Michiardi

Epilepsy affects over 50 million people worldwide, and one-third of patients suffer drug-resistant seizures where surgery offers the best chance of seizure freedom. Accurate localization of the epileptogenic zone (EZ) relies on intracranial…

We apply two variations of the principle of Minimum Cross Entropy (the Kullback information measure) to fit parameterized probability density models to observed data densities. For an array beamforming problem with P incident narrowband…

Information Theory · Computer Science 2008-06-24 Cheng-Yuan Liou , Bruce R. Musicus

Refractory epileptic patients can suffer a seizure at any moment. Seizure prediction would substantially improve their lives. In this work, based on scalp EEG and its transformation into images, the likelihood of an epileptic seizure…

Signal Processing · Electrical Eng. & Systems 2022-04-15 Tiago Leal , Fabio Lopes , Cesar Teixeira , Antonio Dourado

Status epilepticus (SE) carries risks of morbidity and mortality. Experimental studies have implicated the entorhinal cortex in prolonged seizures; however, studies in large human cohorts are limited. We hypothesised that individuals with…

Neurons and Cognition · Quantitative Biology 2024-08-13 Jonathan Horsley , Yujiang Wang , Callum Simpson , Vyte Janiukstyte , Karoline Leiberg , Beth Little , Jane de Tisi , John Duncan , Peter N. Taylor

The notion of group entropy is proposed. It enables to unify and generalize many different definitions of entropy known in the literature, as those of Boltzmann-Gibbs, Tsallis, Abe and Kaniadakis. Other new entropic functionals are…

Statistical Mechanics · Physics 2015-05-28 Piergiulio Tempesta

We propose a new regularisation strategy for the classical ensemble Kalman inversion (EKI) framework. The strategy consists of: (i) an adaptive choice for the regularisation parameter in the update formula in EKI, and (ii) criteria for the…

Numerical Analysis · Mathematics 2020-09-24 Marco Iglesias , Yuchen Yang

Electrophysiological observation plays a major role in epilepsy evaluation. However, human interpretation of brain signals is subjective and prone to misdiagnosis. Automating this process, especially seizure detection relying on scalp-based…

Machine Learning · Computer Science 2018-07-06 David Ahmedt-Aristizabal , Clinton Fookes , Kien Nguyen , Sridha Sridharan

A seizure tracking system is crucial for monitoring and evaluating epilepsy treatments. Caretaker seizure diaries are used in epilepsy care today, but clinical seizure monitoring may miss seizures. Monitoring devices that can be worn may be…

Machine Learning · Computer Science 2023-09-07 Zag ElSayed , Murat Ozer , Nelly Elsayed , Ahmed Abdelgawad

A range of nonlinear image reconstruction procedures based on extremizing the generalized Shannon entropy, Kullback-Leibler cross-entropy and Renyi information measures and proposed by the author in early papers is presented. The…

Astrophysics · Physics 2007-05-23 Anisa T. Bajkova

Epilepsy is one of the most common neurological disorders that greatly impair patient' daily lives. Traditional epileptic diagnosis relies on tedious visual screening by neurologists from lengthy EEG recording that requires the presence of…

Artificial Intelligence · Computer Science 2016-11-18 Forrest Sheng Bao , Donald Yu-Chun Lie , Yuanlin Zhang

In this chapter we shall discuss the recent progresses of information theoretic tools in the context of free and confined harmonic oscillator. Confined quantum systems have provided appreciable interest in areas of physics, chemistry,…

Quantum Physics · Physics 2021-05-06 Neetik Mukherjee , Amlan K. Roy

Among the existing models for compressible fluids, the one by Kataoka and Tsutahara (KT model, Phys. Rev. E 69, 056702, 2004) has a simple and rigorous theoretical background. The drawback of this KT model is that it can cause numerical…

Computational Physics · Physics 2015-05-13 Zheng Ran , Yupeng Xu

EEG time series are analyzed using the diffusion entropy method. The resulting EEG entropy manifests short-time scaling, asymptotic saturation and an attenuated alpha-rhythm modulation. These properties are faithfully modeled by a…

Data Analysis, Statistics and Probability · Physics 2009-03-06 M. Ignaccolo , M. Latka , W. Jernajczyk , P. Grigolini , B. J. West

A semi-implicit in time, entropy stable finite volume scheme for the compressible barotropic Euler system is designed and analyzed and its weak convergence to a dissipative measure-valued (DMV) solution [E. Feireisl et al., Dissipative…

Numerical Analysis · Mathematics 2023-12-07 K. R. Arun , Amogh Krishnamurthy

Entropy measures have become increasingly popular as an evaluation metric for complexity in the analysis of time series data, especially in physiology and medicine. Entropy measures the rate of information gain, or degree of regularity in a…

Methodology · Statistics 2015-12-03 Chee Chun Gan , Gerard Learmonth

The effect of relative entropy asymmetry is analyzed in the context of empirical risk minimization (ERM) with relative entropy regularization (ERM-RER). Two regularizations are considered: $(a)$ the relative entropy of the measure to be…

Machine Learning · Statistics 2025-05-01 Francisco Daunas , Iñaki Esnaola , Samir M. Perlaza , H. Vincent Poor

We present the implementation of seizure detection algorithms based on a minimal number of EEG channels on a parallel ultra-low-power embedded platform. The analyses are based on the CHB-MIT dataset, and include explorations of different…