English
Related papers

Related papers: Kullback-Leibler and Renormalized Entropy: Applica…

200 papers

Epilepsy affects nearly 1% of the global population, of which two thirds can be treated by anti-epileptic drugs and a much lower percentage by surgery. Diagnostic procedures for epilepsy and monitoring are highly specialized and…

Signal Processing · Electrical Eng. & Systems 2020-01-20 Tennison Liu , Nhan Duy Truong , Armin Nikpour , Luping Zhou , Omid Kavehei

Reliable seizure detection from electroencephalography (EEG) time series is a high-priority clinical goal, yet the acquisition cost and scarcity of labeled EEG data limit the performance of machine learning methods. This challenge is…

Methodology · Statistics 2026-01-30 Nina Moutonnet , Joshua Corneck , Felipe Tobar , Danilo Mandic

Relative entropy serves as a cornerstone concept in quantum information theory. In this work, we study relative entropy of random states from major generic state models of Hilbert-Schmidt and Bures-Hall ensembles. In particular, we derive…

Mathematical Physics · Physics 2026-05-28 Lu Wei

We review the renormalization of one-loop effective action for gravity coupled to a scalar field and that of the Bekenstein-Hawking entropy of a black hole plus the statistical entropy of the scalar field. It is found that the total entropy…

General Relativity and Quantum Cosmology · Physics 2008-11-26 Sang Pyo Kim , Sung Ku Kim , Kwang-Sup Soh , Jae Hyung Yee

Let recall that the term 'k-th extreme' was introduced in a limiting sense. That is, if $X_{r:n}$ denote the r-th order statistic then for fix k, as $n\to\infty$, $X_{n-k+1:n}$ is called the k-th extremes or k-th largest order statistics.…

Statistics Theory · Mathematics 2024-07-17 Ali Saeb

Epilepsy represents the most prevalent neurological disease in the world. One-third of people suffering from mesial temporal lobe epilepsy (MTLE) exhibit drug resistance, urging the need to develop new treatments. A key part in anti-seizure…

In a variety of applications it is important to extract information from a probability measure $\mu$ on an infinite dimensional space. Examples include the Bayesian approach to inverse problems and possibly conditioned) continuous time…

Probability · Mathematics 2016-06-02 Frank Pinski , Gideon Simpson , Andrew Stuart , Hendrik Weber

Group sequential designs enable interim analyses and potential early stopping for efficacy or futility. While these adaptations improve trial efficiency and ethical considerations, they also introduce bias into the adapted analyses. We…

Methodology · Statistics 2025-10-07 G. Caruso , W. F. Rosenberger , P. Mozgunov , N. Flournoy

We study minimization of a parametric family of relative entropies, termed relative $\alpha$-entropies (denoted $\mathscr{I}_{\alpha}(P,Q)$). These arise as redundancies under mismatched compression when cumulants of compressed lengths are…

Information Theory · Computer Science 2014-10-21 M. Ashok Kumar , Rajesh Sundaresan

In the dynamics of open quantum systems, the backflow of information to the reduced system under study has been suggested as the actual physical mechanism inducing memory and thus leading to non-Markovian quantum dynamics. To this aim, the…

Quantum Physics · Physics 2021-07-21 Nina Megier , Andrea Smirne , Bassano Vacchini

Experimental designs are tools which can drastically reduce the number of simulations required by time-consuming computer codes. One strategy for selecting the values of the inputs, whose response is to be observed, is to choose these…

Statistics Theory · Mathematics 2009-04-17 Astrid Jourdan , Jessica Franco

Approximately over 50 million people worldwide suffer from epilepsy. Traditional diagnosis of epilepsy relies on tedious visual screening by highly trained clinicians from lengthy EEG recording that contains the presence of seizure (ictal)…

Artificial Intelligence · Computer Science 2009-04-27 Forrest Sheng Bao , Jue-Ming Gao , Jing Hu , Donald Y. -C. Lie , Yuanlin Zhang , K. J. Oommen

K-complexes are an important marker of brain activity and are used both in clinical practice to perform sleep scoring, and in research. However, due to the size of electroencephalography (EEG) records, as well as the subjective nature of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Alexey Protopopov

In recent years, machine learning has become an increasingly powerful tool for supporting seizure detection and monitoring in epilepsy care. Traditional approaches focus on identifying seizures only after they begin, which limits the…

Machine Learning · Computer Science 2025-10-30 Ria Jayanti , Tanish Jain

In this paper, some new upper bounds for Kullback-Leibler divergence(KL-divergence) based on $L^1, L^2$ and $L^\infty$ norms of density functions are discussed. Our findings unveil that the convergence in KL-divergence sense sandwiches…

Probability · Mathematics 2024-10-31 Liuquan Yao , Songhao Liu

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

In an earlier study, we showed that Tsallis relative entropy (TRE), which is the generalization of Kullback-Leibler relative entropy (KLRE) to non-extensive systems, can be used as a possible risk measure in constructing risk optimal…

Statistical Finance · Quantitative Finance 2022-05-30 Sandhya Devi , Sherman Page

We address the question and related controversy of the formulation of the $q$-entropy, and its relative entropy counterpart, for models described by continuous (non-discrete) sets of variables. We notice that an $L_p$ normalized functional…

Statistical Mechanics · Physics 2020-04-22 Nikolaos Kalogeropoulos

Over 15 million epilepsy patients worldwide do not respond to drugs and require surgical treatment. Successful surgical treatment requires complete removal, or disconnection of the epileptogenic zone (EZ), but without a prospective…

Machine Learning · Computer Science 2022-02-16 Adam Li , Chester Huynh

Experimental designs are tools which can dramatically reduce the number of simulations required by time-consuming computer codes. Because we don't know the true relation between the response and inputs, designs should allow one to fit a…

Methodology · Statistics 2008-11-04 Astrid Jourdan