English
Related papers

Related papers: On the Practical Estimation and Interpretation of …

200 papers

Most of the existing classification methods are aimed at minimization of empirical risk (through some simple point-based error measured with loss function) with added regularization. We propose to approach this problem in a more information…

Machine Learning · Computer Science 2015-01-22 Wojciech Marian Czarnecki , Jacek Tabor

This paper addresses the critical challenge of estimating the reliability of an Electric Vehicle (EV) charging systems when facing risks such as overheating, unpredictable, weather, and cyberattacks. Traditional methods for predicting…

Systems and Control · Electrical Eng. & Systems 2025-08-19 Himanshu Tripathi , Subash Neupane , Shahram Rahimi , Noorbakhsh Amiri Golilarz , Sudip Mittal , Mohammad Sepehrifar

The entropy of a quantum system is a measure of its randomness, and has applications in measuring quantum entanglement. We study the problem of measuring the von Neumann entropy, $S(\rho)$, and R\'enyi entropy, $S_\alpha(\rho)$ of an…

Quantum Physics · Physics 2022-04-19 Jayadev Acharya , Ibrahim Issa , Nirmal V. Shende , Aaron B. Wagner

The entropy of probability distribution defined by Shannon has several extensions. R\'enyi entropy is one of the general extensions of Shannon entropy and is widely used in engineering, physics, and so on. On the other hand, the quantum…

Mathematical Physics · Physics 2019-09-04 Farrukh Mukhamedov , Kyouhei Ohmura , Noboru Watanabe

Entropy estimation is a fundamental problem in information theory that has applications in various fields, including physics, biology, and computer science. Estimating the entropy of discrete sequences can be challenging due to limited data…

Statistical Mechanics · Physics 2024-01-18 Juan De Gregorio , David Sanchez , Raul Toral

Relative entropy of entanglement (REE) is an entanglement measure of bipartite mixed states, defined by the minimum of the relative entropy $S(\rho_{AB}|| \sigma_{AB})$ between a given mixed state $\rho_{AB}$ and an arbitrary separable…

High Energy Physics - Theory · Physics 2018-11-14 Tadashi Takayanagi , Tomonori Ugajin , Koji Umemoto

Rapid aerodynamic evaluation is crucial for modern vehicle design, yet existing neural operators struggle to capture intricate spatial correlations. We propose the rotary-enhanced transformer operator (RETO), a novel neural solver featuring…

Image and Video Processing · Electrical Eng. & Systems 2026-05-08 Bojun Zhang , Huiyu Yang , Yunpeng Wang , Yuntian Chen , Yuanwei Bin , Rikui Zhang , Jianchun Wang

A variety of new measures of quantum Renyi mutual information and quantum Renyi conditional entropy have recently been proposed, and some of their mathematical properties explored. Here, we show that the Renyi mutual information attains…

Quantum Physics · Physics 2016-10-20 Masahito Hayashi , Marco Tomamichel

In this paper, we provide the R\'enyi entropy and complexity measure for a novel, flexible class of skew-gaussian distributions and their related families, as a characteristic form of the skew-gaussian Shannon entropy. We give closed…

Data Analysis, Statistics and Probability · Physics 2016-05-10 Javier E. Contreras-Reyes

Recent improvements in the method of estimating Renyi entropies from measurements of coincidences between the events observed in high energy collisions are reviewed. A new, more precise, formulation of the method is presented and its…

High Energy Physics - Phenomenology · Physics 2007-05-23 A. Bialas , K. Zalewski

The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…

Statistics Theory · Mathematics 2018-04-25 Alexander Bulinski , Alexey Kozhevin

We compute the Renyi entropy in a one-dimensional transverse-field quantum Ising model by employing a swapping operator acting on the states which are prepared from the neural network methods. In the static ground state, Renyi entropy can…

Disordered Systems and Neural Networks · Physics 2024-03-15 Han-Qing Shi , Hai-Qing Zhang

In the context of control and estimation under information constraints, restoration entropy measures the minimal required data rate above which the state of a system can be estimated so that the estimation quality does not degrade over time…

Optimization and Control · Mathematics 2020-09-22 C. Kawan , A. Matveev , A. Pogromsky

Entropy estimation, due in part to its connection with mutual information, has seen considerable use in the study of time series data including causality detection and information flow. In many cases, the entropy is estimated using…

Statistics Theory · Mathematics 2019-08-06 Alexander L Young , David B Dunson

The Boltzmann entropy $S^{(B)}$ is true in the case of equal probability of all microstates of a system. In the opposite case it should be averaged over all microstates that gives rise to the Boltzmann--Shannon entropy (BSE). Maximum…

Statistical Mechanics · Physics 2007-05-23 A. G. Bashkirov

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide…

Statistical Mechanics · Physics 2020-05-11 S. E. Marzen , J. P. Crutchfield

In this paper, we propose a novel neural network approach, termed DeepRTE, to address the steady-state Radiative Transfer Equation (RTE). The RTE is a differential-integral equation that governs the propagation of radiation through a…

Machine Learning · Computer Science 2025-10-30 Yekun Zhu , Min Tang , Zheng Ma

Using a Corner Transfer Matrix approach, we compute the bipartite entanglement R\'enyi entropy in the off-critical perturbations of non-unitary conformal minimal models realised by lattice spin chains Hamiltonians related to the Forrester…

High Energy Physics - Theory · Physics 2016-07-18 Davide Bianchini , Francesco Ravanini

While significant progress has been made in heterogeneous treatment effect (HTE) estimation, the evaluation of HTE estimators remains underdeveloped. In this article, we propose a robust evaluation framework based on relative error, which…

Machine Learning · Statistics 2025-10-21 Jiayi Guo , Haoxuan Li , Ye Tian , Peng Wu

We investigate the large-time asymptotics of nonlinear diffusion equations $u_t = \Delta u^p$ in dimension $n \ge 1$, in the exponent interval $p > n/(n+2)$, when the initial datum $u_0$ is of bounded second moment. Precise rates of…

Analysis of PDEs · Mathematics 2015-06-19 J. A. Carrillo , G. Toscani