English
Related papers

Related papers: Decomposed entropy and estimation of output power …

200 papers

Non Performing Asset(NPA) has been in a serious attention by banks over the past few years. NPA cause a huge loss to the banks hence it becomes an extremely critical step in deciding which loans have the capabilities to become an NPA and…

Machine Learning · Computer Science 2020-05-01 Ambarish Moharil , Nikhil Sonavane , Chirag Kedia , Mansimran Singh Anand

The stretched exponential function, $\exp[-(t/\tau_{K})^{\beta}]$, describes various relaxation processes while it has been suggested that the power exponent, $\beta$ is derived from the non-uniformity of the process. In this paper, we…

Soft Condensed Matter · Physics 2018-09-12 Hirokazu Maruoka , Akio Nishimura , Makoto Yoshida , Keisuke Hatada

We propose a novel sparse tensor decomposition method, namely Tensor Truncated Power (TTP) method, that incorporates variable selection into the estimation of decomposition components. The sparsity is achieved via an efficient truncation…

Machine Learning · Statistics 2016-05-04 Will Wei Sun , Junwei Lu , Han Liu , Guang Cheng

Statistical properties of coupled dynamic-stochastic systems are studied within a combination of the maximum information principle and the superstatistical approach. The conditions at which the Shannon entropy functional leads to a…

Statistical Mechanics · Physics 2009-11-11 E. V. Vakarin , J. P. Badiali

We show that for log-concave real random variables with fixed variance the Shannon differential entropy is minimized for an exponential random variable. We apply this result to derive upper bounds on capacities of additive noise channels…

Probability · Mathematics 2024-03-19 James Melbourne , Piotr Nayar , Cyril Roberto

We present the Shannon entropy as an indicator of spatial resolution for morphology of resonance mode pattern in dielectric micro cavity. We obtain two types of optimized mesh point for the minimum and maximum sizes, respectively. The…

Quantum Physics · Physics 2019-06-24 Kyu-Won Park , SongKy Moon , JinUk Kim

This paper studies the Shannon regime for the random displacement of stationary point processes. Let each point of some initial stationary point process in $\R^n$ give rise to one daughter point, the location of which is obtained by adding…

Information Theory · Computer Science 2015-03-17 Venkat Anantharam , Francois Baccelli

Divergences that occur in density matrices of decay and scattering processes are shown to be regularized by tracing and unitarity or the optical theorem. These divergences are regularized by the lifetime of the decaying particle or the…

High Energy Physics - Phenomenology · Physics 2024-06-13 Shanmuka Shivashankara , Patti Rizzo , Nicole Cafe

Denoising Diffusion Probabilistic Model (DDPM) is able to make flexible conditional image generation from prior noise to real data, by introducing an independent noise-aware classifier to provide conditional gradient guidance at each time…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Shengming Li , Guangcong Zheng , Hui Wang , Taiping Yao , Yang Chen , Shoudong Ding , Xi Li

Forthcoming fixed-target coherent elastic neutrino-nucleus scattering experiments aim at measurements with $\cal{O}(\text{tonne})$-scale detectors and substantially reduced systematic and statistical uncertainties. With such high quality…

High Energy Physics - Phenomenology · Physics 2023-08-30 D. Aristizabal Sierra

We have studied the variation of the position space statistical complexity measure defined by L\'{o}pez-Ruiz, Mancini, and Calbet such as the product of exponential of the Shannon information entropy and the disequilibrium by using the…

Quantum Physics · Physics 2018-06-26 Ferhat Nutku , K. D. Sen , Ekrem Aydiner

In this paper, I expand Shannon's definition of entropy into a new form of entropy that allows integration of information from different random events. Shannon's notion of entropy is a special case of my more general definition of entropy.…

Machine Learning · Computer Science 2008-11-04 Stefan Jaeger

Magnetic guiding fields in combination with energy dispersive semiconductor detectors have been employed already more than 50 years ago for in-beam internal conversion electron spectroscopy. Even then it was recognized that efficiency…

Instrumentation and Detectors · Physics 2015-03-25 H. Backe

Shannon entropy is often a quantity of interest to linguists studying the communicative capacity of human language. However, entropy must typically be estimated from observed data because researchers do not have access to the underlying…

Computation and Language · Computer Science 2022-04-06 Aryaman Arora , Clara Meister , Ryan Cotterell

The relative entropy for two different degenerate diffusion processes is estimated by using the Wasserstein distance of initial distributions and the difference between coefficients. As applications, the entropy cost inequality and…

Probability · Mathematics 2024-05-02 Zhongmin Qian , Panpan Ren , Feng-Yu Wang

Rapid development of ultrafast ultraintense laser technologies continues to create opportunities for studying strong-field physics under extreme conditions. However, accurate determination of the spatial and temporal characteristics of a…

Plasma Physics · Physics 2023-01-03 Zhi-Wei Lu , Xin-Di Hou , Feng Wan , Yousef I. Salamin , Chong Lv , Bo Zhang , Fei Wang , Zhong-Feng Xu , Jian-Xing Li

Even if a probability distribution is properly normalizable, its associated Shannon (or von Neumann) entropy can easily be infinite. We carefully analyze conditions under which this phenomenon can occur. Roughly speaking, this happens when…

Statistical Mechanics · Physics 2013-04-04 Valentina Baccetti , Matt Visser

In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…

Information Theory · Computer Science 2010-10-21 Oliver Johnson , Yaming Yu

The entropy region is constructed from vectors of random variables by collecting Shannon entropies of all subvectors. Its shape is studied here by means of polymatroidal constructions, notably by convolution. The closure of the region is…

Information Theory · Computer Science 2013-10-23 František Matúš , Lászlo Csirmaz