English
Related papers

Related papers: R\'enyi Information Measures for Spectral Change D…

200 papers

People often listen to music in noisy environments, seeking to isolate themselves from ambient sounds. Indeed, a music signal can mask some of the noise's frequency components due to the effect of simultaneous masking. In this article, we…

Sound · Computer Science 2025-02-26 Clémentine Berger , Roland Badeau , Slim Essid

Change point detection (CPD) aims to locate abrupt property changes in time series data. Recent CPD methods demonstrated the potential of using deep learning techniques, but often lack the ability to identify more subtle changes in the…

Machine Learning · Computer Science 2021-07-21 Tim De Ryck , Maarten De Vos , Alexander Bertrand

We compute R\'enyi entropies for the statistics of a noisy simultaneous observation of two complementary observables in two-dimensional quantum systems. The relative amount of uncertainty between two states depends on the uncertainty…

Quantum Physics · Physics 2015-11-17 Alfredo Luis , Gustavo Martín Bosyk , Mariela Portesi

Photon-number squeezing and correlations enable measurement of absorption with an accuracy exceeding that of the shot-noise limit. However, sub-shot noise imaging and sensing based on these methods require high detection efficiency, which…

Quantum Physics · Physics 2019-03-06 E. Knyazev , F. Ya. Khalili , M. V. Chekhova

Many time series problems feature epidemic changes - segments where a parameter deviates from a background baseline. The number and location of such changes can be estimated in a principled way by existing detection methods, providing that…

Methodology · Statistics 2020-08-20 Julius Juodakis , Stephen Marsland

We characterize different cell states, related to cancer and ageing phenotypes, by a measure of entropy of network ensembles, integrating gene expression values and protein interaction networks. The entropy measure estimates the parameter…

Molecular Networks · Quantitative Biology 2013-05-24 G. Menichetti , G. Bianconi , E. Giampieri , G. Castellani , D. Remondini

Shannon entropy was defined for probability distributions and then its using was expanded to measure the uncertainty of knowledge for systems with complete information. In this article, it is proposed to extend the using of Shannon entropy…

Information Theory · Computer Science 2017-09-15 Vasile Patrascu

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon,…

Statistical Mechanics · Physics 2008-04-30 Juan A. Bonachela , Haye Hinrichsen , Miguel A. Munoz

Phase-space versions of quantum mechanics -- from Wigner's original distribution to modern discrete-qudit constructions -- represent some states with negative quasi-probabilities. Conventional Shannon and R\'enyi entropies become…

Quantum Physics · Physics 2025-12-23 Adam Brandenburger , Pierfrancesco La Mura

This paper presents end-to-end learning from spectrum data - an umbrella term for new sophisticated wireless signal identification approaches in spectrum monitoring applications based on deep neural networks. End-to-end learning allows to…

Networking and Internet Architecture · Computer Science 2017-12-13 Merima Kulin , Tarik Kazaz , Ingrid Moerman , Eli de Poorter

Fisher information and Shannon entropy are fundamental tools for understanding and analyzing dynamical systems from complementary perspectives. They can characterize unknown parameters by quantifying the information contained in variables,…

Information Theory · Computer Science 2025-12-19 Yuxuan Bao , J. Nathan Kutz

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To…

Information Theory · Computer Science 2023-07-19 Fabrizio Biondi , Yusuke Kawamoto , Axel Legay , Louis-Marie Traonouez

This paper focuses on parameter estimation and introduces a new method for lower bounding the Bayesian risk. The method allows for the use of virtually \emph{any} information measure, including R\'enyi's $\alpha$, $\varphi$-Divergences, and…

Information Theory · Computer Science 2023-03-27 Amedeo Roberto Esposito , Adrien Vandenbroucque , Michael Gastpar

We develop a novel method for detection of signals and reconstruction of images in the presence of random noise. The method uses results from percolation theory. We specifically address the problem of detection of multiple objects of…

Applications · Statistics 2013-12-02 Mikhail Langovoy , Michael Habeck , Bernhard Schölkopf

This paper presents a framework for the analysis of changes in visual streams: ordered sequences of images, possibly separated by significant time gaps. We propose a new approach to incorporating unlabeled data into training to generate…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Davis Gilton , Ruotian Luo , Rebecca Willett , Greg Shakhnarovich

In this paper we propose a method for automatic local time adap- tation of the spectrogram of an audio signal, based on its decomposition within a Gabor multi-frame. The sparsity of the analyses within each individual frame is evaluated…

Sound · Computer Science 2011-09-29 M. Liuni , A. Röbel , M. Romito , X. Rodet

Assume that there are multiple data streams (channels, sensors) and in each stream the process of interest produces generally dependent and non-identically distributed observations. When the process is in a normal mode (in-control), the…

Statistics Theory · Mathematics 2018-07-25 Alexander Tartakovsky

High-precision measurements benefit from lock-in detection of small signals. Here we discuss the extension of lock-in detection to many channels, using mutually orthogonal modulation waveforms, and show how the the choice of waveforms…

Instrumentation and Detectors · Physics 2014-03-04 J J Hudson , M R Tarbutt , B E Sauer , E A Hinds

Shannon entropy ($S$), R{\'e}nyi entropy ($R$), Tsallis entropy ($T$), Fisher information ($I$) and Onicescu energy ($E$) have been explored extensively in both \emph{free} H atom (FHA) and \emph{confined} H atom (CHA). For a given quantum…

Quantum Physics · Physics 2019-04-05 Neetik Mukherjee , Amlan K. Roy

Spectral homodyne detection, a widely used technique for measuring quantum properties of light beams, cannot retrieve all the information needed to reconstruct the quantum state of spectral field modes. We show that full quantum state…