English
Related papers

Related papers: Validation of Tsallis Entropy In Inter-Modality Ne…

200 papers

In medical imaging it is common practice to acquire a wide range of modalities (MRI, CT, PET, etc.), to highlight different structures or pathologies. As patient movement between scans or scanning session is unavoidable, registration is…

Image and Video Processing · Electrical Eng. & Systems 2021-05-10 Mikael Brudfors , Yaël Balbastre , John Ashburner

Intensity-based image registration approaches rely on similarity measures to guide the search for geometric correspondences with high affinity between images. The properties of the used measure are vital for the robustness and accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Johan Öfverstedt , Joakim Lindblad , Nataša Sladoje

We introduce a comprehensive theoretical and algorithmic framework that bridges formal group theory and group entropies with modern machine learning, paving the way for an infinite, flexible family of Mirror Descent (MD) optimization…

Machine Learning · Computer Science 2026-03-10 Andrzej Cichocki , Piergiulio Tempesta

Image normalization, the correction for intra-volume inhomogeneities in magnetic resonance imaging (MRI) data has little significance for visual diagnosis, but is a crucial step before automated radiotherapy solutions. There are several…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 A. Simkó , T. Löfstedt , A. Garpebring , T. Nyholm , J. Jonsson

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

The acquisition of MRI images offers a trade-off in terms of acquisition time, spatial/temporal resolution and signal-to-noise ratio (SNR). Thus, for instance, increasing the time efficiency of MRI often comes at the expense of reduced SNR.…

Computer Vision and Pattern Recognition · Computer Science 2011-10-28 Sudipto Dolui , Alan Kuurstra , Iván C. Salgado Patarroyo , Oleg V. Michailovich

Mutual Information (MI) is a crucial measure for capturing dependencies between variables, but exact computation is challenging in high dimensions with intractable likelihoods, impacting accuracy and robustness. One idea is to use an…

Machine Learning · Statistics 2025-03-13 Forough Fazeliasl , Michael Minyi Zhang , Bei Jiang , Linglong Kong

In this paper we introduce an easy to compute upper bound on the Tsallis entropy of a density matrix describing a system coupled to a noise source. This suggests that the Tsallis entropy is most natural in the context of quantum information…

Quantum Physics · Physics 2017-02-28 Boaz Tamir

The quality of image encryption is commonly measured by the Shannon entropy over the ciphertext image. However, this measurement does not consider to the randomness of local image blocks and is inappropriate for scrambling based image…

Cryptography and Security · Computer Science 2016-11-27 Yue Wu , Joseph P. Noonan , Sos Agaian

Mutual information has many applications in image alignment and matching, mainly due to its ability to measure the statistical dependence between two images, even if the two images are from different modalities (e.g., CT and MRI). It…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Jiecheng Liao , Junhao Lu , Jeff Ji , Jiacheng He

Deformable image registration is a key task in medical image analysis. The Brain Tumor Sequence Registration challenge (BraTS-Reg) aims at establishing correspondences between pre-operative and follow-up scans of the same patient diagnosed…

Image and Video Processing · Electrical Eng. & Systems 2022-12-12 Javid Abderezaei , Aymeric Pionteck , Agamdeep Chopra , Mehmet Kurt

This paper studies the use of the Tsallis Entropy versus the classic Boltzmann-Gibbs-Shannon entropy for classifying image patterns. Given a database of 40 pattern classes, the goal is to determine the class of a given image sample. Our…

Data Analysis, Statistics and Probability · Physics 2011-12-30 Ricardo Fabbri , Wesley N. Gonçalves , Francisco J. P. Lopes , Odemir M. Bruno

In this paper it is shown that statistical mechanics in the form of thermodynamic entropy can be used as a measure of the severity of individual injuries (AIS), and that the correct way to account for multiple injuries is to sum the…

Medical Physics · Physics 2010-08-24 Clive Neal-Sturgess

The Normalized Mutual Information (NMI) has been widely used to evaluate the accuracy of community detection algorithms. However in this article we show that the NMI is seriously affected by systematic errors due to finite size of networks,…

Physics and Society · Physics 2015-12-09 Pan Zhang

The concept of entropy, firstly introduced in information theory, rapidly became popular in many applied sciences via Shannon's formula to measure the degree of heterogeneity among observations. A rather recent research field aims at…

Methodology · Statistics 2017-03-20 Linda Altieri , Daniela Cocchi , Giulia Roli

Image registration is an important tool for medical image analysis and is used to bring images into the same reference frame by warping the coordinate field of one image, such that some similarity measure is minimized. We study similarity…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Sune Darkner , Jon Sporring

In this paper, we consider the problem of estimating Tsallis entropy from a given data set. We propose four different estimators for Tsallis entropy measure based on higher-order sample spacings, and then discuss estimation of Tsallis…

Methodology · Statistics 2026-02-10 Siddhartha Chakraborty , Asok K. Nanda , Narayanaswamy Balakrishnan

We propose a new benchmark for evaluating stereoscopic visual-inertial computer vision algorithms (SLAM/ SfM/ 3D Reconstruction/ Visual-Inertial Odometry) for minimally invasive surgical (MIS) interventions in the abdomen. Our MITI Dataset…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Regine Hartwig , Daniel Ostler , Jean-Claude Rosenthal , Hubertus Feußner , Dirk Wilhelm , Dirk Wollherr

This paper reveals a conceptually new connection from information theory to approximation theory via quantum algorithms for entropy estimation. Specifically, we provide an information-theoretic lower bound $\Omega(\sqrt{n})$ on the…

Quantum Physics · Physics 2025-09-04 Qisheng Wang

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

Information Theory · Computer Science 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal