English
Related papers

Related papers: Mutual-Information Based Optimal Experimental Desi…

200 papers

Recently, the importance of analysing data and collecting valuable insight efficiently has been increasing in various fields. Estimating mutual information (MI) plays a critical role to investigate the relationship among multiple random…

Quantum Physics · Physics 2025-03-10 Yota Maeda , Hideaki Kawaguchi , Hiroyuki Tezuka

This paper proposes the estimation of a mutual shape from a set of different segmentation results using both active contours and information theory. The mutual shape is here defined as a consensus shape estimated from a set of different…

Image and Video Processing · Electrical Eng. & Systems 2021-02-18 S. Jehan-Besson , R. Clouard , C. Tilmant , A. de Cesare , A. Lalande , J. Lebenberg , P. Clarysse , L. Sarry , F. Frouin , M. Garreau

Semantic segmentation is a fundamental problem in computer vision. It is considered as a pixel-wise classification problem in practice, and most segmentation models use a pixel-wise loss as their optimization riterion. However, the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Shuai Zhao , Yang Wang , Zheng Yang , Deng Cai

We present a mutual information-based framework for unsupervised image-to-image translation. Our MCMI approach treats single-cycle image translation models as modules that can be used recurrently in a multi-cycle translation setting where…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Xiang Xu , Megha Nawhal , Greg Mori , Manolis Savva

Mutual information (MI) is a principled and widely used objective for robotic information gathering (RIG), providing strong theoretical guarantees for sensor placement (SP) and informative path planning (IPP). However, its high…

Robotics · Computer Science 2026-02-16 Kalvik Jakkala , Jason O'Kane , Srinivas Akella

Any suitably well-posed PDE in two spatial dimensions can be represented as a Partial Integral Equation (PIE) -- with system dynamics parameterized using Partial Integral (PI) operators. Furthermore, $L_2$-gain analysis of PDEs with a PIE…

Optimization and Control · Mathematics 2024-06-18 Declan S. Jagt , Matthew M. Peet

Estimating mutual information (MI) between two continuous random variables $X$ and $Y$ allows to capture non-linear dependencies between them, non-parametrically. As such, MI estimation lies at the core of many data science applications.…

Information Theory · Computer Science 2022-01-19 Alexander Marx , Jonas Fischer

To accelerate MRI, the field of compressed sensing is traditionally concerned with optimizing the image quality after a partial undersampling of the measurable $\textit{k}$-space. In our work, we propose to change the focus from the quality…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Artem Razumov , Oleg Y. Rogov , Dmitry V. Dylov

This article proposes a new method to estimate an existing mutual information based dependence measure using histogram density estimates. Finding a suitable bin length for histogram is an open problem. We propose a new way of computing the…

Information Theory · Computer Science 2015-09-15 Namita Jain , C. A. Murthy

The reconfigurable intelligent surface (RIS) is useful to effectively improve the coverage and data rate of end-to-end communications. In contrast to the well-studied coverage-extension use case, in this paper, multiple RIS panels are…

Information Theory · Computer Science 2023-01-31 Zhong Zheng , Siqiang Wang , Zesong Fei , Zhi Sun , Jinhong Yuan

Biophysical model fitting plays a key role in obtaining quantitative parameters from physiological signals and images. However, the model complexity for molecular magnetic resonance imaging (MRI) often translates into excessive computation…

Medical Physics · Physics 2025-04-18 Alex Finkelstein , Nikita Vladimirov , Moritz Zaiss , Or Perlman

Renormalization is an essential technique in field-theoretic descriptions of natural phenomena, where the absence of a UV-complete description yields an abundance of divergent quantities. While the renormalization prescription has been…

High Energy Physics - Theory · Physics 2025-11-14 Brenden Bowen , Albert Farah , Spasen Chaykov , Nishant Agarwal

The mutual information is a core statistical quantity that has applications in all areas of machine learning, whether this is in training of density models over multiple data modalities, in maximising the efficiency of noisy transmission…

Machine Learning · Statistics 2015-09-30 Shakir Mohamed , Danilo Jimenez Rezende

Multiple antenna (MIMO) devices are widely used to increase reliability and information bit rate. Optimal error rate performance (full diversity and large coding gain), for unknown channel state information at the transmitter and for…

Information Theory · Computer Science 2012-05-14 Dieter Duyck , Sheng Yang , Fambirai Takawira , Joseph J. Boutros , Marc Moeneclaey

Multimodal image alignment is the process of finding spatial correspondences between images formed by different imaging techniques or under different conditions, to facilitate heterogeneous data fusion and correlative analysis. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Johan Öfverstedt , Joakim Lindblad , Nataša Sladoje

We propose a probabilistic shaping approach for region-of-interest signaling, where a low-rate signal controls the desired probabilistic ranges of a high-rate data stream using a flexible distribution controller. In addition, we introduce…

Signal Processing · Electrical Eng. & Systems 2022-09-05 Duc-Phuc Nguyen , Yoshifumi Shiraki , Jun Muramatsu , Takehiro Moriya

Mutual information (MI) is a fundamental measure of statistical dependence, with a myriad of applications to information theory, statistics, and machine learning. While it possesses many desirable structural properties, the estimation of…

Information Theory · Computer Science 2021-10-19 Ziv Goldfeld , Kristjan Greenewald

The analysis of glandular morphology within colon histopathology images is an important step in determining the grade of colon cancer. Despite the importance of this task, manual segmentation is laborious, time-consuming and can suffer from…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Simon Graham , Hao Chen , Jevgenij Gamper , Qi Dou , Pheng-Ann Heng , David Snead , Yee Wah Tsang , Nasir Rajpoot

Mixtures of Hidden Markov Models (MHMMs) are frequently used for clustering of sequential data. An important aspect of MHMMs, as of any clustering approach, is that they can be interpretable, allowing for novel insights to be gained from…

Artificial Intelligence · Computer Science 2021-03-24 Negar Safinianaini , Henrik Boström

We develop a class of interacting particle systems for implementing a maximum marginal likelihood estimation (MMLE) procedure to estimate the parameters of a latent variable model. We achieve this by formulating a continuous-time…