English
Related papers

Related papers: Schur-MI: Fast Mutual Information for Robotic Info…

200 papers

Mutual Information (MI) is a powerful statistical measure that quantifies shared information between random variables, particularly valuable in high-dimensional data analysis across fields like genomics, natural language processing, and…

Machine Learning · Computer Science 2024-12-02 Andre O. Falcao

Robotic information gathering (RIG) techniques refer to methods where mobile robots are used to acquire data about the physical environment with a suite of sensors. Informative planning is an important part of RIG where the goal is to find…

Robotics · Computer Science 2025-09-03 Sanjeev Ramkumar Sudha , Joel Jose , Erlend M. Coates

Estimating mutual information is an important statistics and machine learning problem. To estimate the mutual information from data, a common practice is preparing a set of paired samples $\{(\mathbf{x}_i,\mathbf{y}_i)\}_{i=1}^n…

Machine Learning · Statistics 2024-07-16 Yanbin Liu , Makoto Yamada , Yao-Hung Hubert Tsai , Tam Le , Ruslan Salakhutdinov , Yi Yang

Mutual information (MI) is a promising candidate measure for the assessment and optimization of localization systems, as it captures nonlinear dependencies between random variables. However, the high cost of computing MI, especially for…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Sven Hinderer , Manuel Buchfink , Bin Yang

Exploration tasks are essential to many emerging robotics applications, ranging from search and rescue to space exploration. The planning problem for exploration requires determining the best locations for future measurements that will…

Hardware Architecture · Computer Science 2022-10-10 Keshav Gupta , Peter Zhi Xuan Li , Sertac Karaman , Vivienne Sze

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

This paper presents Rummaging Using Mutual Information (RUMI), a method for online generation of robot action sequences to gather information about the pose of a known movable object in visually-occluded environments. Focusing on…

Robotics · Computer Science 2025-07-25 Sheng Zhong , Nima Fazeli , Dmitry Berenson

Estimating mutual information (MI) is a fundamental yet challenging task in data science and machine learning. This work proposes a new estimator for mutual information. Our main discovery is that a preliminary estimate of the data…

Machine Learning · Computer Science 2024-08-20 Yanzhi Chen , Zijing Ou , Adrian Weller , Yingzhen Li

Computation of Mutual Information (MI) helps understand the amount of information shared between a pair of random variables. Automated feature selection techniques based on MI ranking are regularly used to extract information from sensitive…

Cryptography and Security · Computer Science 2020-09-24 Ankit Srivastava , Samira Pouyanfar , Joshua Allen , Ken Johnston , Qida Ma

As a fundamental concept in information theory, mutual information ($MI$) has been commonly applied to quantify association between random vectors. Most existing nonparametric estimators of $MI$ have unstable statistical performance since…

Applications · Statistics 2025-02-19 Soumik Purkayastha , Peter X. K. Song

Multimodal image alignment is the process of finding spatial correspondences between images formed by different imaging techniques or under different conditions, to facilitate heterogeneous data fusion and correlative analysis. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Johan Öfverstedt , Joakim Lindblad , Nataša Sladoje

Exploration tasks are embedded in many robotics applications, such as search and rescue and space exploration. Information-based exploration algorithms aim to find the most informative trajectories by maximizing an information-theoretic…

Robotics · Computer Science 2019-05-08 Zhengdong Zhang , Trevor Henderson , Sertac Karaman , Vivienne Sze

Motivation: Clustering is a frequently used concept in variety of bioinformatical applications. We present a new method for hierarchical clustering of data called mutual information clustering (MIC) algorithm. It uses mutual information…

Quantitative Methods · Quantitative Biology 2007-05-23 Alexander Kraskov , Harald Stögbauer , Ralph G. Andrzejak , Peter Grassberger

Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superior performance…

Image and Video Processing · Electrical Eng. & Systems 2022-10-07 Gerard Snaauw , Michele Sasdelli , Gabriel Maicas , Stephan Lau , Johan Verjans , Mark Jenkinson , Gustavo Carneiro

Mutual information (MI) is the standard method used in image registration and the most studied one but can diverge and produce wrong results when used in an automated manner. In this study we compared the results of the ITK Mattes MI…

Image and Video Processing · Electrical Eng. & Systems 2019-09-25 Vinicius Pavanelli Vianna , Luiz Otavio Murta Junior

Relational data augmentation is a powerful technique for enhancing data analytics and improving machine learning models by incorporating columns from external datasets. However, it is challenging to efficiently discover relevant external…

Databases · Computer Science 2025-03-06 Aécio Santos , Flip Korn , Juliana Freire

We develop the use of mutual information (MI), a well-established metric in information theory, to interpret the inner workings of deep learning models. To accurately estimate MI from a finite number of samples, we present GMM-MI…

Data Analysis, Statistics and Probability · Physics 2023-04-12 Davide Piras , Hiranya V. Peiris , Andrew Pontzen , Luisa Lucie-Smith , Ningyuan Guo , Brian Nord

One of the most complex tasks of decision making and planning is to gather information. This task becomes even more complex when the state is high-dimensional and its belief cannot be expressed with a parametric distribution. Although the…

Artificial Intelligence · Computer Science 2022-09-26 Gilad Rotman , Vadim Indelman

This paper investigates the problem of informative path planning for a mobile robotic sensor network in spatially temporally distributed mapping. The robots are able to gather noisy measurements from an area of interest during their…

Estimating mutual information (MI) is a fundamental task in data science and machine learning. Existing estimators mainly rely on either highly flexible models (e.g., neural networks), which require large amounts of data, or overly…

Machine Learning · Computer Science 2025-10-27 Yanzhi Chen , Zijing Ou , Adrian Weller , Michael U. Gutmann
‹ Prev 1 2 3 10 Next ›