English
Related papers

Related papers: Estimating Conditional Mutual Information for Disc…

200 papers

The Maximal Information Coefficient (MIC) is a powerful statistic to identify dependencies between variables. However, it may be applied to sensitive data, and publishing it could leak private information. As a solution, we present…

Cryptography and Security · Computer Science 2022-06-23 John Lazarsfeld , Aaron Johnson , Emmanuel Adeniran

The representations of conditional entropy and conditional mutual information are significant in explaining the unique effects among variables. While previous studies based on conditional contrastive sampling have effectively removed…

Machine Learning · Computer Science 2025-01-07 Keng Hou Leong , Yuxuan Xiu , Wai Kin , Chan

Tandem mass spectrometry has played a pivotal role in advancing proteomics, enabling the analysis of protein composition in biological samples. Despite the development of various deep learning methods for identifying amino acid sequences…

Quantitative Methods · Quantitative Biology 2024-03-18 Jun Xia , Shaorong Chen , Jingbo Zhou , Tianze Ling , Wenjie Du , Sizhe Liu , Stan Z. Li

Estimating and optimizing Mutual Information (MI) is core to many problems in machine learning; however, bounding MI in high dimensions is challenging. To establish tractable and scalable objectives, recent work has turned to variational…

Machine Learning · Computer Science 2019-05-17 Ben Poole , Sherjil Ozair , Aaron van den Oord , Alexander A. Alemi , George Tucker

This paper develops a conformal method to compute prediction intervals for non-parametric regression that can automatically adapt to skewed data. Leveraging black-box machine learning algorithms to estimate the conditional distribution of…

Methodology · Statistics 2021-10-26 Matteo Sesia , Yaniv Romano

Online Class-Incremental continual Learning (OCIL) addresses the challenge of continuously learning from a single-channel data stream, adapting to new tasks while mitigating catastrophic forgetting. Recently, Mutual Information (MI)-based…

Machine Learning · Computer Science 2024-07-29 Huan Zhang , Fan Lyu , Shenghua Fan , Yujin Zheng , Dingwen Wang

Markov blanket feature selection, while theoretically optimal, is generally challenging to implement. This is due to the shortcomings of existing approaches to conditional independence (CI) testing, which tend to struggle either with the…

Machine Learning · Computer Science 2020-06-23 Alan Yang , AmirEmad Ghassami , Maxim Raginsky , Negar Kiyavash , Elyse Rosenbaum

In this paper we focus on the estimation of mutual information from finite samples $(\mathcal{X}\times\mathcal{Y})$. The main concern with estimations of mutual information is their robustness under the class of transformations for which it…

Data Analysis, Statistics and Probability · Physics 2020-02-04 Nicholas Carrara , Jesse Ernst

The diversity of recommendation is equally crucial as accuracy in improving user experience. Existing studies, e.g., Determinantal Point Process (DPP) and Maximal Marginal Relevance (MMR), employ a greedy paradigm to iteratively select…

Information Retrieval · Computer Science 2024-08-15 Fan Li , Xu Si , Shisong Tang , Dingmin Wang , Kunyan Han , Bing Han , Guorui Zhou , Yang Song , Hechang Chen

We present a new technique to enhance the robustness of imitation learning methods by generating corrective data to account for compounding errors and disturbances. While existing methods rely on interactive expert labeling, additional…

Robotics · Computer Science 2024-06-05 Liyiming Ke , Yunchu Zhang , Abhay Deshpande , Siddhartha Srinivasa , Abhishek Gupta

This work considers a problem of estimating a mixing probability density $f$ in the setting of discrete mixture models. The paper consists of three parts. The first part focuses on the construction of an $L_1$ consistent estimator of $f$.…

Information Theory · Computer Science 2021-05-11 Luc Devroye , Alex Dytso

In the analysis of time series from nonlinear sources, mutual information (MI) is used as a nonlinear statistical criterion for the selection of an appropriate time delay in time delay reconstruction of the state space. MI is a statistic…

Chaotic Dynamics · Physics 2009-10-31 Henry D. I. Abarbanel , Naoki Masuda , M. I. Rabinovich , Evren Tumer

Automatic Modulation Classification (AMC) is an essential technology that is widely applied into various communications scenarios. In recent years, many Machine Learning and Deep-Learning methods have been introduced into AMC, and a lot of…

Signal Processing · Electrical Eng. & Systems 2024-12-31 N. Ussipov , S. Akhtanov , Z. Zhanabaev , D. Turlykozhayeva , B. Karibayev , T. Namazbayev , D. Almen , A. Akhmetali , X. Tang

A new expression as a certain asymptotic limit via "discrete micro-states" of permutations is provided to the mutual information of both continuous and discrete random variables.

Probability · Mathematics 2007-05-23 F. Hiai , D. Petz

Heterogeneous, mixed type datasets including both continuous and categorical variables are ubiquitous, and enriches data analysis by allowing for more complex relationships and interactions to be modelled. Mixture models offer a flexible…

Methodology · Statistics 2026-03-03 Junyang Wang , James Bennett , Victor Lhoste , Sarah Filippi

We consider nonparametric estimation of a mixed discrete-continuous distribution under anisotropic smoothness conditions and possibly increasing number of support points for the discrete part of the distribution. For these settings, we…

Statistics Theory · Mathematics 2018-06-21 Andriy Norets , Justinas Pelenis

Partial information decomposition (PID) of the multivariate mutual information describes the distinct ways in which a set of source variables contains information about a target variable. The groundbreaking work of Williams and Beer has…

Information Theory · Computer Science 2021-03-31 Abdullah Makkeh , Aaron J. Gutknecht , Michael Wibral

In the problem of selecting variables in a multivariate linear regression model, we derive new Bayesian information criteria based on a prior mixing a smooth distribution and a delta distribution. Each of them can be interpreted as a fusion…

Statistics Theory · Mathematics 2022-09-29 Haruki Kono , Tatsuya Kubokawa

Humans can learn concepts or recognize items from just a handful of examples, while machines require many more samples to perform the same task. In this paper, we build a computational model to investigate the possibility of this kind of…

Artificial Intelligence · Computer Science 2016-11-09 Wen-Chieh Fang , Yi-ting Chiang

Adaptive dynamical systems arise in a multitude of contexts, e.g., optimization, control, communications, signal processing, and machine learning. A precise characterization of their fundamental limitations is therefore of paramount…

Information Theory · Computer Science 2010-10-13 Maxim Raginsky