English
Related papers

Related papers: Ensemble Estimation of Generalized Mutual Informat…

200 papers

Information theoretic quantities play an important role in various settings in machine learning, including causality testing, structure inference in graphical models, time-series problems, feature selection as well as in providing privacy…

Information Theory · Computer Science 2018-10-30 Arman Rahimzamani , Himanshu Asnani , Pramod Viswanath , Sreeram Kannan

This paper proposes a geometric estimator of dependency between a pair of multivariate samples. The proposed estimator of dependency is based on a randomly permuted geometric graph (the minimal spanning tree) over the two multivariate…

Machine Learning · Computer Science 2019-10-02 Salimeh Yasaei Sekeh , Alfred O. Hero

Estimating mutual information between continuous random variables is often intractable and extremely challenging for high-dimensional data. Recent progress has leveraged neural networks to optimize variational lower bounds on mutual…

Machine Learning · Computer Science 2020-12-01 Ruizhi Liao , Daniel Moyer , Polina Golland , William M. Wells

In clinical trials involving paired organs such as eyes, ears, and kidneys, binary outcomes may be collected bilaterally or unilaterally. In such combined datasets, bilateral outcomes exhibit intra-subject correlation, while unilateral…

Methodology · Statistics 2025-08-19 Jia Zhou , Chang-Xing Ma

Powerful array-based single-nucleotide polymorphism--typing platforms have recently heralded a new era in which genome-wide studies are conducted with increasing frequency. A genetic polymorphism associated with population pharmacokinetics…

Methodology · Statistics 2018-05-15 Kengo Nagashima , Yasunori Sato , Hisashi Noma , Chikuma Hamada

Originally introduced as a neural network for ensemble learning, mixture of experts (MoE) has recently become a fundamental building block of highly successful modern deep neural networks for heterogeneous data analysis in several…

Machine Learning · Statistics 2024-02-12 Huy Nguyen , TrungTin Nguyen , Khai Nguyen , Nhat Ho

The objective of this paper is to define an effective strategy for building an ensemble of Genetic Programming (GP) models. Ensemble methods are widely used in machine learning due to their features: they average out biases, they reduce the…

Neural and Evolutionary Computing · Computer Science 2019-06-14 Mauro Castelli , Ivo Gonçalves , Luca Manzoni , Leonardo Vanneschi

Both the median-based classifier and the quantile-based classifier are useful for discriminating high-dimensional data with heavy-tailed or skewed inputs. But these methods are restricted as they assign equal weight to each variable in an…

Machine Learning · Statistics 2019-10-30 Yuanhao Lai , Ian McLeod

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To…

Information Theory · Computer Science 2023-07-19 Fabrizio Biondi , Yusuke Kawamoto , Axel Legay , Louis-Marie Traonouez

We consider the problem of estimating mutual information between dependent data, an important problem in many science and engineering applications. We propose a data-driven, non-parametric estimator of mutual information in this paper. The…

Information Theory · Computer Science 2017-03-08 Rakesh Malladi , Don H Johnson , Behnaam Aazhang

A new trend in deep learning, represented by Mutual Information Neural Estimation (MINE) and Information Noise Contrast Estimation (InfoNCE), is emerging. In this trend, similarity functions and Estimated Mutual Information (EMI) are used…

Information Theory · Computer Science 2023-05-25 Chenguang Lu

Polynomial ensembles are a sub-class of probability measures within determinantal point processes. Examples include products of independent random matrices, with applications to Lyapunov exponents, and random matrices with an external…

Mathematical Physics · Physics 2020-11-11 Gernot Akemann , Eugene Strahov , Tim R. Würfel

The ensemble Gaussian mixture filter (EnGMF) is a non-linear filter suited to data assimilation of highly non-Gaussian and non-linear models that has practical utility in the case of a small number of samples, and theoretical convergence to…

Optimization and Control · Mathematics 2024-06-03 Andrey A. Popov , Enrico M. Zucchelli , Renato Zanetti

We develop the use of mutual information (MI), a well-established metric in information theory, to interpret the inner workings of deep learning models. To accurately estimate MI from a finite number of samples, we present GMM-MI…

Data Analysis, Statistics and Probability · Physics 2023-04-12 Davide Piras , Hiranya V. Peiris , Andrew Pontzen , Luisa Lucie-Smith , Ningyuan Guo , Brian Nord

The rapid development of high-throughput technologies has enabled the generation of data from biological or disease processes that span multiple layers, like genomic, proteomic or metabolomic data, and further pertain to multiple sources,…

Machine Learning · Statistics 2022-01-25 Subhabrata Majumdar , George Michailidis

We propose an approach based on function evaluations and Bayesian inference to extract higher-order differential information of objective functions {from a given ensemble of particles}. Pointwise evaluation $\{V(x^i)\}_i$ of some potential…

Machine Learning · Statistics 2023-03-02 Claudia Schillings , Claudia Totzeck , Philipp Wacker

This work focuses on the mixed membership models for multivariate categorical data widely used for analyzing survey responses and population genetics data. These grade of membership (GoM) models offer rich modeling power but present…

Methodology · Statistics 2024-12-30 Ling Chen , Chengzhu Huang , Yuqi Gu

We propose generalized resubstitution error estimators for regression, a broad family of estimators, each corresponding to a choice of empirical probability measures and loss function. The usual sum of squares criterion is a special case…

Machine Learning · Computer Science 2024-10-24 Diego Marcondes , Ulisses Braga-Neto

Mixture of Experts (MoE) models constitute a widely utilized class of ensemble learning approaches in statistics and machine learning, known for their flexibility and computational efficiency. They have become integral components in…

Machine Learning · Statistics 2025-05-26 Tuan Thai , TrungTin Nguyen , Dat Do , Nhat Ho , Christopher Drovandi

Variational approaches based on neural networks are showing promise for estimating mutual information (MI) between high dimensional variables. However, they can be difficult to use in practice due to poorly understood bias/variance…

Machine Learning · Computer Science 2020-03-25 Jiaming Song , Stefano Ermon