English
Related papers

Related papers: Information estimation using nonparametric copulas

200 papers

This paper introduces a nonparametric copula-based index for detecting the strength and monotonicity structure of linear and nonlinear statistical dependence between pairs of random variables or stochastic signals. Our index, termed Copula…

Machine Learning · Statistics 2020-02-25 Kiran Karra , Lamine Mili

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

A factor copula model is proposed in which factors are either simulable or estimable from exogenous information. Point estimation and inference are based on a simulated methods of moments (SMM) approach with non-overlapping simulation…

Econometrics · Economics 2022-12-02 Alexander Mayer , Dominik Wied

This paper introduces a new property of estimators of the strength of statistical association, which helps characterize how well an estimator will perform in scenarios where dependencies between continuous and discrete random variables need…

Machine Learning · Statistics 2021-01-12 Kiran Karra , Lamine Mili

The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data.…

Machine Learning · Statistics 2017-07-28 Hiroaki Sasaki , Michael U. Gutmann , Hayaru Shouno , Aapo Hyvärinen

This paper considers nonparametric identification and estimation of the regression function when a covariate is mismeasured. The measurement error need not be classical. Employing the small measurement error approximation, we establish…

Econometrics · Economics 2024-03-19 Kirill S. Evdokimov , Andrei Zeleneev

The paper overviews and investigates several nonparametric methods of estimating covariograms. It provides a unified approach and notation to compare the main approaches used in applied research. The primary focus is on methods that utilise…

Methodology · Statistics 2024-08-06 Adam Bilchouris , Andriy Olenko

Compositional data arise in many real-life applications and versatile methods for properly analyzing this type of data in the regression context are needed. When parametric assumptions do not hold or are difficult to verify, non-parametric…

Methodology · Statistics 2023-09-07 Michail Tsagris , Abdulaziz Alenazi , Connie Stewart

Weighted estimators are commonly used for estimating exposure effects in observational settings to establish causal relations. These estimators have a long history of development when the exposure of interest is binary and where the weights…

Accurately estimating the proportion of true signals among a large number of variables is crucial for enhancing the precision and reliability of scientific research. Traditional signal proportion estimators often assume independence among…

Statistics Theory · Mathematics 2026-05-15 Jingtian Bai , Xinge Jessie Jeng

The NPMLE of a distribution function from doubly truncated data was introduced in the seminal paper of Efron and Petrosian. The consistency of the Efron-Petrosian estimator depends however on the assumption of independent truncation. In…

Methodology · Statistics 2021-01-15 Carla Moreira , Jacobo de Uña-Álvarez , Roel Braekers

A semiparametric copula-based two-part quantile regression framework is developed for the analysis of semicontinuous outcomes characterized by a point mass at zero and a continuous positive component. The proposed approach models the…

Methodology · Statistics 2026-03-17 Guanjie Lyu , Mohamed Belalia , Abdulkadir Hussein

Estimating information-theoretic quantities such as entropy and mutual information is central to many problems in statistics and machine learning, but challenging in high dimensions. This paper presents estimators of entropy via inference…

Machine Learning · Statistics 2022-12-13 Feras A. Saad , Marco Cusumano-Towner , Vikash K. Mansinghka

Describing statistical dependencies is foundational to empirical scientific research. For uncovering intricate and possibly non-linear dependencies between a single target variable and several source variables within a system, a principled…

Information Theory · Computer Science 2024-03-28 David A. Ehrlich , Kyle Schick-Poland , Abdullah Makkeh , Felix Lanfermann , Patricia Wollstadt , Michael Wibral

We propose a model selection approach for covariance estimation of a multi-dimensional stochastic process. Under very general assumptions, observing i.i.d replications of the process at fixed observation points, we construct an estimator of…

Statistics Theory · Mathematics 2009-09-29 Jérémie Bigot , Rolando Biscay , Jean-Michel Loubes , Lilian Muniz Alvarez

The non-identifiability of the competing risks model requires researchers to work with restrictions on the model to obtain informative results. We present a new identifiability solution based on an exclusion restriction. Many areas of…

Methodology · Statistics 2023-09-06 Munir Hiabu , Simon M. S. LU , Ralf A. Wilke

Our article addresses the problem of flexibly estimating a multivariate density while also attempting to estimate its marginals correctly. We do so by proposing two new estimators that try to capture the best features of mixture of normals…

Methodology · Statistics 2009-01-05 Paolo Giordani , Xiuyan Mun , Robert Kohn

Value-of-information analyses provide a straightforward means for selecting the best next observation to make, and for determining whether it is better to gather additional information or to act immediately. Determining the next best test…

Artificial Intelligence · Computer Science 2015-05-19 David Heckerman , Eric J. Horvitz , Blackford Middleton

We consider non-parametric estimation problems in the presence of dependent data, notably non-parametric regression with random design and non-parametric density estimation. The proposed estimation procedure is based on a dimension…

Statistics Theory · Mathematics 2016-02-02 Nicolas Asin , Jan Johannes

Copula-based modeling has seen rapid advances in recent years. However, in big data applications, the lengthy computation time for estimating copula parameters is a major difficulty. Here, we develop a novel method to speed computation time…

Methodology · Statistics 2016-09-20 Zheng Wei , Daeyoung Kim , Erin Marie Conlon