English
Related papers

Related papers: Variable Selection with Copula Entropy

200 papers

This paper addresses the challenge of identifying a minimal subset of discrete, independent variables that best predicts a binary class. We propose an efficient iterative method that sequentially selects variables based on which one…

Computation · Statistics 2025-11-03 María del Carmen Romero , Mariana del Fresno , Alejandro Clausse

Variable selection is a procedure to attain the truly important predictors from inputs. Complex nonlinear dependencies and strong coupling pose great challenges for variable selection in high-dimensional data. In addition, real-world…

Methodology · Statistics 2023-07-04 Keyao Wang , Huiwen Wang , Jichang Zhao , Lihong Wang

Variational Bayes methods approximate the posterior density by a family of tractable distributions whose parameters are estimated by optimisation. Variational approximation is useful when exact inference is intractable or very costly. Our…

Computation · Statistics 2023-08-15 David Gunawan , Robert Kohn , David Nott

Scalability issue plays a crucial role in productionizing modern recommender systems. Even lightweight architectures may suffer from high computational overload due to intermediate calculations, limiting their practicality in real-world…

Information Retrieval · Computer Science 2024-12-03 Gleb Mezentsev , Danil Gusak , Ivan Oseledets , Evgeny Frolov

The original development of Shapley values for prediction explanation relied on the assumption that the features being described were independent. If the features in reality are dependent this may lead to incorrect explanations. Hence,…

Methodology · Statistics 2021-02-15 Kjersti Aas , Thomas Nagler , Martin Jullum , Anders Løland

Cross Entropy (CE) has an important role in machine learning and, in particular, in neural networks. It is commonly used in neural networks as the cost between the known distribution of the label and the Softmax/Sigmoid output. In this…

Machine Learning · Computer Science 2020-07-17 Ron Shoham , Haim Permuter

The selection of essential variables in logistic regression is vital because of its extensive use in medical studies, finance, economics and related fields. In this paper, we explore four main typologies (test-based, penalty-based,…

Methodology · Statistics 2022-05-17 Souvik Bag , Kapil Gupta , Soudeep Deb

We introduce an entropy-based classification method for pairs of sequences (ECPS) for quantifying mutual dependencies in heart rate and beat-to-beat blood pressure recordings. The purpose of the method is to build a classifier for data in…

Copula modeling has gained much attention in many fields recently with the advantage of separating dependence structure from marginal distributions. In real data, however, serious ties are often present in one or multiple margins, which…

Methodology · Statistics 2022-12-15 Yan Li , Yang Li , Yichen Qin , Jun Yan

This study develops a data-driven group variable selection method for data envelopment analysis (DEA), a non-parametric linear programming approach to the estimation of production frontiers. The proposed method extends the group Lasso…

Optimization and Control · Mathematics 2014-02-18 Zhiwei Qin , Irene Song

We introduce a novel perspective by linking ordered probabilistic choice to copula theory, a mathematical framework for modeling dependencies in multivariate distributions. Each representation of ordered probabilistic choice behavior can be…

Theoretical Economics · Economics 2025-07-10 Christopher P. Chambers , Yusufcan Masatlioglu , Kemal Yildiz

Incorporating feature selection into a classification or regression method often carries a number of advantages. In this paper we formalize feature selection specifically from a discriminative perspective of improving…

Machine Learning · Computer Science 2013-01-18 Tony S. Jebara , Tommi S. Jaakkola

Variable selection for optimal treatment regime in a clinical trial or an observational study is getting more attention. Most existing variable selection techniques focused on selecting variables that are important for prediction, therefore…

Methodology · Statistics 2014-05-22 Ailin Fan , Wenbin Lu , Rui Song

The empirical copula process plays a central role for statistical inference on copulas. Recently, Segers (2011) investigated the asymptotic behavior of this process under non-restrictive smoothness assumptions for the case of i.i.d. random…

Statistics Theory · Mathematics 2011-11-14 Axel Bücher , Stanislav Volgushev

This paper considers the problem of variable selection in regression models in the case of functional variables that may be mixed with other type of variables (scalar, multivariate, directional, etc.). Our proposal begins with a simple null…

In this paper, we provide a new algorithm for the problem of prediction in Reinforcement Learning, \emph{i.e.}, estimating the Value Function of a Markov Reward Process (MRP) using the linear function approximation architecture, with memory…

Systems and Control · Computer Science 2016-09-30 Ajin George Joseph , Shalabh Bhatnagar

We proposed a new statistical dependency measure called Copula Dependency Coefficient(CDC) for two sets of variables based on copula. It is robust to outliers, easy to implement, powerful and appropriate to high-dimensional variables. These…

Machine Learning · Statistics 2018-03-28 Hangjin Jiang , Yiming Ding

We propose a model for unbalanced longitudinal data, where the univariate margins can be selected arbitrarily and the dependence structure is described with the help of a D-vine copula. We show that our approach is an extremely flexible…

Methodology · Statistics 2017-05-18 Matthias Killiches , Claudia Czado

Conformal prediction is a powerful framework for distribution-free uncertainty quantification. The standard approach to conformal prediction relies on comparing the ranks of prediction scores: under exchangeability, the rank of a future…

Machine Learning · Statistics 2025-05-07 Etienne Gauthier , Francis Bach , Michael I. Jordan

A frequent task in exploratory data analysis consists in examining pairwise dependencies between data variables. Popular approaches include visualizing correlation or scatter plot matrices. However, both methods can be misleading. The…

Applications · Statistics 2022-04-04 Arturo Erdely , Manuel Rubio-Sanchez