English
Related papers

Related papers: The mRMR variable selection method: a comparative …

200 papers

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

Machine Learning · Computer Science 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Data from spectrophotometers form vectors of a large number of exploitable variables. Building quantitative models using these variables most often requires using a smaller set of variables than the initial one. Indeed, a too large number…

Machine Learning · Computer Science 2007-09-26 Fabrice Rossi , Amaury Lendasse , Damien François , Vincent Wertz , Michel Verleysen

Simultaneously performing variable selection and inference in high-dimensional regression models is an open challenge in statistics and machine learning. The increasing availability of vast amounts of variables requires the adoption of…

Methodology · Statistics 2025-05-08 Marco Molinari , Magne Thoresen

Recommender system data presents unique challenges to the data mining, machine learning, and algorithms communities. The high missing data rate, in combination with the large scale and high dimensionality that is typical of recommender…

Information Retrieval · Computer Science 2017-03-22 Veronika Strnadova-Neeley , Aydin Buluc , John R. Gilbert , Leonid Oliker , Weimin Ouyang

Lasso and other regularization procedures are attractive methods for variable selection, subject to a proper choice of shrinkage parameter. Given a set of potential subsets produced by a regularization algorithm, a consistent model…

Methodology · Statistics 2014-02-26 Minh-Ngoc Tran

This study combines two different learning paradigms, k-nearest neighbor (k-NN) rule, as memory-based learning paradigm and relevance vector machines (RVM), as statistical learning paradigm. This combination is performed in kernel space and…

Machine Learning · Computer Science 2021-03-09 Sara Hosseinzadeh Kassani , Farhood Rismanchian , Peyman Hosseinzadeh Kassani

Mutual exclusion (ME) is one of the most commonly used techniques to handle conflicts in concurrent systems. Traditionally, mutual exclusion algorithms have been designed under the assumption that a process does not fail while…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-04 Sahil Dhoked , Neeraj Mittal

Recent studies show that Generative Relevance Feedback (GRF), using text generated by Large Language Models (LLMs), can enhance the effectiveness of query expansion. However, LLMs can generate irrelevant information that harms retrieval…

Information Retrieval · Computer Science 2023-06-19 Iain Mackie , Ivan Sekulic , Shubham Chatterjee , Jeffrey Dalton , Fabio Crestani

We describe a variational approximation method for efficient inference in large-scale probabilistic models. Variational methods are deterministic procedures that provide approximations to marginal and conditional probabilities of interest.…

Artificial Intelligence · Computer Science 2011-05-30 T. S. Jaakkola , M. I. Jordan

Most existing feature selection methods are insufficient for analytic purposes as soon as high dimensional data or redundant sensor signals are dealt with since features can be selected due to spurious effects or correlations rather than…

Machine Learning · Computer Science 2019-08-13 Lukas Pfannschmidt , Christina Göpfert , Ursula Neumann , Dominik Heider , Barbara Hammer

The dual problem of testing the predictive significance of a particular covariate, and identification of the set of relevant covariates is common in applied research and methodological investigations. To study this problem in the context of…

Statistics Theory · Mathematics 2015-06-11 Julian A. A. Collazos , Adriano Z. Zambom

In our paper, we focus on robust variable selection for missing data and measurement error. Missing data and measurement errors can lead to confusing data distribution. We propose an exponential loss function with a tuning parameter to…

Methodology · Statistics 2025-07-01 Zhenhao Zhang , Yunquan Song

Standard approaches for variable selection in linear models are not tailored to deal properly with high-dimensional and incomplete data. Currently, methods dedicated to high-dimensional data handle missing values by ad-hoc strategies, like…

Methodology · Statistics 2021-06-09 Avner Bar-Hen , Vincent Audigier

We propose a robust variable selection procedure using a divergence based M-estimator combined with a penalty function. It produces robust estimates of the regression parameters and simultaneously selects the important explanatory…

Methodology · Statistics 2020-01-01 Abhijit Mandal , Samiran Ghosh

This paper describes a distributed MapReduce implementation of the minimum Redundancy Maximum Relevance algorithm, a popular feature selection method in bioinformatics and network inference problems. The proposed approach handles both…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-08 Claudio Reggiani , Yann-Aël Le Borgne , Gianluca Bontempi

Variable selection in cluster analysis is important yet challenging. It can be achieved by regularization methods, which realize a trade-off between the clustering accuracy and the number of selected variables by using a lasso-type penalty.…

Methodology · Statistics 2016-12-23 Marbac Matthieu , Sedki Mohammed

Adaptations of features commonly applied in the field of visual computing, co-occurrence matrix (COM) and run-length matrix (RLM), are proposed for the similarity computation of strings in general (words, phrases, codes and texts). The…

Machine Learning · Computer Science 2026-05-15 E. O. Rodrigues , D. Casanova , M. Teixeira , V. Pegorini , F. Favarim , E. Clua , A. Conci , Panos Liatsis

For visual-semantic embedding, the existing methods normally treat the relevance between queries and candidates in a bipolar way -- relevant or irrelevant, and all "irrelevant" candidates are uniformly pushed away from the query by an equal…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Mo Zhou , Zhenxing Niu , Le Wang , Zhanning Gao , Qilin Zhang , Gang Hua

We consider a problem of linear model selection in the presence of both continuous and categorical predictors. Feasible models consist of subsets of numerical variables and partitions of levels of factors. A new algorithm called delete or…

Applications · Statistics 2015-12-22 Aleksandra Maj-Kańska , Piotr Pokarowski , Agnieszka Prochenka

Extracting a small subset of crucial rationales from the full input is a key problem in explainability research. The most widely used fundamental criterion for rationale extraction is the maximum mutual information (MMI) criterion. In this…

Artificial Intelligence · Computer Science 2025-03-11 Wei Liu , Zhiying Deng , Zhongyu Niu , Jun Wang , Haozhao Wang , Zhigang Zeng , Ruixuan Li