English
Related papers

Related papers: Feature Selection with Distance Correlation

200 papers

We revisit vertex discriminant analysis (VDA) from the perspective of proximal distance algorithms. By specifying sparsity sets as constraints that directly control the number of active features, VDA is able to fit multiclass classifiers…

Computation · Statistics 2022-03-22 Alfonso Landeros , Tong Tong Wu , Kenneth Lange

This paper discusses the critical decision process of extracting or selecting the features in a supervised learning context. It is often confusing to find a suitable method to reduce dimensionality. There are pros and cons to deciding…

Machine Learning · Computer Science 2022-06-22 Jean-Sébastien Dessureault , Daniel Massicotte

Leveraging the large body of work devoted in recent years to describe redundancy and synergy in multivariate interactions among random variables, we propose a novel approach to quantify cooperative effects in feature importance, one of the…

Data Analysis, Statistics and Probability · Physics 2025-03-14 Marlis Ontivero-Ortega , Luca Faes , Jesus M Cortes , Daniele Marinazzo , Sebastiano Stramaglia

Features play an important role in various visual tasks, especially in visual place recognition applied in perceptual changing environments. In this paper, we address the challenges of place recognition due to dynamics and confusable…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Yuxin Tian , Jinyu MIao , Xingming Wu , Haosong Yue , Zhong Liu , Weihai Chen

Discriminant Correlation Filters (DCF) based methods now become a kind of dominant approach to online object tracking. The features used in these methods, however, are either based on hand-crafted features like HoGs, or convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Qiang Wang , Jin Gao , Junliang Xing , Mengdan Zhang , Weiming Hu

We introduce a novel ensemble approach for feature selection based on hierarchical stacking for non-stationarity and/or a limited number of samples with a large number of features. Our approach exploits the co-dependency between features…

Machine Learning · Computer Science 2024-10-08 Aysin Tumay , Mustafa E. Aydin , Ali T. Koc , Suleyman S. Kozat

Along with the flourish of the information age, massive amounts of data are generated day by day. Due to the large-scale and high-dimensional characteristics of these data, it is often difficult to achieve better decision-making in…

Machine Learning · Computer Science 2023-04-04 Peican Zhu , Xin Hou , Keke Tang , Zhen Wang , Feiping Nie

Selecting relevant features is an important and necessary step for intelligent machines to maximize their chances of success. However, intelligent machines generally have no enough computing resources when faced with huge volume of data.…

Machine Learning · Computer Science 2025-07-04 Hexiang Bai , Deyu Li , Jiye Liang , Yanhui Zhai

Kernel learning methods are among the most effective learning methods and have been vigorously studied in the past decades. However, when tackling with complicated tasks, classical kernel methods are not flexible or "rich" enough to…

Machine Learning · Computer Science 2019-10-08 Jiaxuan Xie , Fanghui Liu , Kaijie Wang , Xiaolin Huang

In this article, we describe a new method of extracting information from signals, called functional dissipation, that proves to be very effective for enhancing classification of high resolution, texture-rich data. Our algorithm bypasses to…

Data Analysis, Statistics and Probability · Physics 2012-06-15 D. Napoletani , D. C. Struppa , T. Sauer , V. Morozov , N. Vsevolodov , C. Bailey

Feature Selection is a crucial procedure in Data Science tasks such as Classification, since it identifies the relevant variables, making thus the classification procedures more interpretable, cheaper in terms of measurement and more…

Machine Learning · Statistics 2024-01-17 Sandra Benítez-Peña , Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo

A number of machine learning algorithms are using a metric, or a distance, in order to compare individuals. The Euclidean distance is usually employed, but it may be more efficient to learn a parametric distance such as Mahalanobis metric.…

Machine Learning · Computer Science 2016-12-16 Hoel Le Capitaine

We propose a new unsupervised anomaly detection method based on the sliced-Wasserstein distance for training data selection in machine learning approaches. Our filtering technique is interesting for decision-making pipelines deploying…

Machine Learning · Computer Science 2025-04-18 Julien Pallage , Antoine Lesage-Landry

Dealing with datasets of very high dimension is a major challenge in machine learning. In this paper, we consider the problem of feature selection in applications where the memory is not large enough to contain all features. In this…

Machine Learning · Statistics 2017-09-07 Antonio Sutera , Célia Châtel , Gilles Louppe , Louis Wehenkel , Pierre Geurts

Many computer vision and medical imaging problems are faced with learning from large-scale datasets, with millions of observations and features. In this paper we propose a novel efficient learning scheme that tightens a sparsity constraint…

Machine Learning · Statistics 2017-02-07 Adrian Barbu , Yiyuan She , Liangjing Ding , Gary Gramajo

Modern datasets often contain large subsets of correlated features and nuisance features, which are not or loosely related to the main underlying structures of the data. Nuisance features can be identified using the Laplacian score…

Machine Learning · Statistics 2021-10-12 Uri Shaham , Ofir Lindenbaum , Jonathan Svirsky , Yuval Kluger

Feature selection is beneficial for improving the performance of general machine learning tasks by extracting an informative subset from the high-dimensional features. Conventional feature selection methods usually ignore the class…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Meng Liu , Chang Xu , Yong Luo , Chao Xu , Yonggang Wen , Dacheng Tao

As machine learning is applied to an increasing variety of complex problems, which are defined by high dimensional and complex data sets, the necessity for task oriented feature learning grows in importance. With the advancement of Deep…

Machine Learning · Computer Science 2016-07-06 Vishwajeet Singh , Killamsetti Ravi Kumar , K Eswaran

Selecting a small set of informative features from a large number of possibly noisy candidates is a challenging problem with many applications in machine learning and approximate Bayesian computation. In practice, the cost of computing…

Methodology · Statistics 2022-09-05 Louis Raynal , Till Hoffmann , Jukka-Pekka Onnela

Image registration is a classic problem of computer vision with several applications across areas like defence, remote sensing, medicine etc. Feature based image registration methods traditionally used hand-crafted feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 K. Kavitha , B. Thirumala Rao