English
Related papers

Related papers: Feature Selection with Distance Correlation

200 papers

Feature importance ranking has become a powerful tool for explainable AI. However, its nature of combinatorial optimization poses a great challenge for deep learning. In this paper, we propose a novel dual-net architecture consisting of…

Machine Learning · Computer Science 2020-10-20 Maksymilian Wojtas , Ke Chen

We address a core problem of computer vision: Detection and description of 2D feature points for image matching. For a long time, hand-crafted designs, like the seminal SIFT algorithm, were unsurpassed in accuracy and efficiency. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Aritra Bhowmik , Stefan Gumhold , Carsten Rother , Eric Brachmann

Continual learning is an emerging paradigm in machine learning, wherein a model is exposed in an online fashion to data from multiple different distributions (i.e. environments), and is expected to adapt to the distribution change.…

Machine Learning · Computer Science 2022-03-29 Binghui Peng , Andrej Risteski

High-dimensional measurements are often correlated which motivates their approximation by factor models. This holds also true when features are engineered via low-dimensional interactions or kernel tricks. This often results in over…

Applications · Statistics 2025-09-03 Xiaonan Zhu , Bingyan Wang , Jianqing Fan

Deep Recommender Systems (DRS) are increasingly dependent on a large number of feature fields for more precise recommendations. Effective feature selection methods are consequently becoming critical for further enhancing the accuracy and…

Information Retrieval · Computer Science 2024-06-21 Pengyue Jia , Yejing Wang , Zhaocheng Du , Xiangyu Zhao , Yichao Wang , Bo Chen , Wanyu Wang , Huifeng Guo , Ruiming Tang

Feature identification is an important task in many fluid dynamics applications and diverse methods have been developed for this purpose. These methods are based on a physical understanding of the underlying behavior of the flow in the…

Fluid Dynamics · Physics 2019-01-07 Carlos Michelén Ströfer , Jinlong Wu , Heng Xiao , Eric Paterson

Existing feature selection methods fail to properly account for interactions between features when evaluating feature subsets. In this paper, we attempt to remedy this issue by using orthogonal variance decomposition to evaluate features.…

Machine Learning · Computer Science 2019-10-23 Firuz Kamalov

Feature selection is a crucial preprocessing step in data analytics and machine learning. Classical feature selection algorithms select features based on the correlations between predictive features and the class variable and do not attempt…

Machine Learning · Computer Science 2019-11-19 Kui Yu , Xianjie Guo , Lin Liu , Jiuyong Li , Hao Wang , Zhaolong Ling , Xindong Wu

Feature selection is crucial for fuzzy decision systems (FDSs), as it identifies informative features and eliminates rule redundancy, thereby enhancing predictive performance and interpretability. Most existing methods either fail to…

Machine Learning · Computer Science 2025-10-01 Suping Xu , Chuyi Dai , Ye Liu , Lin Shang , Xibei Yang , Witold Pedrycz

Correlations in streams of multivariate time series data means that typically, only a small subset of the features are required for a given data mining task. In this paper, we propose a technique which we call Merit Score for Time-Series…

Machine Learning · Computer Science 2021-12-08 Bahavathy Kathirgamanathan , Padraig Cunningham

Aiming at improving the performance of existing detection algorithms developed for different applications, we propose a region regression-based multi-stage class-agnostic detection pipeline, whereby the existing algorithms are employed for…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Wei Li , Matthias Breier , Dorit Merhof

Feature selection is an important problem studied in data analytics seeking to identify a minimal-size feature subset that is optimally predictive for an outcome of interest. It is also a powerful tool in Knowledge Discovery as a means for…

Statistics Theory · Mathematics 2018-02-27 Yannis Pantazis , Vincenzo Lagani , Paulos Charonyktakis , Ioannis Tsamardinos

In data mining applications, feature selection is an essential process since it reduces a model's complexity. The cost of obtaining the feature values must be taken into consideration in many domains. In this paper, we study the…

Machine Learning · Computer Science 2013-06-04 Hong Zhao , Fan Min , William Zhu

In this paper, we leverage existing statistical methods to better understand feature learning from data. We tackle this by modifying the model-free variable selection method, Feature Ordering by Conditional Independence (FOCI), which is…

Machine Learning · Statistics 2025-02-14 Krunoslav Lehman Pavasovic , David Lopez-Paz , Giulio Biroli , Levent Sagun

Building compact convolutional neural networks (CNNs) with reliable performance is a critical but challenging task, especially when deploying them in real-world applications. As a common approach to reduce the size of CNNs, pruning methods…

Machine Learning · Computer Science 2020-05-26 Hang Li , Chen Ma , Wei Xu , Xue Liu

In machine learning, Feature Selection (FS) is a major part of efficient algorithm. It fuels the algorithm and is the starting block for our prediction. In this paper, we present a new method, called Optimal Coordinate Ascent (OCA) that…

Machine Learning · Statistics 2018-12-04 David Saltiel , Eric Benhamou

Machine learning methods are used to discover complex nonlinear relationships in biological and medical data. However, sophisticated learning models are computationally unfeasible for data with millions of features. Here we introduce the…

Feature selection is an essential problem in computer vision, important for category learning and recognition. Along with the rapid development of a wide variety of visual features and classifiers, there is a growing need for efficient…

Computer Vision and Pattern Recognition · Computer Science 2014-12-01 Marius Leordeanu , Alexandra Radu , Rahul Sukthankar

Feature selection is a problem of finding efficient features among all features in which the final feature set can improve accuracy and reduce complexity. In feature selection algorithms search strategies are key aspects. Since feature…

Machine Learning · Computer Science 2016-01-27 Mohadeseh Montazeri , Hamid Reza Naji , Mitra Montazeri , Ahmad Faraahi

In this work, we study and analyze different feature selection algorithms that can be used to classify cancer subtypes in case of highly varying high-dimensional data. We apply three different feature selection methods on five different…

Machine Learning · Computer Science 2021-10-01 Vaibhav Sinha , Siladitya Dash , Nazma Naskar , Sk Md Mosaddek Hossain