English
Related papers

Related papers: Shap-Select: Lightweight Feature Selection Using S…

200 papers

A novel 3D shape classification scheme, based on collaborative representation learning, is investigated in this work. A data-driven feature-extraction procedure, taking the form of a simple projection operator, is in the core of our…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 F. Fotopoulou , S. Oikonomou , A. Papathanasiou , G. Economou , S. Fotopoulos

Inspired by biological vision systems, the over-complete local features with huge cardinality are increasingly used for face recognition during the last decades. Accordingly, feature selection has become more and more important and plays a…

Computer Vision and Pattern Recognition · Computer Science 2011-02-15 Yixiong Liang , Lei Wang , Yao Xiang , Beiji Zou

In this paper a hybrid feature selection method is proposed which takes advantages of wrapper subset evaluation with a lower cost and improves the performance of a group of classifiers. The method uses combination of sample domain filtering…

Machine Learning · Computer Science 2014-03-12 Mehdi Naseriparsa , Amir-Masoud Bidgoli , Touraj Varaee

We investigate fast methods that allow to quickly eliminate variables (features) in supervised learning problems involving a convex loss function and a $l_1$-norm penalty, leading to a potentially substantial reduction in the number of…

Machine Learning · Computer Science 2010-10-28 Laurent El Ghaoui , Vivian Viallon , Tarek Rabbani

Data selection studies the problem of identifying high-quality subsets of training data. While some existing works have considered selecting the subset of data with top-$m$ Data Shapley or other semivalues as they account for the…

Machine Learning · Computer Science 2026-05-13 Xiao Tian , Jue Fan , Rachael Hwee Ling Sim , Zixuan Wang , Nancy F. Chen , Bryan Kian Hsiang Low

Feature attribution for kernel methods is often heuristic and not individualised for each prediction. To address this, we turn to the concept of Shapley values~(SV), a coalition game theoretical framework that has previously been applied to…

Machine Learning · Statistics 2022-05-27 Siu Lun Chau , Robert Hu , Javier Gonzalez , Dino Sejdinovic

This paper proposes inverse feature learning as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to…

Machine Learning · Computer Science 2020-03-10 Behzad Ghazanfari , Fatemeh Afghah , MohammadTaghi Hajiaghayi

Uplift modeling is a causal learning technique that estimates subgroup-level treatment effects. It is commonly used in industry and elsewhere for tasks such as targeting ads. In a typical setting, uplift models can take thousands of…

Machine Learning · Computer Science 2022-07-15 Zhenyu Zhao , Yumin Zhang , Totte Harinen , Mike Yung

When processing high-dimensional datasets, a common pre-processing step is feature selection. Filter-based feature selection algorithms are not tailored to a specific classification method, but rather rank the relevance of each feature with…

Machine Learning · Computer Science 2023-03-06 Shir Friedman , Gonen Singer , Neta Rabin

In this paper we introduce a new feature selection algorithm to remove the irrelevant or redundant features in the data sets. In this algorithm the importance of a feature is based on its fitting to the Catastrophe model. Akaike information…

Machine Learning · Computer Science 2017-04-25 Mahdi Zarei

The goal of supervised feature selection is to find a subset of input features that are responsible for predicting output values. The least absolute shrinkage and selection operator (Lasso) allows computationally efficient feature selection…

Machine Learning · Statistics 2019-01-07 Makoto Yamada , Wittawat Jitkrittum , Leonid Sigal , Eric P. Xing , Masashi Sugiyama

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Feature Selection (FS) is a key task in Machine Learning. It consists in selecting a number of relevant variables for the model construction or data analysis. We present the R package, FSinR, which implements a variety of widely known…

Machine Learning · Computer Science 2020-02-25 F. Aragón-Royón , A. Jiménez-Vílchez , A. Arauzo-Azofra , J. M. Benítez

Shapelets are discriminative time series subsequences that allow generation of interpretable classification models, which provide faster and generally better classification than the nearest neighbor approach. However, the shapelet discovery…

Machine Learning · Computer Science 2017-02-23 Atif Raza , Stefan Kramer

Feature selection refers to the process of selecting useful features for machine learning tasks, and it is also a key step for structural health monitoring (SHM). This paper proposes a fast feature selection algorithm by efficiently…

Machine Learning · Statistics 2024-09-11 Sikai Zhang , Tingna Wang , Keith Worden , Limin Sun , Elizabeth J. Cross

The presence of irrelevant features in the input dataset tends to reduce the interpretability and predictive quality of machine learning models. Therefore, the development of feature selection methods to recognize irrelevant features is a…

Machine Learning · Statistics 2020-10-13 Federico Amato , Fabian Guignard , Philippe Jacquet , Mikhail Kanevski

We present a machine learning framework and a new test bed for data mining from the Slurm Workload Manager for high-performance computing (HPC) clusters. The focus was to find a method for selecting features to support decisions: helping…

Machine Learning · Computer Science 2020-12-16 Adedolapo Okanlawon , Huichen Yang , Avishek Bose , William Hsu , Dan Andresen , Mohammed Tanash

Distributed and federated learning are important tools for high-dimensional classification of large datasets. To reduce computational costs and overcome the curse of dimensionality, feature screening plays a pivotal role in eliminating…

Machine Learning · Statistics 2025-06-03 Qi Qin , Erbo Li , Xingxiang Li , Yifan Sun , Wu Wang , Chen Xu

In the domain of black-box model extraction, conventional methods reliant on soft labels or surrogate datasets struggle with scaling to high-dimensional input spaces and managing the complexity of an extensive array of interrelated classes.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Somnath Sendhil Kumar , Yuvaraj Govindarajulu , Pavan Kulkarni , Manojkumar Parmar

Feature selection is a critical component in predictive analytics that significantly affects the prediction accuracy and interpretability of models. Intrinsic methods for feature selection are built directly into model learning, providing a…

Machine Learning · Computer Science 2024-03-19 Theodor Stoecker , Nico Hambauer , Patrick Zschech , Mathias Kraus