English
Related papers

Related papers: Theoretical Foundations of Forward Feature Selecti…

200 papers

We here introduce a novel classification approach adopted from the nonlinear model identification framework, which jointly addresses the feature selection and classifier design tasks. The classifier is constructed as a polynomial expansion…

Machine Learning · Computer Science 2016-07-29 Aida Brankovic , Alessandro Falsone , Maria Prandini , Luigi Piroddi

Feature selection and instance selection are two important techniques of data processing. However, such selections have mostly been studied separately, while existing work towards the joint selection conducts feature/instance selection…

Machine Learning · Computer Science 2022-05-18 Wei Fan , Kunpeng Liu , Hao Liu , Hengshu Zhu , Hui Xiong , Yanjie Fu

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

In Machine Learning scenarios, privacy is a crucial concern when models have to be trained with private data coming from users of a service, such as a recommender system, a location-based mobile service, a mobile phone text messaging…

Machine Learning · Computer Science 2020-07-20 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

The unit selection problem is to identify a group of individuals who are most likely to exhibit a desired mode of behavior, for example, selecting individuals who would respond one way if incentivized and a different way if not. The unit…

Artificial Intelligence · Computer Science 2022-10-18 Ang Li , Song Jiang , Yizhou Sun , Judea Pearl

We provide an information-theoretic framework for studying the generalization properties of machine learning algorithms. Our framework ties together existing approaches, including uniform convergence bounds and recent methods for adaptive…

Machine Learning · Computer Science 2020-06-22 Thomas Steinke , Lydia Zakynthinou

In this paper we study the problem of learning from multiple modal data for purpose of document classification. In this problem, each document is composed two different modals of data, i.e., an image and a text. Cross-modal factor analysis…

Machine Learning · Computer Science 2015-08-19 Jingbin Wang , Yihua Zhou , Kanghong Duan , Jim Jing-Yan Wang , Halima Bensmail

Federated learning has recently been applied to recommendation systems to protect user privacy. In federated learning settings, recommendation systems can train recommendation models only collecting the intermediate parameters instead of…

Information Retrieval · Computer Science 2023-03-10 Zehua Sun , Yonghui Xu , Yong Liu , Wei He , Lanju Kong , Fangzhao Wu , Yali Jiang , Lizhen Cui

In this paper, we propose a novel approach for learning multi-label classifiers with the help of privileged information. Specifically, we use similarity constraints to capture the relationship between available information and privileged…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Shiyu Chen , Shangfei Wang , Tanfang Chen , Xiaoxiao Shi

In machine learning and pattern recognition, feature selection has been a hot topic in the literature. Unsupervised feature selection is challenging due to the loss of labels which would supply the related information.How to define an…

Machine Learning · Computer Science 2015-01-14 Chang Liu , Yi Xu

This paper proposes a new feature screening method for the multi-response ultrahigh dimensional linear model by empirical likelihood. Through a multivariate moment condition, the empirical likelihood induced ranking statistics can exploit…

Methodology · Statistics 2022-06-07 Jun Lu , Qinqin Hu , Lu Lin

One of the most important problems in the field of pattern recognition is data classification. Due to the increasing development of technologies introduced in the field of data classification, some of the solutions are still open and need…

Machine Learning · Computer Science 2021-08-03 Khalil Taheri , Hadi Moradi , Mostafa Tavassolipour

Fairness is a widely discussed topic in recommender systems, but its practical implementation faces challenges in defining sensitive features while maintaining recommendation accuracy. We propose feature fairness as the foundation to…

Information Retrieval · Computer Science 2023-09-28 Hengchang Hu , Yiming Cao , Zhankui He , Samson Tan , Min-Yen Kan

Feature selection eliminates redundancy among features to improve downstream task performance while reducing computational overhead. Existing methods often struggle to capture intricate feature interactions and adapt across diverse…

Machine Learning · Computer Science 2026-03-02 Rui Liu , Tao Zhe , Yanjie Fu , Feng Xia , Ted Senator , Dongjie Wang

Large-scale online marketplaces and recommender systems serve as critical technological support for e-commerce development. In industrial recommender systems, features play vital roles as they carry information for downstream models.…

Information Retrieval · Computer Science 2026-02-24 Xianquan Wang , Zhaocheng Du , Jieming Zhu , Qinglin Jia , Zhenhua Dong , Kai Zhang

Class imbalance and distributional differences in large datasets present significant challenges for classification tasks machine learning, often leading to biased models and poor predictive performance for minority classes. This work…

Machine Learning · Statistics 2024-12-20 Alex Mak , Shubham Sahoo , Shivani Pandey , Yidan Yue , Linglong Kong

Deep neural networks obtain state-of-the-art performance on a series of tasks. However, they are easily fooled by adding a small adversarial perturbation to input. The perturbation is often human imperceptible on image data. We observe a…

Machine Learning · Computer Science 2019-06-11 Puyudi Yang , Jianbo Chen , Cho-Jui Hsieh , Jane-Ling Wang , Michael I. Jordan

Technology videos contain rich multi-modal information. In cross-modal information search, the data features of different modalities cannot be compared directly, so the semantic gap between different modalities is a key problem that needs…

Information Retrieval · Computer Science 2022-10-12 Xiangbin Liu , Junping Du , Meiyu Liang , Ang Li

Unsupervised feature selection aims to identify a compact subset of features that captures the intrinsic structure of data without supervised label. Most existing studies evaluate the performance of methods using the single-label dataset…

Machine Learning · Computer Science 2026-02-10 Gyu-Il Kim , Dae-Won Kim , Jaesung Lee

The first step in constructing a machine learning model is defining the features of the data set that can be used for optimal learning. In this work we discuss feature selection methods, which can be used to build better models, as well as…

Machine Learning · Statistics 2018-06-19 Ankita Mangal , Elizabeth A. Holm