English
Related papers

Related papers: PPFS: Predictive Permutation Feature Selection

200 papers

Feature selection (FS) is essential for biomarker discovery and clinical predictive modeling. Over the past decades, methodological literature on FS has become rich and mature, offering a wide spectrum of algorithmic approaches. However,…

Unsupervised feature selection (FS) is essential for high-dimensional learning tasks where labels are not available. It helps reduce noise, improve generalization, and enhance interpretability. However, most existing unsupervised FS methods…

Machine Learning · Computer Science 2025-11-13 Shira Lifshitz , Ofir Lindenbaum , Gal Mishne , Ron Meir , Hadas Benisty

Feature selection is a process of choosing a subset of relevant features so that the quality of prediction models can be improved. An extensive body of work exists on information-theoretic feature selection, based on maximizing Mutual…

Machine Learning · Computer Science 2016-12-05 Jilin Wu , Soumyajit Gupta , Chandrajit Bajaj

Combining the mutual information criterion with a forward feature selection strategy offers a good trade-off between optimality of the selected feature subset and computation time. However, it requires to set the parameter(s) of the mutual…

Machine Learning · Computer Science 2007-09-26 Damien François , Fabrice Rossi , Vincent Wertz , Michel Verleysen

One of the key challenges of machine learning (ML) based intrusion detection system (IDS) is the expensive computational complexity which is largely due to redundant, incomplete, and irrelevant features contain in the IDS datasets. To…

Cryptography and Security · Computer Science 2020-08-19 Mubarak Albarka Umar , Chen Zhanfang , Yan Liu

Accurate and early prediction of a disease allows to plan and improve a patient's quality of future life. During pandemic situations, the medical decision becomes a speed challenge in which physicians have to act fast to diagnose and…

Machine Learning · Computer Science 2022-06-09 Pierluigi Costanzo , Kalia Orphanou

Many feature subset selection (FSS) algorithms have been proposed, but not all of them are appropriate for a given feature selection problem. At the same time, so far there is rarely a good way to choose appropriate FSS algorithms for the…

Machine Learning · Computer Science 2014-02-05 Guangtao Wang , Qinbao Song , Heli Sun , Xueying Zhang , Baowen Xu , Yuming Zhou

Prediction-powered inference (PPI) enables valid statistical inference by combining experimental data with machine learning predictions. When a sufficient number of high-quality predictions is available, PPI results in more accurate…

Machine Learning · Statistics 2025-08-18 Stefano Cortinovis , François Caron

Machine learning models usually assume that a set of feature values used to obtain an output is fixed in advance. However, in many real-world problems, a cost is associated with measuring these features. To address the issue of reducing…

Machine Learning · Computer Science 2025-03-13 Katsumi Takahashi , Koh Takeuchi , Hisashi Kashima

Along with the flourish of the information age, massive amounts of data are generated day by day. Due to the large-scale and high-dimensional characteristics of these data, it is often difficult to achieve better decision-making in…

Machine Learning · Computer Science 2023-04-04 Peican Zhu , Xin Hou , Keke Tang , Zhen Wang , Feiping Nie

We introduce the probabilistic sequential matrix factorization (PSMF) method for factorizing time-varying and non-stationary datasets consisting of high-dimensional time-series. In particular, we consider nonlinear Gaussian state-space…

Machine Learning · Statistics 2021-03-19 Ömer Deniz Akyildiz , Gerrit J. J. van den Burg , Theodoros Damoulas , Mark F. J. Steel

Domain adaptive image retrieval includes single-domain retrieval and cross-domain retrieval. Most of the existing image retrieval methods only focus on single-domain retrieval, which assumes that the distributions of retrieval databases and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Fuxiang Huang , Lei Zhang , Yang Yang , Xichuan Zhou

Feature selection is a combinatorial optimization problem that is NP-hard. Conventional approaches often employ heuristic or greedy strategies, which are prone to premature convergence and may fail to capture subtle yet informative…

Machine Learning · Computer Science 2025-10-22 Yusi Fan , Tian Wang , Zhiying Yan , Chang Liu , Qiong Zhou , Qi Lu , Zhehao Guo , Ziqi Deng , Wenyu Zhu , Ruochi Zhang , Fengfeng Zhou

Unsupervised feature selection has been always attracting research attention in the communities of machine learning and data mining for decades. In this paper, we propose an unsupervised feature selection method seeking a feature…

Machine Learning · Computer Science 2015-06-04 Sen Wang , Feiping Nie , Xiaojun Chang , Lina Yao , Xue Li , Quan Z. Sheng

Measuring divergence between two distributions is essential in machine learning and statistics and has various applications including binary classification, change point detection, and two-sample test. Furthermore, in the era of big data,…

In this paper we study predictive pattern mining problems where the goal is to construct a predictive model based on a subset of predictive patterns in the database. Our main contribution is to introduce a novel method called safe pattern…

Machine Learning · Statistics 2016-02-16 Kazuya Nakagawa , Shinya Suzumura , Masayuki Karasuyama , Koji Tsuda , Ichiro Takeuchi

Effective patent value assessment provides decision support for patent transection and promotes the practical application of patent technology. The limitations of previous research on patent value assessment were analyzed in this work, and…

Machine Learning · Computer Science 2020-01-24 Yihui Qiu , Chiyu Zhang

In machine learning and pattern recognition, feature selection has been a hot topic in the literature. Unsupervised feature selection is challenging due to the loss of labels which would supply the related information.How to define an…

Machine Learning · Computer Science 2015-01-14 Chang Liu , Yi Xu

Variable selection, also known as feature selection in machine learning, plays an important role in modeling high dimensional data and is key to data-driven scientific discoveries. We consider here the problem of detecting influential…

Methodology · Statistics 2014-09-24 Bo Jiang , Jun S. Liu

Generative Bayesian Filtering (GBF) provides a powerful and flexible framework for performing posterior inference in complex nonlinear and non-Gaussian state-space models. Our approach extends Generative Bayesian Computation (GBC) to…

Methodology · Statistics 2025-11-07 Edoardo Marcelli , Sean O'Hagan , Veronika Rockova