English
Related papers

Related papers: Utilizing stability criteria in choosing feature s…

200 papers

Compositional data, where only relative abundances are available, are common in microbiome and other high-throughput sequencing studies. Log ratios between groups of variables serve as key biomarkers in these settings. However, selecting…

Methodology · Statistics 2025-04-02 Jing Ma , Paizhe Xie , Kristyn Pantoja , David E. Jones

Despite being a foundational concept of modern systems theory, there have been few studies on observability of non-linear stochastic systems under partial observations. In this paper, we introduce a definition of observability for…

Probability · Mathematics 2022-12-08 Curtis McDonald , Serdar Yuksel

A lack of software reproducibility has become increasingly apparent in the last several years, calling into question the validity of scientific findings affected by published tools. Reproducibility issues may have numerous sources of error,…

Neurons and Cognition · Quantitative Biology 2020-04-23 Gregory Kiar , Pablo de Oliveira Castro , Pierre Rioux , Eric Petit , Shawn T. Brown , Alan C. Evans , Tristan Glatard

The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its…

Methodology · Statistics 2022-01-11 Ryan Thompson

Feature selection and reducing the dimensionality of data is an essential step in data analysis. In this work, we propose a new criterion for feature selection that is formulated as conditional information between features given the labeled…

Machine Learning · Statistics 2019-05-20 Salimeh Yasaei Sekeh , Alfred O. Hero

In health related machine learning applications, the training data often corresponds to a non-representative sample from the target populations where the learners will be deployed. In anticausal prediction tasks, selection biases often make…

Machine Learning · Statistics 2020-11-10 Elias Chaibub Neto , Phil Snyder , Solveig K Sieberts , Larsson Omberg

Feature selection is an important task in many problems occurring in pattern recognition, bioinformatics, machine learning and data mining applications. The feature selection approach enables us to reduce the computation burden and the…

Machine Learning · Computer Science 2016-08-30 Hadi Zare , Mojtaba Niazi

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

Mechanistic Interpretability (MI) aims to reverse-engineer model behaviors by identifying functional sub-networks. Yet, the scientific validity of these findings depends on their stability. In this work, we argue that circuit discovery is…

Machine Learning · Computer Science 2026-02-04 Maxime Méloux , François Portet , Maxime Peyrard

Modern biomedical data mining requires feature selection methods that can (1) be applied to large scale feature spaces (e.g. `omics' data), (2) function in noisy problems, (3) detect complex patterns of association (e.g. gene-gene…

Machine Learning · Computer Science 2018-04-04 Ryan J. Urbanowicz , Randal S. Olson , Peter Schmitt , Melissa Meeker , Jason H. Moore

Reproducibility is a fundamental requirement of the scientific process since it enables outcomes to be replicated and verified. Computational scientific experiments can benefit from improved reproducibility for many reasons, including…

Databases · Computer Science 2019-09-04 Maria Luiza Mondelli , A. Townsend Peterson , Luiz M. R. Gadelha

Ensemble learning that can be used to combine the predictions from multiple learners has been widely applied in pattern recognition, and has been reported to be more robust and accurate than the individual learners. This ensemble logic has…

Machine Learning · Computer Science 2020-02-12 Xiaokang Zhang , Inge Jonassen

Feature selection plays a critical role in biomedical data mining, driven by increasing feature dimensionality in target problems and growing interest in advanced but computationally expensive methodologies able to model complex…

Data Structures and Algorithms · Computer Science 2018-04-04 Ryan J. Urbanowicz , Melissa Meeker , William LaCava , Randal S. Olson , Jason H. Moore

Minimizing the Mean Squared Error (MSE) is a key objective in machine learning and is commonly used for imputing missing values. While this approach provides accurate point estimates, it introduces systematic biases in downstream analyses.…

Machine Learning · Statistics 2026-05-06 Stef van Buuren

Owing to their inherently interpretable structure, decision trees are commonly used in applications where interpretability is essential. Recent work has focused on improving various aspects of decision trees, including their predictive…

Machine Learning · Statistics 2023-05-30 Dimitris Bertsimas , Vassilis Digalakis

It is preferred that feature selectors be \textit{stable} for better interpretabity and robust prediction. Ensembling is known to be effective for improving the stability of feature selectors. Since ensembling is time-consuming, it is…

Machine Learning · Computer Science 2021-08-04 Rina Onda , Zhengyan Gao , Masaaki Kotera , Kenta Oono

Plant biomass estimation is critical due to the variability of different environmental factors and crop management practices associated with it. The assessment is largely impacted by the accurate prediction of different environmental…

Artificial Intelligence · Computer Science 2023-02-07 Syeda Nyma Ferdous , Xin Li , Kamalakanta Sahoo , Richard Bergman

Similarity is a fundamental measure in network analyses and machine learning algorithms, with wide applications ranging from personalized recommendation to socio-economic dynamics. We argue that an effective similarity measurement should…

Physics and Society · Physics 2015-12-07 Jian-Guo Liu , Lei Hou , Xue Pan , Qiang Guo , Tao Zhou

In machine learning and pattern recognition, feature selection has been a hot topic in the literature. Unsupervised feature selection is challenging due to the loss of labels which would supply the related information.How to define an…

Machine Learning · Computer Science 2015-01-14 Chang Liu , Yi Xu

Feature selection, which searches for the most representative features in observed data, is critical for health data analysis. Unlike feature extraction, such as PCA and autoencoder based methods, feature selection preserves…

Machine Learning · Computer Science 2018-12-04 Shiyu Liu , Mehul Motani