English
Related papers

Related papers: Feature space reduction method for ultrahigh-dimen…

200 papers

We propose a novel methodology, forest floor, to visualize and interpret random forest (RF) models. RF is a popular and useful tool for non-linear multi-variate classification and regression, which yields a good trade-off between robustness…

Machine Learning · Statistics 2016-07-05 Soeren H. Welling , Hanne H. F. Refsgaard , Per B. Brockhoff , Line H. Clemmensen

The high feature dimensionality is a challenge in music emotion recognition. There is no common consensus on a relation between audio features and emotion. The MER system uses all available features to recognize emotion; however, this is…

Sound · Computer Science 2022-12-29 Le Cai , Sam Ferguson , Haiyan Lu , Gengfa Fang

Many feature subset selection (FSS) algorithms have been proposed, but not all of them are appropriate for a given feature selection problem. At the same time, so far there is rarely a good way to choose appropriate FSS algorithms for the…

Machine Learning · Computer Science 2014-02-05 Guangtao Wang , Qinbao Song , Heli Sun , Xueying Zhang , Baowen Xu , Yuming Zhou

The data made available for analysis are becoming more and more complex along several directions: high dimensionality, number of examples and the amount of labels per example. This poses a variety of challenges for the existing machine…

Machine Learning · Computer Science 2020-08-11 Matej Petković , Sašo Džeroski , Dragi Kocev

Feature selection is a pattern recognition approach to choose important variables according to some criteria to distinguish or explain certain phenomena. There are many genomic and proteomic applications which rely on feature selection to…

Computer Vision and Pattern Recognition · Computer Science 2011-06-13 Fabricio Martins Lopes , David Correa Martins-Jr , Roberto M. Cesar-Jr

Feature selection with high-dimensional data and a very small proportion of relevant features poses a severe challenge to standard statistical methods. We have developed a new approach (HARVEST) that is straightforward to apply, albeit…

Machine Learning · Statistics 2018-03-01 Herbert Weisberg , Victor Pontes , Mathis Thoma

In this work, we study and analyze different feature selection algorithms that can be used to classify cancer subtypes in case of highly varying high-dimensional data. We apply three different feature selection methods on five different…

Machine Learning · Computer Science 2021-10-01 Vaibhav Sinha , Siladitya Dash , Nazma Naskar , Sk Md Mosaddek Hossain

Random forests are a machine learning method used to automatically classify datasets and consist of a multitude of decision trees. While these random forests often have higher performance and generalize better than a single decision tree,…

Machine Learning · Computer Science 2025-07-31 Max Sondag , Christofer Meinecke , Dennis Collaris , Tatiana von Landesberger , Stef van den Elzen

Unsupervised feature selection has been always attracting research attention in the communities of machine learning and data mining for decades. In this paper, we propose an unsupervised feature selection method seeking a feature…

Machine Learning · Computer Science 2015-06-04 Sen Wang , Feiping Nie , Xiaojun Chang , Lina Yao , Xue Li , Quan Z. Sheng

In this study, we propose a method Distributionally Robust Safe Screening (DRSS), for identifying unnecessary samples and features within a DR covariate shift setting. This method effectively combines DR learning, a paradigm aimed at…

Popular approaches for few-shot classification consist of first learning a generic data representation based on a large annotated dataset, before adapting the representation to new classes given only a few labeled samples. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Nikita Dvornik , Cordelia Schmid , Julien Mairal

In recent years, there has been an ever increasing amount of multivariate time series (MTS) data in various domains, typically generated by a large family of sensors such as wearable devices. This has led to the development of novel…

Machine Learning · Computer Science 2022-02-08 Kang Gu , Soroush Vosoughi , Temiloluwa Prioleau

Although much progress has been made in classification with high-dimensional features \citep{Fan_Fan:2008, JGuo:2010, CaiSun:2014, PRXu:2014}, classification with ultrahigh-dimensional features, wherein the features much outnumber the…

Machine Learning · Statistics 2016-11-14 Yanming Li , Hyokyoung Hong , Jian Kang , Kevin He , Ji Zhu , Yi Li

We extend our study of Motion Planning via Manifold Samples (MMS), a general algorithmic framework that combines geometric methods for the exact and complete analysis of low-dimensional configuration spaces with sampling-based approaches…

Robotics · Computer Science 2015-09-17 Oren Salzman , Michael Hemmer , Dan Halperin

Monocular vision based road detection methods are mostly based on machine learning methods, relying on classification and feature extraction accuracy, and suffer from appearance, illumination and weather changes. Traditional methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Prassanna Ganesh Ravishankar , Antonio M. Lopez , Gemma M. Sanchez

Kernel methods offer the flexibility to learn complex relationships in modern, large data sets while enjoying strong theoretical guarantees on quality. Unfortunately, these methods typically require cubic running time in the data set size,…

Machine Learning · Statistics 2019-03-01 Raj Agrawal , Trevor Campbell , Jonathan H. Huggins , Tamara Broderick

\noindent Randomized nomination sampling (RNS) is a rank-based sampling technique which has been shown to be effective in several nonparametric studies involving environmental and ecological applications. In this paper, we investigate…

Methodology · Statistics 2015-12-18 Mohammad Nourmohammadi , Mohammad Jafari Jozani , Brad Johnson

We investigate feature selection problem for generic machine learning models. We introduce a novel framework that selects features considering the outcomes of the model. Our framework introduces a novel feature masking approach to eliminate…

Machine Learning · Computer Science 2024-12-10 Mehmet E. Lorasdagi , Mehmet Y. Turali , Suleyman S. Kozat

Classification of functional data where observations are curves or trajectories poses unique challenges, particularly under severe class imbalance. Traditional Random Forest algorithms, while robust for tabular data, often fail to capture…

Machine Learning · Statistics 2025-12-10 Fahad Mostafa , Hafiz Khan

In the realm of cybersecurity, intrusion detection systems (IDS) detect and prevent attacks based on collected computer and network data. In recent research, IDS models have been constructed using machine learning (ML) and deep learning…

Machine Learning · Computer Science 2023-03-24 Adam M. Lehavi , Seongtae Kim