English
Related papers

Related papers: Challenges of Feature Selection for Big Data Analy…

200 papers

Feature requests are proposed by users to request new features or enhancements of existing features of software products, which represent users' wishes and demands. Satisfying users' demands can benefit the product from both competitiveness…

Software Engineering · Computer Science 2026-02-27 Feifei Niu , Chuanyi Li , Haosheng Zuo , Jionghan Wu , Xin Xia

Feature selection is an essential process in machine learning, especially when dealing with high-dimensional datasets. It helps reduce the complexity of machine learning models, improve performance, mitigate overfitting, and decrease…

Machine Learning · Computer Science 2024-10-10 Egor Kraev , Baran Koseoglu , Luca Traverso , Mohammed Topiwalla

There are many problems in machine learning and data mining which are equivalent to selecting a non-redundant, high "quality" set of objects. Recommender systems, feature selection, and data summarization are among many applications of…

Machine Learning · Computer Science 2019-04-19 Mehrdad Ghadiri , Mark Schmidt

This paper studies simultaneous feature selection and extraction in supervised and unsupervised learning. We propose and investigate selective reduced rank regression for constructing optimal explanatory factors from a parsimonious subset…

Methodology · Statistics 2016-10-27 Yiyuan She

Streaming feature selection techniques have become essential in processing real-time data streams, as they facilitate the identification of the most relevant attributes from continuously updating information. Despite their performance,…

Machine Learning · Computer Science 2024-06-21 Zhangling Duan , Tianci Li , Xingyu Wu , Zhaolong Ling , Jingye Yang , Zhaohong Jia

In this paper, we investigate dynamic feature selection within multivariate time-series scenario, a common occurrence in clinical prediction monitoring where each feature corresponds to a bio-test result. Many existing feature selection…

Machine Learning · Computer Science 2024-05-31 Yutong Chen , Jiandong Gao , Ji Wu

Recently, feature selection has become an increasingly important area of research due to the surge in high-dimensional datasets in all areas of modern life. A plethora of feature selection algorithms have been proposed, but it is difficult…

Neural and Evolutionary Computing · Computer Science 2019-10-24 Andrew Lensen , Bing Xue , Mengjie Zhang

The blessing of ubiquitous data also comes with a curse: the communication, storage, and labeling of massive, mostly redundant datasets. We seek to solve this problem at its core, collecting only valuable data and throwing out the rest via…

Machine Learning · Computer Science 2023-12-18 Mariel Werner , Anastasios Angelopoulos , Stephen Bates , Michael I. Jordan

Traditionally it had been a problem that researchers did not have access to enough spatial data to answer pressing research questions or build compelling visualizations. Today, however, the problem is often that we have too much data.…

Machine Learning · Computer Science 2018-03-23 Geoff Boeing

Feature selection is a technique that extracts a meaningful subset from a set of features in training data. When the training data is large-scale, appropriate feature selection enables the removal of redundant features, which can improve…

Cryptography and Security · Computer Science 2025-05-20 Koki Wakiyama , Tomohiro I , Hiroshi Sakamoto

The growth and success of deep learning approaches can be attributed to two major factors: availability of hardware resources and availability of large number of training samples. For problems with large training databases, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Rohit Keshari , Soumyadeep Ghosh , Saheb Chhabra , Mayank Vatsa , Richa Singh

Relevant and high-quality data are critical to successful development of machine learning applications. For machine learning applications on dynamic systems equipped with a large number of sensors, such as connected vehicles and robots, how…

Machine Learning · Computer Science 2021-08-31 Alp Sahin , Xiangrui Zeng

Feature selection (FS) is a process which attempts to select more informative features. In some cases, too many redundant or irrelevant features may overpower main features for classification. Feature selection can remedy this problem and…

Machine Learning · Computer Science 2013-06-07 A. Nisthana Parveen , H. Hannah Inbarani , E. N. Sathishkumar

The feature-selection problem is formulated from an information-theoretic perspective. We show that the problem can be efficiently solved by an extension of the recently proposed info-clustering paradigm. This reveals the fundamental…

Information Theory · Computer Science 2016-10-06 Chung Chan , Ali Al-Bashabsheh , Qiaoqiao Zhou , Tie Liu

Top-$N$ recommender systems typically utilize side information to address the problem of data sparsity. As nowadays side information is growing towards high dimensionality, the performances of existing methods deteriorate in terms of both…

Information Retrieval · Computer Science 2017-05-17 Yifan Chen , Xiang Zhao

Current quantum systems have significant limitations affecting the processing of large datasets with high dimensionality, typical of high energy physics. In the present paper, feature and data prototype selection techniques were studied to…

High Energy Physics - Phenomenology · Physics 2023-12-18 Miguel Caçador Peixoto , Nuno Filipe Castro , Miguel Crispim Romão , Maria Gabriela Jordão Oliveira , Inês Ochoa

Machine learning is a data-driven field, and the quality of the underlying datasets plays a crucial role in learning success. However, high performance on held-out test data does not necessarily indicate that a model generalizes or learns…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Nicolas M. Müller , Jochen Jacobs , Jennifer Williams , Konstantin Böttinger

In many real-world machine learning problems, feature values are not readily available. To make predictions, some of the missing features have to be acquired, which can incur a cost in money, computational time, or human time, depending on…

Machine Learning · Computer Science 2019-12-20 Kimmo Kärkkäinen , Mohammad Kachuee , Orpaz Goldstein , Majid Sarrafzadeh

With the advent of big data applications and the increasing amount of data being produced in these applications, the importance of efficient methods for big data analysis has become highly evident. However, the success of any such method…

Computers and Society · Computer Science 2019-11-05 Mostafa Mirzaie , Behshid Behkamal , Samad Paydar

The all-relevant problem of feature selection is the identification of all strongly and weakly relevant attributes. This problem is especially hard to solve for time series classification and regression in industrial applications such as…

Machine Learning · Computer Science 2017-05-23 Maximilian Christ , Andreas W. Kempa-Liehr , Michael Feindt