English
Related papers

Related papers: Online Sparse Feature Selection in Data Streams vi…

200 papers

Feature selection is a classical problem in statistics and machine learning, and it continues to remain an extremely challenging problem especially in the context of unknown non-linear relationships with dependent features. On the other…

Machine Learning · Statistics 2026-04-17 Chenghui Zheng , Garvesh Raskutti

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on…

Methodology · Statistics 2019-11-20 Yixuan Qiu , Jing Lei , Kathryn Roeder

Ocean salinity plays a vital role in circulation, climate, and marine ecosystems, yet its measurement is often sparse, irregular, and noisy, especially in drifter-based datasets. Traditional approaches, such as remote sensing and optimal…

Feature selection aims to identify the most pattern-discriminative feature subset. In prior literature, filter (e.g., backward elimination) and embedded (e.g., Lasso) methods have hyperparameters (e.g., top-K, score thresholding) and tie to…

Machine Learning · Computer Science 2024-03-07 Wangyang Ying , Dongjie Wang , Haifeng Chen , Yanjie Fu

We present 2SDS (Scene Separation and Data Selection algorithm), a temporal segmentation algorithm used in real-time video stream interpretation. It complements CNN-based models to make use of temporal information in videos. 2SDS can detect…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Yuelin Xin , Zihan Zhou , Yuxuan Xia

Inferring the evolution of high-dimensional and multi-modal (e.g., spatio-temporal) physical fields from irregular sparse measurements in real time is a fundamental challenge in science and engineering. Existing approaches, including…

Machine Learning · Computer Science 2026-05-12 Panqi Chen , Yifan Sun , Shikai Fang , Xiao Fu , Lei Cheng

This paper considers a class of real-time stochastic optimization problems dependent on an unknown probability distribution. In the considered scenario, data is streaming frequently while trying to reach a decision. Thus, we aim to devise a…

Optimization and Control · Mathematics 2020-09-08 Dan Li , Sonia Martinez

A variety of complex biological, natural and man-made systems exhibit non-Markovian dynamics that can be modeled through fractional order differential equations, yet, we lack sample comlexity aware system identification strategies. Towards…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Xiaole Zhang , Vijay Gupta , Paul Bogdan

The goal of Feature Selection - comprising filter, wrapper, and embedded approaches - is to find the optimal feature subset for designated downstream tasks. Nevertheless, current feature selection methods are limited by: 1) the selection…

Machine Learning · Computer Science 2023-09-18 Meng Xiao , Dongjie Wang , Min Wu , Pengfei Wang , Yuanchun Zhou , Yanjie Fu

Many current approaches to the design of intrusion detection systems apply feature selection in a static, non-adaptive fashion. These methods often neglect the dynamic nature of network data which requires to use adaptive feature selection…

Cryptography and Security · Computer Science 2018-06-18 Buse Gul Atli , Alexander Jung

For classification problems, feature extraction is a crucial process which aims to find a suitable data representation that increases the performance of the machine learning algorithm. According to the curse of dimensionality theorem, the…

Machine Learning · Computer Science 2010-10-12 Ilknur Icke , Andrew Rosenberg

To deal with high-dimensional unlabeled datasets in many areas, principal component analysis (PCA) has become a rising technique for unsupervised feature selection (UFS). However, most existing PCA-based methods only consider the structure…

Optimization and Control · Mathematics 2025-08-15 Xianchao Xiu , Chenyi Huang , Pan Shang , Wanquan Liu

Data-centric AI encourages the need of cleaning and understanding of data in order to achieve trustworthy AI. Existing technologies, such as AutoML, make it easier to design and train models automatically, but there is a lack of a similar…

Machine Learning · Computer Science 2022-03-10 Girmaw Abebe Tadesse , William Ogallo , Celia Cintas , Skyler Speakman

Feature selection is an important tool to deal with high dimensional data. In unsupervised case, many popular algorithms aim at maintaining the structure of the original data. In this paper, we propose a simple and effective feature…

Machine Learning · Statistics 2020-04-06 Xiaoyun Li , Chengxi Wu , Ping Li

We propose a novel and robust online function-on-scalar regression technique via geometric median to learn associations between functional responses and scalar covariates based on massive or streaming datasets. The online estimation…

Methodology · Statistics 2024-05-24 Guanghui Cheng , Wenjuan Hu , Ruitao Lin , Chen Wang

Feature selection is a critical component in predictive analytics that significantly affects the prediction accuracy and interpretability of models. Intrinsic methods for feature selection are built directly into model learning, providing a…

Machine Learning · Computer Science 2024-03-19 Theodor Stoecker , Nico Hambauer , Patrick Zschech , Mathias Kraus

Out-of-distribution (OOD) detection is critical for ensuring the reliability of open-world intelligent systems. Despite the notable advancements in existing OOD detection methodologies, our study identifies a significant performance drop…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiuqing Dong , Yongbin Gao , Heng Zhou , Jun Cen , Yifan Yao , Sook Yoon , Park Dong Sun

Orthogonal Time Frequency Space (OTFS) is a novel framework that processes modulation symbols via a time-independent channel characterized by the delay-Doppler domain. The conventional waveform, orthogonal frequency division multiplexing…

Signal Processing · Electrical Eng. & Systems 2021-07-20 Zhou Zhou , Lingjia Liu , Jiarui Xu , Robert Calderbank

Deep sparse networks are widely investigated as a neural network architecture for prediction tasks with high-dimensional sparse features, with which feature interaction selection is a critical component. While previous methods primarily…

Machine Learning · Computer Science 2023-10-31 Fuyuan Lyu , Xing Tang , Dugang Liu , Chen Ma , Weihong Luo , Liang Chen , Xiuqiang He , Xue Liu

We present statistical methods for big data arising from online analytical processing, where large amounts of data arrive in streams and require fast analysis without storage/access to the historical data. In particular, we develop…

Computation · Statistics 2018-06-13 Elizabeth D. Schifano , Jing Wu , Chun Wang , Jun Yan , Ming-Hui Chen