English
Related papers

Related papers: Online Debiased Lasso for Streaming Data

200 papers

In this paper we develop an online statistical inference approach for high-dimensional generalized linear models with streaming data for real-time estimation and inference. We propose an online debiased lasso (ODL) method to accommodate the…

Statistics Theory · Mathematics 2021-08-11 Lan Luo , Ruijian Han , Yuanyuan Lin , Jian Huang

Online statistical inference facilitates real-time analysis of sequentially collected data, making it different from traditional methods that rely on static datasets. This paper introduces a novel approach to online inference in…

Machine Learning · Statistics 2025-02-27 Ruijian Han , Lan Luo , Yuanhang Luo , Yuanyuan Lin , Jian Huang

Sparse regression has been a popular approach to perform variable selection and enhance the prediction accuracy and interpretability of the resulting statistical model. Existing approaches focus on offline regularized regression, while the…

Machine Learning · Statistics 2023-01-03 Shuoguang Yang , Yuhao Yan , Xiuneng Zhu , Qiang Sun

Traditional statistical methods are faced with new challenges due to streaming data. The major challenge is the rapidly growing volume and velocity of data, which makes storing such huge datasets in memory impossible. The paper presents an…

Methodology · Statistics 2022-10-04 Dongxiao Han , Jinhan Xie , Jin Liu , Liuquan Sun , Jian Huang , Bei Jian , Linglong Kong

Large-scale streaming data are common in modern machine learning applications and have led to the development of online learning algorithms. Many fields, such as supply chain management, weather and meteorology, energy markets, and finance,…

Machine Learning · Statistics 2026-04-27 Simon Hirsch , Jonathan Berrisch , Florian Ziel

Linear regression is arguably the most prominent among statistical inference methods, popular both for its simplicity as well as its broad applicability. On par with data-intensive applications, the sheer size of linear regression problems…

Applications · Statistics 2016-06-29 Dimitris Berberidis , Vassilis Kekatos , Georgios B. Giannakis

Traditional static functional data analysis is facing new challenges due to streaming data, where data constantly flow in. A major challenge is that storing such an ever-increasing amount of data in memory is nearly impossible. In addition,…

Methodology · Statistics 2023-10-11 Jinhan Xie , Enze Shi , Peijun Sang , Zuofeng Shang , Bei Jiang , Linglong Kong

Modern technological advances have expanded the scope of applications requiring analysis of large-scale datastreams that comprise multiple indefinitely long time series. There is an acute need for statistical methodologies that perform…

Methodology · Statistics 2021-11-03 Jingshen Wang , Lilun Du , Changliang Zou , Zhenke Wu

Adaptive collection of data is commonplace in applications throughout science and engineering. From the point of view of statistical inference however, adaptive data collection induces memory and correlation in the samples, and poses…

Methodology · Statistics 2020-05-07 Yash Deshpande , Adel Javanmard , Mohammad Mehrabi

We propose a general privacy-preserving optimization-based framework for real-time environments without requiring trusted data curators. In particular, we introduce a noisy stochastic gradient descent algorithm for online statistical…

Methodology · Statistics 2025-06-11 Jinhan Xie , Enze Shi , Bei Jiang , Linglong Kong , Xuming He

The state-of-the-art online learning models generally conduct a single online gradient descent when a new sample arrives and thus suffer from suboptimal model weights. To this end, we introduce an online broad learning system framework with…

Machine Learning · Computer Science 2025-12-09 Chunyu Lei , Guang-Ze Chen , C. L. Philip Chen , Tong Zhang

We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresentable noise features, our algorithm recovers the support set…

Statistics Theory · Mathematics 2014-12-16 Jacob Steinhardt , Stefan Wager , Percy Liang

We present statistical methods for big data arising from online analytical processing, where large amounts of data arrive in streams and require fast analysis without storage/access to the historical data. In particular, we develop…

Computation · Statistics 2018-06-13 Elizabeth D. Schifano , Jing Wu , Chun Wang , Jun Yan , Ming-Hui Chen

The processing of high-dimensional streaming data commonly utilizes online streaming feature selection (OSFS) techniques. However, practical implementations often face challenges with data incompleteness due to equipment failures and…

Machine Learning · Computer Science 2025-11-26 Ruiyang Xu

Online decision making aims to learn the optimal decision rule by making personalized decisions and updating the decision rule recursively. It has become easier than before with the help of big data, but new challenges also come along.…

Machine Learning · Statistics 2020-10-16 Haoyu Chen , Wenbin Lu , Rui Song

The study of online decision-making problems that leverage contextual information has drawn notable attention due to their significant applications in fields ranging from healthcare to autonomous systems. In modern applications, contextual…

Machine Learning · Statistics 2025-04-22 Qiyu Han , Will Wei Sun , Yichen Zhang

Existing high-dimensional online learning methods often face the challenge that their error bounds, or per-batch sample sizes, diverge as the number of data batches increases. To address this issue, we propose an asynchronous decomposition…

Machine Learning · Statistics 2026-03-24 Shixiang Liu , Zhifan Li , Hanming Yang , Jianxin Yin

Addressing the challenges of irregularity and concept drift in streaming time series is crucial for real-world predictive modelling. Previous studies in time series continual learning often propose models that require buffering long…

Machine Learning · Computer Science 2025-04-10 Futoon M. Abushaqra , Hao Xue , Yongli Ren , Flora D. Salim

Streaming data often exhibit heterogeneity due to heteroscedastic variances or inhomogeneous covariate effects. Online renewable quantile and expectile regression methods provide valuable tools for detecting such heteroscedasticity by…

Methodology · Statistics 2026-02-27 Wei Cao , Shanshan Wanga , Xiaoxue Hua

Due to the demand for tackling the problem of streaming data with high dimensional covariates, we propose an online sparse sliced inverse regression (OSSIR) method for online sufficient dimension reduction. The existing online sufficient…

Computation · Statistics 2021-07-05 Haoyang Cheng , Wenquan Cui , Xu Jianjun
‹ Prev 1 2 3 10 Next ›