English
Related papers

Related papers: Online Updating Huber Robust Regression for Big Da…

200 papers

Modern longitudinal data, for example from wearable devices, measures biological signals on a fixed set of participants at a diverging number of time points. Traditional statistical methods are not equipped to handle the computational…

Methodology · Statistics 2023-03-23 Lan Luo , Jingshen Wang , Emily C. Hector

We propose a novel and robust online function-on-scalar regression technique via geometric median to learn associations between functional responses and scalar covariates based on massive or streaming datasets. The online estimation…

Methodology · Statistics 2024-05-24 Guanghui Cheng , Wenjuan Hu , Ruitao Lin , Chen Wang

The use of mediation analysis has become increasingly popular in various research fields in recent years. The primary objective of mediation analysis is to examine the indirect effects along the pathways from exposure to outcome. Meanwhile,…

Computation · Statistics 2024-11-06 Xueyan Bai , Haixiang Zhang

The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its…

Methodology · Statistics 2022-01-11 Ryan Thompson

The inflated beta regression model is widely used for modeling continuous proportions with values at the boundaries. Maximum likelihood estimation for these models is well-known for its sensitivity to outliers, which can severely distort…

Methodology · Statistics 2026-05-15 Francisco Felipe Queiroz , Silvia Lopes de Paula Ferrari

Clustering of event stream data is of great importance in many application scenarios, including but not limited to, e-commerce, electronic health, online testing, mobile music service, etc. Existing clustering algorithms fail to take…

Methodology · Statistics 2024-05-29 Yuecheng Zhang , Guanhua Fang , Wen Yu

Online learning updates models incrementally with new data, avoiding large storage requirements and costly model recalculations. In this paper, we introduce "OLR-WA; OnLine Regression with Weighted Average", a novel and versatile…

Machine Learning · Computer Science 2025-12-18 Mohammad Abu-Shaira , Alejandro Rodriguez , Greg Speegle , Victor Sheng , Ishfaq Ahmad

In this paper we derive an updating scheme for calculating some important network statistics such as degree, clustering coefficient, etc., aiming at reduce the amount of computation needed to track the evolving behavior of large networks;…

Data Analysis, Statistics and Probability · Physics 2009-04-02 Jie Sun , James P. Bagrow , Erik M. Bollt , Joesph D. Skufca

This paper develops an updatable inverse probability weighting (UIPW) estimation for the generalized linear models with response missing at random in streaming data sets. A two-step online updating algorithm is provided for the proposed…

Statistics Theory · Mathematics 2023-10-10 Xianhua Zhang , Lu lin , Qihua Wang

The nature of modern data is increasingly real-time, making outlier detection crucial in any data-related field, such as finance for fraud detection and healthcare for monitoring patient vitals. Traditional outlier detection methods, such…

Computation · Statistics 2025-01-03 Rui Hu , Luc , Chen , Yiwei Wang

Existing high-dimensional online learning methods often face the challenge that their error bounds, or per-batch sample sizes, diverge as the number of data batches increases. To address this issue, we propose an asynchronous decomposition…

Machine Learning · Statistics 2026-03-24 Shixiang Liu , Zhifan Li , Hanming Yang , Jianxin Yin

As more data are produced each day, and faster, data stream mining is growing in importance, making clear the need for algorithms able to fast process these data. Data stream mining algorithms are meant to be solutions to extract knowledge…

Transfer learning has become an essential technique for utilizing information from source datasets to improve the performance of the target task. However, in the context of high-dimensional data, heterogeneity arises due to heteroscedastic…

Methodology · Statistics 2024-06-26 Xiaohui Yuan , Shujie Ren

We consider online convex optimization when a number k of data points are outliers that may be corrupted. We model this by introducing the notion of robust regret, which measures the regret only on rounds that are not outliers. The aim for…

Machine Learning · Computer Science 2021-08-31 Tim van Erven , Sarah Sachs , Wouter M. Koolen , Wojciech Kotłowski

When data are stored across multiple locations, directly pooling all the data together for statistical analysis may be impossible due to communication costs and privacy concerns. Distributed computing systems allow the analysis of such…

Methodology · Statistics 2025-02-27 Xian Li , Xuan Liang , A. H. Welsh , Tao Zou

In data analysis, contamination caused by outliers is inevitable, and robust statistical methods are strongly demanded. In this paper, our concern is to develop a new approach for robust data analysis based on scoring rules. The scoring…

Statistics Theory · Mathematics 2013-11-22 Takafumi Kanamori , Hironori Fujisawa

Reinforcement learning has emerged as one of the prominent topics attracting attention in modern statistical learning, with policy evaluation being a key component. Unlike the traditional machine learning literature on this topic, our work…

Machine Learning · Statistics 2025-03-04 Weidong Liu , Jiyuan Tu , Xi Chen , Yichen Zhang

In this paper, we consider sequential online prediction (SOP) for streaming data in the presence of outliers and change points. We propose an INstant TEmporal structure Learning (INTEL) algorithm to address this problem. Our INTEL algorithm…

Machine Learning · Computer Science 2020-02-12 Bin Liu , Yu Qi , Ke-Jia Chen

This paper studies the adversarial-robustness of importance-sampling (aka sensitivity sampling); a useful algorithmic technique that samples elements with probabilities proportional to some measure of their importance. A streaming or online…

Data Structures and Algorithms · Computer Science 2025-12-11 Yotam Kenneth-Mordoch , Shay Sapir

In this paper we develop an online statistical inference approach for high-dimensional generalized linear models with streaming data for real-time estimation and inference. We propose an online debiased lasso (ODL) method to accommodate the…

Statistics Theory · Mathematics 2021-08-11 Lan Luo , Ruijian Han , Yuanyuan Lin , Jian Huang