中文
相关论文

相关论文: Online Updating Huber Robust Regression for Big Da…

200 篇论文

We consider the problem of learning from noisy data in practical settings where the size of data is too large to store on a single machine. More challenging, the data coming from the wild may contain malicious outliers. To address the…

机器学习 · 计算机科学 2017-01-03 Jiashi Feng , Huan Xu , Shie Mannor

The presence of data corruption in user-generated streaming data, such as social media, motivates a new fundamental problem that learns reliable regression coefficient when features are not accessible entirely at one time. Until now,…

机器学习 · 计算机科学 2019-02-06 Xuchao Zhang , Shuo Lei , Liang Zhao , Arnold P. Boedihardjo , Chang-Tien Lu

Data stream algorithms tackle operations on high-volume sequences of read-once data items. Data stream scenarios include inherently real-time systems like sensor networks and financial markets. They also arise in purely-computational…

数据结构与算法 · 计算机科学 2024-03-04 Matthew Andres Moreno , Santiago Rodriguez Papa , Emily Dolson

Robust change-point detection for large-scale data streams has many real-world applications in industrial quality control, signal detection, biosurveillance. Unfortunately, it is highly non-trivial to develop efficient schemes due to three…

统计方法学 · 统计学 2021-10-18 Ruizhi Zhang , Yajun Mei , Jianjun Shi

Conformal prediction has emerged as a powerful framework for constructing distribution-free prediction sets with guaranteed coverage assuming only the exchangeability assumption. However, this assumption is often violated in online…

机器学习 · 统计学 2025-11-07 Jungbin Jun , Ilsang Ohn

This paper considers a class of real-time decision making problems to minimize the expected value of a function that depends on a random variable $\xi$ under an unknown distribution $\mathbb{P}$. In this process, samples of $\xi$ are…

最优化与控制 · 数学 2020-09-08 Dan Li , Sonia Martinez

In this work we revisit two classic high-dimensional online learning problems, namely linear regression and contextual bandits, from the perspective of adversarial robustness. Existing works in algorithmic robust statistics make strong…

机器学习 · 计算机科学 2021-06-14 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

This paper proposes an adaptive penalized weighted mean regression for outlier detection of high-dimensional data. In comparison to existing approaches based on the mean shift model, the proposed estimators demonstrate robustness against…

统计理论 · 数学 2023-06-27 Jiaqi Li , Linglong Kong , Bei Jiang , Wei Tu

One of the most well-established applications of machine learning is in deciding what content to show website visitors. When observation data comes from high-velocity, user-generated data streams, machine learning methods perform a…

Data assimilation is the process to fuse information from priors, observations of nature, and numerical models, in order to obtain best estimates of the parameters or state of a physical system of interest. Presence of large errors in some…

数值分析 · 数学 2015-11-06 Vishwas Rao , Adrian Sandu , Michael Ng , Elias Nino-Ruiz

Measuring the built and natural environment at a fine-grained scale is now possible with low-cost urban environmental sensor networks. However, fine-grained city-scale data analysis is complicated by tedious data cleaning including removing…

机器学习 · 计算机科学 2021-09-03 Yue Hu , Ao Qu , Yanbing Wang , Dan Work

We propose an online debiased lasso (ODL) method for statistical inference in high-dimensional linear models with streaming data. The proposed ODL consists of an efficient computational algorithm for streaming data and approximately normal…

统计理论 · 数学 2021-08-20 Ruijian Han , Lan Luo , Yuanyuan Lin , Jian Huang

This paper addresses the robust estimation of linear regression models in the presence of potentially endogenous outliers. Through Monte Carlo simulations, we demonstrate that existing $L_1$-regularized estimation methods, including the…

计量经济学 · 经济学 2024-08-08 Zhan Gao , Hyungsik Roger Moon

Disease control experts inspect public health data streams daily for outliers worth investigating, like those corresponding to data quality issues or disease outbreaks. However, they can only examine a few of the thousands of maximally-tied…

人工智能 · 计算机科学 2024-01-04 Ananya Joshi , Tina Townes , Nolan Gormley , Luke Neureiter , Roni Rosenfeld , Bryan Wilder

In the research field of big data, one of important issues is how to recover the sequentially changing sets of true features when the data sets arrive sequentially. The paper presents a general framework for online updating variable…

统计方法学 · 统计学 2021-01-22 Xiaoyu Ma , Lu Lin , Yujie Gai

With the rapid development of data collection and aggregation technologies in many scientific disciplines, it is becoming increasingly ubiquitous to conduct large-scale or online regression to analyze real-world data and unveil real-world…

统计方法学 · 统计学 2021-03-22 Jinfeng Xu , Zhiliang Ying , Na Zhao

Cellwise outliers are likely to occur together with casewise outliers in modern data sets with relatively large dimension. Recent work has shown that traditional robust regression methods may fail for data sets in this paradigm. The…

统计理论 · 数学 2016-12-28 Andy Leung , Hongyang Zhang , Ruben H. Zamar

Outlier detection algorithms typically assign an outlier score to each observation in a dataset, indicating the degree to which an observation is an outlier. However, these scores are often not comparable across algorithms and can be…

Online multiple-output regression is an important machine learning technique for modeling, predicting, and compressing multi-dimensional correlated data streams. In this paper, we propose a novel online multiple-output regression method,…

机器学习 · 计算机科学 2015-09-09 Changsheng Li , Fan Wei , Weishan Dong , Qingshan Liu , Xiangfeng Wang , Xin Zhang

We derive a robust update rule for the online infinite hidden Markov model (iHMM) for when the streaming data contains outliers and the model is misspecified. Leveraging recent advances in generalised Bayesian inference, we define…

机器学习 · 统计学 2026-05-13 Horace Yiu , Leandro Sánchez-Betancourt , Álvaro Cartea , Gerardo Duran-Martin