中文
相关论文

相关论文: Online Updating Huber Robust Regression for Big Da…

200 篇论文

The paper explores the challenges of regression analysis in evolving data streams, an area that remains relatively underexplored compared to classification. We propose a standardized evaluation process for regression and prediction interval…

机器学习 · 计算机科学 2025-02-20 Yibin Sun , Heitor Murilo Gomes , Bernhard Pfahringer , Albert Bifet

This paper presents a fast methodology, called ROBOUT, to identify outliers in a response variable conditional on a set of linearly related predictors, retrieved from a large granular dataset. ROBOUT is shown to be effective and…

统计方法学 · 统计学 2021-04-27 Matteo Farnè , Angelos Vouldis

We present a novel algorithm for anomaly detection on very large datasets and data streams. The method, named EXPected Similarity Estimation (EXPoSE), is kernel-based and able to efficiently compute the similarity between new data points…

机器学习 · 计算机科学 2016-06-07 Markus Schneider , Wolfgang Ertel , Fabio Ramos

Monitoring the performance of large shared computing systems such as the cloud computing infrastructure raises many challenging algorithmic problems. One common problem is to track users with the largest deviation from the norm (outliers),…

数据库 · 计算机科学 2009-07-20 Chiranjeeb Buragohain , Luca Foschini , Subhash Suri

In the contemporary context of rapid advancements in information technology and the exponential growth of data volume, language models are confronted with significant challenges in effectively navigating the dynamic and ever-evolving…

信息检索 · 计算机科学 2025-01-14 Yuxin Fan , Yuxiang Wang , Lipeng Liu , Xirui Tang , Na Sun , Zidong Yu

Many applications from various disciplines are now required to analyze fast evolving big data in real time. Various approaches for incremental processing of queries have been proposed over the years. Traditional approaches rely on updating…

数据库 · 计算机科学 2019-02-05 Iman Elghandour , Ahmet Kara , Dan Olteanu , Stijn Vansummeren

The amount of data moved over dedicated and non-dedicated network links increases much faster than the increase in the network capacity, but the current solutions fail to guarantee even the promised achievable transfer throughputs. In this…

分布式、并行与集群计算 · 计算机科学 2019-01-01 Zulkar Nine , Tevfik Kosar

In online learning from non-stationary data streams, it is necessary to learn robustly to outliers and to adapt quickly to changes in the underlying data generating mechanism. In this paper, we refer to the former attribute of online…

机器学习 · 统计学 2021-09-29 Shintaro Fukushima , Atsushi Nitanda , Kenji Yamanishi

In this work, we focus on distance-based outliers in a metric space, where the status of an entity as to whether it is an outlier is based on the number of other entities in its neighborhood. In recent years, several solutions have tackled…

We provide a new computationally-efficient class of estimators for risk minimization. We show that these estimators are robust for general statistical models: in the classical Huber epsilon-contamination model and in heavy-tailed settings.…

机器学习 · 统计学 2018-04-23 Adarsh Prasad , Arun Sai Suggala , Sivaraman Balakrishnan , Pradeep Ravikumar

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

数据结构与算法 · 计算机科学 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

This paper develops an incremental learning algorithm based on quadratic inference function (QIF) to analyze streaming datasets with correlated outcomes such as longitudinal data and clustered data. We propose a renewable QIF (RenewQIF)…

统计方法学 · 统计学 2021-07-01 Lan Luo , Ling Zhou , Peter X. -K. Song

Generalized Linear Models are routinely used in data analysis. The classical procedures for estimation are based on Maximum Likelihood and it is well known that the presence of outliers can have a large impact on this estimator. Robust…

统计计算 · 统计学 2017-10-02 Marina Valdora , Claudio Agostinelli , Victor J. Yohai

We propose an online inference method for censored quantile regression with streaming data sets. A key strategy is to approximate the martingale-based unsmooth objective function with a quadratic loss function involving a well-justified…

统计理论 · 数学 2025-07-22 Yi Deng , Shuwei Li , Liuquan Sun , Baoxue Zhang

In an era of ubiquitous large-scale streaming data, the availability of data far exceeds the capacity of expert human analysts. In many settings, such data is either discarded or stored unprocessed in datacenters. This paper proposes a…

机器学习 · 统计学 2016-09-13 Xin Jiang , Rebecca Willett

This study presents an efficient incremental/decremental approach for big streams based on Kernel Ridge Regression (KRR), a frequently used data analysis in cloud centers. To avoid reanalyzing the whole dataset whenever sensors receive new…

机器学习 · 计算机科学 2017-11-10 Bo-Wei Chen , Nik Nailah Binti Abdullah , Sangoh Park

In this paper, we introduce adversarially robust streaming algorithms for central machine learning and algorithmic tasks, such as regression and clustering, as well as their more general counterparts, subspace embedding, low-rank…

机器学习 · 计算机科学 2021-10-27 Vladimir Braverman , Avinatan Hassidim , Yossi Matias , Mariano Schain , Sandeep Silwal , Samson Zhou

Sparse regression has been a popular approach to perform variable selection and enhance the prediction accuracy and interpretability of the resulting statistical model. Existing approaches focus on offline regularized regression, while the…

机器学习 · 统计学 2023-01-03 Shuoguang Yang , Yuhao Yan , Xiuneng Zhu , Qiang Sun

We propose an online data compression approach for efficiently solving distributionally robust optimization (DRO) problems with streaming data while maintaining out-of-sample performance guarantees. Our method dynamically constructs…

最优化与控制 · 数学 2025-09-12 Irina Wang , Marta Fochesato , Bartolomeo Stellato

Deep learning benefits from the growing abundance of available data. Meanwhile, efficiently dealing with the growing data scale has become a challenge. Data publicly available are from different sources with various qualities, and it is…