English
Related papers

Related papers: Online Updating Huber Robust Regression for Big Da…

200 papers

In this article, we introduce an adaptive online model update algorithm designed for predictive control applications in networked systems, particularly focusing on power distribution systems. Unlike traditional methods that depend on…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Vivek Khatana , Chin-Yao Chang , Wenbo Wang

Subsampling is an important technique to tackle the computational challenges brought by big data. Many subsampling procedures fall within the framework of importance sampling, which assigns high sampling probabilities to the samples…

Machine Learning · Statistics 2022-03-07 Tieliang Gong , Yuxin Dong , Hong Chen , Bo Dong , Chen Li

We study robust mean estimation in an online and distributed scenario in the presence of adversarial data attacks. At each time step, each agent in a network receives a potentially corrupted data point, where the data points were originally…

Cryptography and Security · Computer Science 2022-09-21 Tong Yao , Shreyas Sundaram

We study the problem of linear regression where both covariates and responses are potentially (i) heavy-tailed and (ii) adversarially contaminated. Several computationally efficient estimators have been proposed for the simpler setting…

Statistics Theory · Mathematics 2021-05-18 Ankit Pensia , Varun Jog , Po-Ling Loh

Real-world network applications must cope with failing nodes, malicious attacks, or, somehow, nodes facing corrupted data --- classified as outliers. One enabling application is the geographic localization of the network nodes. However,…

Optimization and Control · Mathematics 2016-10-31 Cláudia Soares , João Gomes

Traditional static functional data analysis is facing new challenges due to streaming data, where data constantly flow in. A major challenge is that storing such an ever-increasing amount of data in memory is nearly impossible. In addition,…

Methodology · Statistics 2023-10-11 Jinhan Xie , Enze Shi , Peijun Sang , Zuofeng Shang , Bei Jiang , Linglong Kong

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Computer Vision and Pattern Recognition · Computer Science 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

Operations over data streams typically hinge on efficient mechanisms to aggregate or summarize history on a rolling basis. For high-volume data steams, it is critical to manage state in a manner that is fast and memory efficient --…

Data Structures and Algorithms · Computer Science 2024-09-24 Matthew Andres Moreno , Luis Zaman , Emily Dolson

Efficient learning from streaming data is important for modern data analysis due to the continuous and rapid evolution of data streams. Despite significant advancements in stream pattern mining, challenges persist, particularly in managing…

Machine Learning · Computer Science 2024-11-04 Lamine Diop , Marc Plantevit , Arnaud Soulet

Efficient management of storage resources in big data and cloud computing environments requires accurate identification of data's "cold" and "hot" states. Traditional methods, such as rule-based algorithms and early AI techniques, often…

Machine Learning · Computer Science 2024-11-25 Kai Lu , Siqi Zhao , Jiguang Wan

When applying a statistical method in practice it often occurs that some observations deviate from the usual assumptions. However, many classical methods are sensitive to outliers. The goal of robust statistics is to develop methods that…

Methodology · Statistics 2008-08-06 Mia Hubert , Peter J. Rousseeuw , Stefan Van Aelst

Active statistical inference is a new method for inference with AI-assisted data collection. Given a budget on the number of labeled data points that can be collected and assuming access to an AI predictive model, the basic idea is to…

Machine Learning · Statistics 2025-11-13 Puheng Li , Tijana Zrnic , Emmanuel Candès

This paper describes recursive algorithms for state estimation of linear dynamical systems when measurements are noisy with unknown bias and/or outliers. For situations with noisy and biased measurements, algorithms are proposed that…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Krishan Mohan Nagpal

It is of importance to develop statistical techniques to analyze high-dimensional data in the presence of both complex dependence and possible outliers in real-world applications such as imaging data analyses. We propose a new robust…

Methodology · Statistics 2021-10-01 Bingyuan Liu , Qi Zhang , Lingzhou Xue , Peter X. K. Song , Jian Kang

Real-world network applications must cope with failing nodes, malicious attacks, or nodes facing corrupted data - data classified as outliers. Our work addresses these concerns in the scope of the sensor network localization problem where,…

Optimization and Control · Mathematics 2021-10-05 Claudia Soares , João Gomes

Conventional hyperparameter optimization methods are computationally intensive and hard to generalize to scenarios that require dynamically adapting hyperparameters, such as life-long learning. Here, we propose an online hyperparameter…

Machine Learning · Computer Science 2021-04-09 Daniel Jiwoong Im , Cristina Savin , Kyunghyun Cho

This paper establishes unified frameworks of renewable weighted sums (RWS) for various online updating estimations in the models with streaming data sets. The newly defined RWS lays the foundation of online updating likelihood, online…

Methodology · Statistics 2020-08-21 Lu Lin , Weiyu Li , Jun Lu

Machine learning and data analysis have been used in many robotics fields, especially for modelling. Data are usually the result of sensor measurements and, as such, they might be subjected to noise and outliers. The presence of outliers…

Robotics · Computer Science 2019-08-26 Francesco Cursi , Guang-Zhong Yang

Accurate uncertainty estimates are important in sequential model-based decision-making tasks such as Bayesian optimization. However, these estimates can be imperfect if the data violates assumptions made by the model (e.g., Gaussianity).…

Machine Learning · Computer Science 2024-06-27 Shachi Deshpande , Charles Marx , Volodymyr Kuleshov

Given the rapid rise in energy demand by data centers and computing systems in general, it is fundamental to incorporate energy considerations when designing (scheduling) algorithms. Machine learning can be a useful approach in practice by…

Data Structures and Algorithms · Computer Science 2021-12-07 Antonios Antoniadis , Peyman Jabbarzade Ganje , Golnoosh Shahkarami