English
Related papers

Related papers: On Robust Aggregation for Distributed Data

200 papers

Distributed data mining techniques and mainly distributed clustering are widely used in the last decade because they deal with very large and heterogeneous datasets which cannot be gathered centrally. Current distributed clustering…

Databases · Computer Science 2018-02-02 Malika Bendechache , M-Tahar Kechadi

Distributed data aggregation is an important task, allowing the decentralized determination of meaningful global properties, that can then be used to direct the execution of other applications. The resulting values result from the…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-10-05 Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida

We consider the estimation of Dirichlet Process Mixture Models (DPMMs) in distributed environments, where data are distributed across multiple computing nodes. A key advantage of Bayesian nonparametric models such as DPMMs is that they…

Machine Learning · Statistics 2017-09-20 Ruohui Wang , Dahua Lin

Non-linear aggregation strategies have recently been proposed in response to the problem of how to combine, in a non-linear way, estimators of the regression function (see for instance \cite{biau:16}), classification rules (see…

Statistics Theory · Mathematics 2018-12-24 Alejandro Cholaquidis , Ricardo Fraiman , Badih Ghattas , Juan Kalemkerian

In this paper we propose a new approach for Big Data mining and analysis. This new approach works well on distributed datasets and deals with data clustering task of the analysis. The approach consists of two main phases, the first phase…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-05 Malika Bendechache , Nhien-An Le-Khac , M-Tahar Kechadi

This work proposes diffusion normalized least mean M-estimate algorithm based on the modified Huber function, which can equip distributed networks with robust learning capability in the presence of impulsive interference. In order to…

Machine Learning · Computer Science 2020-04-21 Y. Yu , H. He , T. Yang , X. Wang , R. C. de Lamare

Particle probability hypothesis density filtering has become a promising means for multi-target tracking due to its capability of handling an unknown and time-varying number of targets in non-linear non-Gaussian system. However, its…

Computation · Statistics 2015-03-13 Wang Junjie , Zhao Lingling , Su Xiaohong , Ma Peijun

For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't…

Methodology · Statistics 2022-09-29 Xin Xin , Boyi Xie , Yunhai Xiao

Objective: The main objective of this paper is to construct a distributed clustering algorithm based upon spatial data correlation among sensor nodes and perform data accuracy for each distributed cluster at their respective cluster head…

Networking and Internet Architecture · Computer Science 2011-08-15 Jyotirmoy Karjee , H. S Jamadagni

It is of soaring demand to develop statistical analysis tools that are robust against contamination as well as preserving individual data owners' privacy. In spite of the fact that both topics host a rich body of literature, to the best of…

Statistics Theory · Mathematics 2022-09-01 Mengchu Li , Thomas B. Berrett , Yi Yu

In this paper, partition-based distributed state estimation of general linear systems is considered. A distributed moving horizon state estimation scheme is developed via decomposing the entire system model into subsystem models and…

Systems and Control · Electrical Eng. & Systems 2024-04-11 Xiaojie Li , Song Bo , Yan Qin , Xunyuan Yin

Existing statistical methods for the analysis of micro-randomized trials (MRTs) are designed to estimate causal excursion effects using data from a single MRT. In practice, however, researchers can often find previous MRTs that employ…

Methodology · Statistics 2025-05-13 Easton Huch , Inbal Nahum-Shani , Lindsey Potter , Cho Lam , David W. Wetter , Walter Dempsey

Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [{\it Ann. Statist.} {\bf 1} (1973) 799--821], robust…

Statistics Theory · Mathematics 2017-11-16 Wen-Xin Zhou , Koushiki Bose , Jianqing Fan , Han Liu

We study robust regression under a contamination model in which covariates are clean while the responses may be corrupted in an adaptive manner. Unlike the classical Huber's contamination model, where both covariates and responses may be…

Statistics Theory · Mathematics 2026-04-07 Ilias Diakonikolas , Chao Gao , Daniel M. Kane , Ankit Pensia , Dong Xie

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

Methodology · Statistics 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang

Data aggregation is a fundamental primitive in distributed computing wherein a network computes a function of every nodes' input. However, while compute time is non-negligible in modern systems, standard models of distributed computing do…

Data Structures and Algorithms · Computer Science 2019-11-14 Bernhard Haeupler , D Ellis Hershkowitz , Anson Kahng , Ariel D. Procaccia

Robustly determining the optimal number of clusters in a data set is an essential factor in a wide range of applications. Cluster enumeration becomes challenging when the true underlying structure in the observed data is corrupted by…

Signal Processing · Electrical Eng. & Systems 2021-05-06 Christian A. Schroth , Michael Muma

Clustering analysis of functional data, which comprises observations that evolve continuously over time or space, has gained increasing attention across various scientific disciplines. Practical applications often involve functional data…

Methodology · Statistics 2024-06-19 Tingyu Zhu , Lan Xue , Carmen Tekwe , Keith Diaz , Mark Benden , Roger Zoh

The major sources of abundant data are constantly expanding with the available data collection methodologies in various applications - medical, insurance, scientific, bio-informatics and business. These data sets may be distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-24 Aruna Govada , Sanjay K. Sahay

The local computation of Linial [FOCS'87] and Naor and Stockmeyer [STOC'93] concerns with the question of whether a locally definable distributed computing problem can be solved locally: for a given local CSP whether a CSP solution can be…

Data Structures and Algorithms · Computer Science 2022-09-09 Weiming Feng , Yuxin Sun , Yitong Yin