English
Related papers

Related papers: Learning over inherently distributed data

200 papers

Federated learning is an emerging distributed machine learning framework aiming at protecting data privacy. Data heterogeneity is one of the core challenges in federated learning, which could severely degrade the convergence rate and…

Machine Learning · Statistics 2025-11-27 Feifei Wang , Huiyun Tang , Yang Li

Combining data from varied sources has considerable potential for knowledge discovery: collaborating data parties can mine data in an expanded feature space, allowing them to explore a larger range of scientific questions. However, data…

Machine Learning · Computer Science 2019-11-11 Erik-Jan van Kesteren , Chang Sun , Daniel L. Oberski , Michel Dumontier , Lianne Ippel

In this study, we focus on the analysis of financial data in a federated setting, wherein data is distributed across multiple clients or locations, and the raw data never leaves the local devices. Our primary focus is not only on the…

Machine Learning · Computer Science 2025-04-30 Kun Yang , Nikhil Krishnan , Sanjeev R. Kulkarni

This paper considers distributed statistical inference for general symmetric statistics %that encompasses the U-statistics and the M-estimators in the context of massive data where the data can be stored at multiple platforms in different…

Statistics Theory · Mathematics 2018-05-30 Song Xi Chen , Liuhua Peng

In the rapidly evolving realm of machine learning, algorithm effectiveness often faces limitations due to data quality and availability. Traditional approaches grapple with data sharing due to legal and privacy concerns. The federated…

Machine Learning · Computer Science 2023-11-16 Sin Cheng Ciou , Pin Jui Chen , Elvin Y. Tseng , Yuh-Jye Lee

Effective information analysis generally boils down to properly identifying the structure or geometry of the data, which is often represented by a graph. In some applications, this structure may be partly determined by design constraints or…

Machine Learning · Computer Science 2016-11-07 Dorina Thanou , Xiaowen Dong , Daniel Kressner , Pascal Frossard

The modeling of probability distributions, specifically generative modeling and density estimation, has become an immensely popular subject in recent years by virtue of its outstanding performance on sophisticated data such as images and…

Machine Learning · Statistics 2023-01-02 Hongkang Yang

Federated learning, a distributed learning paradigm, utilizes multiple clients to build a robust global model. In real-world applications, local clients often operate within their limited domains, leading to a `domain shift' across clients.…

Machine Learning · Computer Science 2024-07-12 Seunghan Yang , Seokeon Choi , Hyunsin Park , Sungha Choi , Simyung Chang , Sungrack Yun

Due to the rapid growth of data and computational resources, distributed optimization has become an active research area in recent years. While first-order methods seem to dominate the field, second-order methods are nevertheless attractive…

Machine Learning · Computer Science 2018-06-21 Celestine Dünner , Aurelien Lucchi , Matilde Gargiani , An Bian , Thomas Hofmann , Martin Jaggi

Federated Learning is machine learning in the context of a network of clients whilst maintaining data residency and/or privacy constraints. Community detection is the unsupervised discovery of clusters of nodes within graph-structured data.…

Machine Learning · Computer Science 2023-12-15 William Leeney , Ryan McConville

With the increasing complexity of computing systems, complete hardware reliability can no longer be guaranteed. We need, however, to ensure overall system reliability. One of the most important features of artificial neural networks is…

Neural and Evolutionary Computing · Computer Science 2015-10-07 Anton Kulakov , Mark Zwolinski , Jeff Reeve

This paper proposes Hamiltonian Learning, a novel unified framework for learning with neural networks "over time", i.e., from a possibly infinite stream of data, in an online manner, without having access to future information. Existing…

Machine Learning · Computer Science 2024-09-19 Stefano Melacci , Alessandro Betti , Michele Casoni , Tommaso Guidi , Matteo Tiezzi , Marco Gori

Differentially private federated learning is crucial for maintaining privacy in distributed environments. This paper investigates the challenges of high-dimensional estimation and inference under the constraints of differential privacy.…

Machine Learning · Statistics 2024-04-26 Zhe Zhang , Ryumei Nakada , Linjun Zhang

We present a framework for learning disentangled and interpretable jointly continuous and discrete representations in an unsupervised manner. By augmenting the continuous latent distribution of variational autoencoders with a relaxed…

Machine Learning · Statistics 2018-10-23 Emilien Dupont

In this overview paper, data-driven learning model-based cooperative localization and location data processing are considered, in line with the emerging machine learning and big data methods. We first review (1) state-of-the-art algorithms…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-26 Feng Yin , Zhidi Lin , Yue Xu , Qinglei Kong , Deshi Li , Sergios Theodoridis , Shuguang , Cui

Terabytes of data are collected by wind turbine manufacturers from their fleets every day. And yet, a lack of data access and sharing impedes exploiting the full potential of the data. We present a distributed machine learning approach that…

Machine Learning · Computer Science 2023-09-18 Lorin Jenkel , Stefan Jonas , Angela Meyer

Global financial crime activity is driving demand for machine learning solutions in fraud prevention. However, prevention systems are commonly serviced to financial institutions in isolation, and few provisions exist for data sharing due to…

Cryptography and Security · Computer Science 2024-01-08 Iker Perez , Jason Wong , Piotr Skalski , Stuart Burrell , Richard Mortier , Derek McAuley , David Sutton

Due to rapid data growth, statistical analysis of massive datasets often has to be carried out in a distributed fashion, either because several datasets stored in separate physical locations are all relevant to a given problem, or simply to…

Computation · Statistics 2016-02-08 Matthias Katzfuss , Dorit Hammerling

With the advent of the Internet of Things and Industry 4.0 an enormous amount of data is produced at the edge of the network. Due to a lack of computing power, this data is currently send to the cloud where centralized machine learning…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-16 Thomas Bach , Muhammad Adnan Tariq , Ruben Mayer , Kurt Rothermel

Distributed aggregation allows the derivation of a given global aggregate property from many individual local values in nodes of an interconnected network system. Simple aggregates such as minima/maxima, counts, sums and averages have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-04-09 Miguel Borges , Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida