English
Related papers

Related papers: Distributed Machine Learning with Sparse Heterogen…

200 papers

Federated learning is a distributed learning paradigm in which multiple mobile clients train a global model while keeping data local. These mobile clients can have various available memory and network bandwidth. However, to achieve the best…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Dixi Yao

Federated Learning is a distributed machine learning approach that enables geographically distributed data silos to collaboratively learn a joint machine learning model without sharing data. Most of the existing work operates on…

Machine Learning · Computer Science 2023-05-17 Dimitris Stripelis , Jose Luis Ambite

This paper addresses learning of sparse structural changes or differential network between two classes of non-paranormal graphical models. We assume a multi-source and heterogeneous dataset is available for each class, where the covariance…

Machine Learning · Computer Science 2024-10-04 Mojtaba Nikahd , Seyed Abolfazl Motahari

Data-driven methods have recently made great progress in the discovery of partial differential equations (PDEs) from spatial-temporal data. However, several challenges remain to be solved, including sparse noisy data, incomplete candidate…

Computational Physics · Physics 2021-09-28 Hao Xu , Dongxiao Zhang , Junsheng Zeng

Federated learning (FL) is a distributed framework for collaboratively training with privacy guarantees. In real-world scenarios, clients may have Non-IID data (local class imbalance) with poor annotation quality (label noise). The…

Machine Learning · Computer Science 2023-04-07 Chenrui Wu , Zexi Li , Fangxin Wang , Chao Wu

Motivated by extreme multi-label classification applications, we consider training deep learning models over sparse data in multi-GPU servers. The variance in the number of non-zero features across training batches and the intrinsic GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-15 Yujing Ma , Florin Rusu , Kesheng Wu , Alexander Sim

Sparse model is widely used in hyperspectral image classification.However, different of sparsity and regularization parameters has great influence on the classification results.In this paper, a novel adaptive sparse deep network based on…

Image and Video Processing · Electrical Eng. & Systems 2019-10-22 Jingwen Yan , Zixin Xie , Jingyao Chen , Yinan Liu , Lei Liu

In diverse fields ranging from finance to omics, it is increasingly common that data is distributed and with multiple individual sources (referred to as ``clients'' in some studies). Integrating raw data, although powerful, is often not…

Methodology · Statistics 2022-11-08 Yuanxing Chen , Qingzhao Zhang , Shuangge Ma , Kuangnan Fang

This work proposes a decentralized architecture, where individual agents aim at solving a classification problem while observing streaming features of different dimensions and arising from possibly different distributions. In the context of…

Machine Learning · Computer Science 2022-12-27 Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed

Federated learning is an emerging distributed machine learning framework aiming at protecting data privacy. Data heterogeneity is one of the core challenges in federated learning, which could severely degrade the convergence rate and…

Machine Learning · Statistics 2025-11-27 Feifei Wang , Huiyun Tang , Yang Li

This work proposes a novel method for semi-supervised learning from partially labeled massive network-structured datasets, i.e., big data over networks. We model the underlying hypothesis, which relates data points to labels, as a graph…

Machine Learning · Computer Science 2017-05-16 Alexander Jung , Alfred O. Hero , Alexandru Mara , Saeed Jahromi

We demonstrate the possibility of what we call sparse learning: accelerated training of deep neural networks that maintain sparse weights throughout training while achieving dense performance levels. We accomplish this by developing sparse…

Machine Learning · Computer Science 2019-08-27 Tim Dettmers , Luke Zettlemoyer

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

Modern realities and trends in learning require more and more generalization ability of models, which leads to an increase in both models and training sample size. It is already difficult to solve such tasks in a single device mode. This is…

Optimization and Control · Mathematics 2024-12-03 Dmitry Bylinkin , Kirill Degtyarev , Aleksandr Beznosikov

In distributed machine learning, data is dispatched to multiple machines for processing. Motivated by the fact that similar data points often belong to the same or similar classes, and more generally, classification rules of high accuracy…

Machine Learning · Computer Science 2016-12-16 Travis Dick , Mu Li , Venkata Krishna Pillutla , Colin White , Maria Florina Balcan , Alex Smola

Federated systems enable collaborative training on highly heterogeneous data through model personalization, which can be facilitated by employing multi-task learning algorithms. However, significant variation in device computing…

Spatial data are central to applications such as environmental monitoring and urban planning, but are often distributed across devices where privacy and communication constraints limit direct sharing. Federated modeling offers a practical…

Methodology · Statistics 2025-10-03 Jianwei Shi , Sameh Abdulah , Ying Sun , Marc G. Genton

We study distributed schemes for high-dimensional sparse linear regression, based on orthogonal matching pursuit (OMP). Such schemes are particularly suited for settings where a central fusion center is connected to end machines, that have…

Machine Learning · Statistics 2023-11-01 Chen Amiraz , Robert Krauthgamer , Boaz Nadler

The problem of heterogeneous clients in federated learning has recently drawn a lot of attention. Spectral model sharding, i.e., partitioning the model parameters into low-rank matrices based on the singular value decomposition, has been…

Machine Learning · Computer Science 2024-11-01 Denis Korzhenkov , Christos Louizos

This paper considers the problem of distributed model fitting using the alternating directions method of multipliers (ADMM). ADMM splits the learning problem into several smaller subproblems, usually by partitioning the data samples. The…

Optimization and Control · Mathematics 2022-03-04 Dinesh Krishnamoorthy , Vyacheslav Kungurtsev