English
Related papers

Related papers: Dimensionally Distributed Learning: Models and Alg…

200 papers

A recent take towards Federated Analytics (FA), which allows analytical insights of distributed datasets, reuses the Federated Learning (FL) infrastructure to evaluate the summary of model performances across the training devices. However,…

Machine Learning · Computer Science 2021-06-01 Shashi Raj Pandey , Minh N. H. Nguyen , Tri Nguyen Dang , Nguyen H. Tran , Kyi Thar , Zhu Han , Choong Seon Hong

Cooperative decentralized learning relies on direct information exchange between communicating agents, each with access to locally available datasets. The goal is to agree on model parameters that are optimal over all data. However, sharing…

Machine Learning · Computer Science 2024-10-28 Jasmine Bayrooti , Zhan Gao , Amanda Prorok

Loss functions play a crucial role in deep metric learning thus a variety of them have been proposed. Some supervise the learning process by pairwise or tripletwise similarity constraints while others take advantage of structured similarity…

Machine Learning · Computer Science 2019-11-25 Xinshao Wang , Elyor Kodirov , Yang Hua , Neil Robertson

Federated learning is a distributed machine learning paradigm where multiple data owners (clients) collaboratively train one machine learning model while keeping data on their own devices. The heterogeneity of client datasets is one of the…

Machine Learning · Computer Science 2021-08-18 Ye Xue , Diego Klabjan , Yuan Luo

We consider estimation under scenarios where the signals of interest exhibit change of characteristics over time. In particular, we consider the continual learning problem where different tasks, e.g., data with different distributions,…

Machine Learning · Computer Science 2023-12-05 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

Distributed learning paradigms, such as federated and decentralized learning, allow for the coordination of models across a collection of agents, and without the need to exchange raw data. Instead, agents compute model updates locally based…

Machine Learning · Computer Science 2022-04-04 Stefan Vlaski , Christian Schroth , Michael Muma , Abdelhak M. Zoubir

Federated Learning has been recently proposed for distributed model training at the edge. The principle of this approach is to aggregate models learned on distributed clients to obtain a new more general "average" model (FedAvg). The…

Machine Learning · Statistics 2022-07-20 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis , David Naccache

Integrated sensing and communication (ISAC) aims to unify radar and communication systems through a combination of joint hardware, joint waveforms, joint signal design, and joint signal processing. At high carrier frequencies, where ISAC is…

Signal Processing · Electrical Eng. & Systems 2021-11-04 José Miguel Mateos-Ramos , Jinxiang Song , Yibo Wu , Christian Häger , Musa Furkan Keskin , Vijaya Yajnanarayana , Henk Wymeersch

Federated learning involves training machine learning models over devices or data silos, such as edge processors or data warehouses, while keeping the data local. Training in heterogeneous and potentially massive networks introduces bias…

Machine Learning · Computer Science 2021-06-18 Zichen Ma , Yu Lu , Zihan Lu , Wenye Li , Jinfeng Yi , Shuguang Cui

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network that coexists through underlay dynamic spectrum access (DSA) with a primary…

Networking and Internet Architecture · Computer Science 2020-03-09 Ankita Tondwalkar , Dr Andres Kwasinski

Federated Edge Learning (FEEL) emerges as a pioneering distributed machine learning paradigm for the 6G Hyper-Connectivity, harnessing data from the Internet of Things (IoT) devices while upholding data privacy. However, current FEEL…

Machine Learning · Computer Science 2024-12-10 Gang Hu , Yinglei Teng , Nan Wang , Zhu Han

Independent Component Analysis (ICA) is a foundational tool for unsupervised representation learning, yet its high-dimensional theory remains largely limited to single-component recovery. We develop an asymptotically exact mean-field theory…

Machine Learning · Statistics 2026-05-12 Eser Ilke Genc , Samet Demir , Zafer Dogan

This paper investigates a distributed ISEA system under a Bayesian framework, focusing on incorporating task-relevant priors to maximize inference performance. At the sensing level, an RWB estimator with a GM prior is designed. By weighting…

Signal Processing · Electrical Eng. & Systems 2026-05-29 Biao Dong , Bin Cao , Guan Gui , Qinyu Zhang

As artificial intelligence is increasingly affecting all parts of society and life, there is growing recognition that human interpretability of machine learning models is important. It is often argued that accuracy or other similar…

Machine Learning · Statistics 2018-06-27 Kush R. Varshney , Prashant Khanduri , Pranay Sharma , Shan Zhang , Pramod K. Varshney

Federated learning encapsulates distributed learning strategies that are managed by a central unit. Since it relies on using a selected number of agents at each iteration, and since each agent, in turn, taps into its local data, it is only…

Machine Learning · Computer Science 2020-12-15 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

We address the problem of federated learning (FL) where users are distributed and partitioned into clusters. This setup captures settings where different groups of users have their own objectives (learning tasks) but by aggregating their…

Machine Learning · Statistics 2021-06-10 Avishek Ghosh , Jichan Chung , Dong Yin , Kannan Ramchandran

Learning features from data is one of the defining characteristics of deep learning, but our theoretical understanding of the role features play in deep learning is still rudimentary. To address this gap, we introduce a new tool, the…

Machine Learning · Computer Science 2023-06-09 Yiding Jiang , Christina Baek , J. Zico Kolter

We focus on the continual learning problem where the tasks arrive sequentially and the aim is to perform well on the newly arrived task without performance degradation on the previously seen tasks. In contrast to the continual learning…

Machine Learning · Statistics 2023-12-06 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

Distributed learning provides an attractive framework for scaling the learning task by sharing the computational load over multiple nodes in a network. Here, we investigate the performance of distributed learning for large-scale linear…

Machine Learning · Statistics 2021-11-03 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

Deep edge intelligence aims to deploy deep learning models that demand computationally expensive training in the edge network with limited computational power. Moreover, many deep edge intelligence applications require handling distributed…

Machine Learning · Computer Science 2023-07-28 Ilkay Sikdokur , İnci M. Baytaş , Arda Yurdakul