English
Related papers

Related papers: Distributed Gradient Descent for Functional Learni…

200 papers

Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection, and search. In these domains, the graphs are typically…

Machine Learning · Computer Science 2021-08-04 Da Zheng , Chao Ma , Minjie Wang , Jinjing Zhou , Qidong Su , Xiang Song , Quan Gan , Zheng Zhang , George Karypis

Despite some promising results in federated learning using game-theoretical methods, most existing studies mainly employ a one-level game in either a cooperative or competitive environment, failing to capture the complex dynamics among…

Computer Science and Game Theory · Computer Science 2024-12-23 Xiaobing Chen , Xiangwei Zhou , Songyang Zhang , Mingxuan Sun

The emerging machine learning paradigm of decentralized federated learning (DFL) has the promise of greatly boosting the deployment of artificial intelligence (AI) by directly learning across distributed agents without centralized…

Machine Learning · Computer Science 2024-08-12 Yudi Huang , Tingyang Sun , Ting He

The recent decades have seen a surge of interests in distributed computing. Existing work focus primarily on either distributed computing platforms, data query tools, or, algorithms to divide big data and conquer at individual machines etc.…

Machine Learning · Statistics 2019-08-01 Donghui Yan , Ying Xu

Federated learning enables a collaborative training and optimization of global models among a group of devices without sharing local data samples. However, the heterogeneity of data in federated learning can lead to unfair representation of…

Machine Learning · Computer Science 2023-11-03 Weikang Chen , Junping Du , Yingxia Shao , Jia Wang , Yangxi Zhou

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller

Federated Learning (FL) is a distributed machine learning scheme in which clients jointly participate in the collaborative training of a global model by sharing model information rather than their private datasets. In light of concerns…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Kangyang Luo , Shuai Wang , Yexuan Fu , Renrong Shao , Xiang Li , Yunshi Lan , Ming Gao , Jinlong Shu

This paper presents a personalized graph federated learning (PGFL) framework in which distributedly connected servers and their respective edge devices collaboratively learn device or cluster-specific models while maintaining the privacy of…

Machine Learning · Computer Science 2023-10-31 Francois Gauthier , Vinay Chakravarthi Gogineni , Stefan Werner , Yih-Fang Huang , Anthony Kuh

The order of training samples can have a significant impact on the performance of a classifier. Curriculum learning is a method of ordering training samples from easy to hard. This paper proposes the novel idea of a curriculum learning…

Machine Learning · Computer Science 2024-11-12 Shonal Chaudhry , Anuraganand Sharma

Crop disease detection and classification is a critical challenge in agriculture, with major implications for productivity, food security, and environmental sustainability. While deep learning models such as CNN and ViT have shown excellent…

Machine Learning · Computer Science 2025-05-30 Denis Mamba Kabala , Adel Hafiane , Laurent Bobelin , Raphael Canals

This work considers the problem of decentralized online learning, where the goal is to track the optimum of the sum of time-varying functions, distributed across several nodes in a network. The local availability of the functions and their…

Machine Learning · Computer Science 2024-02-14 Shivangi Dubey Sharma , Ketan Rajawat

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

We propose a new approach, called as functional deep neural network (FDNN), for classifying multi-dimensional functional data. Specifically, a deep neural network is trained based on the principle components of the training data which shall…

Machine Learning · Statistics 2022-05-19 Shuoyang Wang , Guanqun Cao , Zuofeng Shang

We propose a new decentralized robust kernel-based learning algorithm within the framework of reproducing kernel Hilbert spaces (RKHSs) by utilizing a networked system that can be represented as a connected graph. The robust loss function…

Machine Learning · Computer Science 2025-08-18 Zhan Yu , Zhongjie Shi , Ding-Xuan Zhou

Federated learning (FL) allows multiple clients to collectively train a high-performance global model without sharing their private data. However, the key challenge in federated learning is that the clients have significant statistical…

Machine Learning · Computer Science 2022-03-23 Liang Gao , Huazhu Fu , Li Li , Yingwen Chen , Ming Xu , Cheng-Zhong Xu

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Multi-grade deep learning (MGDL) has been shown to significantly outperform the standard single-grade deep learning (SGDL) across various applications. This work aims to investigate the computational advantages of MGDL focusing on its…

Machine Learning · Computer Science 2025-07-29 Ronglong Fang , Yuesheng Xu

To date, distributional reinforcement learning (distributional RL) methods have exclusively focused on the discounted setting, where an agent aims to optimize a discounted sum of rewards over time. In this work, we extend distributional RL…

Machine Learning · Computer Science 2026-01-14 Juan Sebastian Rojas , Chi-Guhn Lee

We consider the problem of function estimation by a multi-agent system comprising of two agents and a fusion center. Each agent receives data comprising of samples of an independent variable (input) and the corresponding values of the…

Systems and Control · Electrical Eng. & Systems 2024-01-09 Aneesh Raghavan , Karl Henrik Johansson

Federated Learning (FL) has become a key choice for distributed machine learning. Initially focused on centralized aggregation, recent works in FL have emphasized greater decentralization to adapt to the highly heterogeneous network edge.…

Machine Learning · Computer Science 2022-12-15 Ahnaf Hannan Lodhi , Barış Akgün , Öznur Özkasap