English
Related papers

Related papers: Optimal Integrative Estimation for Distributed Pre…

200 papers

When the data are stored in a distributed manner, direct application of traditional statistical inference procedures is often prohibitive due to communication cost and privacy concerns. This paper develops and investigates two…

Machine Learning · Statistics 2021-08-04 Jianqing Fan , Yongyi Guo , Kaizheng Wang

Federated learning has attracted significant attention as a privacy-preserving framework for training personalised models on multi-source heterogeneous data. However, most existing approaches are unable to handle scenarios where subgroup…

Methodology · Statistics 2025-10-14 Changxin Yang , Zhongyi Zhu , Heng Lian

Modern realities and trends in learning require more and more generalization ability of models, which leads to an increase in both models and training sample size. It is already difficult to solve such tasks in a single device mode. This is…

Optimization and Control · Mathematics 2024-12-03 Dmitry Bylinkin , Kirill Degtyarev , Aleksandr Beznosikov

Dataset Condensation aims to condense a large dataset into a smaller one while maintaining its ability to train a well-performing model, thus reducing the storage cost and training effort in deep learning applications. However, conventional…

Machine Learning · Computer Science 2023-07-20 Ganlong Zhao , Guanbin Li , Yipeng Qin , Yizhou Yu

An efficient, reliable, and interpretable global solution method, the Deep learning-based algorithm for Heterogeneous Agent Models (DeepHAM), is proposed for solving high dimensional heterogeneous agent models with aggregate shocks. The…

General Economics · Economics 2022-02-22 Jiequn Han , Yucheng Yang , Weinan E

In this paper, we deal with distributed estimation problems in diffusion networks with heterogeneous nodes, i.e., nodes that either implement different adaptive rules or differ in some other aspect such as the filter structure or length, or…

Systems and Control · Computer Science 2017-09-05 Jesus Fernandez-Bes , Jerónimo Arenas-García , Magno T. M. Silva , Luis A. Azpicueta-Ruiz

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa

Electronic health records (EHRs) offer great promises for advancing precision medicine and, at the same time, present significant analytical challenges. Particularly, it is often the case that patient-level data in EHRs cannot be shared…

Methodology · Statistics 2022-07-04 Changgee Chang , Zhiqi Bu , Qi Long

In federated learning, communication cost is often a critical bottleneck to scale up distributed optimization algorithms to collaboratively learn a model from millions of devices with potentially unreliable or limited communication and…

Machine Learning · Computer Science 2020-11-24 Farzin Haddadpour , Mohammad Mahdi Kamani , Aryan Mokhtari , Mehrdad Mahdavi

Gradient-type distributed optimization methods have blossomed into one of the most important tools for solving a minimization learning task over a networked agent system. However, only one gradient update per iteration is difficult to…

Optimization and Control · Mathematics 2024-03-06 Mou Wu , Haibin Liao , Zhengtao Ding , Yonggang Xiao

Distributed optimization finds applications in large-scale machine learning, data processing and classification over multi-agent networks. In real-world scenarios, the communication network of agents may encounter latency that may affect…

Systems and Control · Electrical Eng. & Systems 2025-10-06 Mohammadreza Doostmohammadian , Narahari Kasagatta Ramesh , Alireza Aghasi

Machine learning methods for estimating heterogeneous treatment effects (HTE) facilitate large-scale personalized decision-making across various domains such as healthcare, policy making, education, and more. Current machine learning…

Machine Learning · Computer Science 2024-06-25 Disha Makhija , Joydeep Ghosh , Yejin Kim

Federated Learning has emerged as a transformative paradigm for collaborative machine learning across distributed environments. However, its performance is strongly influenced by the aggregation strategy used to combine local model updates…

Machine Learning · Computer Science 2026-05-13 Antonios Makris , Christos Dousis , Emmanouil Kritharakis , Stavros Bouras , Konstantinos Tserpes

Federated Edge Learning (FEEL) emerges as a pioneering distributed machine learning paradigm for the 6G Hyper-Connectivity, harnessing data from the Internet of Things (IoT) devices while upholding data privacy. However, current FEEL…

Machine Learning · Computer Science 2024-12-10 Gang Hu , Yinglei Teng , Nan Wang , Zhu Han

Simultaneous trajectory prediction for multiple heterogeneous traffic participants is essential for the safe and efficient operation of connected automated vehicles under complex driving situations in the real world. The multi-agent…

Robotics · Computer Science 2021-06-15 Xiaoyu Mo , Yang Xing , Chen Lv

In this paper, we address the distributed optimization problem over unidirectional networks with possibly time-invariant heterogeneous bounded transmission delays. In particular, we propose a modified version of the Accelerated Distributed…

In recent years, as data and problem sizes have increased, distributed learning has become an essential tool for training high-performance models. However, the communication bottleneck, especially for high-dimensional data, is a challenge.…

Optimization and Control · Mathematics 2025-04-28 Dmitry Bylinkin , Aleksandr Beznosikov

Combinatorial optimization problems are widespread but inherently challenging due to their discrete nature. The primary limitation of existing methods is that they can only access a small fraction of the solution space at each iteration,…

Machine Learning · Statistics 2024-09-27 Hengyuan Ma , Wenlian Lu , Jianfeng Feng

Distributed stochastic optimization algorithms can simultaneously process large-scale datasets, significantly accelerating model training. However, their effectiveness is often hindered by the sparsity of distributed networks and data…

Machine Learning · Computer Science 2025-02-14 Yuchen Hu , Xi Chen , Weidong Liu , Xiaojun Mao

While extensive research has been conducted on high-dimensional data and on regression with left-censored responses, simultaneously addressing these complexities remains challenging, with only a few proposed methods available. In this…

Methodology · Statistics 2024-05-07 Changxin Yang , Zhongyi Zhu , Heng Lian