English
Related papers

Related papers: Temporal-Structure-Assisted Gradient Aggregation f…

200 papers

Federated learning (FL) is an approach to training machine learning models that takes advantage of multiple distributed datasets while maintaining data privacy and reducing communication costs associated with sharing local datasets.…

Machine Learning · Computer Science 2024-12-06 John Fischer , Marko Orescanin , Justin Loomis , Patrick McClure

Federated learning is highly valued due to its high-performance computing in distributed environments while safeguarding data privacy. To address resource heterogeneity, researchers have proposed a semi-asynchronous federated learning…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-28 Yunbo Li , Jiaping Gui , Yue Wu

Performance analysis based on modelling consists of two major steps: model construction and model analysis. Formal modelling techniques significantly aid model construction but can exacerbate model analysis. In particular, here we consider…

Performance · Computer Science 2013-09-09 Alireza Pourranjbar , Jane Hillston

Generative recommendation (GR) has emerged as a promising paradigm that replaces fragmented, scenario-specific architectures with unified Transformer-based models, exhibiting scaling-law behavior where recommendation quality improves…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-14 Huichao Chai , Zhixin Wu , Xuemiao Li , Shiqing Fan , Hengfeng Wang , Maojun Peng , Lu Xu , Yaoyuan Wang , Yibo Jin , Wei Guo , Yongxiang Feng

Federated Learning (FL) enables collaborative model training across distributed clients while preserving data privacy. While existing approaches for aggregating client-specific classification heads and adapted backbone parameters require…

Machine Learning · Computer Science 2025-09-16 Cosimo Fiorini , Matteo Mosconi , Pietro Buzzega , Riccardo Salami , Simone Calderara

In this work, we analyze the optimization dynamics of generative fine-tuning. We observe that under the Flow Matching framework, the standard MSE objective can be formulated as a Quadratic Form governed by a dynamically evolving Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Zhinan Xiong , Shunqi Yuan

Retrieval-Augmented Generation (RAG) improves large language models by retrieving external knowledge, often truncated into smaller chunks due to the input context window, which leads to information loss, resulting in response hallucinations…

Computation and Language · Computer Science 2025-11-18 Jie Zhang , Bo Tang , Wanzi Shao , Wenqiang Wei , Jihao Zhao , Jianqing Zhu , Zhiyu li , Wen Xi , Zehao Lin , Feiyu Xiong , Yanchao Tan

We study the problem of estimating a temporally varying coefficient and varying structure (VCVS) graphical model underlying nonstationary time series data, such as social states of interacting individuals or microarray expression profiles…

Machine Learning · Statistics 2010-12-21 Mladen Kolar , Eric P. Xing

Federated learning (FL) leverages data distributed at the edge of the network to enable intelligent applications. The efficiency of FL can be improved by using over-the-air computation (AirComp) technology in the process of gradient…

Machine Learning · Computer Science 2023-12-20 Fan Zhang , Jining Chen , Kunlun Wang , Wen Chen

Text-Attributed Graphs (TAGs) enhance graph structures with natural language descriptions, enabling detailed representation of data and their relationships across a broad spectrum of real-world scenarios. Despite the potential for deeper…

Machine Learning · Computer Science 2024-05-28 Zheng Zhang , Yuntong Hu , Bo Pan , Chen Ling , Liang Zhao

Event cameras have the ability to record continuous and detailed trajectories of objects with high temporal resolution, thereby providing intuitive motion cues for optical flow estimation. Nevertheless, most existing learning-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Haotian Liu , Guang Chen , Sanqing Qu , Yanping Zhang , Zhijun Li , Alois Knoll , Changjun Jiang

Over-the-air federated edge learning (Air-FEEL) is a communication-efficient solution for privacy-preserving distributed learning over wireless networks. Air-FEEL allows "one-shot" over-the-air aggregation of gradient/model-updates by…

Information Theory · Computer Science 2020-11-12 Xiaowen Cao , Guangxu Zhu , Jie Xu , Shuguang Cui

Edge computing has revolutionized the world of mobile and wireless networks world thanks to its flexible, secure, and performing characteristics. Lately, we have witnessed the increasing use of it to make more performing the deployment of…

Machine Learning · Computer Science 2021-12-23 Hung T. Nguyen , Roberto Morabito , Kwang Taik Kim , Mung Chiang

Federated learning (FL) is a promising technique that enables many edge devices to train a machine learning model collaboratively in wireless networks. By exploiting the superposition nature of wireless waveforms, over-the-air computation…

Signal Processing · Electrical Eng. & Systems 2020-11-26 Naifu Zhang , Meixia Tao

More powerful feature representations derived from deep neural networks benefit visual tracking algorithms widely. However, the lack of exploitation on temporal information prevents tracking algorithms from adapting to appearances changing…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Lichao Huang , Xianming Liu , Han Shen

Over-the-air federated learning (OTA-FL) improves communication efficiency by exploiting the superposition property of wireless channels, but this same property also creates a critical security vulnerability: the parameter server (PS)…

Cryptography and Security · Computer Science 2026-05-20 Xiaoyan Ma , Seohyun Lee , Taejoon Kim , Christopher G. Brinton

In this paper, we present a communication-efficient federated learning framework inspired by quantized compressed sensing. The presented framework consists of gradient compression for wireless devices and gradient reconstruction for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-01 Yongjeong Oh , Namyoon Lee , Yo-Seb Jeon , H. Vincent Poor

Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in…

Machine Learning · Computer Science 2023-11-16 Irene Tenison , Sai Aravind Sreeramadas , Vaikkunth Mugunthan , Edouard Oyallon , Irina Rish , Eugene Belilovsky

We consider the problem of aggregating models learned from sequestered, possibly heterogeneous datasets. Exploiting tools from Bayesian nonparametrics, we develop a general meta-modeling framework that learns shared global latent structures…

Machine Learning · Statistics 2019-11-04 Mikhail Yurochkin , Mayank Agarwal , Soumya Ghosh , Kristjan Greenewald , Trong Nghia Hoang

Federated Learning (FL) enables multiple clients to collaboratively train a model without sharing their local data. Yet the FL system is vulnerable to well-designed Byzantine attacks, which aim to disrupt the model training process by…

Machine Learning · Computer Science 2024-09-05 Jiahao Xu , Zikai Zhang , Rui Hu