English
Related papers

Related papers: PSLF: A PID Controller-incorporated Second-order L…

200 papers

Fine-tuning Large Language Models (LLMs) typically involves either full fine-tuning, which updates all model parameters, or Parameter-Efficient Fine-Tuning (PEFT), which adjusts a small subset of parameters. However, both approaches have…

Artificial Intelligence · Computer Science 2026-04-14 Shaocong Ma , Peiran Yu , Heng Huang

Split Federated Learning (SFL) is a distributed machine learning paradigm that combines federated learning and split learning. In SFL, a neural network is partitioned at a cut layer, with the initial layers deployed on clients and remaining…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-23 Justin Dachille , Chao Huang , Xin Liu

We propose a combined model, which integrates the latent factor model and the logistic regression model, for the citation network. It is noticed that neither a latent factor model nor a logistic regression model alone is sufficient to…

Machine Learning · Statistics 2019-12-03 Namjoon Suh , Xiaoming Huo , Eric Heim , Lee Seversky

Adaptive cooperative tracking control with prescribed performance function (PPF) is proposed for high-order nonlinear multi-agent systems. The tracking error originally within a known large set is confined to a smaller predefined set using…

Optimization and Control · Mathematics 2019-04-29 Hashim A Hashim

Federated Learning (FL) aims to learn a single global model that enables the central server to help the model training in local clients without accessing their local data. The key challenge of FL is the heterogeneity of local data in…

Machine Learning · Computer Science 2023-04-17 Sicong Liang , Junchao Tian , Shujun Yang , Yu Zhang

Decision-making under uncertainty is often considered in two stages: predicting the unknown parameters, and then optimizing decisions based on predictions. While traditional prediction-focused learning (PFL) treats these two stages…

Machine Learning · Computer Science 2025-09-11 Haeun Jeon , Hyunglip Bae , Chanyeong Kim , Yongjae Lee , Woo Chang Kim

Federated learning (FL) has emerged as a privacy solution for collaborative distributed learning where clients train AI models directly on their devices instead of sharing their data with a centralized (potentially adversarial) server.…

Machine Learning · Computer Science 2022-09-08 Haleh Hayati , Carlos Murguia , Nathan van de Wouw

Split Federated Learning (SFL) enables collaborative training between resource-constrained edge devices and a compute-rich server. Communication overhead is a central issue in SFL and can be mitigated with auxiliary networks. Yet, the…

Machine Learning · Computer Science 2026-01-15 Zhoubin Kou , Zihan Chen , Jing Yang , Cong Shen

Proportional-integral-derivative (PID) controller is widely used across various industrial process control applications because of its straightforward implementation. However, it can be challenging to fine-tune the PID parameters in…

Systems and Control · Electrical Eng. & Systems 2022-06-09 Hozefa Jesawada , Amol Yerudkar , Carmen Del Vecchio , Navdeep Singh

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton

High-Dimensional and Incomplete matrices, which usually contain a large amount of valuable latent information, can be well represented by a Latent Factor Analysis model. The performance of an LFA model heavily rely on its optimization…

Machine Learning · Computer Science 2023-02-24 Jia Chen , Yixian Chun , Yuanyi Liu , Renyu Zhang , Yang Hu

In contrast to training traditional machine learning (ML) models in data centers, federated learning (FL) trains ML models over local datasets contained on resource-constrained heterogeneous edge devices. Existing FL algorithms aim to learn…

Machine Learning · Computer Science 2022-09-13 El Houcine Bergou , Konstantin Burlachenko , Aritra Dutta , Peter Richtárik

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

Machine Learning · Computer Science 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

Non-Intrusive Load Monitoring (NILM) has emerged as a key smart grid technology, identifying electrical device and providing detailed energy consumption data for precise demand response management. Nevertheless, NILM data suffers from…

Machine Learning · Computer Science 2025-04-21 Yiran Wang , Tangtang Xie , Hao Wu

Federated Learning (FL) empowers multiple clients to collaboratively train machine learning models without sharing local data, making it highly applicable in heterogeneous Internet of Things (IoT) environments. However, intrinsic…

Machine Learning · Computer Science 2025-01-29 Xi Chen , Qin Li , Haibin Cai , Ting Wang

Recently, Stochastic Variational Inference (SVI) has been increasingly attractive thanks to its ability to find good posterior approximations of probabilistic models. It optimizes the variational objective with stochastic optimization,…

Machine Learning · Computer Science 2022-03-16 Minta Liu , Suliang Bu

A dynamic weighted directed graph (DWDG) is commonly encountered in various application scenarios. It involves extensive dynamic interactions among numerous nodes. Most existing approaches explore the intricate temporal patterns hidden in a…

Artificial Intelligence · Computer Science 2024-08-01 Hongxun Zhou , Xiangyu Chen , Ye Yuan

There are two categories of methods in Federated Learning (FL) for joint training across multiple clients: i) parallel FL (PFL), where clients train models in a parallel manner; and ii) sequential FL (SFL), where clients train models in a…

Machine Learning · Computer Science 2024-05-09 Yipeng Li , Xinchen Lyu

Integrated localization and communication systems aim to reuse communication waveforms for simultaneous data transmission and localization, but delay resolution is fundamentally limited by the available bandwidth. In practice, large…

Signal Processing · Electrical Eng. & Systems 2026-01-27 Jialun Kou , Achiel Colpaert , Zhuangzhuang Cui , Sofie Pollin

System identification methods for multivariate time-series, such as neural and behavioral recordings, have been used to build models for predicting one from the other. For example, Preferential Subspace Identification (PSID) builds a…

Machine Learning · Computer Science 2025-07-22 Omid G. Sani , Maryam M. Shanechi