English
Related papers

Related papers: Prediction Loss Guided Decision-Focused Learning

200 papers

Decentralized federated learning (DFL) enables edge devices to collaboratively train models through local training and fully decentralized device-to-device (D2D) model exchanges. However, these energy-intensive operations often rapidly…

Machine Learning · Computer Science 2026-02-17 Kai Zhang , Xuanyu Cao , Khaled B. Letaief

Federated Learning enables collaborative model training across decentralized data sources without data transfer. Averaging-based FL is limited by the presence of non-IID data, which negatively impacts convergence speed and final model…

Machine Learning · Computer Science 2026-05-22 Adda Akram Bendoukha , Heber Hwang Arcolezi , Nesrine Kaaniche , Aymen Boudguiga

Federated learning is a method of training a global model from decentralized data distributed across client devices. Here, model parameters are computed locally by each client device and exchanged with a central server, which aggregates the…

Machine Learning · Computer Science 2020-12-23 Sagar Dhakal , Saurav Prakash , Yair Yona , Shilpa Talwar , Nageen Himayat

Task Free online continual learning (TF-CL) is a challenging problem where the model incrementally learns tasks without explicit task information. Although training with entire data from the past, present as well as future is considered as…

Machine Learning · Computer Science 2024-02-20 Byung Hyun Lee , Min-hwan Oh , Se Young Chun

Most decision-focused learning work has focused on single stage problems whereas many real-world decision problems are more appropriately modelled using multistage optimisation. In multistage problems contextual information is revealed over…

Optimization and Control · Mathematics 2025-05-29 Egon Peršak , Miguel F. Anjos

This paper studies the performative prediction problem where a learner aims to minimize the expected loss with a decision-dependent data distribution. Such setting is motivated when outcomes can be affected by the prediction model, e.g., in…

Optimization and Control · Mathematics 2024-05-24 Haitong Liu , Qiang Li , Hoi-To Wai

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

To preserve the data privacy, the federated learning (FL) paradigm emerges in which clients only expose model gradients rather than original data for conducting model training. To enhance the protection of model gradients in FL,…

Machine Learning · Computer Science 2024-08-19 Jiating Ma , Yipeng Zhou , Qi Li , Quan Z. Sheng , Laizhong Cui , Jiangchuan Liu

Deterministic neural nets have been shown to learn effective predictors on a wide range of machine learning problems. However, as the standard approach is to train the network to minimize a prediction loss, the resultant model remains…

Machine Learning · Computer Science 2018-11-02 Murat Sensoy , Lance Kaplan , Melih Kandemir

Federated learning (FL) triggers intra-client and inter-client class imbalance, with the latter compared to the former leading to biased client updates and thus deteriorating the distributed models. Such a bias is exacerbated during the…

Machine Learning · Computer Science 2024-12-24 Chenguang Xiao , Zheming Zuo , Shuo Wang

Formulating real-world optimization problems often begins with making predictions from historical data (e.g., an optimizer that aims to recommend fast routes relies upon travel-time predictions). Typically, learning the prediction model…

Machine Learning · Computer Science 2021-12-20 Chris Cameron , Jason Hartford , Taylor Lundy , Kevin Leyton-Brown

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

Deep learning has achieved impressive performance on many tasks in recent years. However, it has been found that it is still not enough for deep neural networks to provide only point estimates. For high-risk tasks, we need to assess the…

Machine Learning · Computer Science 2021-04-28 Yuandu Lai , Yucheng Shi , Yahong Han , Yunfeng Shao , Meiyu Qi , Bingshuai Li

Traditional Federated Learning (FL) methods encounter significant challenges when dealing with heterogeneous data and providing personalized solutions for non-IID scenarios. Personalized Federated Learning (PFL) approaches aim to address…

Machine Learning · Computer Science 2025-11-11 Yasaman Saadati , Mohammad Rostami , M. Hadi Amini

We consider a federated learning (FL) system consisting of multiple clients and a server, where the clients aim to collaboratively learn a common decision model from their distributed data. Unlike the conventional FL framework that assumes…

Machine Learning · Computer Science 2023-05-10 Kun Jin , Tongxin Yin , Zhongzhu Chen , Zeyu Sun , Xueru Zhang , Yang Liu , Mingyan Liu

Iterative methods such as iterative closest point (ICP) for point cloud registration often suffer from bad local optimality (e.g. saddle points), due to the nature of nonconvex optimization. To address this fundamental challenge, in this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Ziming Zhang , Yuping Shao , Yiqing Zhang , Fangzhou Lin , Haichong Zhang , Elke Rundensteiner

Decentralized Federated Learning (DFL) is an emerging paradigm that enables collaborative model training without centralized data and model aggregation, enhancing privacy and resilience. However, its sustainability remains underexplored, as…

Computers and Society · Computer Science 2025-09-09 Chao Feng , Alberto Huertas Celdrán , Xi Cheng , Gérôme Bovet , Burkhard Stiller

Federated learning (FL) is an emerging privacy-preserving paradigm that enables multiple participants collaboratively to train a global model without uploading raw data. Considering heterogeneous computing and communication capabilities of…

Machine Learning · Computer Science 2022-03-03 Zihao Zhou , Yanan Li , Xuebin Ren , Shusen Yang

Federated Learning (FL) is a widespread and well-adopted paradigm of decentralised learning that allows training one model from multiple sources without the need to transfer data between participating clients directly. Since its inception…

Machine Learning · Computer Science 2025-09-03 Maciej Krzysztof Zuziak , Roberto Pellungrini , Salvatore Rinzivillo

Continual learning (CL) presents a fundamental challenge in training neural networks on sequential tasks without experiencing catastrophic forgetting. Traditionally, the dominant approach in CL has been gradient-based optimization, where…

Machine Learning · Computer Science 2025-04-03 Grzegorz Rypeść