English
Related papers

Related papers: Prediction Loss Guided Decision-Focused Learning

200 papers

Decision-focused learning (DFL) trains a machine learning (ML) model to predict parameters of an optimization problem, to directly minimize decision regret, i.e., maximize decision quality. Gradient-based DFL requires computing the…

Machine Learning · Computer Science 2025-08-26 Jayanta Mandi , Ali İrfan Mahmutoğulları , Senne Berden , Tias Guns

Decentralized federated learning (DFL) captures FL settings where both (i) model updates and (ii) model aggregations are exclusively carried out by the clients without a central server. Existing DFL works have mostly focused on settings…

Machine Learning · Computer Science 2025-03-07 Shahryar Zehtabi , Dong-Jun Han , Rohit Parasnis , Seyyedali Hosseinalipour , Christopher G. Brinton

In decision-making problems under uncertainty, predicting unknown parameters is often considered independent of the optimization part. Decision-focused learning (DFL) is a task-oriented framework that integrates prediction and optimization…

Machine Learning · Computer Science 2025-02-11 Haeun Jeon , Hyunglip Bae , Minsu Park , Chanyeong Kim , Woo Chang Kim

Personalized Federated Learning (PFL) is proposed to find the greatest personalized models for each client. To avoid the central failure and communication bottleneck in the server-based FL, we concentrate on the Decentralized Personalized…

Machine Learning · Computer Science 2024-05-29 Yingqi Liu , Yifan Shi , Qinglun Li , Baoyuan Wu , Xueqian Wang , Li Shen

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton

Decision Focused Learning has emerged as a critical paradigm for integrating machine learning with downstream optimisation. Despite its promise, existing methodologies predominantly rely on probabilistic models and focus narrowly on task…

Machine Learning · Computer Science 2025-03-21 Keivan Shariatmadar , Neil Yorke-Smith , Ahmad Osman , Fabio Cuzzolin , Hans Hallez , David Moens

Federated Learning (FL) is a decentralized approach for collaborative model training on edge devices. This distributed method of model training offers advantages in privacy, security, regulatory compliance, and cost-efficiency. Our emphasis…

Machine Learning · Computer Science 2024-10-24 Charuka Herath , Xiaolan Liu , Sangarapillai Lambotharan , Yogachandran Rahulamathavan

This paper presents a novel decision-focused framework integrating the physical energy storage model into machine learning pipelines. Motivated by the model predictive control for energy storage, our end-to-end method incorporates the prior…

Systems and Control · Electrical Eng. & Systems 2024-12-06 Ming Yi , Saud Alghumayjan , Bolun Xu

Federated Learning (FL) is a popular distributed learning paradigm to break down data silo. Traditional FL approaches largely rely on gradient-based updates, facing significant issues about heterogeneity, scalability, convergence, and…

We propose a novel family of decision-aware surrogate losses, called Perturbation Gradient (PG) losses, for the predict-then-optimize framework. The key idea is to connect the expected downstream decision loss with the directional…

Machine Learning · Computer Science 2024-11-01 Michael Huang , Vishal Gupta

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

Most existing federated learning methods are unable to estimate model/predictive uncertainty since the client models are trained using the standard loss function minimization approach which ignores such uncertainties. In many situations,…

Machine Learning · Computer Science 2023-10-03 Shrey Bhatt , Aishwarya Gupta , Piyush Rai

Performative prediction is a framework that captures distribution shifts that occur during the training of machine learning models due to their deployment. As the trained model is used, data generation causes the model to evolve, leading to…

Machine Learning · Computer Science 2025-11-10 Xue Zheng , Tian Xie , Xuwei Tan , Aylin Yener , Xueru Zhang

Federated learning (FL) is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. One central server is not enough, due to…

Fairness is a central pillar of trustworthy machine learning, especially in domains where accuracy- or profit-driven optimization is insufficient. While most fairness research focuses on supervised learning, fairness in policy learning…

Machine Learning · Statistics 2026-02-11 Zeyu Bian , Lan Wang , Chengchun Shi , Zhengling Qi

To support real-world decision-making, it is crucial for models to be well-calibrated, i.e., to assign reliable confidence estimates to their predictions. Uncertainty quantification is particularly important in personalized federated…

Machine Learning · Computer Science 2024-10-21 Boning Zhang , Dongzhu Liu , Osvaldo Simeone , Guanchu Wang , Dimitrios Pezaros , Guangxu Zhu

Federated Learning (FL) is a collaborative machine learning paradigm for training models on local sensitive data with privacy protection. Pre-trained transformer-based models have emerged as useful foundation models (FMs) to be fine-tuned…

Machine Learning · Computer Science 2025-06-24 Yuning Yang , Han Yu , Chuan Sun , Tianrun Gao , Xiaohong Liu , Xiaodong Xu , Ping Zhang , Guangyu Wang

Federated Learning (FL) has emerged as a new paradigm for training machine learning models distributively without sacrificing data security and privacy. Learning models on edge devices such as mobile phones is one of the most common use…

Machine Learning · Computer Science 2023-02-10 Sixing Yu , Phuong Nguyen , Ali Anwar , Ali Jannesari

Predict-then-Optimize (PTO) pipelines are widely employed in computing and networked systems, where Machine Learning (ML) models are used to predict critical contextual information for downstream decision-making tasks such as cloud LLM…

Machine Learning · Computer Science 2026-02-04 Jiaqi Wen , Lei Fan , Jianyi Yang