English
Related papers

Related papers: Online Decision-Focused Learning

200 papers

We study the problem of online learning (OL) from revealed preferences: a learner wishes to learn a non-strategic agent's private utility function through observing the agent's utility-maximizing actions in a changing environment. We adopt…

Optimization and Control · Mathematics 2021-06-07 Violet Xinying Chen , Fatma Kılınç-Karzan

The emerging machine learning paradigm of decentralized federated learning (DFL) has the promise of greatly boosting the deployment of artificial intelligence (AI) by directly learning across distributed agents without centralized…

Machine Learning · Computer Science 2024-08-12 Yudi Huang , Tingyang Sun , Ting He

We consider the general problem of learning a predictor that satisfies multiple objectives of interest simultaneously, a broad framework that captures a range of specific learning goals including calibration, regret, and multiaccuracy. We…

Machine Learning · Computer Science 2026-02-17 Jivat Neet Kaur , Isaac Gibbs , Michael I. Jordan

In recent years, Federated Learning (FL) has gained relevance in training collaborative models without sharing sensitive data. Since its birth, Centralized FL (CFL) has been the most common approach in the literature, where a central entity…

Federated learning (FL) aims to train machine learning (ML) models collaboratively using decentralized data, bypassing the need for centralized data aggregation. Standard FL models often assume that all data come from the same unknown…

Machine Learning · Computer Science 2025-03-25 Wen Bai , Yi Wong , Xiao Qiao , Chin Pang Ho

The goal of an offline reinforcement learning (RL) algorithm is to learn optimal polices using historical (offline) data, without access to the environment for online exploration. One of the main challenges in offline RL is the distribution…

Machine Learning · Computer Science 2023-10-31 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

Decentralized federated learning (DFL) is an emerging paradigm to enable edge devices collaboratively training a learning model using a device-to-device (D2D) communication manner without the coordination of a parameter server (PS).…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Zhiyuan Zhai , Xiaojun Yuan , Xin Wang , Geoffrey Ye Li

In recent years, different types of distributed and parallel learning schemes have received increasing attention for their strong advantages in handling large-scale data information. In the information era, to face the big data challenges…

Machine Learning · Statistics 2024-07-23 Zhan Yu , Jun Fan , Zhongjie Shi , Ding-Xuan Zhou

This paper investigates the problem of online prediction learning, where learning proceeds continuously as the agent interacts with an environment. The predictions made by the agent are contingent on a particular way of behaving,…

Machine Learning · Computer Science 2018-11-08 Sina Ghiassian , Andrew Patterson , Martha White , Richard S. Sutton , Adam White

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

The goal in offline data-driven decision-making is synthesize decisions that optimize a black-box utility function, using a previously-collected static dataset, with no active interaction. These problems appear in many forms: offline…

Machine Learning · Computer Science 2022-11-28 Han Qi , Yi Su , Aviral Kumar , Sergey Levine

Decentralized federated learning (DFL) is a collaborative machine learning framework for training a model across participants without a central server or raw data exchange. DFL faces challenges due to statistical heterogeneity, as…

Machine Learning · Computer Science 2025-06-16 Gabriel Thompson , Kai Yue , Chau-Wai Wong , Huaiyu Dai

Decentralized federated learning (DFL) enables edge devices to collaboratively train models through local training and fully decentralized device-to-device (D2D) model exchanges. However, these energy-intensive operations often rapidly…

Machine Learning · Computer Science 2026-02-17 Kai Zhang , Xuanyu Cao , Khaled B. Letaief

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

Machine Learning · Computer Science 2021-12-16 Xiaoxuan Wang , Rolf Stadler

Federated learning (FL) is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. One central server is not enough, due to…

Performative prediction is a framework that captures distribution shifts that occur during the training of machine learning models due to their deployment. As the trained model is used, data generation causes the model to evolve, leading to…

Machine Learning · Computer Science 2025-11-10 Xue Zheng , Tian Xie , Xuwei Tan , Aylin Yener , Xueru Zhang

Federated Learning (FL) is a distributed machine learning (ML) paradigm, aiming to train a global model by exploiting the decentralized data across millions of edge devices. Compared with centralized learning, FL preserves the clients'…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-15 Bocheng Chen , Nikolay Ivanov , Guangjing Wang , Qiben Yan

Recently, several universal methods have been proposed for online convex optimization which can handle convex, strongly convex and exponentially concave cost functions simultaneously. However, most of these algorithms have been designed…

Machine Learning · Computer Science 2023-02-14 Arnold Salas

Offline Reinforcement Learning (RL) is structured to derive policies from static trajectory data without requiring real-time environment interactions. Recent studies have shown the feasibility of framing offline RL as a sequence modeling…

Machine Learning · Computer Science 2023-09-01 Abdelghani Ghanem , Philippe Ciblat , Mounir Ghogho

Fairness is a central pillar of trustworthy machine learning, especially in domains where accuracy- or profit-driven optimization is insufficient. While most fairness research focuses on supervised learning, fairness in policy learning…

Machine Learning · Statistics 2026-02-11 Zeyu Bian , Lan Wang , Chengchun Shi , Zhengling Qi