English
Related papers

Related papers: Collaborative Value Function Estimation Under Mode…

200 papers

Temporal difference (TD) learning is one of the main foundations of modern reinforcement learning. This paper studies the use of TD(0), a canonical TD algorithm, to estimate the value function of a given policy from a batch of data. In this…

Machine Learning · Computer Science 2020-08-18 Brahma Pavse , Ishan Durugkar , Josiah Hanna , Peter Stone

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

Machine Learning · Computer Science 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan

Reinforcement learning works best when the impact of the agent's actions on its environment can be perfectly simulated or fully appraised from available data. Some systems are however both hard to simulate and very sensitive to small…

Trading and Market Microstructure · Quantitative Finance 2025-01-30 Vincent Ragel , Damien Challet

Federated Learning (FL) has emerged as a significant paradigm for training machine learning models. This is due to its data-privacy-preserving property and its efficient exploitation of distributed computational resources. This is achieved…

Machine Learning · Computer Science 2025-01-22 Mustafa Ghaleb , Mohanad Obeed , Muhamad Felemban , Anas Chaaban , Halim Yanikomeroglu

In the beyond 5G era, AI/ML empowered realworld digital twins (DTs) will enable diverse network operators to collaboratively optimize their networks, ultimately improving end-user experience. Although centralized AI-based learning…

Networking and Internet Architecture · Computer Science 2025-11-05 Saroj Kumar Panda , Tania Panayiotou , Georgios Ellinas , Sadananda Behera

Reinforcement Learning (RL) agents deployed in real-world environments face degradation from sensor faults, actuator wear, and environmental shifts, yet lack intrinsic mechanisms to detect and diagnose these failures. We present an…

Artificial Intelligence · Computer Science 2025-09-15 Cameron Reid , Wael Hafez , Amirhossein Nazeri

Federated learning (FL) is a distributed machine learning approach involving multiple clients collaboratively training a shared model. Such a system has the advantage of more training data from multiple clients, but data can be…

Machine Learning · Computer Science 2021-08-24 Sone Kyaw Pye , Han Yu

Traditional distributed deep reinforcement learning (RL) commonly relies on exchanging the experience replay memory (RM) of each agent. Since the RM contains all state observations and action policy history, it may incur huge communication…

Machine Learning · Computer Science 2020-05-18 Han Cha , Jihong Park , Hyesung Kim , Mehdi Bennis , Seong-Lyun Kim

State-of-the-art meta reinforcement learning algorithms typically assume the setting of a single agent interacting with its environment in a sequential manner. A negative side-effect of this sequential execution paradigm is that, as the…

Artificial Intelligence · Computer Science 2019-03-08 Emilio Parisotto , Soham Ghosh , Sai Bhargav Yalamanchi , Varsha Chinnaobireddy , Yuhuai Wu , Ruslan Salakhutdinov

Motivated by the high resource costs and privacy concerns associated with centralized machine learning, federated learning (FL) has emerged as an efficient alternative that enables clients to collaboratively train a global model while…

Machine Learning · Computer Science 2025-09-10 Yiyue Chen , Usman Akram , Chianing Wang , Haris Vikalo

In this work we describe a novel deep reinforcement learning architecture that allows multiple actions to be selected at every time-step in an efficient manner. Multi-action policies allow complex behaviours to be learnt that would…

Artificial Intelligence · Computer Science 2018-09-07 Jack Harmer , Linus Gisslén , Jorge del Val , Henrik Holst , Joakim Bergdahl , Tom Olsson , Kristoffer Sjöö , Magnus Nordin

Federated learning (FL) allows machine learning models to be trained on distributed datasets without directly accessing local data. In FL markets, numerous Data Consumers compete to recruit Data Owners for their respective training tasks,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-27 Zhuan Shi , Patrick Ohl , Boi Faltings

Federated Learning (FL) enables numerous participants to train deep learning models collaboratively without exposing their personal, potentially sensitive data, making it a promising solution for data privacy in collaborative training. The…

Cryptography and Security · Computer Science 2022-06-02 Manaar Alam , Esha Sarkar , Michail Maniatakos

In multi-vehicle cooperative driving tasks involving high-frequency continuous control, traditional state-based reward functions suffer from the issue of vanishing reward differences. This phenomenon results in a low signal-to-noise ratio…

Artificial Intelligence · Computer Science 2025-11-24 Ye Han , Lijun Zhang , Dejian Meng , Zhuang Zhang

Federated learning (FL) allows multiple clients to collectively train a high-performance global model without sharing their private data. However, the key challenge in federated learning is that the clients have significant statistical…

Machine Learning · Computer Science 2022-03-23 Liang Gao , Huazhu Fu , Li Li , Yingwen Chen , Ming Xu , Cheng-Zhong Xu

Cooperative perception is essential to enhance the efficiency and safety of future transportation systems, requiring extensive data sharing among vehicles on the road, which raises significant privacy concerns. Federated learning offers a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhenrong Zhang , Jianan Liu , Xi Zhou , Tao Huang , Qing-Long Han , Jingxin Liu , Hongbin Liu

Repeated parameter sharing in federated learning causes significant information leakage about private data, thus defeating its main purpose: data privacy. Mitigating the risk of this information leakage, using state of the art…

Machine Learning · Computer Science 2023-09-12 Zebang Shen , Jiayuan Ye , Anmin Kang , Hamed Hassani , Reza Shokri

Federated Inference (FI) studies how independently trained and privately owned models can collaborate at inference time without sharing data or model parameters. While recent work has explored secure and distributed inference from disparate…

Artificial Intelligence · Computer Science 2026-03-05 Jungwon Seo , Ferhat Ozgur Catak , Chunming Rong , Jaeyeon Jang

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

Machine Learning · Computer Science 2020-08-27 Dimitris Stripelis , Jose Luis Ambite

Federated learning (FL) has emerged as a promising paradigm that trains machine learning (ML) models on clients' devices in a distributed manner without the need of transmitting clients' data to the FL server. In many applications of ML,…

Machine Learning · Computer Science 2023-02-02 Yuxi Zhao , Xiaowen Gong , Shiwen Mao