English
Related papers

Related papers: FineFT: Efficient and Risk-Aware Ensemble Reinforc…

200 papers

We investigate portfolio optimization in financial markets from a trading and risk management perspective. We term this task Risk-Aware Trading Portfolio Optimization (RATPO), formulate the corresponding optimization problem, and propose an…

Risk Management · Quantitative Finance 2025-03-07 Marco Bianchetti , Gabriele D'Acunto , Gianmarco De Francisci Morales , Yuko Kuroki , Marco Scaringi , Fabio Vitale

Federated learning (FL) enables collaborative model training across distributed devices while preserving data privacy, but deployment on resource-constrained edge nodes remains challenging due to limited memory, energy, and communication…

Machine Learning · Computer Science 2026-03-25 Irene Tenison , Anna Murphy , Charles Beauville , Lalana Kagal

This paper proposes a reinforcement learning-based framework for optimizing the operation of electric arc furnaces (EAFs) under volatile electricity prices. We formulate the deterministic version of the EAF scheduling problem into a…

Systems and Control · Electrical Eng. & Systems 2025-12-11 Ruonan Pi , Zhiyuan Fan , Bolun Xu

Ensuring safety is a critical challenge in applying Reinforcement Learning (RL) to real-world scenarios. Constrained Reinforcement Learning (CRL) addresses this by maximizing returns under predefined constraints, typically formulated as the…

Machine Learning · Computer Science 2026-01-21 Shiqing Gao , Yihang Zhou , Shuai Shao , Haoyu Luo , Yiheng Bing , Jiaxin Ding , Luoyi Fu , Xinbing Wang

In the 5G era and beyond, it is favorable to deploy latency-sensitive and reliability-aware services on edge computing networks in which the computing and network resources are more limited compared to cloud and core networks but can…

Networking and Internet Architecture · Computer Science 2024-08-29 Congzhou Li , Zhouxiang Wu , Divya Khanure , Jason P. Jue

Parameter-efficient fine-tuning (PEFT) methods typically assume that Large Language Models (LLMs) are trained on data from a single device or client. However, real-world scenarios often require fine-tuning these models on private data…

Machine Learning · Computer Science 2025-06-03 Sajjad Ghiasvand , Yifan Yang , Zhiyu Xue , Mahnoosh Alizadeh , Zheng Zhang , Ramtin Pedarsani

Despite the massive success of fine-tuning Pre-trained Language Models (PLMs), they remain susceptible to out-of-distribution input. Dataset cartography is a simple yet effective dual-model approach that improves the robustness of…

Computation and Language · Computer Science 2024-12-12 Yupei Du , Albert Gatt , Dong Nguyen

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

Machine Learning · Computer Science 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan

Federated learning is vulnerable to poisoning and backdoor attacks under partial observability. We formulate defence as a partially observable sequential decision problem and introduce a trust-aware Deep Q-Network that integrates…

Machine Learning · Computer Science 2025-10-03 Vedant Palit

Value-based reinforcement learning (RL) can in principle learn effective policies for a wide range of multi-turn problems, from games to dialogue to robotic control, including via offline RL from static previously collected datasets.…

Machine Learning · Computer Science 2024-11-28 Joey Hong , Anca Dragan , Sergey Levine

Federated learning (FL) enables edge-devices to collaboratively learn a model without disclosing their private data to a central aggregating server. Most existing FL algorithms require models of identical architecture to be deployed across…

Machine Learning · Computer Science 2022-04-28 Yae Jee Cho , Andre Manoel , Gauri Joshi , Robert Sim , Dimitrios Dimitriadis

Recent advances in joint audio-video generation have been remarkable, yet real-world applications demand strong per-modality fidelity, cross-modal alignment, and fine-grained synchronization. Reinforcement Learning (RL) offers a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Guohui Zhang , XiaoXiao Ma , Jie Huang , Hang Xu , Hu Yu , Siming Fu , Yuming Li , Zeyue Xue , Lin Song , Haoyang Huang , Nan Duan , Feng Zhao

The growing literature of Federated Learning (FL) has recently inspired Federated Reinforcement Learning (FRL) to encourage multiple agents to federatively build a better decision-making policy without sharing raw trajectories. Despite its…

Machine Learning · Computer Science 2022-11-04 Flint Xiaofeng Fan , Yining Ma , Zhongxiang Dai , Wei Jing , Cheston Tan , Bryan Kian Hsiang Low

Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the…

Machine Learning · Computer Science 2021-09-30 Wenjing Li , Randy C. Paffenroth , David Berthiaume

The trade off between risks and returns gives rise to multi-criteria optimisation problems that are well understood in finance, efficient frontiers being the tool to navigate their set of optimal solutions. Motivated by the recent advances…

Computational Finance · Quantitative Finance 2021-04-13 Zheng Gong , Carmine Ventre , John O'Hara

Reinforcement learning agents for portfolio management are typically trained and deployed as static policies, with no mechanism for using price forecasts at inference time. We propose $\text{FPILOT}$ (**Fin**ancial **P**lugin…

Machine Learning · Computer Science 2026-05-14 Eun Go , Rohan Deb , Arindam Banerjee

While many algorithmic extensions to Deep Q-Networks (DQN) have been proposed, there remains limited understanding of how different improvements interact. In particular, multi-step and ensemble style extensions have shown promise in…

Machine Learning · Computer Science 2025-06-09 Adrian Ly , Richard Dazeley , Peter Vamplew , Francisco Cruz , Sunil Aryal

Parameter-Efficient Fine-Tuning (PEFT) methods like Low-Rank Adaptation (LoRA) optimize federated training by reducing computational and communication costs. We propose RoLoRA, a federated framework using alternating optimization to…

Machine Learning · Computer Science 2025-11-06 Shuangyi Chen , Yuanxin Guo , Yue Ju , Harik Dalal , Zhongwen Zhu , Ashish Khisti

Quantum Federated Learning (QFL) inherits the core vulnerability of federated optimization to malicious clients, while also introducing an attack surface from variational circuit training and measurement-driven gradients. This work proposes…

Quantum Physics · Physics 2026-05-28 Aakar Mathur , Mohammed Ruknuddin , Ashish Gupta

Reinforcement learning (RL) can be used to create a decision-making agent for autonomous driving. However, previous approaches provide only black-box solutions, which do not offer information on how confident the agent is about its…

Robotics · Computer Science 2023-04-18 Carl-Johan Hoel , Krister Wolff , Leo Laine