English
Related papers

Related papers: Improving performance in multi-objective decision-…

200 papers

The scaling law of Large Language Models (LLMs) reveals a power-law relationship, showing diminishing return on performance as model scale increases. While training LLMs from scratch is resource-intensive, fine-tuning a pre-trained model…

Computation and Language · Computer Science 2025-05-22 Yiyun Zhou , Chang Yao , Jingyuan Chen

We explore a Federated Reinforcement Learning (FRL) problem where $N$ agents collaboratively learn a common policy without sharing their trajectory data. To date, existing FRL work has primarily focused on agents operating in the same or…

Machine Learning · Computer Science 2024-06-03 Han Wang , Sihong He , Zhili Zhang , Fei Miao , James Anderson

Recent literature on fine-tuning Large Language Models highlights a fundamental debate. While Full Fine-Tuning (FFT) provides the representational plasticity required for high-entropy knowledge injection, Low-Rank Adaptation (LoRA) can…

Computation and Language · Computer Science 2026-05-19 Haozhan Tang , Xiuqi Zhu , Xinyin Zhang , Boxun Li , Virginia Smith , Kevin Kuo

Federated Learning (FL) is a novel, multidisciplinary Machine Learning paradigm where multiple clients, such as mobile devices, collaborate to solve machine learning problems. Initially introduced in Kone{\v{c}}n{\'y} et al. (2016a,b);…

Machine Learning · Computer Science 2025-09-11 Konstantin Burlachenko

Although adversarial training (AT) has proven effective in enhancing the model's robustness, the recently revealed issue of fairness in robustness has not been well addressed, i.e. the robust accuracy varies significantly among different…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Yanghao Zhang , Tianle Zhang , Ronghui Mu , Xiaowei Huang , Wenjie Ruan

Few-Shot Learning (FSL) algorithms are commonly trained through Meta-Learning (ML), which exposes models to batches of tasks sampled from a meta-dataset to mimic tasks seen during evaluation. However, the standard training procedures…

Machine Learning · Computer Science 2024-10-28 Mateusz Ochal , Massimiliano Patacchiola , Amos Storkey , Jose Vazquez , Sen Wang

The objective comparison of Reinforcement Learning (RL) algorithms is notoriously complex as outcomes and benchmarking of performances of different RL approaches are critically sensitive to environmental design, reward structures, and…

Machine Learning · Computer Science 2026-03-19 Sinan Ibrahim , Grégoire Ouerdane , Hadi Salloum , Henni Ouerdane , Stefan Streif , Pavel Osinenko

Federated edge learning (FEEL) is envisioned as a promising paradigm to achieve privacy-preserving distributed learning. However, it consumes excessive learning time due to the existence of straggler devices. In this paper, a novel…

Information Theory · Computer Science 2022-04-04 Shanfeng Huang , Zezhong Zhang , Shuai Wang , Rui Wang , Kaibin Huang

The objective of a reinforcement learning agent is to discover better actions through exploration. However, typical exploration techniques aim to maximize rewards, often incurring high costs in both exploration and learning processes. We…

Machine Learning · Computer Science 2024-12-24 Akane Tsuboya , Yu Kono , Tatsuji Takahashi

Adversarial inverse reinforcement learning (IRL) for multi-agent task allocation (MATA) is challenged by non-stationary interactions and high-dimensional coordination. Unconstrained reward inference in these settings often leads to high…

Machine Learning · Computer Science 2026-02-10 Huilin Yin , Zhikun Yang , Linchuan Zhang , Daniel Watzenig

Vision-Language-Action (VLA) models have demonstrated remarkable generalization capabilities in robotic manipulation tasks, yet their substantial computational overhead remains a critical obstacle to real-world deployment. Improving…

Robotics · Computer Science 2026-02-03 Yujie Wei , Jiahan Fan , Jiyu Guo , Ruichen Zhen , Rui Shao , Xiu Su , Zeke Xie , Shuo Yang

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

Split Learning (SL) is a promising collaborative machine learning approach, enabling resource-constrained devices to train models without sharing raw data, while reducing computational load and preserving privacy simultaneously. However,…

Machine Learning · Computer Science 2024-11-22 Yunrui Sun , Gang Hu , Yinglei Teng , Dunbo Cai

Few-shot learning (FSL) is a central problem in meta-learning, where learners must efficiently learn from few labeled examples. Within FSL, feature pre-training has recently become an increasingly popular strategy to significantly improve…

Machine Learning · Computer Science 2023-11-07 Ruohan Wang , Isak Falk , Massimiliano Pontil , Carlo Ciliberto

With the development of edge networks and mobile computing, the need to serve heterogeneous data sources at the network edge requires the design of new distributed machine learning mechanisms. As a prevalent approach, Federated Learning…

Machine Learning · Computer Science 2024-06-04 Yilin Zheng , Atilla Eryilmaz

Due to their adaptability and mobility, Unmanned Aerial Vehicles (UAVs) are becoming increasingly essential for wireless network services, particularly for data harvesting tasks. In this context, Artificial Intelligence (AI)-based…

Machine Learning · Computer Science 2026-01-21 Babacar Toure , Dimitrios Tsilimantos , Omid Esrafilian , Marios Kountouris

Federated Learning (FL) enables collaborative model training across decentralized clients, enhancing privacy by keeping data local. Yet conventional FL, relying on frequent parameter-sharing, suffers from high communication overhead and…

Machine Learning · Computer Science 2026-02-02 Kitsuya Azuma , Takayuki Nishio , Yuichi Kitagawa , Wakako Nakano , Takahito Tanimura

Safe reinforcement learning (RL) with hard constraint guarantees is a promising optimal control direction for multi-energy management systems. It only requires the environment-specific constraint functions itself a priori and not a complete…

Systems and Control · Electrical Eng. & Systems 2023-11-07 Glenn Ceusters , Muhammad Andy Putratama , Rüdiger Franke , Ann Nowé , Maarten Messagie

Inverse reinforcement learning (IRL) methods assume that the expert data is generated by an agent optimizing some reward function. However, in many settings, the agent may optimize a reward function subject to some constraints, where the…

Machine Learning · Computer Science 2023-05-01 Ashish Gaurav , Kasra Rezaee , Guiliang Liu , Pascal Poupart

As AI models expand in size, it has become increasingly challenging to deploy federated learning (FL) on resource-constrained edge devices. To tackle this issue, split federated learning (SFL) has emerged as an FL framework with reduced…

Machine Learning · Computer Science 2025-04-22 Zheng Lin , Wei Wei , Zhe Chen , Chan-Tong Lam , Xianhao Chen , Yue Gao , Jun Luo