English
Related papers

Related papers: Foundation Model Self-Play: Open-Ended Strategy In…

200 papers

Enhancing the diversity of policies is beneficial for robustness, exploration, and transfer in reinforcement learning (RL). In this paper, we aim to seek diverse policies in an under-explored setting, namely RL tasks with structured action…

Machine Learning · Computer Science 2023-02-24 Wenhao Li , Baoxiang Wang , Shanchao Yang , Hongyuan Zha

This work considers a repeated principal-agent bandit game, where the principal can only interact with her environment through the agent. The principal and the agent have misaligned objectives and the choice of action is only left to the…

Multi-agent games in dynamic nonlinear settings are challenging due to the time-varying interactions among the agents and the non-stationarity of the (potential) Nash equilibria. In this paper we consider model-free games, where agent…

Systems and Control · Electrical Eng. & Systems 2025-09-24 Eduardo Sebastián , Maitrayee Keskar , Eeman Iqbal , Eduardo Montijano , Carlos Sagüés , Nikolay Atanasov

Natural language processing (NLP) sees rich mobile applications. To support various language understanding tasks, a foundation NLP model is often fine-tuned in a federated, privacy-preserving setting (FL). This process currently relies on…

Machine Learning · Computer Science 2023-08-22 Dongqi Cai , Shangguang Wang , Yaozong Wu , Felix Xiaozhu Lin , Mengwei Xu

In federated learning, benign participants aim to optimize a global model collaboratively. However, the risk of \textit{privacy leakage} cannot be ignored in the presence of \textit{semi-honest} adversaries. Existing research has focused…

Machine Learning · Computer Science 2024-02-29 Xiaojin Zhang , Lixin Fan , Siwei Wang , Wenjie Li , Kai Chen , Qiang Yang

One important direction of Federated Foundation Models (FedFMs) is leveraging data from small client models to enhance the performance of a large server-side foundation model. Existing methods based on model level or representation level…

Machine Learning · Computer Science 2026-02-13 Gongxi Zhu , Hanlin Gu , Lixin Fan , Qiang Yang , Yuxing Han

Multi-agent reinforcement learning (MARL) has become effective in tackling discrete cooperative game scenarios. However, MARL has yet to penetrate settings beyond those modelled by team and zero-sum games, confining it to a small subset of…

Multiagent Systems · Computer Science 2021-06-16 David Mguni , Yutong Wu , Yali Du , Yaodong Yang , Ziyi Wang , Minne Li , Ying Wen , Joel Jennings , Jun Wang

Multi-agent Pathfinding (MAPF) problem generally asks to find a set of conflict-free paths for a set of agents confined to a graph and is typically solved in a centralized fashion. Conversely, in this work, we investigate the decentralized…

Artificial Intelligence · Computer Science 2023-10-03 Alexey Skrynnik , Anton Andreychuk , Maria Nesterova , Konstantin Yakovlev , Aleksandr Panov

Website Fingerprinting (WFP) uses deep learning models to classify encrypted network traffic to infer visited websites. While historically effective, prior methods fail to generalize to modern web environments. Single-page applications…

Cryptography and Security · Computer Science 2025-09-17 Chuxu Song , Dheekshith Dev Manohar Mekala , Hao Wang , Richard Martin

Fine-tuning foundation models is critical for superior performance on personalized downstream tasks, compared to using pre-trained models. Collaborative learning can leverage local clients' datasets for fine-tuning, but limited client data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Tianjun Yuan , Jiaxiang Geng , Pengchao Han , Xianhao Chen , Bing Luo

We consider a setting involving $N$ agents, where each agent interacts with an environment modeled as a Markov Decision Process (MDP). The agents' MDPs differ in their reward functions, capturing heterogeneous objectives/tasks. The…

Machine Learning · Computer Science 2024-09-10 Feng Zhu , Robert W. Heath , Aritra Mitra

Optimization of deep learning algorithms to approach Nash Equilibrium remains a significant problem in imperfect information games, e.g. StarCraft and poker. Neural Fictitious Self-Play (NFSP) has provided an effective way to learn…

Artificial Intelligence · Computer Science 2021-04-23 Yuxuan Chen , Li Zhang , Shijian Li , Gang Pan

Modeling latent character states is crucial for consistent and engaging role-playing (RP) with large language models (LLMs). Yet, existing prompting-based approaches mainly capture surface actions, often failing to track the latent states…

Computation and Language · Computer Science 2026-02-06 Letian Peng , Yupeng Hou , Kun Zhou , Jingbo Shang

We present a generative optimization approach for learning game-playing agents, where policies are represented as Python programs and refined using large language models (LLMs). Our method treats decision-making policies as self-evolving…

Machine Learning · Computer Science 2025-08-28 Zhiyi Kuang , Ryan Rong , YuCheng Yuan , Allen Nie

This paper addresses a variant of multi-agent path finding (MAPF) in continuous space and time. We present a new solving approach based on satisfiability modulo theories (SMT) to obtain makespan optimal solutions. The standard MAPF is a…

Artificial Intelligence · Computer Science 2019-03-26 Pavel Surynek

The foundation models (FMs) have been used to generate synthetic public datasets for the heterogeneous federated learning (HFL) problem where each client uses a unique model architecture. However, the vulnerabilities of integrating FMs,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-01 Xi Li , Chen Wu , Jiaqi Wang

AlphaZero-type algorithms may stop improving on single-player tasks in case the value network guiding the tree search is unable to approximate the outcome of an episode sufficiently well. One technique to address this problem is…

Machine Learning · Computer Science 2023-06-08 Jonathan Pirnay , Quirin Göttl , Jakob Burger , Dominik Gerhard Grimm

Federated Learning (FL), while a breakthrough in decentralized machine learning, contends with significant challenges such as limited data availability and the variability of computational resources, which can stifle the performance and…

Machine Learning · Computer Science 2025-10-07 Jiaqi Wang , Xi Li

The advent of large language models (LLMs) has catalyzed a transformative shift in artificial intelligence, paving the way for advanced intelligent agents capable of sophisticated reasoning, robust perception, and versatile action across…

Recent tabular Foundational Models (FM) such as TabPFN and TabICL, leverage in-context learning to achieve strong performance without gradient updates or fine-tuning. However, their robustness to adversarial manipulation remains largely…

Machine Learning · Computer Science 2026-04-10 Mohamed Djilani , Thibault Simonetto , Karim Tit , Florian Tambon , Salah Ghamizi , Maxime Cordy , Mike Papadakis