English
Related papers

Related papers: Mechanism Design for LLM Fine-tuning with Multiple…

200 papers

We investigate the mechanism design problem faced by a principal who hires \emph{multiple} agents to gather and report costly information. Then, the principal exploits the information to make an informed decision. We model this problem as a…

Computer Science and Game Theory · Computer Science 2023-07-13 Federico Cacciamani , Matteo Castiglioni , Nicola Gatti

Aligning large language models (LLMs) with human preferences through reinforcement learning (RLHF) can lead to reward hacking, where LLMs exploit failures in the reward model (RM) to achieve seemingly high rewards without meeting the…

Machine Learning · Computer Science 2024-01-23 Alexandre Ramé , Nino Vieillard , Léonard Hussenot , Robert Dadashi , Geoffrey Cideron , Olivier Bachem , Johan Ferret

Designing effective auxiliary rewards for cooperative multi-agent systems remains challenging, as misaligned incentives can induce suboptimal coordination, particularly when sparse task rewards provide insufficient grounding for coordinated…

Machine Learning · Computer Science 2026-04-07 Dogan Urgun , Gokhan Gungor

Although Deep Reinforcement Learning (DRL) has achieved notable success in numerous robotic applications, designing a high-performing reward function remains a challenging task that often requires substantial manual input. Recently, Large…

Robotics · Computer Science 2023-10-03 Jiayang Song , Zhehua Zhou , Jiawei Liu , Chunrong Fang , Zhan Shu , Lei Ma

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Code-generating Large Language Models (LLMs) have become essential tools in modern software development, enhancing productivity and accelerating development. This paper aims to investigate the fine-tuning of code-generating LLMs using…

Software Engineering · Computer Science 2025-05-06 Marina Sakharova , Abhinav Anand , Mira Mezini

Recent months have seen the emergence of a powerful new trend in which large language models (LLMs) are augmented to become autonomous language agents capable of performing objective oriented multi-step tasks on their own, rather than…

Reward Models (RMs) are crucial for online alignment of language models (LMs) with human preferences. However, RM-based preference-tuning is vulnerable to reward hacking, whereby LM policies learn undesirable behaviors from flawed RMs. By…

Computation and Language · Computer Science 2026-03-05 Daniel Fein , Max Lamparth , Violet Xiang , Mykel J. Kochenderfer , Nick Haber

Directly training Large Language Models (LLMs) for Multi-Agent Systems (MAS) remains challenging due to intricate reward modeling, dynamic agent interactions, and demanding generalization requirements. This paper explores whether…

Artificial Intelligence · Computer Science 2025-06-03 Yufa Zhou , Shaobo Wang , Xingyu Dong , Xiangqi Jin , Yifang Chen , Yue Min , Kexin Yang , Xingzhang Ren , Dayiheng Liu , Linfeng Zhang

When we design and deploy an Reinforcement Learning (RL) agent, reward functions motivates agents to achieve an objective. An incorrect or incomplete specification of the objective can result in behavior that does not align with human…

Artificial Intelligence · Computer Science 2024-06-03 Zhaoyue Wang

Large language models (LLMs) excel in tasks like question answering and dialogue, but complex tasks requiring interaction, such as negotiation and persuasion, require additional long-horizon reasoning and planning. Reinforcement learning…

Computation and Language · Computer Science 2025-12-04 Joey Hong , Anca Dragan , Sergey Levine

This paper addresses the challenge of aligning large language models (LLMs) with diverse human preferences within federated learning (FL) environments, where standard methods often fail to adequately represent diverse viewpoints. We…

Computation and Language · Computer Science 2025-12-17 Mahmoud Srewa , Tianyu Zhao , Salma Elmalaki

Multimodal Large Language Models (MLLMs) already achieve state-of-the-art results across a wide range of tasks and modalities. To push their reasoning ability further, recent studies explore advanced prompting schemes and post-training…

Artificial Intelligence · Computer Science 2025-09-09 Zhenyu Pan , Yutong Zhang , Jianshu Zhang , Haoran Lu , Haozheng Luo , Yuwei Han , Philip S. Yu , Manling Li , Han Liu

The aggregation of conflicting preferences is a central problem in multiagent systems. The key difficulty is that the agents may report their preferences insincerely. Mechanism design is the art of designing the rules of the game so that…

Computer Science and Game Theory · Computer Science 2014-08-08 Vincent Conitzer , Tuomas Sandholm

Bilateral bargaining under incomplete information provides a controlled testbed for evaluating large language model (LLM) agent capabilities. Bilateral trade demands individual rationality, strategic surplus maximization, and cooperation to…

Computer Science and Game Theory · Computer Science 2026-04-21 Dirk Bergemann , Soheil Ghili , Xinyang Hu , Chuanhao Li , Zhuoran Yang

The aggregation of conflicting preferences is a central problem in multiagent systems. The key difficulty is that the agents may report their preferences insincerely. Mechanism design is the art of designing the rules of the game so that…

Computer Science and Game Theory · Computer Science 2007-05-23 Vincent Conitzer , Tuomas Sandholm

Reinforcement Learning (RL) in games has gained significant momentum in recent years, enabling the creation of different agent behaviors that can transform a player's gaming experience. However, deploying RL agents in production…

Artificial Intelligence · Computer Science 2025-07-01 António Afonso , Iolanda Leite , Alessandro Sestini , Florian Fuchs , Konrad Tollmar , Linus Gisslén

In a multi-party machine learning system, different parties cooperate on optimizing towards better models by sharing data in a privacy-preserving way. A major challenge in learning is the incentive issue. For example, if there is…

Multiagent Systems · Computer Science 2020-08-11 Mengjing Chen , Yang Liu , Weiran Shen , Yiheng Shen , Pingzhong Tang , Qiang Yang

Large Language Models (LLMs) often generate substantively relevant content but fail to adhere to formal constraints, leading to outputs that are conceptually correct but procedurally flawed. Traditional prompt refinement approaches focus on…

Artificial Intelligence · Computer Science 2026-01-08 Alberto Purpura , Li Wang , Sahil Badyal , Eugenio Beaufrand , Adam Faulkner

Designing reward functions for continuous-control robotics often leads to subtle misalignments or reward hacking, especially in complex tasks. Preference-based RL mitigates some of these pitfalls by learning rewards from comparative…

Artificial Intelligence · Computer Science 2025-03-19 Anukriti Singh , Amisha Bhaskar , Peihong Yu , Souradip Chakraborty , Ruthwik Dasyam , Amrit Bedi , Pratap Tokekar