English
Related papers

Related papers: Corruption-robust Offline Multi-agent Reinforcemen…

200 papers

We address in this paper Reinforcement Learning (RL) among agents that are grouped into teams such that there is cooperation within each team but general-sum (non-zero sum) competition across different teams. To develop an RL method that…

Machine Learning · Computer Science 2025-02-11 Muhammad Aneeq uz Zaman , Alec Koppel , Mathieu Laurière , Tamer Başar

We study the problem of learning the optimal policy in a discounted, infinite-horizon reinforcement learning (RL) setting in the presence of adversarially corrupted rewards. To address this problem, we develop a novel robust variant of the…

Machine Learning · Computer Science 2026-05-22 Sreejeet Maity , Aritra Mitra

In multi-agent dynamic games, the Nash equilibrium state trajectory of each agent is determined by its cost function and the information pattern of the game. However, the cost and trajectory of each agent may be unavailable to the other…

Multiagent Systems · Computer Science 2023-01-05 Jingqi Li , Chih-Yuan Chiu , Lasse Peters , Somayeh Sojoudi , Claire Tomlin , David Fridovich-Keil

Classical multi-agent reinforcement learning (MARL) assumes risk neutrality and complete objectivity for agents. However, in settings where agents need to consider or model human economic or social preferences, a notion of risk must be…

Machine Learning · Computer Science 2024-02-09 Hafez Ghaemi , Hamed Kebriaei , Alireza Ramezani Moghaddam , Majid Nili Ahamdabadi

This paper studies optimal consensus tracking problem of heterogeneous linear multi-agent systems. By introducing tracking error dynamics, the optimal tracking problem is reformulated as finding a Nash-equilibrium solution of a multi-player…

Optimization and Control · Mathematics 2019-05-21 Jilie Zhang , Zhanshan Wang , Hongwei Zhang

We study linear contextual bandits under adversarial corruption and heavy-tailed noise with finite $(1+\epsilon)$-th moments for some $\epsilon \in (0,1]$. Existing work that addresses both adversarial corruption and heavy-tailed noise…

Machine Learning · Computer Science 2026-03-17 Naoto Tani , Futoshi Futami

Offline reinforcement learning (RL) aims to optimize a policy using collected data without online interactions. Model-based approaches are particularly appealing for addressing offline RL challenges because of their capability to mitigate…

Machine Learning · Computer Science 2026-04-14 Hao Li , Xiao-Hu Zhou , Shu-Hai Li , Mei-Jiang Gui , Xiao-Liang Xie , Shi-Qi Liu , Shuang-Yi Wang , Zhen-Qiu Feng , Zeng-Guang Hou

Neural Networks are sensitive to various corruptions that usually occur in real-world applications such as blurs, noises, low-lighting conditions, etc. To estimate the robustness of neural networks to these common corruptions, we generally…

Machine Learning · Computer Science 2021-05-27 Alfred Laugros , Alice Caplier , Matthieu Ospici

In modern transportation networks, adversaries can manipulate routing algorithms using false data injection attacks, such as simulating heavy traffic with multiple devices running crowdsourced navigation applications, to mislead vehicles…

Artificial Intelligence · Computer Science 2026-03-13 Taha Eghtesad , Yevgeniy Vorobeychik , Aron Laszka

We study offline meta-reinforcement learning, a practical reinforcement learning paradigm that learns from offline data to adapt to new tasks. The distribution of offline data is determined jointly by the behavior policy and the task.…

Machine Learning · Computer Science 2022-06-22 Haoqi Yuan , Zongqing Lu

In this paper, we address the inverse problem for linear-quadratic differential non-cooperative games with output-feedback. Given players' stabilizing feedback laws, the goal is to find cost function parameters that lead to a game for which…

Optimization and Control · Mathematics 2024-10-27 Emin Martirosyan , Ming Cao

Reinforcement learning from human feedback (RLHF) and direct preference optimization (DPO) are important techniques to align large language models (LLM) with human preference. However, the quality of RLHF and DPO training is seriously…

Machine Learning · Computer Science 2025-12-10 Ziyi Chen , Junyi Li , Peiran Yu , Heng Huang

The performance of graph representation learning is affected by the quality of graph input. While existing research usually pursues a globally smoothed graph embedding, we believe the rarely observed anomalies are as well harmful to an…

Machine Learning · Computer Science 2023-08-14 Bingxin Zhou , Yuanhong Jiang , Yu Guang Wang , Jingwei Liang , Junbin Gao , Shirui Pan , Xiaoqun Zhang

This work studies the parameter identification problem of a generalized non-cooperative game, where each player's cost function is influenced by an observable signal and some unknown parameters. We consider the scenario where equilibrium of…

Computer Science and Game Theory · Computer Science 2023-10-17 Jianguo Chen , Jinlong Lei , Hongsheng Qi , Yiguang Hong

Multi-agent large language model (LLM) architectures increasingly rely on response-level aggregation, such as Majority Voting (MAJ), to raise reasoning ceilings. However, in open environments, agents are highly susceptible to stealthy…

Computation and Language · Computer Science 2026-04-21 Jiayuan Liu , Shiyi Du , Weihua Du , Mingyu Guo , Vincent Conitzer

The presence of data corruption in user-generated streaming data, such as social media, motivates a new fundamental problem that learns reliable regression coefficient when features are not accessible entirely at one time. Until now,…

Machine Learning · Computer Science 2019-02-06 Xuchao Zhang , Shuo Lei , Liang Zhao , Arnold P. Boedihardjo , Chang-Tien Lu

Behavioral diversity, expert imitation, fairness, safety goals and others give rise to preferences in sequential decision making domains that do not decompose additively across time. We introduce the class of convex Markov games that allow…

Computer Science and Game Theory · Computer Science 2025-06-17 Ian Gemp , Andreas Haupt , Luke Marris , Siqi Liu , Georgios Piliouras

In this paper, we address the inverse problem in the case of linear-quadratic discrete-time dynamic non-cooperative games. Given feedback laws of players that are known to be a Nash equilibrium pair for a discrete-time linear system, we…

Optimization and Control · Mathematics 2024-07-19 Emin Martirosyan , Ming Cao

Consider a strongly monotone game where the players' utility functions include a reward function and a linear term for each dimension, with coefficients that are controlled by the manager. Gradient play converges to a unique Nash…

Multiagent Systems · Computer Science 2026-02-25 Siddharth Chandak , Ilai Bistritz , Nicholas Bambos

This paper considers the problem of Nash equilibrium (NE) seeking in aggregative games, where the payoff function of each player depends on an aggregate of all players' actions. We present a distributed continuous time algorithm such that…

Optimization and Control · Mathematics 2019-11-04 Mehran Shakarami , Claudio De Persis , Nima Monshizadeh