English
Related papers

Related papers: Fairness Auditing with Multi-Agent Collaboration

200 papers

In a setting where heterogeneous agents interact to accomplish a given set of goals, cooperation is of utmost importance, especially when agents cannot achieve their individual goals by exclusive use of their own efforts. Even when we…

Multiagent Systems · Computer Science 2008-06-25 Ilker Yildirim , Haluk Bingol

Machine learning tasks may admit multiple competing models that achieve similar performance yet produce conflicting outputs for individual samples -- a phenomenon known as predictive multiplicity. We demonstrate that fairness interventions…

Machine Learning · Computer Science 2023-06-19 Carol Xuan Long , Hsiang Hsu , Wael Alghamdi , Flavio P. Calmon

Fairness research in machine learning often centers on ensuring equitable performance of individual models. However, real-world recommendation systems are built on multiple models and even multiple stages, from candidate retrieval to…

Artificial Intelligence · Computer Science 2025-01-03 Brian Hsu , Cyrus DiCiccio , Natesh Sivasubramoniapillai , Hongseok Namkoong

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

Collective or group intelligence is manifested in the fact that a team of cooperating agents can solve problems more efficiently than when those agents work in isolation. Although cooperation is, in general, a successful problem solving…

Multiagent Systems · Computer Science 2019-12-19 Sandro M. Reia , André C. Amado , José F. Fontanari

Multi-agent reinforcement learning (RL) has important implications for the future of human-agent teaming. We show that improved performance with multi-agent RL is not a guarantee of the collaborative behavior thought to be important for…

Multiagent Systems · Computer Science 2018-07-24 Sean L. Barton , Nicholas R. Waytowich , Erin Zaroukian , Derrik E. Asher

AI agents powered by large language models (LLMs) have shown strong capabilities in problem solving. Through combining many intelligent agents, multi-agent collaboration has emerged as a promising approach to tackle complex, multi-faceted…

Computation and Language · Computer Science 2024-12-10 Raphael Shu , Nilaksh Das , Michelle Yuan , Monica Sunkara , Yi Zhang

Recent years have seen the development of many open-source ML fairness toolkits aimed at helping ML practitioners assess and address unfairness in their systems. However, there has been little research investigating how ML practitioners…

Human-Computer Interaction · Computer Science 2023-01-11 Wesley Hanwen Deng , Manish Nagireddy , Michelle Seng Ah Lee , Jatinder Singh , Zhiwei Steven Wu , Kenneth Holstein , Haiyi Zhu

Historically, much of machine learning research has focused on the performance of the algorithm alone, but recently more attention has been focused on optimizing joint human-algorithm performance. Here, we analyze a specific type of…

Machine Learning · Computer Science 2024-02-27 Kate Donahue , Sreenivas Gollapudi , Kostas Kollias

While much of the rapidly growing literature on fair decision-making focuses on metrics for one-shot decisions, recent work has raised the intriguing possibility of designing sequential decision-making to positively impact long-term social…

Machine Learning · Statistics 2024-07-11 Bhagyashree Puranik , Ozgur Guldogan , Upamanyu Madhow , Ramtin Pedarsani

Predictive algorithms are now used to help distribute a large share of our society's resources and sanctions, such as healthcare, loans, criminal detentions, and tax audits. Under the right circumstances, these algorithms can improve the…

Machine Learning · Computer Science 2023-02-21 Alex Chohlas-Wood , Madison Coots , Sharad Goel , Julian Nyarko

Smart recommendation algorithms have revolutionized content delivery and improved efficiency across various domains. However, concerns about user agency arise from the algorithms' inherent opacity (information asymmetry) and one-way output…

Human-Computer Interaction · Computer Science 2025-05-13 Mengke Wu , Weizi Liu , Yanyun Wang , Mike Yao

Recent advances in LLM-based multi-agent systems (MAS) show that workflows composed of multiple LLM agents with distinct roles, tools, and communication patterns can outperform single-LLM baselines on complex tasks. However, most frameworks…

Multiagent Systems · Computer Science 2026-01-21 Jiawei Xu , Arief Koesdwiady , Sisong Bei , Yan Han , Baixiang Huang , Dakuo Wang , Yutong Chen , Zheshen Wang , Peihao Wang , Pan Li , Ying Ding

We study a collaborative learning problem where $m$ agents aim to estimate a vector $\mu =(\mu_1,\ldots,\mu_d)\in \mathbb{R}^d$ by sampling from associated univariate normal distributions $\{\mathcal{N}(\mu_k, \sigma^2)\}_{k\in[d]}$. Agent…

Computer Science and Game Theory · Computer Science 2025-08-15 Alex Clinton , Yiding Chen , Xiaojin Zhu , Kirthevasan Kandasamy

A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models. Recent advances in large language models and tool-using agents have made…

The effectiveness of machine learning in evaluating the creditworthiness of loan applicants has been demonstrated for a long time. However, there is concern that the use of automated decision-making processes may result in unequal treatment…

Machine Learning · Computer Science 2023-06-23 Darie Moldovan

Large language models (LLMs) represent a major advance in artificial intelligence (AI) research. However, the widespread use of LLMs is also coupled with significant ethical and social challenges. Previous research has pointed towards…

Computation and Language · Computer Science 2023-06-28 Jakob Mökander , Jonas Schuett , Hannah Rose Kirk , Luciano Floridi

The rapid advancement of Large Language Models (LLMs) has stimulated interest in multi-agent collaboration for addressing complex medical tasks. However, the practical advantages of multi-agent collaboration approaches remain insufficiently…

Artificial Intelligence · Computer Science 2025-10-31 Yinghao Zhu , Ziyi He , Haoran Hu , Xiaochen Zheng , Xichen Zhang , Zixiang Wang , Junyi Gao , Liantao Ma , Lequan Yu

In many settings, multiple uninformed agents bargain simultaneously with a single informed agent in each of multiple periods. For example, workers and firms negotiate each year over salaries, and the firm has private information about the…

Theoretical Economics · Economics 2020-11-10 Quitzé Valenzuela-Stookey

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You