English
Related papers

Related papers: Fairness Auditing with Multi-Agent Collaboration

200 papers

In many societal resource allocation domains, machine learning methods are increasingly used to either score or rank agents in order to decide which ones should receive either resources (e.g., homeless services) or scrutiny (e.g., child…

Multiagent Systems · Computer Science 2020-12-17 Andrew Estornell , Sanmay Das , Yevgeniy Vorobeychik

Multi-agent systems have demonstrated the ability to improve performance on a variety of predictive tasks by leveraging collaborative decision making. However, the lack of effective evaluation methodologies has made it difficult to estimate…

Machine Learning · Computer Science 2025-12-19 Maeve Madigan , Parameswaran Kamalaruban , Glenn Moynihan , Tom Kempton , David Sutton , Stuart Burrell

In many real-world situations, data is distributed across multiple self-interested agents. These agents can collaborate to build a machine learning model based on data from multiple agents, potentially reducing the error each experiences.…

Computers and Society · Computer Science 2023-02-28 Kate Donahue , Jon Kleinberg

The fast spreading adoption of machine learning (ML) by companies across industries poses significant regulatory challenges. One such challenge is scalability: how can regulatory bodies efficiently audit these ML models, ensuring that they…

Machine Learning · Computer Science 2022-06-20 Tom Yan , Chicheng Zhang

In a recent paper, we analyzed the self-assembly of a complex cooperation network. The network was shown to approach a state where every agent invests the same amount of resources. Nevertheless, highly-connected agents arise that extract…

Physics and Society · Physics 2012-03-07 Anne-Ly Do , Lars Rudolf , Thilo Gross

Even when a tool is explicitly described as unfair and harmful to others, ostensibly safety-aligned LLM agents still voluntarily engage in secret collusion whenever doing so confers a strategic advantage. To investigate this phenomenon, we…

Artificial Intelligence · Computer Science 2026-05-28 Xijie Zeng , Frank Rudzicz

We investigate whether fairness is compatible with efficiency in economies with multi-self agents, who may not be able to integrate their multiple objectives into a single complete and transitive ranking. We adapt envy-freeness,…

Theoretical Economics · Economics 2022-04-15 Sophie Bade , Erel Segal-Halevi

Machine learning (ML) models often exhibit bias that can exacerbate inequities in biomedical applications. Fairness auditing, the process of evaluating a model's performance across subpopulations, is critical for identifying and mitigating…

Methodology · Statistics 2026-05-19 Jianhui Gao , Jessica Gronsbell

In this study, we examined the impact of recommendation systems' algorithms on individuals' collaborator choices when forming teams. Different algorithmic designs can lead individuals to select one collaborator over another, thereby shaping…

Human-Computer Interaction · Computer Science 2024-10-02 Diego Gomez-Zara , Victoria Kam , Charles Chiang , Leslie DeChurch , Noshir Contractor

Large Language Models (LLMs) have shown remarkable capabilities in general natural language processing tasks but often fall short in complex reasoning tasks. Recent studies have explored human-like problem-solving strategies, such as…

Computation and Language · Computer Science 2023-12-19 Zhenran Xu , Senbao Shi , Baotian Hu , Jindi Yu , Dongfang Li , Min Zhang , Yuxiang Wu

We study the self-assembly of a complex network of collaborations among self-interested agents. The agents can maintain different levels of cooperation with different partners. Further, they continuously, selectively, and independently…

Physics and Society · Physics 2015-05-13 Anne-Ly Do , Lars Rudolf , Thilo Gross

The trajectory of AI development suggests that we will increasingly rely on agent-based systems composed of independently developed agents with different information, privileges, and tools. The success of these systems will critically…

Artificial Intelligence · Computer Science 2025-11-05 Tim R. Davidson , Adam Fourney , Saleema Amershi , Robert West , Eric Horvitz , Ece Kamar

We study fairness through the lens of cooperative multi-agent learning. Our work is motivated by empirical evidence that naive maximization of team reward yields unfair outcomes for individual team members. To address fairness in…

Artificial Intelligence · Computer Science 2022-01-20 Niko A. Grupen , Bart Selman , Daniel D. Lee

Multi-agent LLM systems are increasingly deployed as autonomous collaborators, where agents interact freely rather than execute fixed, pre-specified workflows. In such settings, effective coordination cannot be fully designed in advance and…

Multiagent Systems · Computer Science 2026-02-10 Aneesh Pappu , Batu El , Hancheng Cao , Carmelo di Nolfo , Yanchao Sun , Meng Cao , James Zou

When agents interact with people as part of a team, fairness becomes an important factor. Prior work has proposed fairness metrics based on teammates' capabilities for task allocation within human-agent teams. However, most metrics only…

Human-Computer Interaction · Computer Science 2025-05-23 Mai Lee Chang , Kim Baraka , Greg Trafton , Zach Lalu Vazhekatt , Andrea Lockerd Thomaz

Large Language Model (LLM)-based multi-agent systems are increasingly applied to automate computational workflows in science and engineering. However, how inter-agent dynamics influence reasoning quality and verification reliability remains…

Artificial Intelligence · Computer Science 2025-11-07 Chuan Tian , Yilei Zhang

Algorithm audits have increased in recent years due to a growing need to independently assess the performance of automatically curated services that process, filter, and rank the large and dynamic amount of information available on the…

Computers and Society · Computer Science 2023-04-06 Roberto Ulloa , Mykola Makhortykh , Aleksandra Urman

Ensuring fairness in decentralized multi-agent systems presents significant challenges due to emergent biases, systemic inefficiencies, and conflicting agent incentives. This paper provides a comprehensive survey of fairness in multi-agent…

Multiagent Systems · Computer Science 2025-03-04 Rajesh Ranjan , Shailja Gupta , Surya Narayan Singh

In this work, we study the risks of collective financial fraud in large-scale multi-agent systems powered by large language model (LLM) agents. We investigate whether agents can collaborate in fraudulent behaviors, how such collaboration…

Multiagent Systems · Computer Science 2026-04-07 Qibing Ren , Zhijie Zheng , Jiaxuan Guo , Junchi Yan , Lizhuang Ma , Jing Shao

Large language model (LLM) agents have shown increasing promise for collaborative task completion. However, existing multi-agent frameworks often rely on static workflows, fixed roles, and limited inter-agent communication, reducing their…

Multiagent Systems · Computer Science 2026-02-13 Chengxuan Xia , Qianye Wu , Sixuan Tian , Yilun Hao
‹ Prev 1 2 3 10 Next ›