English
Related papers

Related papers: AI-Olympics: Exploring the Generalization of Agent…

200 papers

In the midst of the growing integration of Artificial Intelligence (AI) into various aspects of our lives, agents are experiencing a resurgence. These autonomous programs that act on behalf of humans are neither new nor exclusive to the…

Artificial Intelligence · Computer Science 2024-12-24 Chirag Shah , Ryen W. White

Online judges are systems designed for the reliable evaluation of algorithm source code submitted by users, which is next compiled and tested in a homogeneous environment. Online judges are becoming popular in various applications. Thus, we…

Computers and Society · Computer Science 2018-07-17 Szymon Wasik , Maciej Antczak , Jan Badura , Artur Laskowski , Tomasz Sternal

We show that the ability to lead groups of humans is predicted by leadership skill with Artificially Intelligent agents. In a large pre-registered lab experiment, human leaders worked with AI agents to solve problems. Their performance on…

General Economics · Economics 2025-08-06 Ben Weidmann , Yixian Xu , David J. Deming

This paper investigates multimodal agents, in particular, OpenAI's Computer-User Agent (CUA), trained to control and complete tasks through a standard computer interface, similar to humans. We evaluated the agent's performance on the New…

Artificial Intelligence · Computer Science 2025-04-23 Sarath Shekkizhar , Romain Cosentino

The goal of this paper is to share our experience in designing and organizing educational competitions with anonymous and (near) real-time leaderboards in both academic and industrial settings. While such competitions serve as a great…

Human-Computer Interaction · Computer Science 2024-02-14 Serdar Kadıoğlu , Bernard Kleynhans

Airlift operations require the timely distribution of various cargo, much of which is time sensitive and valuable. These operations, however, have to contend with sudden disruptions from weather and malfunctions, requiring immediate…

Artificial Intelligence · Computer Science 2025-04-22 Adis Delanovic , Carmen Chiu , John F. Kolen , Marvin Gülhan , Jonathan Cawalla , Andre Beckus

Today, AI is increasingly being used in many high-stakes decision-making applications in which fairness is an important concern. Already, there are many examples of AI being biased and making questionable and unfair decisions. The AI…

Artificial Intelligence · Computer Science 2020-02-06 Yunfeng Zhang , Rachel K. E. Bellamy , Kush R. Varshney

This paper argues that the next generation of AI agent (NGENT) should integrate across-domain abilities to advance toward Artificial General Intelligence (AGI). Although current AI agents are effective in specialized tasks such as robotics,…

Artificial Intelligence · Computer Science 2025-05-01 Zhicong Li , Hangyu Mao , Jiangjin Yin , Mingzhe Xing , Zhiwei Xu , Yuanxing Zhang , Yang Xiao

AI agents today are mostly siloed - they either retrieve and reason over vast amount of digital information and knowledge obtained online; or interact with the physical world through embodied perception, planning and action - but rarely…

Artificial Intelligence · Computer Science 2025-07-31 Yining Hong , Rui Sun , Bingxuan Li , Xingcheng Yao , Maxine Wu , Alexander Chien , Da Yin , Ying Nian Wu , Zhecan James Wang , Kai-Wei Chang

Artificial Intelligence (AI) has demonstrated remarkable capabilities in domains such as recruitment, finance, healthcare, and the judiciary. However, biases in AI systems raise ethical and societal concerns, emphasizing the need for…

The algorithm selection problem is to choose the most suitable algorithm for solving a given problem instance. It leverages the complementarity between different approaches that is present in many areas of AI. We report on the state of the…

Artificial Intelligence · Computer Science 2018-10-05 Marius Lindauer , Jan N. van Rijn , Lars Kotthoff

The Alexa Prize program has empowered numerous university students to explore, experiment, and showcase their talents in building conversational agents through challenges like the SocialBot Grand Challenge and the TaskBot Challenge. As…

Metcalfe et al (1) argue that the greatest potential for human-AI partnerships lies in their application to highly complex problem spaces. Herein, we discuss three different forms of hybrid team intelligence and posit that across all three…

Human-Computer Interaction · Computer Science 2025-03-03 Kaleb Mcdowell , Nick Waytowich , Javier Garcia , Stephen Gordon , Bryce Bartlett , Jeremy Gaston

The Multi-Agent Programming Contest, MAPC, is an annual event organized since 2005 out of Clausthal University of Technology. Its aim is to investigate the potential of using decentralized, autonomously acting intelligent agents, by…

Multiagent Systems · Computer Science 2020-10-01 Tobias Ahlbrecht , Jürgen Dix , Niklas Fiekas , Tabajara Krausburg

In 2021 the Johns Hopkins University Applied Physics Laboratory held an internal challenge to develop artificially intelligent (AI) agents that could excel at the collaborative card game Hanabi. Agents were evaluated on their ability to…

Artificial Intelligence · Computer Science 2021-11-19 Nicholas Kantack

AI agents are increasingly used in consumer-facing applications to assist with tasks such as product search, negotiation, and transaction execution. In this paper, we explore a future scenario where both consumers and merchants authorize AI…

Artificial Intelligence · Computer Science 2025-09-23 Shenzhe Zhu , Jiao Sun , Yi Nian , Tobin South , Alex Pentland , Jiaxin Pei

This paper studies the relations between agent performances and their intellective abilities in mix-games in which there are two groups of agents: one group plays a minority game, and the other plays a majority game. These two groups have…

Physics and Society · Physics 2007-05-23 Chengling Gou

Most games have, or can be generalised to have, a number of parameters that may be varied in order to provide instances of games that lead to very different player experiences. The space of possible parameter settings can be seen as a…

Artificial Intelligence · Computer Science 2017-03-21 Jialin Liu , Julian Togelius , Diego Perez-Liebana , Simon M. Lucas

Rapid advances in large language models and agentic AI are driving the emergence of the Internet of Agents (IoA), a paradigm where billions of autonomous software and embodied agents interact, coordinate, and collaborate to accomplish…

Networking and Internet Architecture · Computer Science 2026-03-13 Shaolong Guo , Yuntao Wang , Zhou Su , Yanghe Pan , Qinnan Hu , Tom H. Luan

Despite the growing interest in collaborative AI, designing systems that seamlessly integrate human input remains a major challenge. In this study, we developed a task to systematically examine human preferences for collaborative agents. We…

Artificial Intelligence · Computer Science 2025-10-28 Lukas William Mayer , Sheer Karny , Jackie Ayoub , Miao Song , Danyang Tian , Ehsan Moradi-Pari , Mark Steyvers