English
Related papers

Related papers: Shutdownable Agents through POST-Agency

200 papers

Can artificial agents learn to assist others in achieving their goals without knowing what those goals are? Generic reinforcement learning agents could be trained to behave altruistically towards others by rewarding them for altruistic…

Artificial Intelligence · Computer Science 2022-03-22 Tim Franzmeyer , Mateusz Malinowski , João F. Henriques

Online platforms in the Internet Economy commonly incorporate recommender systems that recommend products (or "arms") to users (or "agents"). A key challenge in this domain arises from myopic agents who are naturally incentivized to exploit…

Information Retrieval · Computer Science 2024-06-19 Xiaowu Dai , Wenlu Xu , Yuan Qi , Michael I. Jordan

Game-theoretic dynamics between AI agents could differ from traditional human-human interactions in various ways. One such difference is that it may be possible to accurately simulate an AI agent, for example because its source code is…

Artificial Intelligence · Computer Science 2024-03-05 Vojtech Kovarik , Caspar Oesterheld , Vincent Conitzer

As more and more AI agents are used in practice, it is time to think about how to make these agents fully autonomous so that they can learn by themselves in a self-motivated and self-supervised manner rather than being retrained…

Artificial Intelligence · Computer Science 2024-03-01 Bing Liu , Eric Robertson , Scott Grigsby , Sahisnu Mazumder

We consider the problem of stable matching with dynamic preference lists. At each time step, the preference list of some player may change by swapping random adjacent members. The goal of a central agency (algorithm) is to maintain an…

Computer Science and Game Theory · Computer Science 2016-06-29 Varun Kanade , Nikos Leonardos , Frédéric Magniez

Coalition formation is concerned with the question of how to partition a set of agents into disjoint coalitions according to their preferences. Deviating from most of the previous work, we consider an online variant of the problem, where…

Computer Science and Game Theory · Computer Science 2025-03-11 Martin Bullinger , René Romen

In bipartite matching problems, agents on two sides of a graph want to be paired according to their preferences. The stability of a matching depends on these preferences, which in uncertain environments also reflect agents' beliefs about…

Computer Science and Game Theory · Computer Science 2025-11-10 Jonathan Shaki , Jiarui Gan , Sarit Kraus

We analyze the optimal delegation problem between a principal and an agent, assuming that the latter has state-independent preferences. We demonstrate that if the principal is more risk-averse than the agent toward non-status quo options,…

Theoretical Economics · Economics 2024-09-19 Xiaoxiao Hu , Haoran Lei

People often optimize for long-term goals in collaboration: A mentor or companion doesn't just answer questions, but also scaffolds learning, tracks progress, and prioritizes the other person's growth over immediate results. In contrast,…

Artificial Intelligence · Computer Science 2026-04-08 Grace Liu , Brian Christian , Tsvetomira Dumbalska , Michiel A. Bakker , Rachit Dubey

We show that in delegation problems, a principal benefits from belief misalignment vis-\`a-vis an agent when the latter can flexibly acquire costly information. The agent optimally succumbs to confirmatory learning, leading him to favor the…

Theoretical Economics · Economics 2025-07-30 Pavel Ilinov , Andrei Matveenko , Maxim Senkov , Egor Starkov

Here we consider the communications tactics appropriate for a group of agents that need to "swarm" together in a highly adversarial environment. Specfically, whilst they need to cooperate by exchanging information with each other about…

Multiagent Systems · Computer Science 2023-04-07 Paul Kinsler , Sean Holman , Andrew Elliott , Cathryn N. Mitchell , R. Eddie Wilson

The usage of automated learning agents is becoming increasingly prevalent in many online economic applications such as online auctions and automated trading. Motivated by such applications, this paper is dedicated to fundamental modeling…

Computer Science and Game Theory · Computer Science 2023-01-04 Yoav Kolumbus , Noam Nisan

An implicit expectation of asking users to rate agents, such as an AI decision-aid, is that they will use only relevant information -- ask them about an agent's benevolence, and they should consider whether or not it was kind. Behavioral…

Human-Computer Interaction · Computer Science 2023-07-28 Nikolos Gurney , David Pynadath , Ning Wang

Actor systems are a flexible model of concurrent and distributed programming, which are efficiently implementable, and avoid many classic concurrency bugs by construction. However actor systems must still deal with the challenge of messages…

Programming Languages · Computer Science 2025-09-16 Colin S. Gordon

Artificial general intelligence aims to create agents capable of learning to solve arbitrary interesting problems. We define two versions of asymptotic optimality and prove that no agent can satisfy the strong version while in some cases,…

Artificial Intelligence · Computer Science 2012-02-10 Tor Lattimore , Marcus Hutter

Thanks to advances in large language models, a new type of software agent, the artificial intelligence (AI) agent, has entered the marketplace. Companies such as OpenAI, Google, Microsoft, and Salesforce promise their AI Agents will go from…

Computers and Society · Computer Science 2025-02-26 Deven R. Desai , Mark O. Riedl

In the future, artificial learning agents are likely to become increasingly widespread in our society. They will interact with both other learning agents and humans in a variety of complex settings including social dilemmas. We argue that…

Artificial Intelligence · Computer Science 2022-02-22 Tobias Baumann

A network of agents attempt to learn some unknown state of the world drawn by nature from a finite set. Agents observe private signals conditioned on the true state, and form beliefs about the unknown state accordingly. Each agent may face…

Machine Learning · Computer Science 2015-03-13 Shahin Shahrampour , Mohammad Amin Rahimian , Ali Jadbabaie

We consider agents in a social network competing to be selected as partners in collaborative, mutually beneficial activities. We study this through a model in which an agent i can initiate a limited number k_i>0 of games and selects the…

Computer Science and Game Theory · Computer Science 2024-01-23 Timothy Murray , Jugal Garg , Rakesh Nagi

This essay discusses the advantages of a probabilistic agent-based approach to questions in theoretical economics, from the nature of economic agents, to the nature of the equilibria supported by their interactions. One idea we propose is…

General Finance · Quantitative Finance 2013-11-05 Ted Theodosopoulos