English
Related papers

Related papers: Do LLM Agents Have Regret? A Case Study in Online …

200 papers

A central capability of intelligent systems is the ability to continuously build upon previous experiences to speed up and enhance learning of new tasks. Two distinct research paradigms have studied this question. Meta-learning views this…

Machine Learning · Computer Science 2019-07-05 Chelsea Finn , Aravind Rajeswaran , Sham Kakade , Sergey Levine

The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Aren Karapetyan , Anastasios Tsiamis , Efe C. Balta , Andrea Iannelli , John Lygeros

We develop an online learning algorithm for identifying unlabeled data points that are most informative for training (i.e., active learning). By formulating the active learning problem as the prediction with sleeping experts problem, we…

Machine Learning · Computer Science 2022-02-24 Cenk Baykal , Lucas Liebenwein , Dan Feldman , Daniela Rus

To improve the reasoning and question-answering capabilities of Large Language Models (LLMs), several multi-agent approaches have been introduced. While these methods enhance performance, the application of collective intelligence-based…

Artificial Intelligence · Computer Science 2024-07-10 Ciaran Regan , Alexandre Gournail , Mizuki Oka

We examine the problem of regret minimization when the learner is involved in a continuous game with other optimizing agents: in this case, if all players follow a no-regret algorithm, it is possible to achieve significantly lower regret…

Computer Science and Game Theory · Computer Science 2023-03-20 Yu-Guan Hsieh , Kimon Antonakopoulos , Volkan Cevher , Panayotis Mertikopoulos

Rapid advancements in large language models (LLMs) have revitalized in LLM-based agents, exhibiting impressive human-like behaviors and cooperative capabilities in various scenarios. However, these agents also bring some exclusive risks,…

Computation and Language · Computer Science 2024-02-05 Yu Tian , Xiao Yang , Jingyuan Zhang , Yinpeng Dong , Hang Su

No-regret learners seek to minimize the difference between the loss they cumulated through the actions they played, and the loss they would have cumulated in hindsight had they consistently modified their behavior according to some strategy…

Computer Science and Game Theory · Computer Science 2023-11-09 Gabriele Farina , Charilaos Pipis

We propose a novel online learning method for minimizing regret in large extensive-form games. The approach learns a function approximator online to estimate the regret for choosing a particular action. A no-regret algorithm uses these…

Artificial Intelligence · Computer Science 2015-01-05 Kevin Waugh , Dustin Morrill , J. Andrew Bagnell , Michael Bowling

Recent advances in large language models (LLMs) have shown promising results in medical diagnosis, with some studies indicating superior performance compared to human physicians in specific scenarios. However, the diagnostic capabilities of…

Artificial Intelligence · Computer Science 2025-03-24 Zhoujian Sun , Ziyi Liu , Cheng Luo , Jiebin Chu , Zhengxing Huang

Large Language Models (LLMs) have shown promise as decision-makers in dynamic settings, but their stateless nature necessitates creating a natural language representation of history. We present a unifying framework for systematically…

Artificial Intelligence · Computer Science 2025-06-19 Lyle Goodyear , Rachel Guo , Ramesh Johari

Ideal or real - that is the question.In this work, we explore whether principles from game theory can be effectively applied to the evaluation of large language models (LLMs). This inquiry is motivated by the growing inadequacy of…

Computation and Language · Computer Science 2026-04-07 Gao Yang , Yuhang Liu , Siyu Miao , Xinyue Liang , Zhengyang Liu , Heyan Huang

The observed similarities in the behavior of humans and Large Language Models (LLMs) have prompted researchers to consider the potential of using LLMs as models of human cognition. However, several significant challenges must be addressed…

Artificial Intelligence · Computer Science 2025-05-07 Jian-Qiao Zhu , Haijiang Yan , Thomas L. Griffiths

Although engagement in self-directed wellness exercises typically declines over time, integrating social support such as coaching can sustain it. However, traditional forms of support are often inaccessible due to the high costs and complex…

Large Language Models (LLMs) are increasingly used to simulate human users in interactive settings such as therapy, education, and social role-play. While these simulations enable scalable training and evaluation of AI agents, off-the-shelf…

Computation and Language · Computer Science 2025-11-04 Marwa Abdulhai , Ryan Cheng , Donovan Clay , Tim Althoff , Sergey Levine , Natasha Jaques

Large Language Models (LLMs) are increasingly being used to simulate human-like decision making in agent-based financial market models (ABMs). As models become more powerful and accessible, researchers can now incorporate individual LLM…

Machine Learning · Computer Science 2025-01-29 Alicia Vidler , Toby Walsh

Lifelong learning is essential for intelligent agents operating in dynamic environments. Current large language model (LLM)-based agents, however, remain stateless and unable to accumulate or transfer knowledge over time. Existing…

Artificial Intelligence · Computer Science 2025-06-02 Junhao Zheng , Xidi Cai , Qiuke Li , Duzhen Zhang , ZhongZhi Li , Yingying Zhang , Le Song , Qianli Ma

No-regret learning dynamics ensure that a learner asymptotically achieves an average reward no worse than that of any fixed strategy. This no-regret guarantee does not determine the value of the asymptotic average reward. Indeed, it is…

Systems and Control · Electrical Eng. & Systems 2026-03-04 Hassan Abdelraouf , Jeff S. Shamma

It has been established in recent work that Large Language Models (LLMs) can be prompted to "self-play" conversational games that probe certain capabilities (general instruction following, strategic goal orientation, language understanding…

Computation and Language · Computer Science 2024-06-03 Anne Beyer , Kranti Chalamalasetti , Sherzod Hakimov , Brielen Madureira , Philipp Sadler , David Schlangen

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

Large Language Models (LLMs) have increasingly been utilized in social simulations, where they are often guided by carefully crafted instructions to stably exhibit human-like behaviors during simulations. Nevertheless, we doubt the…

Artificial Intelligence · Computer Science 2024-10-29 Zengqing Wu , Run Peng , Shuyuan Zheng , Qianying Liu , Xu Han , Brian Inhyuk Kwon , Makoto Onizuka , Shaojie Tang , Chuan Xiao