English
Related papers

Related papers: Implicit Strategic Optimization: Rethinking Long-H…

200 papers

This research presents LLM Pokemon League, a competitive tournament system that leverages Large Language Models (LLMs) as intelligent agents to simulate strategic decision-making in Pok\'emon battles. The platform is designed to analyze and…

Artificial Intelligence · Computer Science 2025-08-05 Tadisetty Sai Yashwanth , Dhatri C

Contextual linear optimization (CLO) uses predictive contextual features to reduce uncertainty in random cost coefficients in the objective and thereby improve decision-making performance. A canonical example is the stochastic shortest path…

Machine Learning · Statistics 2025-11-11 Yichun Hu , Nathan Kallus , Xiaojie Mao , Yanchen Wu

We present Self-Play Preference Optimization (SPO), an algorithm for reinforcement learning from human feedback. Our approach is minimalist in that it does not require training a reward model nor unstable adversarial training and is…

Machine Learning · Computer Science 2024-06-14 Gokul Swamy , Christoph Dann , Rahul Kidambi , Zhiwei Steven Wu , Alekh Agarwal

Social simulation provides a compelling testbed for studying social intelligence, where agents interact through multi-turn dialogues under evolving contexts and strategically adapting opponents. Such environments are inherently…

Artificial Intelligence · Computer Science 2026-05-20 Xiang Li , Liping Yi , Mingze Kong , Min Zhang , Zhongxiang Dai , QingHua Hu

Optimization problems routinely depend on uncertain parameters that must be predicted before a decision is made. Classical robust and regret formulations are designed to handle erroneous predictions and can provide statistical error bounds…

Optimization and Control · Mathematics 2026-03-30 Jannis Kurtz , Bart P. G. van Parys

In inverse reinforcement learning (IRL), an agent seeks to replicate expert demonstrations through interactions with the environment. Traditionally, IRL is treated as an adversarial game, where an adversary searches over reward models, and…

Machine Learning · Computer Science 2025-04-23 Arnav Kumar Jain , Harley Wiltzer , Jesse Farebrother , Irina Rish , Glen Berseth , Sanjiban Choudhury

Large language model (LLM) agents learn by interacting with environments, but long-horizon training remains fundamentally bottlenecked by sparse and delayed rewards. Existing methods typically address this challenge through post-hoc credit…

In multi-agent settings with mixed incentives, methods developed for zero-sum games have been shown to lead to detrimental outcomes. To address this issue, opponent shaping (OS) methods explicitly learn to influence the learning dynamics of…

Artificial Intelligence · Computer Science 2024-02-13 Akbir Khan , Timon Willi , Newton Kwan , Andrea Tacchetti , Chris Lu , Edward Grefenstette , Tim Rocktäschel , Jakob Foerster

Inverse reinforcement learning (IRL) aims to recover the reward function of an expert agent from demonstrations of behavior. It is well-known that the IRL problem is fundamentally ill-posed, i.e., many reward functions can explain the…

Machine Learning · Computer Science 2024-06-07 Filippo Lazzati , Mirco Mutti , Alberto Maria Metelli

As LLMs increasingly act as autonomous agents in interactive and multi-agent settings, understanding their strategic behavior is critical for safety, coordination, and AI-driven social and economic systems. We investigate how payoff…

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

Machine Learning · Computer Science 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

Reinforcement learning with verifiable rewards (RLVR) has become a standard approach for large language models (LLMs) post-training to incentivize reasoning capacity. Among existing recipes, group-based policy gradient is prevalent, which…

This study proposes a regime-aware reinforcement learning framework for long-horizon portfolio optimization. Moving beyond traditional feedforward and GARCH-based models, we design realistic environments where agents dynamically reallocate…

Portfolio Management · Quantitative Finance 2025-09-19 Gabriel Nixon Raj

In this paper, we study the problem of obtaining a control policy that can mimic and then outperform expert demonstrations in Markov decision processes where the reward function is unknown to the learning agent. One main relevant approach…

Machine Learning · Computer Science 2020-09-24 Feng Tao , Yongcan Cao

Post-training processes are essential phases in grounding pre-trained language models to real-world tasks, with learning from demonstrations or preference signals playing a crucial role in this adaptation. We present a unified theoretical…

Machine Learning · Computer Science 2025-07-08 Bo Wang , Qinyuan Cheng , Runyu Peng , Rong Bao , Peiji Li , Qipeng Guo , Linyang Li , Zhiyuan Zeng , Yunhua Zhou , Xipeng Qiu

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent…

Machine Learning · Computer Science 2023-01-04 Franck Djeumou , Christian Ellis , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Effective optimization is essential for real-world interactive systems to provide a satisfactory user experience in response to changing user behavior. However, it is often challenging to find an objective to optimize for interactive…

Artificial Intelligence · Computer Science 2020-06-24 Ziming Li , Julia Kiseleva , Alekh Agarwal , Maarten de Rijke , Ryen W. White

Large Language Models (LLMs) empowered with Tool-Integrated Reasoning (TIR) can iteratively plan, call external tools, and integrate returned information to solve complex, long-horizon reasoning tasks. Agentic Reinforcement Learning…

Computation and Language · Computer Science 2026-01-21 Jianghao Su , Xia Zeng , Luhui Liu , Chao Luo , Ye Chen , Zhuoran Zhuang

Exploration remains a key challenge in deep reinforcement learning (RL). Optimism in the face of uncertainty is a well-known heuristic with theoretical guarantees in the tabular setting, but how best to translate the principle to deep…

Machine Learning · Computer Science 2023-06-06 Brendan O'Donoghue

A significant portion of recent research on Large Language Model (LLM) alignment focuses on developing new policy optimization methods based on Group Relative Policy Optimization (GRPO). Two prominent directions have emerged: (i) a shift…

Machine Learning · Computer Science 2026-02-27 Svetlana Glazyrina , Maksim Kryzhanovskiy , Roman Ischenko
‹ Prev 1 8 9 10 Next ›