English
Related papers

Related papers: Latent Q-Barrier Shielding for Safe In-Context Rei…

200 papers

In-context reinforcement learning (ICRL) is an emerging RL paradigm where an agent, after pretraining, can adapt to out-of-distribution test tasks without any parameter updates, instead relying on an expanding context of interaction…

Machine Learning · Computer Science 2026-05-28 Amir Moeini , Minjae Kwon , Alper Kamil Bozkurt , Yuichi Motai , Rohan Chandra , Lu Feng , Shangtong Zhang

In-Context Reinforcement Learning (ICRL) enables Large Language Models (LLMs) to learn online from external rewards directly within the context window. However, a central challenge in ICRL is reward estimation, as models typically lack…

Computation and Language · Computer Science 2026-04-02 Wenxuan Jiang , Yuxin Zuo , Zijian Zhang , Xuecheng Wu , Zining Fan , Wenxuan Liu , Li Chen , Xiaoyu Li , Xuezhi Cao , Xiaolong Jin , Ninghao Liu

Recent advancements in language models have demonstrated remarkable in-context learning abilities, prompting the exploration of in-context reinforcement learning (ICRL) to extend the promise to decision domains. Due to involving more…

Artificial Intelligence · Computer Science 2026-02-09 Jinmei Liu , Fuhong Liu , Zhenhong Sun , Jianye Hao , Huaxiong Li , Bo Wang , Daoyi Dong , Chunlin Chen , Zhi Wang

Typically, a modern reinforcement learning (RL) agent solves a task by updating its neural network parameters to adapt its policy to the task. Recently, it has been observed that some RL agents can solve a wide range of new…

Machine Learning · Computer Science 2025-10-06 Jiuqi Wang , Rohan Chandra , Shangtong Zhang

Existing offline in-context reinforcement learning (ICRL) methods have predominantly relied on supervised training objectives, which are known to have limitations in offline RL settings. In this study, we explore the integration of RL…

Safety is a critical concern when deploying reinforcement learning agents for realistic tasks. Recently, safe reinforcement learning algorithms have been developed to optimize the agent's performance while avoiding violations of safety…

Machine Learning · Computer Science 2021-01-05 Baiming Chen , Zuxin Liu , Jiacheng Zhu , Mengdi Xu , Wenhao Ding , Ding Zhao

In-context reinforcement learning (ICRL) leverages the in-context learning capabilities of transformer models (TMs) to efficiently generalize to unseen sequential decision-making tasks without parameter updates. However, existing ICRL…

Machine Learning · Computer Science 2026-02-10 Juncheng Dong , Bowen He , Moyang Guo , Ethan X. Fang , Zhuoran Yang , Vahid Tarokh

Reinforcement learning (RL) is a framework for solving sequential decision-making problems. In this work, we demonstrate that, surprisingly, RL emerges during the inference time of large language models (LLMs), a phenomenon we term…

Machine Learning · Computer Science 2026-04-28 Kefan Song , Amir Moeini , Peng Wang , Lei Gong , Rohan Chandra , Shangtong Zhang , Yanjun Qi

Offline Reinforcement Learning (RL), which operates solely on static datasets without further interactions with the environment, provides an appealing alternative to learning a safe and promising control policy. The prevailing methods…

Machine Learning · Computer Science 2025-03-18 Kun Wu , Yinuo Zhao , Zhiyuan Xu , Zhengping Che , Chengxiang Yin , Chi Harold Liu , Feiferi Feng , Jian Tang

In-context reinforcement learning (ICRL) studies agents that, after pretraining, adapt to new tasks by conditioning on additional context without parameter updates. Existing theoretical analyses of ICRL largely rely on linear attention,…

Machine Learning · Computer Science 2026-05-19 Zixuan Xie , Xinyu Liu , Claire Chen , Shuze Daniel Liu , Rohan Chandra , Shangtong Zhang

Autonomous UAV infiltration in dynamic contested environments remains a significant challenge due to the partially observable nature of threats and the conflicting objectives of mission efficiency versus survivability. Traditional…

Machine Learning · Computer Science 2026-03-03 Jiahao Fu , Feng Yang

In-context reinforcement learning (ICRL) promises fast adaptation to unseen environments without parameter updates, but current methods either cannot improve beyond the training distribution or require near-optimal data, limiting practical…

Machine Learning · Computer Science 2026-01-07 Anaïs Berkes , Vincent Taboga , Donna Vakalis , David Rolnick , Yoshua Bengio

In-context reinforcement learning (ICRL) refers to the ability of RL agents to adapt to new tasks at inference time without parameter updates by conditioning on additional context. Recent empirical studies further demonstrate that…

Machine Learning · Computer Science 2026-05-11 Zixuan Xie , Xinyu Liu , Rohan Chandra , Shangtong Zhang

In-context learning (ICL) has demonstrated remarkable success in large language models (LLMs) due to its adaptability and parameter-free nature. However, it also introduces a critical vulnerability to backdoor attacks, where adversaries can…

Machine Learning · Computer Science 2025-07-03 Zhiyao Ren , Siyuan Liang , Aishan Liu , Dacheng Tao

In-Context Reinforcement Learning (ICRL) has emerged as a promising paradigm for developing agents that can rapidly adapt to new tasks by leveraging past experiences as context, without updating their parameters. Recent approaches train…

Machine Learning · Computer Science 2025-09-30 Wenhao Zhang , Shao Zhang , Xihuai Wang , Yang Li , Ying Wen

While reasoning models have achieved remarkable success in complex reasoning tasks, their increasing power necessitates stringent safety measures. For safety alignment, the core challenge lies in the inherent trade-off between safety and…

Cryptography and Security · Computer Science 2026-02-17 Yanbo Wang , Minzheng Wang , Jian Liang , Lu Wang , Yongcan Yu , Ran He

Traditionally, reinforcement learning (RL) agents learn to solve new tasks by updating their neural network parameters through interactions with the task environment. However, recent works demonstrate that some RL agents, after certain…

Machine Learning · Computer Science 2025-02-26 Jiuqi Wang , Ethan Blaser , Hadi Daneshmand , Shangtong Zhang

Offline reinforcement learning requires reconciling two conflicting aims: learning a policy that improves over the behavior policy that collected the dataset, while at the same time minimizing the deviation from the behavior policy so as to…

Machine Learning · Computer Science 2021-10-13 Ilya Kostrikov , Ashvin Nair , Sergey Levine

Reinforcement learning (RL) agents typically optimize their policies by performing expensive backward passes to update their network parameters. However, some agents can solve new tasks without updating any parameters by simply conditioning…

Machine Learning · Computer Science 2025-02-13 Amir Moeini , Jiuqi Wang , Jacob Beck , Ethan Blaser , Shimon Whiteson , Rohan Chandra , Shangtong Zhang

Large Language Models (LLMs) excel at in-context learning (ICL), a supervised learning technique that relies on adding annotated examples to the model context. We investigate a contextual bandit version of in-context reinforcement learning…

Computation and Language · Computer Science 2025-09-30 Giovanni Monea , Antoine Bosselut , Kianté Brantley , Yoav Artzi
‹ Prev 1 2 3 10 Next ›