中文
相关论文

相关论文: Towards Large-Scale In-Context Reinforcement Learn…

200 篇论文

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent…

机器学习 · 计算机科学 2023-01-04 Franck Djeumou , Christian Ellis , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Reinforcement learning (RL) is a framework for solving sequential decision-making problems. In this work, we demonstrate that, surprisingly, RL emerges during the inference time of large language models (LLMs), a phenomenon we term…

机器学习 · 计算机科学 2026-04-28 Kefan Song , Amir Moeini , Peng Wang , Lei Gong , Rohan Chandra , Shangtong Zhang , Yanjun Qi

Reinforcement learning (RL) has become a pivotal component of large language model (LLM) post-training, and agentic RL extends this paradigm to operate as agents through multi-turn interaction and tool use. Scaling such systems exposes two…

分布式、并行与集群计算 · 计算机科学 2025-10-08 Zheyue Tan , Mustapha Abdullahi , Tuo Shi , Huining Yuan , Zelai Xu , Chao Yu , Boxun Li , Bo Zhao

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

机器学习 · 计算机科学 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

计算与语言 · 计算机科学 2024-08-26 Haowei Du , Dongyan Zhao

In-context learning (ICL) empowers generative models to address new tasks effectively and efficiently on the fly, without relying on any artificially crafted optimization techniques. In this paper, we study extending ICL to address a…

人工智能 · 计算机科学 2024-09-13 Fan Wang , Chuan Lin , Yang Cao , Yu Kang

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

计算与语言 · 计算机科学 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

In this work, we propose a novel inverse reinforcement learning (IRL) algorithm for constrained Markov decision process (CMDP) problems. In standard IRL problems, the inverse learner or agent seeks to recover the reward function of the MDP,…

机器学习 · 计算机科学 2024-01-08 Nirjhar Das , Arpan Chattopadhyay

Reinforcement learning is an emerging approaches to facilitate multi-stage sequential decision-making problems. This paper studies a real-time multi-stage stochastic power dispatch considering multivariate uncertainties. Current researches…

机器学习 · 计算机科学 2024-01-24 Bairong Deng , Tao Yu , Zhenning Pan , Xuehan Zhang , Yufeng Wu , Qiaoyi Ding

When deploying Reinforcement Learning (RL) agents into a physical system, we must ensure that these agents are well aware of the underlying constraints. In many real-world problems, however, the constraints are often hard to specify…

机器学习 · 计算机科学 2023-03-03 Guiliang Liu , Yudong Luo , Ashish Gaurav , Kasra Rezaee , Pascal Poupart

Inverse reinforcement learning (IRL) has become a useful tool for learning behavioral models from demonstration data. However, IRL remains mostly unexplored for multi-agent systems. In this paper, we show how the principle of IRL can be…

机器学习 · 统计学 2017-03-27 Adrian Šošić , Wasiur R. KhudaBukhsh , Abdelhak M. Zoubir , Heinz Koeppl

In-context learning (ICL) with dynamically selected demonstrations combines the flexibility of prompting large language models (LLMs) with the ability to leverage training data to improve performance. While ICL has been highly successful…

计算与语言 · 计算机科学 2025-06-17 Shivanshu Gupta , Sameer Singh , Ashish Sabharwal , Tushar Khot , Ben Bogin

In-Context Learning (ICL) has gained prominence due to its ability to perform tasks without requiring extensive training data and its robustness to noisy labels. A typical ICL workflow involves selecting localized examples relevant to a…

信息检索 · 计算机科学 2025-05-07 Janak Kapuriya , Manit Kaushik , Debasis Ganguly , Sumit Bhatia

Large language models (LLM) have recently shown the extraordinary ability to perform unseen tasks based on few-shot examples provided as text, also known as in-context learning (ICL). While recent works have attempted to understand the…

计算与语言 · 计算机科学 2024-04-05 Harmon Bhasin , Timothy Ossowski , Yiqiao Zhong , Junjie Hu

In order for robots to perform mission-critical tasks, it is essential that they are able to quickly adapt to changes in their environment as well as to injuries and or other bodily changes. Deep reinforcement learning has been shown to be…

机器人学 · 计算机科学 2017-10-19 Ayaka Kume , Eiichi Matsumoto , Kuniyuki Takahashi , Wilson Ko , Jethro Tan

Contextual Reinforcement Learning (CRL) tackles the problem of solving a set of related Contextual Markov Decision Processes (CMDPs) that vary across different context variables. Traditional approaches--independent training and multi-task…

机器学习 · 计算机科学 2026-03-31 Tianyue Zhou , Jung-Hoon Cho , Cathy Wu

In-context learning (ICL) enables large language models to adapt to new tasks from demonstrations without parameter updates. Despite extensive empirical studies, a principled understanding of ICL emergence at scale remains more elusive. We…

机器学习 · 计算机科学 2025-11-11 Sushant Mehta , Ishan Gupta

In-context Learning (ICL) has emerged as a powerful capability alongside the development of scaled-up large language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks…

计算与语言 · 计算机科学 2024-07-24 Quanyu Long , Yin Wu , Wenya Wang , Sinno Jialin Pan

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

机器学习 · 计算机科学 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott

The emergence of in-context learning (ICL) enables large pre-trained language models (PLMs) to make predictions for unseen inputs without updating parameters. Despite its potential, ICL's effectiveness heavily relies on the quality,…

机器学习 · 计算机科学 2024-07-02 Xiaoling Zhou , Wei Ye , Yidong Wang , Chaoya Jiang , Zhemg Lee , Rui Xie , Shikun Zhang