中文
相关论文

相关论文: Meta-DT: Offline Meta-RL as Conditional Sequence M…

200 篇论文

Meta-gradient methods (Xu et al., 2018; Zahavy et al., 2020) offer a promising solution to the problem of hyperparameter selection and adaptation in non-stationary reinforcement learning problems. However, the properties of meta-gradients…

机器学习 · 计算机科学 2022-09-14 Jelena Luketina , Sebastian Flennerhag , Yannick Schroecker , David Abel , Tom Zahavy , Satinder Singh

Most deep reinforcement learning (RL) systems are not able to learn effectively from off-policy data, especially if they cannot explore online in the environment. These are critical shortcomings for applying RL to real-world problems where…

Multimodal Large Language Models (MLLMs) have been widely adopted as MLLM-as-a-Judges due to their strong alignment with human judgment across various visual tasks. However, most existing judge models are optimized for single-task scenarios…

计算与语言 · 计算机科学 2026-04-22 Junjie Wu , Xuan Kan , Zihao He , Shunwen Tan , Bo Pan , Kaitai Zhang

World models are progressively being employed across diverse fields, extending from basic environment simulation to complex scenario construction. However, existing models are mainly trained on domain-specific states and actions, and…

人工智能 · 计算机科学 2024-10-01 Zhiqi Ge , Hongzhe Huang , Mingze Zhou , Juncheng Li , Guoming Wang , Siliang Tang , Yueting Zhuang

In recent years, meta-learning, in which a model is trained on a family of tasks (i.e. a task distribution), has emerged as an approach to training neural networks to perform tasks that were previously assumed to require structured…

机器学习 · 计算机科学 2021-03-19 Sreejan Kumar , Ishita Dasgupta , Jonathan D. Cohen , Nathaniel D. Daw , Thomas L. Griffiths

Domain shift refers to the well known problem that a model trained in one source domain performs poorly when applied to a target domain with different statistics. {Domain Generalization} (DG) techniques attempt to alleviate this issue by…

机器学习 · 计算机科学 2017-10-11 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Since the publication of the original Transformer architecture (Vaswani et al. 2017), Transformers revolutionized the field of Natural Language Processing. This, mainly due to their ability to understand timely dependencies better than…

机器学习 · 计算机科学 2020-12-21 Gideon Stein , Andrey Filchenkov , Arip Asadulaev

In this paper, hypernetworks are trained to generate behaviors across a range of unseen task conditions, via a novel TD-based training objective and data from a set of near-optimal RL solutions for training tasks. This work relates to meta…

In many-task optimization scenarios, surrogate models are valuable for mitigating the computational burden of repeated fitness evaluations across tasks. This study proposes a novel meta-surrogate framework to assist many-task optimization,…

机器学习 · 计算机科学 2026-02-05 Xian-Rong Zhang , Yue-Jiao Gong , Yuan-Ting Zhong , Ting Huang , Jun Zhang

Accurate and effective channel state information (CSI) feedback is a key technology for massive multiple-input and multiple-output systems. Recently, deep learning (DL) has been introduced for CSI feedback enhancement through massive…

信号处理 · 电气工程与系统科学 2023-10-26 Han Xiao , Wenqiang Tian , Wendong Liu , Jiajia Guo , Zhi Zhang , Shi Jin , Zhihua Shi , Li Guo , Jia Shen

Offline meta reinforcement learning (OMRL) has emerged as a promising approach for interaction avoidance and strong generalization performance by leveraging pre-collected data and meta-learning techniques. Previous context-based approaches…

机器学习 · 计算机科学 2025-02-04 Hai Zhang , Boyuan Zheng , Tianying Ji , Jinhang Liu , Anqi Guo , Junqiao Zhao , Lanqing Li

Meta learning has attracted much attention recently in machine learning community. Contrary to conventional machine learning aiming to learn inherent prediction rules to predict labels for new query data, meta learning aims to learn the…

机器学习 · 计算机科学 2023-07-04 Jun Shu , Deyu Meng , Zongben Xu

Reinforcement learning (RL) is a sub-domain of machine learning, mainly concerned with solving sequential decision-making problems by a learning agent that interacts with the decision environment to improve its behavior through the reward…

机器学习 · 计算机科学 2025-09-23 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Liang Lin

Offline meta-reinforcement learning (OMRL) utilizes pre-collected offline datasets to enhance the agent's generalization ability on unseen tasks. However, the context shift problem arises due to the distribution discrepancy between the…

机器学习 · 计算机科学 2023-11-08 Yunkai Gao , Rui Zhang , Jiaming Guo , Fan Wu , Qi Yi , Shaohui Peng , Siming Lan , Ruizhi Chen , Zidong Du , Xing Hu , Qi Guo , Ling Li , Yunji Chen

We propose a novel framework for comprehending the reasoning capabilities of large language models (LLMs) through the perspective of meta-learning. By conceptualizing reasoning trajectories as pseudo-gradient descent updates to the LLM's…

计算与语言 · 计算机科学 2025-05-27 Junnan Liu , Hongwei Liu , Linchen Xiao , Shudong Liu , Taolin Zhang , Zihan Ma , Songyang Zhang , Kai Chen

Deep neural networks excel in regimes with large amounts of data, but tend to struggle when data is scarce or when they need to adapt quickly to changes in the task. In response, recent work in meta-learning proposes training a meta-learner…

人工智能 · 计算机科学 2018-02-27 Nikhil Mishra , Mostafa Rohaninejad , Xi Chen , Pieter Abbeel

Decision-making for urban autonomous driving is challenging due to the stochastic nature of interactive traffic participants and the complexity of road structures. Although reinforcement learning (RL)-based decision-making scheme is…

机器学习 · 计算机科学 2023-08-28 Haochen Liu , Zhiyu Huang , Xiaoyu Mo , Chen Lv

Typical reinforcement learning (RL) agents learn to complete tasks specified by reward functions tailored to their domain. As such, the policies they learn do not generalize even to similar domains. To address this issue, we develop a…

人工智能 · 计算机科学 2017-05-26 Himanshu Sahni , Saurabh Kumar , Farhan Tejani , Yannick Schroecker , Charles Isbell

Reinforcement learning (RL) is well known for requiring large amounts of data in order for RL agents to learn to perform complex tasks. Recent progress in model-based RL allows agents to be much more data-efficient, as it enables them to…

机器学习 · 计算机科学 2021-08-17 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

Meta reinforcement learning (Meta-RL) methods such as RL$^2$ have emerged as promising approaches for learning data-efficient RL algorithms tailored to a given task distribution. However, they show poor asymptotic performance and struggle…

机器学习 · 计算机科学 2025-07-29 Abhinav Bhatia , Samer B. Nashed , Shlomo Zilberstein