中文
相关论文

相关论文: Generalized Decision Transformer for Offline Hinds…

200 篇论文

Predictive models of the future are fundamental for an agent's ability to reason and plan. A common strategy learns a world model and unrolls it step-by-step at inference, where small errors can rapidly compound. Geometric Horizon Models…

机器学习 · 计算机科学 2025-03-14 Jesse Farebrother , Matteo Pirotta , Andrea Tirinzoni , Rémi Munos , Alessandro Lazaric , Ahmed Touati

Decision Transformers have recently emerged as a new and compelling paradigm for offline Reinforcement Learning (RL), completing a trajectory in an autoregressive way. While improvements have been made to overcome initial shortcomings,…

机器学习 · 计算机科学 2024-11-01 Kai Yan , Alexander G. Schwing , Yu-Xiong Wang

Decision Transformer (DT), which integrates reinforcement learning (RL) with the transformer model, introduces a novel approach to offline RL. Unlike classical algorithms that take maximizing cumulative discounted rewards as objective, DT…

机器学习 · 计算机科学 2025-10-08 Rui Lin , Yiwen Zhang , Zhicheng Peng , Minghao Lyu

Diversified distribution matching (DDM) finds a unified translation function mapping a diverse collection of conditional source distributions to their target counterparts. DDM was proposed to resolve content misalignment issues in unpaired…

机器学习 · 计算机科学 2025-11-11 Sagar Shrestha , Xiao Fu

Prompt tuning has emerged as a key technique for adapting large pre-trained Decision Transformers (DTs) in offline Reinforcement Learning (RL), particularly in multi-task and few-shot settings. The Prompting Decision Transformer (PDT)…

机器学习 · 计算机科学 2025-10-02 Finn Rietz , Oleg Smirnov , Sara Karimi , Lele Cao

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

人工智能 · 计算机科学 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

If the probability model is correctly specified, then we can estimate the covariance matrix of the asymptotic maximum likelihood estimate distribution using either the first or second derivatives of the likelihood function. Therefore, if…

统计方法学 · 统计学 2024-11-06 Reyhaneh Hosseinpourkhoshkbari , Richard M. Golden

Long Document Classification (LDC) has gained significant attention recently. However, multi-modal data in long documents such as texts and images are not being effectively utilized. Prior studies in this area have attempted to integrate…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Tengfei Liu , Yongli Hu , Junbin Gao , Yanfeng Sun , Baocai Yin

Going beyond few-shot action recognition (FSAR), cross-domain FSAR (CDFSAR) has attracted recent research interests by solving the domain gap lying in source-to-target transfer learning. Existing CDFSAR methods mainly focus on joint…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Yilong Wang , Zilin Gao , Qilong Wang , Zhaofeng Chen , Peihua Li , Qinghua Hu

Securing long-term success is the ultimate aim of recommender systems, demanding strategies capable of foreseeing and shaping the impact of decisions on future user satisfaction. Current recommendation strategies grapple with two…

信息检索 · 计算机科学 2025-01-14 Chongming Gao , Kexin Huang , Ziang Fei , Jiaju Chen , Jiawei Chen , Jianshan Sun , Shuchang Liu , Qingpeng Cai , Peng Jiang

Temporal-difference learning with gradient correction (TDC) is a two time-scale algorithm for policy evaluation in reinforcement learning. This algorithm was initially proposed with linear function approximation, and was later extended to…

机器学习 · 计算机科学 2021-10-29 Yue Wang , Shaofeng Zou , Yi Zhou

The Knowledge Tracing (KT) task focuses on predicting a learner's future performance based on the historical interactions. The knowledge state plays a key role in learning process. However, considering that the knowledge state is influenced…

人工智能 · 计算机科学 2024-12-30 Shanshan Wang , Xueying Zhang , Keyang Wang , Xun Yang , Xingyi Zhang

Two major sources of training data exist for post-training modern language models: online (model-generated rollouts) data, and offline (human or other-model demonstrations) data. These two types of data are typically used by approaches like…

Planning based on long and short term time series forecasts is a common practice across many industries. In this context, temporal aggregation and reconciliation techniques have been useful in improving forecasts, reducing model…

机器学习 · 计算机科学 2022-01-31 Himanshi Charotia , Abhishek Garg , Gaurav Dhama , Naman Maheshwari

Offline reinforcement learning (RL) allows agents to learn effective, return-maximizing policies from a static dataset. Three popular algorithms for offline RL are Conservative Q-Learning (CQL), Behavior Cloning (BC), and Decision…

机器学习 · 计算机科学 2024-03-13 Prajjwal Bhargava , Rohan Chitnis , Alborz Geramifard , Shagun Sodhani , Amy Zhang

Restricted Boltzmann machines (RBMs) and their extensions, called 'deep-belief networks', are powerful neural networks that have found applications in the fields of machine learning and artificial intelligence. The standard way to training…

机器学习 · 计算机科学 2018-10-25 Haik Manukian , Fabio L. Traversa , Massimiliano Di Ventra

One of the key challenges of learning an online recommendation model is the temporal domain shift, which causes the mismatch between the training and testing data distribution and hence domain generalization error. To overcome, we propose…

Knowledge tracing (KT), wherein students' problem-solving histories are used to estimate their current levels of knowledge, has attracted significant interest from researchers. However, most existing KT models were developed with an…

计算与语言 · 计算机科学 2024-06-19 Heeseok Jung , Jaesang Yoo , Yohaan Yoon , Yeonju Jang

Cross-domain Click-Through Rate prediction aims to tackle the data sparsity and the cold start problems in online advertising systems by transferring knowledge from source domains to a target domain. Most existing methods rely on…

人工智能 · 计算机科学 2025-07-08 Wei Xu , Haoran Li , Baoyuan Ou , Lai Xu , Yingjie Qin , Ruilong Su , Ruiwen Xu

Domain generalization (DG) aims to improve the generalizability of computer vision models toward distribution shifts. The mainstream DG methods focus on learning domain invariance, however, such methods overlook the potential inherent in…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Shaocong Long , Qianyu Zhou , Xiangtai Li , Chenhao Ying , Yunhai Tong , Lizhuang Ma , Yuan Luo , Dacheng Tao