English
Related papers

Related papers: Adjusting the Output of Decision Transformer with …

200 papers

Traditional approaches in offline reinforcement learning aim to learn the optimal policy that maximizes the cumulative reward, also known as return. It is increasingly important to adjust the performance of AI agents to meet human…

Machine Learning · Computer Science 2025-06-23 Tsunehiko Tanaka , Kenshi Abe , Kaito Ariu , Tetsuro Morimura , Edgar Simo-Serra

Recent works have shown that tackling offline reinforcement learning (RL) with a conditional policy produces promising results. The Decision Transformer (DT) combines the conditional policy approach and a transformer architecture, showing…

Machine Learning · Computer Science 2023-05-26 Taku Yamagata , Ahmed Khalil , Raul Santos-Rodriguez

We study offline off-dynamics reinforcement learning (RL) to utilize data from an easily accessible source domain to enhance policy learning in a target domain with limited data. Our approach centers on return-conditioned supervised…

Machine Learning · Computer Science 2026-03-03 Ruhan Wang , Yu Yang , Zhishuai Liu , Dongruo Zhou , Pan Xu

Decision Transformer (DT) is an innovative algorithm leveraging recent advances of the transformer architecture in reinforcement learning (RL). However, a notable limitation of DT is its reliance on recalling trajectories from datasets,…

Machine Learning · Computer Science 2023-11-02 Yi Ma , Chenjun Xiao , Hebin Liang , Jianye Hao

The Decision Transformer (DT) has established a powerful sequence modeling approach to offline reinforcement learning. It conditions its action predictions on Return-to-Go (RTG), using it both to distinguish trajectory quality during…

Artificial Intelligence · Computer Science 2026-01-23 Yongyi Wang , Hanyu Liu , Lingfeng Li , Bozhou Chen , Ang Li , Qirui Zheng , Xionghui Yang , Wenxin Li

Reinforcement Learning (RL) methods used for solving real-world optimization problems often involve dynamic state-action spaces, larger scale, and sparse rewards, leading to significant challenges in convergence, scalability, and efficient…

Machine Learning · Computer Science 2025-09-29 Stavros Orfanoudakis , Nanda Kishor Panda , Peter Palensky , Pedro P. Vergara

Decision Transformer (DT) formulates offline reinforcement learning as autoregressive sequence modeling, achieving promising results by predicting actions from a sequence of Return-to-Go (RTG), state, and action tokens. However, RTG is a…

Machine Learning · Computer Science 2026-05-08 Yongyi Wang , Hanyu Liu , Lingfeng Li , Bozhou Chen , Ang Li , Qirui Zheng , Xionghui Yang , Chucai Wang , Wenxin Li

Decision Transformer (DT), which employs expressive sequence modeling techniques to perform action generation, has emerged as a promising approach to offline policy optimization. However, DT generates actions conditioned on a desired future…

Machine Learning · Computer Science 2024-06-25 Chen-Xiao Gao , Chenyang Wu , Mingjun Cao , Rui Kong , Zongzhang Zhang , Yang Yu

Decision Transformers have recently emerged as a new and compelling paradigm for offline Reinforcement Learning (RL), completing a trajectory in an autoregressive way. While improvements have been made to overcome initial shortcomings,…

Machine Learning · Computer Science 2024-11-01 Kai Yan , Alexander G. Schwing , Yu-Xiong Wang

The field of Offline Reinforcement Learning (RL) aims to derive effective policies from pre-collected datasets without active environment interaction. While traditional offline RL algorithms like Conservative Q-Learning (CQL) and Implicit…

Machine Learning · Computer Science 2025-11-21 Ali Murtaza Caunhye , Asad Jeewa

In the realm of online advertising, advertisers partake in ad auctions to obtain advertising slots, frequently taking advantage of auto-bidding tools provided by demand-side platforms. To improve the automation of these bidding systems, we…

Machine Learning · Computer Science 2025-06-30 Hao Jiang , Yongxiang Tang , Yanxiang Zeng , Pengjia Yuan , Yanhua Cheng , Teng Sha , Xialong Liu , Peng Jiang

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

Offline reinforcement learning (RL) is a challenging task, whose objective is to learn policies from static trajectory data without interacting with the environment. Recently, offline RL has been viewed as a sequence modeling problem, where…

Machine Learning · Computer Science 2023-03-08 Shengchao Hu , Li Shen , Ya Zhang , Dacheng Tao

As the next generation of mobile systems evolves, artificial intelligence (AI) is expected to deeply integrate with wireless communications for resource management in variable environments. In particular, deep reinforcement learning (DRL)…

Signal Processing · Electrical Eng. & Systems 2024-10-15 Jie Zhang , Jun Li , Long Shi , Zhe Wang , Shi Jin , Wen Chen , H. Vincent Poor

Control design for robotic systems is complex and often requires solving an optimization to follow a trajectory accurately. Online optimization approaches like Model Predictive Control (MPC) have been shown to achieve great tracking…

Decision Transformer (DT) can learn effective policy from offline datasets by converting the offline reinforcement learning (RL) into a supervised sequence modeling task, where the trajectory elements are generated auto-regressively…

Machine Learning · Computer Science 2024-11-19 Zhihong Liu , Long Qian , Zeyang Liu , Lipeng Wan , Xingyu Chen , Xuguang Lan

Notifications are an important communication channel for delivering timely and relevant information. Optimizing their delivery involves addressing complex sequential decision-making challenges under constraints such as message utility and…

Decision Transformer (DT), a trajectory modelling method, has shown competitive performance compared to traditional offline reinforcement learning (RL) approaches on various classic control tasks. However, it struggles to learn optimal…

Machine Learning · Computer Science 2025-09-18 Xingshuai Huang , Di Wu , Benoit Boulet

We introduce a framework that abstracts Reinforcement Learning (RL) as a sequence modeling problem. This allows us to draw upon the simplicity and scalability of the Transformer architecture, and associated advances in language modeling…

The excellent performance of Transformer in supervised learning has led to growing interest in its potential application to deep reinforcement learning (DRL) to achieve high performance on a wide variety of problems. However, the decision…

Machine Learning · Computer Science 2023-06-27 Hidenori Itaya , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi , Komei Sugiura
‹ Prev 1 2 3 10 Next ›