English
Related papers

Related papers: Elastic Decision Transformer

200 papers

Decision Transformer (DT) is a recently proposed architecture for Reinforcement Learning that frames the decision-making process as an auto-regressive sequence modeling problem and uses a Transformer model to predict the next action in a…

Machine Learning · Computer Science 2022-11-29 Max Siebenborn , Boris Belousov , Junning Huang , Jan Peters

Recent work has shown that Large Language Models (LLMs) can be incredibly effective for offline reinforcement learning (RL) by representing the traditional RL problem as a sequence modelling problem (Chen et al., 2021; Janner et al., 2021).…

Machine Learning · Computer Science 2023-02-01 Shyam Sudhakaran , Sebastian Risi

In-context learning is a promising approach for offline reinforcement learning (RL) to handle online tasks, which can be achieved by providing task prompts. Recent works demonstrated that in-context RL could emerge with self-improvement in…

Machine Learning · Computer Science 2024-06-03 Sili Huang , Jifeng Hu , Hechang Chen , Lichao Sun , Bo Yang

Functional decision theory (FDT) is a fairly new mode of decision theory and a normative viewpoint on how an agent should maximize expected utility. The current standard in decision theory and computer science is causal decision theory…

Theoretical Economics · Economics 2021-04-27 Noah Topper

Predictive control approaches based on deep reinforcement learning (DRL) have gained significant attention in microgrid energy optimization. However, existing research often overlooks the issue of uncertainty stemming from imperfect…

Machine Learning · Computer Science 2025-11-25 Fulong Yao , Wanqing Zhao , Matthew Forshaw

Decision Transformer (DT) can learn effective policy from offline datasets by converting the offline reinforcement learning (RL) into a supervised sequence modeling task, where the trajectory elements are generated auto-regressively…

Machine Learning · Computer Science 2024-11-19 Zhihong Liu , Long Qian , Zeyang Liu , Lipeng Wan , Xingyu Chen , Xuguang Lan

Data-driven learning based methods have recently been particularly successful at learning robust locomotion controllers for a variety of unstructured terrains. Prior work has shown that incorporating good locomotion priors in the form of…

Neural and Evolutionary Computing · Computer Science 2023-06-23 Shikha Surana , Bryan Lim , Antoine Cully

Decision Transformer (DT), which employs expressive sequence modeling techniques to perform action generation, has emerged as a promising approach to offline policy optimization. However, DT generates actions conditioned on a desired future…

Machine Learning · Computer Science 2024-06-25 Chen-Xiao Gao , Chenyang Wu , Mingjun Cao , Rui Kong , Zongzhang Zhang , Yang Yu

Closed-loop control of nonlinear dynamical systems with partial-state observability demands expert knowledge of a diverse, less standardized set of theoretical tools. Moreover, it requires a delicate integration of controller and estimator…

Systems and Control · Electrical Eng. & Systems 2024-04-04 Xiangyuan Zhang , Weichao Mao , Haoran Qiu , Tamer Başar

This paper introduces Dynamic Embeddings with Task-Oriented prompting (DETOT), a novel approach aimed at improving the adaptability and efficiency of machine learning models by implementing a flexible embedding layer. Unlike traditional…

Computation and Language · Computer Science 2024-06-25 Allmin Balloccu , Jack Zhang

Decision Transformer (DT), as one of the representative Reinforcement Learning via Supervised Learning (RvS) methods, has achieved strong performance in offline learning tasks by leveraging the powerful Transformer architecture for…

Machine Learning · Computer Science 2024-11-04 Xiaohang Tang , Afonso Marques , Parameswaran Kamalaruban , Ilija Bogunovic

Offline reinforcement learning (RL) is a challenging task, whose objective is to learn policies from static trajectory data without interacting with the environment. Recently, offline RL has been viewed as a sequence modeling problem, where…

Machine Learning · Computer Science 2023-03-08 Shengchao Hu , Li Shen , Ya Zhang , Dacheng Tao

In tasks aiming for long-term returns, planning becomes essential. We study generative modeling for planning with datasets repurposed from offline reinforcement learning. Specifically, we identify temporal consistency in the absence of…

Machine Learning · Computer Science 2025-08-19 Deqian Kong , Dehong Xu , Minglu Zhao , Bo Pang , Jianwen Xie , Andrew Lizarraga , Yuhao Huang , Sirui Xie , Ying Nian Wu

Early Classification of Time Series (ECTS) addresses decision-making problems in which predictions must be made as early as possible while maintaining high accuracy. Most existing ECTS methods assume that the time-dependent decision costs…

Machine Learning · Computer Science 2026-04-06 Aurélien Renault , Alexis Bondu , Antoine Cornuéjols , Vincent Lemaire

Evolutionary multitasking (EMT) is an emerging approach for solving multitask optimization problems (MTOPs) and has garnered considerable research interest. The implicit EMT is a significant research branch that utilizes evolution operators…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Sheng-Hao Wu , Yuxiao Huang , Xingyu Wu , Liang Feng , Zhi-Hui Zhan , Kay Chen Tan

Many drone-related applications (e.g., drone-aided video capture, drone traffic and safety management) require group communications between drones to efficiently disseminate data or reliably deliver critical information, making use of the…

Networking and Internet Architecture · Computer Science 2020-08-18 Wanqing Tu

Offline reinforcement learning enables policy learning from pre-collected datasets without environment interaction, but existing Decision Transformer (DT) architectures struggle with long-horizon credit assignment and complex state-action…

Machine Learning · Computer Science 2025-12-18 Abraham Itzhak Weinberg

Humans can leverage prior experience and learn novel tasks from a handful of demonstrations. In contrast to offline meta-reinforcement learning, which aims to achieve quick adaptation through better algorithm design, we investigate the…

Machine Learning · Computer Science 2022-06-28 Mengdi Xu , Yikang Shen , Shun Zhang , Yuchen Lu , Ding Zhao , Joshua B. Tenenbaum , Chuang Gan

Recurrent Neural Network, Long Short-Term Memory, and Transformer have made great progress in predicting the trajectories of moving objects. Although the trajectory element with the surrounding scene features has been merged to improve…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Wendong Zhang , Qingjie Chai , Quanqi Zhang , Chengwei Wu

The Transformer, a highly expressive architecture for sequence modeling, has recently been adapted to solve sequential decision-making, most notably through the Decision Transformer (DT), which learns policies by conditioning on desired…

Machine Learning · Computer Science 2025-10-15 Xiaohang Tang , Zhuowen Cheng , Satyabrat Kumar