English
Related papers

Related papers: ACT: Empowering Decision Transformer with Dynamic …

200 papers

Recent research in offline reinforcement learning (RL) has demonstrated that return-conditioned supervised learning is a powerful paradigm for decision-making problems. While promising, return conditioning is limited to training data…

Machine Learning · Computer Science 2023-05-29 Zhihui Xie , Zichuan Lin , Deheng Ye , Qiang Fu , Wei Yang , Shuai Li

Decision Transformer (DT) has recently demonstrated strong generalizability in dynamic resource allocation within unmanned aerial vehicle (UAV) networks, compared to conventional deep reinforcement learning (DRL). However, its performance…

Signal Processing · Electrical Eng. & Systems 2025-08-05 Chi Lu , Yiyang Ni , Zhe Wang , Xiaoli Shi , Jun Li , Shi Jin

With the rapid advancement of Transformer-based Large Language Models (LLMs), generative recommendation has shown great potential in enhancing both the accuracy and semantic understanding of modern recommender systems. Compared to LLMs, the…

Information Retrieval · Computer Science 2025-08-19 Xiang Gao , Tianyuan Liu , Yisha Li , Jingxin Liu , Lexi Gao , Xin Li , Haiyang Lu , Liyin Hong

Leveraging machine learning methods to solve constraint satisfaction problems has shown promising, but they are mostly limited to a static situation where the problem description is completely known and fixed from the beginning. In this…

Machine Learning · Computer Science 2025-09-23 Wook Lee , Frans A. Oliehoek

This paper introduces Elastic Decision Transformer (EDT), a significant advancement over the existing Decision Transformer (DT) and its variants. Although DT purports to generate an optimal trajectory, empirical evidence suggests it…

Machine Learning · Computer Science 2023-10-23 Yueh-Hua Wu , Xiaolong Wang , Masashi Hamaya

Robotics has long been a field riddled with complex systems architectures whose modules and connections, whether traditional or learning-based, require significant human expertise and prior knowledge. Inspired by large pre-trained language…

Robotics · Computer Science 2022-09-27 Rogerio Bonatti , Sai Vemprala , Shuang Ma , Felipe Frujeri , Shuhang Chen , Ashish Kapoor

Test-time adaptation aims to improve model robustness under distribution shifts by adapting models with access to unlabeled target samples. A primary cause of performance degradation under such shifts is the model's reliance on features…

Machine Learning · Computer Science 2025-10-14 Yingnan Liu , Rui Qiao , Mong Li Lee , Wynne Hsu

The predominant approach in reinforcement learning is to assign credit to actions based on the expected return. However, we show that the return may depend on the policy in a way which could lead to excessive variance in value estimation…

Machine Learning · Computer Science 2023-02-07 Hsiao-Ru Pan , Nico Gürtler , Alexander Neitz , Bernhard Schölkopf

Closed-loop control of nonlinear dynamical systems with partial-state observability demands expert knowledge of a diverse, less standardized set of theoretical tools. Moreover, it requires a delicate integration of controller and estimator…

Systems and Control · Electrical Eng. & Systems 2024-04-04 Xiangyuan Zhang , Weichao Mao , Haoran Qiu , Tamer Başar

Catastrophic forgetting poses a substantial challenge for managing intelligent agents controlled by a large model, causing performance degradation when these agents face new tasks. In our work, we propose a novel solution - the Progressive…

Machine Learning · Computer Science 2025-09-04 Zhiyuan Wang , Xiaoyang Qu , Jing Xiao , Bokui Chen , Jianzong Wang

The paper develops the Adaptive Dynamic Programming Toolbox (ADPT), which solves optimal control problems for continuous-time nonlinear systems. Based on the adaptive dynamic programming technique, the ADPT computes optimal feedback…

Optimization and Control · Mathematics 2021-01-01 Xiaowei Xing , Dong Eui Chang

In response to the threat of adversarial examples, adversarial training provides an attractive option for enhancing the model robustness by training models on online-augmented adversarial examples. However, most of the existing adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jia-Li Yin , Lehui Xie , Wanqing Zhu , Ximeng Liu , Bo-Hao Chen

Emergency vehicle (EV) response time is a critical determinant of survival outcomes, yet deployed signal preemption strategies remain reactive and uncontrollable. We propose a return-conditioned framework for emergency corridor optimization…

Machine Learning · Computer Science 2026-03-25 Haoran Su , Hanxiao Deng , Yandong Sun

This article outlines a method for automatically generating models of dynamic decision-making that both have strong predictive power and are interpretable in human terms. This is useful for designing empirically grounded agent-based…

Machine Learning · Statistics 2016-11-17 John J. Nay , Jonathan M. Gilligan

Decision Transformer (DT), as one of the representative Reinforcement Learning via Supervised Learning (RvS) methods, has achieved strong performance in offline learning tasks by leveraging the powerful Transformer architecture for…

Machine Learning · Computer Science 2024-11-04 Xiaohang Tang , Afonso Marques , Parameswaran Kamalaruban , Ilija Bogunovic

Decision Transformer (DT) can learn effective policy from offline datasets by converting the offline reinforcement learning (RL) into a supervised sequence modeling task, where the trajectory elements are generated auto-regressively…

Machine Learning · Computer Science 2024-11-19 Zhihong Liu , Long Qian , Zeyang Liu , Lipeng Wan , Xingyu Chen , Xuguang Lan

As the next generation of mobile systems evolves, artificial intelligence (AI) is expected to deeply integrate with wireless communications for resource management in variable environments. In particular, deep reinforcement learning (DRL)…

Signal Processing · Electrical Eng. & Systems 2024-10-15 Jie Zhang , Jun Li , Long Shi , Zhe Wang , Shi Jin , Wen Chen , H. Vincent Poor

In autonomous driving tasks, trajectory prediction in complex traffic environments requires adherence to real-world context conditions and behavior multimodalities. Existing methods predominantly rely on prior assumptions or generative…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yiming Xu , Hao Cheng , Monika Sester

Data availability is a bottleneck during early stages of development of new capabilities for intelligent artificial agents. We investigate the use of text generation techniques to augment the training data of a popular commercial artificial…

Computation and Language · Computer Science 2019-10-09 Nikolaos Malandrakis , Minmin Shen , Anuj Goyal , Shuyang Gao , Abhishek Sethi , Angeliki Metallinou

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin