English
Related papers

Related papers: Offline Decision Transformers for Neural Combinato…

200 papers

Large transformer models pretrained on offline reinforcement learning datasets have demonstrated remarkable in-context reinforcement learning (ICRL) capabilities, where they can make good decisions when prompted with interaction…

Machine Learning · Computer Science 2024-05-28 Licong Lin , Yu Bai , Song Mei

Existing neural constructive solvers for routing problems have predominantly employed transformer architectures, conceptualizing the route construction as a set-to-sequence learning task. However, their efficacy has primarily been…

Machine Learning · Computer Science 2024-08-08 Yong Liang Goh , Zhiguang Cao , Yining Ma , Yanfei Dong , Mohammed Haroon Dupty , Wee Sun Lee

In the new wave of artificial intelligence, deep learning is impacting various industries. As a closely related area, optimization algorithms greatly contribute to the development of deep learning. But the reverse applications are still…

Machine Learning · Computer Science 2019-11-06 Zhengxuan Ling , Xinyu Tao , Yu Zhang , Xi Chen

Offline Reinforcement Learning (RL) enables policy learning without active interactions, making it especially appealing for self-driving tasks. Recent successes of Transformers inspire casting offline RL as sequence modeling, which,…

Machine Learning · Computer Science 2024-10-08 Zenan Li , Fan Nie , Qiao Sun , Fang Da , Hang Zhao

Offline reinforcement learning (RL) is a learning paradigm where an agent learns from a fixed dataset of experience. However, learning solely from a static dataset can limit the performance due to the lack of exploration. To overcome it,…

Machine Learning · Computer Science 2024-07-23 Kai Zhao , Jianye Hao , Yi Ma , Jinyi Liu , Yan Zheng , Zhaopeng Meng

Off-dynamics reinforcement learning (RL), where training and deployment transition dynamics are different, can be formulated as learning in a robust Markov decision process (RMDP) where uncertainties in transition dynamics are imposed.…

Machine Learning · Computer Science 2025-11-10 Yiting He , Zhishuai Liu , Weixin Wang , Pan Xu

Recent work has shown that Large Language Models (LLMs) can be incredibly effective for offline reinforcement learning (RL) by representing the traditional RL problem as a sequence modelling problem (Chen et al., 2021; Janner et al., 2021).…

Machine Learning · Computer Science 2023-02-01 Shyam Sudhakaran , Sebastian Risi

Deep reinforcement learning (DRL) has been used to learn effective heuristics for solving complex combinatorial optimisation problem via policy networks and have demonstrated promising performance. Existing works have focused on solving…

Machine Learning · Computer Science 2020-12-25 Nasrin Sultana , Jeffrey Chan , A. K. Qin , Tabinda Sarwar

Large Language Models (LLMs) have shown notable potential in code generation for optimization algorithms, unlocking exciting new opportunities. This paper examines how LLMs, rather than creating algorithms from scratch, can improve existing…

Artificial Intelligence · Computer Science 2025-07-22 Camilo Chacón Sartori , Christian Blum

Reinforcement learning (RL) has achieved impressive performance in a variety of online settings in which an agent's ability to query the environment for transitions and rewards is effectively unlimited. However, in many practical…

Machine Learning · Computer Science 2021-05-06 Anurag Ajay , Aviral Kumar , Pulkit Agrawal , Sergey Levine , Ofir Nachum

Hybrid Reinforcement Learning (RL), where an agent learns from both an offline dataset and online explorations in an unknown environment, has garnered significant recent interest. A crucial question posed by Xie et al. (2022) is whether…

Machine Learning · Statistics 2024-08-09 Kevin Tan , Wei Fan , Yuting Wei

We consider the online traveling salesman problem on the real line (OLTSPL) in which a salesman begins at the origin, traveling at no faster than unit speed along the real line, and wants to serve a sequence of requests, arriving online…

Data Structures and Algorithms · Computer Science 2025-07-10 Pei-Chuan Chen , Erik D. Demaine , Chung-Shou Liao , Hao-Ting Wei

Order Picker Routing is a critical issue in Warehouse Operations Management. Due to the complexity of the problem and the need for quick solutions, suboptimal algorithms are frequently employed in practice. However, Reinforcement Learning…

Machine Learning · Computer Science 2024-02-07 George Dunn , Hadi Charkhgard , Ali Eshragh , Sasan Mahmoudinazlou , Elizabeth Stojanovski

A promising paradigm for offline reinforcement learning (RL) is to constrain the learned policy to stay close to the dataset behaviors, known as policy constraint offline RL. However, existing works heavily rely on the purity of the data,…

Machine Learning · Computer Science 2022-10-20 Chengqian Gao , Ke Xu , Liu Liu , Deheng Ye , Peilin Zhao , Zhiqiang Xu

Offline reinforcement-learning (RL) algorithms learn to make decisions using a given, fixed training dataset without online data collection. This problem setting is captivating because it holds the promise of utilizing previously collected…

Machine Learning · Computer Science 2022-12-07 Dan Elbaz , Gal Novik , Oren Salzman

In this paper, we consider the problem of predicting unknown targets from data. We propose Online Residual Learning (ORL), a method that combines online adaptation with offline-trained predictions. At a lower level, we employ multiple…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Anastasios Vlachos , Anastasios Tsiamis , Aren Karapetyan , Efe C. Balta , John Lygeros

Offline reinforcement learning is used to train policies in scenarios where real-time access to the environment is expensive or impossible. As a natural consequence of these harsh conditions, an agent may lack the resources to fully observe…

Machine Learning · Computer Science 2021-12-09 Jayanth Reddy Regatti , Aniket Anand Deshmukh , Frank Cheng , Young Hun Jung , Abhishek Gupta , Urun Dogan

Model-based offline reinforcement learning (RL), which builds a supervised transition model with logging dataset to avoid costly interactions with the online environment, has been a promising approach for offline policy optimization. As the…

Machine Learning · Computer Science 2023-09-06 Junming Yang , Xingguo Chen , Shengyuan Wang , Bolei Zhang

Solving NP-hard/complete combinatorial problems with neural networks is a challenging research area that aims to surpass classical approximate algorithms. The long-term objective is to outperform hand-designed heuristics for…

Neural and Evolutionary Computing · Computer Science 2024-02-14 Dobrik Georgiev , Danilo Numeroso , Davide Bacciu , Pietro Liò

Inventory Routing Problem (IRP) is a crucial challenge in supply chain management as it involves optimizing efficient route selection while considering the uncertainty of inventory demand planning. To solve IRPs, usually a two-stage…

Machine Learning · Computer Science 2024-01-02 MD Shafikul Islam , Azmine Toushik Wasi