English
Related papers

Related papers: True Online TD-Replan(lambda) Achieving Planning t…

200 papers

Building upon the recent success of deep reinforcement learning methods, we investigate the possibility of on-policy reinforcement learning improvement by reusing the data from several consecutive policies. On-policy methods bring many…

Machine Learning · Computer Science 2019-01-21 Dmitry Kangin , Nicolas Pugeault

The number of parameters in large-scale language models based on transformers is gradually increasing, and the scale of computing clusters is also growing. The technology of quickly mobilizing large amounts of computing resources for…

Artificial Intelligence · Computer Science 2025-01-03 Zongbiao Li , Xiezhao Li , Yinghao Cui , Yijun Chen , Zhixuan Gu , Yuxuan Liu , Wenbo Zhu , Fei Jia , Ke Liu , Qifeng Li , Junyao Zhan , Jiangtao Zhou , Chenxi Zhang , Qike Liu

Reinforcement learning (RL) is a critical component of large language model (LLM) post-training. However, on-policy algorithms used for post-training are not naturally robust to a diversified content of experience replay buffers, which…

We consider a distributed setup for reinforcement learning, where each agent has a copy of the same Markov Decision Process but transitions are sampled from the corresponding Markov chain independently by each agent. We show that in this…

Machine Learning · Computer Science 2024-06-04 Haoxing Tian , Ioannis Ch. Paschalidis , Alex Olshevsky

In this work we propose a planning and acting architecture endowed with a module which learns to select subgoals with Deep Q-Learning. This allows us to decrease the load of a planner when faced with scenarios with real-time restrictions.…

Artificial Intelligence · Computer Science 2024-06-24 Carlos Núñez-Molina , Juan Fernández-Olivares , Raúl Pérez

Large language models (LLMs) have achieved remarkable success in a wide range of natural language processing tasks and can be adapted through prompting. However, they remain suboptimal in multi-turn interactions, often relying on incorrect…

Experience replay (ER) is a fundamental component of off-policy deep reinforcement learning (RL). ER recalls experiences from past iterations to compute gradient estimates for the current policy, increasing data-efficiency. However, the…

Machine Learning · Computer Science 2019-05-21 Guido Novati , Petros Koumoutsakos

Diffusion models have shown strong competitiveness in offline reinforcement learning tasks by formulating decision-making as sequential generation. However, the practicality of these methods is limited due to the lengthy inference processes…

Machine Learning · Computer Science 2024-07-24 Renming Huang , Yunqiang Pei , Guoqing Wang , Yangming Zhang , Yang Yang , Peng Wang , Hengtao Shen

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause…

Machine Learning · Computer Science 2019-03-01 Anusha Nagabandi , Ignasi Clavera , Simin Liu , Ronald S. Fearing , Pieter Abbeel , Sergey Levine , Chelsea Finn

In the context of an efficient network traffic engineering process where the network continuously measures a new traffic matrix and updates the set of paths in the network, an automated process is required to quickly and efficiently…

Networking and Internet Architecture · Computer Science 2022-12-23 Shahrooz Pouryousef , Lixin Gao , Don Towsley

We propose a new bootstrap-based online algorithm for stochastic linear bandit problems. The key idea is to adopt residual bootstrap exploration, in which the agent estimates the next step reward by re-sampling the residuals of mean reward…

Machine Learning · Statistics 2022-06-20 Shuang Wu , Chi-Hua Wang , Yuantong Li , Guang Cheng

Experience replay serves as a key component in the success of online reinforcement learning (RL). Prioritized experience replay (PER) reweights experiences by the temporal difference (TD) error empirically enhancing the performance.…

Machine Learning · Computer Science 2024-09-20 Changling Li , Zhang-Wei Hong , Pulkit Agrawal , Divyansh Garg , Joni Pajarinen

Grounding the reasoning ability of large language models (LLMs) for embodied tasks is challenging due to the complexity of the physical world. Especially, LLM planning for multi-agent collaboration requires communication of agents or credit…

Artificial Intelligence · Computer Science 2025-09-30 Yang Zhang , Shixin Yang , Chenjia Bai , Fei Wu , Xiu Li , Zhen Wang , Xuelong Li

Coverage path planning (CPP) is the problem of finding a path that covers the entire free space of a confined area, with applications ranging from robotic lawn mowing to search-and-rescue. While for known environments, offline methods can…

Robotics · Computer Science 2025-08-26 Arvi Jonnarth , Ola Johansson , Jie Zhao , Michael Felsberg

In adversarial settings, a mobile agent may strategically plan its motion to influence an opponent's inference about its intended goal. We study deceptive path planning in a scenario where a mobile agent aims to reach a privately selected…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Violetta Rostobaya , Yue Guan , James Berneburg , Daigo Shishika

Replanning in temporal logic tasks is extremely difficult during the online execution of robots. This study introduces an effective path planner that computes solutions for temporal logic goals and instantly adapts to non-static and…

Robotics · Computer Science 2023-02-23 Yizhou Chen , Ruoyu Wang , Xinyi Wang , Ben M. Chen

How can we plan efficiently in a large and complex environment when the time budget is limited? Given the original simulator of the environment, which may be computationally very demanding, we propose to learn online an approximate but much…

Artificial Intelligence · Computer Science 2022-12-14 Jinke He , Miguel Suau , Hendrik Baier , Michael Kaisers , Frans A. Oliehoek

Training a task-completion dialogue agent via reinforcement learning (RL) is costly because it requires many interactions with real users. One common alternative is to use a user simulator. However, a user simulator usually lacks the…

Computation and Language · Computer Science 2018-05-24 Baolin Peng , Xiujun Li , Jianfeng Gao , Jingjing Liu , Kam-Fai Wong , Shang-Yu Su

Linear Temporal Logic (LTL) offers a precise means for constraining the behavior of reinforcement learning agents. However, in many settings where both satisfaction and optimality conditions are present, LTL is insufficient to capture both.…

Machine Learning · Computer Science 2025-03-26 Ameesh Shah , Cameron Voloshin , Chenxi Yang , Abhinav Verma , Swarat Chaudhuri , Sanjit A. Seshia

Person search is an extended task of person re-identification (Re-ID). However, most existing one-step person search works have not studied how to employ existing advanced Re-ID models to boost the one-step person search performance due to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Chuang Liu , Hua Yang , Qin Zhou , Shibao Zheng