English
Related papers

Related papers: Digi-Q: Learning Q-Value Functions for Training De…

200 papers

Recent advances in Vision-Language Models (VLMs) have enabled mobile agents to perceive and interact with real-world mobile environments based on human instructions. However, the current fully autonomous paradigm poses potential safety…

Artificial Intelligence · Computer Science 2026-04-28 Qihang Ai , Pi Bu , Yue Cao , Yingyao Wang , Jihao Gu , Jingxuan Xing , Zekun Zhu , Wei Jiang , Zhicheng Zheng , Jun Song , Yuning Jiang

We propose Q-Policy, a hybrid quantum-classical reinforcement learning (RL) framework that mathematically accelerates policy evaluation and optimization by exploiting quantum computing primitives. Q-Policy encodes value functions in quantum…

Machine Learning · Computer Science 2025-06-10 Kalyan Cherukuri , Aarav Lala , Yash Yardi

Model-based representations recently stand out as a promising framework that embeds latent dynamics information into the representations for downstream off-policy actor-critic learning. It implicitly combines the advantages of both…

Machine Learning · Computer Science 2026-05-13 Jiafei Lyu , Zichuan Lin , Scott Fujimoto , Kai Yang , Yangkun Chen , Saiyong Yang , Zongqing Lu , Deheng Ye

Scaling reinforcement learning (RL) to recommender systems (RS) is promising since maximizing the expected cumulative rewards for RL agents meets the objective of RS, i.e., improving customers' long-term satisfaction. A key approach to this…

Machine Learning · Computer Science 2022-09-27 Chengqian Gao , Ke Xu , Kuangqi Zhou , Lanqing Li , Xueqian Wang , Bo Yuan , Peilin Zhao

Autonomous driving (AD) agents generate driving policies based on online perception results, which are obtained at multiple levels of abstraction, e.g., behavior planning, motion planning and control. Driving policies are crucial to the…

Robotics · Computer Science 2022-01-21 Zeyu Zhu , Huijing Zhao

This paper explores the application of a reinforcement learning (RL) framework using the Q-Learning algorithm to enhance dynamic pricing strategies in the retail sector. Unlike traditional pricing methods, which often rely on static demand…

Machine Learning · Computer Science 2024-11-28 Mohit Apte , Ketan Kale , Pranav Datar , Pratiksha Deshmukh

Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored…

Multiagent Systems · Computer Science 2018-02-28 Gregory Palmer , Karl Tuyls , Daan Bloembergen , Rahul Savani

The task of collision-free navigation (CFN) of self-driving cars is an NP-hard problem usually tackled using Deep Reinforcement Learning (DRL). While DRL methods have proven to be effective, their implementation requires substantial…

Quantum Physics · Physics 2023-12-27 Akash Sinha , Antonio Macaluso , Matthias Klusch

Consider the problem of training robustly capable agents. One approach is to generate a diverse collection of agent polices. Training can then be viewed as a quality diversity (QD) optimization problem, where we search for a collection of…

Machine Learning · Computer Science 2022-04-18 Bryon Tjanaka , Matthew C. Fontaine , Julian Togelius , Stefanos Nikolaidis

Considering its advantages in dealing with high-dimensional visual input and learning control policies in discrete domain, Deep Q Network (DQN) could be an alternative method of traditional auto-focus means in the future. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Xiaofan Yu , Runze Yu , Jingsong Yang , Xiaohui Duan

New forms of on-demand transportation such as ride-hailing and connected autonomous vehicles are proliferating, yet are a challenging use case for electric vehicles (EV). This paper explores the feasibility of using deep reinforcement…

Systems and Control · Electrical Eng. & Systems 2019-12-10 Jacob F. Pettit , Ruben Glatt , Jonathan R. Donadee , Brenden K. Petersen

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

Machine Learning · Computer Science 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

Sample efficiency is critical when applying learning-based methods to robotic manipulation due to the high cost of collecting expert demonstrations and the challenges of on-robot policy learning through online Reinforcement Learning (RL).…

Machine Learning · Computer Science 2024-06-21 Arsh Tangri , Ondrej Biza , Dian Wang , David Klee , Owen Howell , Robert Platt

This paper addresses the problem of designing control policies for agents with unknown stochastic dynamics and control objectives specified using Linear Temporal Logic (LTL). Recent Deep Reinforcement Learning (DRL) algorithms have aimed to…

Robotics · Computer Science 2025-04-23 Jun Wang , Hosein Hasanbeig , Kaiyuan Tan , Zihe Sun , Yiannis Kantaros

Offline reinforcement learning (RL) allows for the training of competent agents from offline datasets without any interaction with the environment. Online finetuning of such offline models can further improve performance. But how should we…

Machine Learning · Computer Science 2023-03-31 Yicheng Luo , Jackie Kay , Edward Grefenstette , Marc Peter Deisenroth

We employ the Deep Q-Learning algorithm with Experience Replay to train an agent capable of achieving a high-level of play in the L-Game while self-learning from low-dimensional states. We also employ variable batch size for training in…

Machine Learning · Computer Science 2018-02-20 Petros Giannakopoulos , Yannis Cotronis

In this paper, we explore deep reinforcement learning algorithms for vision-based robotic grasping. Model-free deep reinforcement learning (RL) has been successfully applied to a range of challenging environments, but the proliferation of…

Robotics · Computer Science 2018-03-30 Deirdre Quillen , Eric Jang , Ofir Nachum , Chelsea Finn , Julian Ibarz , Sergey Levine

Reinforcement learning is time-consuming for complex tasks due to the need for large amounts of training data. Recent advances in GPU-based simulation, such as Isaac Gym, have sped up data collection thousands of times on a commodity GPU.…

Machine Learning · Computer Science 2023-07-25 Zechu Li , Tao Chen , Zhang-Wei Hong , Anurag Ajay , Pulkit Agrawal

A key problem in off-policy Reinforcement Learning (RL) is the mismatch, or distribution shift, between the dataset and the distribution over states and actions visited by the learned policy. This problem is exacerbated in the fully offline…

Machine Learning · Computer Science 2023-11-28 Melrose Roderick , Gaurav Manek , Felix Berkenkamp , J. Zico Kolter

The $Q$-function is a central quantity in many Reinforcement Learning (RL) algorithms for which RL agents behave following a (soft)-greedy policy w.r.t. to $Q$. It is a powerful tool that allows action selection without a model of the…

Machine Learning · Computer Science 2022-06-01 Nino Vieillard , Marcin Andrychowicz , Anton Raichuk , Olivier Pietquin , Matthieu Geist