中文
相关论文

相关论文: Learning the Model While Learning Q: Finite-Time S…

200 篇论文

Machine learning (ML) has become an attractive tool in information processing, however few ML algorithms have been successfully applied in the quantum domain. We show here how classical reinforcement learning (RL) could be used as a tool…

量子物理 · 物理学 2020-06-02 Jelena Mackeprang , Durga Bhaktavatsala Rao Dasari , Jörg Wrachtrup

How to manage various data in a unified way is a significant research topic in the field of databases. To address this problem, researchers have proposed multi-model databases to support multiple data models in a uniform platform with a…

数据库 · 计算机科学 2021-09-02 Gongsheng Yuan , Jiaheng Lu , Shuxun Zhang , Zhengtong Yan

Model quantization has emerged as an indispensable technique to accelerate deep learning inference. While researchers continue to push the frontier of quantization algorithms, existing quantization work is often unreproducible and…

机器学习 · 计算机科学 2022-01-26 Yuhang Li , Mingzhu Shen , Jian Ma , Yan Ren , Mingxin Zhao , Qi Zhang , Ruihao Gong , Fengwei Yu , Junjie Yan

In this work, we present a scalable reinforcement learning method for training multi-task policies from large offline datasets that can leverage both human demonstrations and autonomously collected data. Our method uses a Transformer to…

We explore the possibilities of using a model-free-based control law in order to train artificial neural networks. In the supervised learning context, we consider the problem of tuning the synaptic weights as a feedback control tracking…

系统与控制 · 电气工程与系统科学 2021-08-31 Loïc Michel

Lane change is a crucial vehicle maneuver which needs coordination with surrounding vehicles. Automated lane changing functions built on rule-based models may perform well under pre-defined operating conditions, but they may be prone to…

机器人学 · 计算机科学 2018-04-24 Pin Wang , Ching-Yao Chan , Arnaud de La Fortelle

Q-learning with neural network function approximation (neural Q-learning for short) is among the most prevalent deep reinforcement learning algorithms. Despite its empirical success, the non-asymptotic convergence rate of neural Q-learning…

机器学习 · 计算机科学 2020-03-05 Pan Xu , Quanquan Gu

Real-world data is often incomplete and contains missing values. To train accurate models over real-world datasets, users need to spend a substantial amount of time and resources imputing and finding proper values for missing data items. In…

机器学习 · 统计学 2024-03-05 Cheng Zhen , Nischal Aryal , Arash Termehchy , Alireza Aghasi , Amandeep Singh Chabada

We present the first regret bound for classical online Q-learning in infinite-horizon discounted Markov decision processes (MDPs), without relying on optimism or bonus terms. We first analyze Boltzmann Q-learning with decaying temperature…

机器学习 · 计算机科学 2026-05-18 Rahul Singh , Siddharth Chandak , Eric Moulines , Vivek S. Borkar , Nicholas Bambos

In this paper, we present a novel algorithm named synchronous integral Q-learning, which is based on synchronous policy iteration, to solve the continuous-time infinite horizon optimal control problems of input-affine system dynamics. The…

系统与控制 · 电气工程与系统科学 2021-05-20 Lei Guo , Han Zhao

Symbolic Regression (SR) holds great potential for uncovering underlying mathematical and physical relationships from observed data. However, the vast combinatorial space of possible expressions poses significant challenges for both online…

机器学习 · 计算机科学 2025-02-12 Yuan Tian , Wenqi Zhou , Michele Viscione , Hao Dong , David Kammer , Olga Fink

Symbolic Regression (SR) holds great potential for uncovering underlying mathematical and physical relationships from observed data. However, the vast combinatorial space of possible expressions poses significant challenges for both online…

机器学习 · 计算机科学 2025-02-14 Yuan Tian , Wenqi Zhou , Michele Viscione , Hao Dong , David Kammer , Olga Fink

Successful teaching requires an assumption of how the learner learns - how the learner uses experiences from the world to update their internal states. We investigate what expectations people have about a learner when they teach them in an…

机器学习 · 计算机科学 2023-06-30 Yun-Shiuan Chuang , Xuezhou Zhang , Yuzhe Ma , Mark K. Ho , Joseph L. Austerweil , Xiaojin Zhu

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

机器人学 · 计算机科学 2025-02-28 Cong Li

We study offline reinforcement learning under $Q^\star$-approximation and partial coverage, a setting that motivates practical algorithms such as Conservative $Q$-Learning (CQL; Kumar et al., 2020) but has received limited theoretical…

机器学习 · 计算机科学 2026-02-13 Haolin Liu , Braham Snyder , Chen-Yu Wei

Although Q-learning is one of the most successful algorithms for finding the best action-value function (and thus the optimal policy) in reinforcement learning, its implementation often suffers from large overestimation of Q-function values…

机器学习 · 计算机科学 2020-10-13 Huaqing Xiong , Lin Zhao , Yingbin Liang , Wei Zhang

We propose a model-based reinforcement learning (RL) approach for noisy time-dependent gate optimization with improved sample complexity over model-free RL. Sample complexity is the number of controller interactions with the physical…

Online class imbalance learning constitutes a new problem and an emerging research topic that focusses on the challenges of online learning under class imbalance and concept drift. Class imbalance deals with data streams that have very…

机器学习 · 计算机科学 2020-09-02 Kleanthis Malialis , Christos G. Panayiotou , Marios M. Polycarpou

Temporal-difference (TD) learning is an important field in reinforcement learning. Sarsa and Q-Learning are among the most used TD algorithms. The Q($\sigma$) algorithm (Sutton and Barto (2017)) unifies both. This paper extends the…

人工智能 · 计算机科学 2017-11-07 Markus Dumke

This paper is dedicated to the application of reinforcement learning combined with neural networks to the general formulation of user scheduling problem. Our simulator resembles real world problems by means of stochastic changes in…

人工智能 · 计算机科学 2020-11-10 Filipp Skomorokhov , George Ovchinnikov