English
Related papers

Related papers: Gradient Q$(\sigma, \lambda)$: A Unified Algorithm…

200 papers

Robots find extensive applications in industry. In recent years, the influence of robots has also increased rapidly in domestic scenarios. The Q-learning algorithm aims to maximise the reward for reaching the goal. This paper proposes a…

Robotics · Computer Science 2024-09-04 Varun Prakash Rajamohan , Senthil Kumar Jagatheesaperumal

Due to the presence of the natural gap between Knowledge Graph (KG) structures and the natural language, the effective integration of holistic structural information of KGs with Large Language Models (LLMs) has emerged as a significant…

Computation and Language · Computer Science 2025-01-31 Qika Lin , Tianzhe Zhao , Kai He , Zhen Peng , Fangzhi Xu , Ling Huang , Jingying Ma , Mengling Feng

The rapid advancement of Large Multi-modal Foundation Models (LMM) has paved the way for the possible Explainable Image Quality Assessment (EIQA) with instruction tuning from two perspectives: overall quality explanation, and attribute-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yiting Lu , Xin Li , Haoning Wu , Bingchen Li , Weisi Lin , Zhibo Chen

We introduce the reinforcement quantum annealing (RQA) scheme in which an intelligent agent interacts with a quantum annealer that plays the stochastic environment role of learning automata and tries to iteratively find better Ising…

Quantum Physics · Physics 2020-01-03 Ramin Ayanzadeh , Milton Halem , Tim Finin

Deep Q Network (DQN) firstly kicked the door of deep reinforcement learning (DRL) via combining deep learning (DL) with reinforcement learning (RL), which has noticed that the distribution of the acquired data would change during the…

Machine Learning · Computer Science 2022-01-11 Jiajun Fan , Changnan Xiao , Yue Huang

This paper considers a class of reinforcement learning problems, which involve systems with two types of states: stochastic and pseudo-stochastic. In such systems, stochastic states follow a stochastic transition kernel while the…

Machine Learning · Computer Science 2023-11-09 Honghao Wei , Xin Liu , Weina Wang , Lei Ying

We devise a control-theoretic reinforcement learning approach to support direct learning of the optimal policy. We establish various theoretical properties of our approach, such as convergence and optimality of our analog of the Bellman…

Machine Learning · Computer Science 2026-04-01 Weiqin Chen , Mark S. Squillante , Chai Wah Wu , Santiago Paternain

The Streaming Engine (SE) is a Coarse-Grained Reconfigurable Array which provides programming flexibility and high-performance with energy efficiency. An application program to be executed on the SE is represented as a combination of…

Q-shaping is an extension of Q-value initialization and serves as an alternative to reward shaping for incorporating domain knowledge to accelerate agent training, thereby improving sample efficiency by directly shaping Q-values. This…

Artificial Intelligence · Computer Science 2024-10-03 Xiefeng Wu

Recent reinforcement learning (RL) methods have substantially enhanced the planning capabilities of Large Language Models (LLMs), yet the theoretical basis for their effectiveness remains elusive. In this work, we investigate RL's benefits…

Artificial Intelligence · Computer Science 2026-03-04 Siwei Wang , Yifei Shen , Haoran Sun , Shi Feng , Shang-Hua Teng , Li Dong , Yaru Hao , Wei Chen

Reinforcement learning algorithms have been widely used for decision-making tasks in various domains. However, the performance of these algorithms can be impacted by high variance and instability, particularly in environments with noise or…

Machine Learning · Statistics 2026-03-31 Saunak Kumar Panda , Tong Li , Ruiqi Liu , Yisha Xiang

Two of the leading approaches for model-free reinforcement learning are policy gradient methods and $Q$-learning methods. $Q$-learning methods can be effective and sample-efficient when they work, however, it is not well-understood why they…

Machine Learning · Computer Science 2018-10-16 John Schulman , Xi Chen , Pieter Abbeel

Equalisation Maximisation (EqM) is an algorithm for estimating parameters in auto-regressive (AR) models where some fraction of the data is missing. It has previously been shown that the EqM algorithm is a competitive alternative to…

Computation · Statistics 2013-08-22 Johan Dahlin , Fredrik Lindsten , Thomas B. Schön

Our world is full of asymmetries. Gravity and wind can make reaching a place easier than coming back. Social artifacts such as genealogy charts and citation graphs are inherently directed. In reinforcement learning and control, optimal…

Machine Learning · Computer Science 2022-10-05 Tongzhou Wang , Phillip Isola

Bimodal, stochastic environments present a challenge to typical Reinforcement Learning problems. This problem is one that is surprisingly common in real world applications, being particularly applicable to pricing problems. In this paper we…

Machine Learning · Computer Science 2023-07-04 E. Hurwitz , N. Peace , G. Cevora

We construct a uniformly discrete, and even sparse, sequence of real numbers $\Lambda=\{\lambda_n\}$ and a function g in $L^2(R)$, such that for every q>2, every function f in $L^2(R)$ can be approximated with arbitrary small error by a…

Classical Analysis and ODEs · Mathematics 2008-09-16 Shahaf Nitzan-Hahamov , Alexander Olevskii

Higher-dimensional quantum systems, such as qudits, offer architectural and algorithmic advantages over qubits, but their increased spectral crowding and limited controllability render high-fidelity quantum gates particularly challenging.…

Quantum Physics · Physics 2026-04-23 Amine Jaouadi , Sahel Ashhab

It is well known that the extension of Watkins' algorithm to general function approximation settings is challenging: does the projected Bellman equation have a solution? If so, is the solution useful in the sense of generating a good…

Optimization and Control · Mathematics 2020-08-11 Prashant G. Mehta , Sean P. Meyn

Reinforcement learning is one of the most popular approaches for automated game playing. This method allows an agent to estimate the expected utility of its state in order to make optimal actions in an unknown environment. We seek to apply…

Artificial Intelligence · Computer Science 2020-04-09 Tai Vu , Leon Tran

Rapid progress has been made towards question answering (QA) systems that can extract answers from text. Existing neural approaches make use of expensive bi-directional attention mechanisms or score all possible answer spans, limiting…

Computation and Language · Computer Science 2017-09-12 Jonathan Raiman , John Miller