English
Related papers

Related papers: On the consistency of hyper-parameter selection in…

200 papers

The Learning Rate (LR) has a high impact on deep learning training performance. A common practice is to train a Deep Neural Network (DNN) multiple times with different LR policies to find the optimal LR policy, which has been widely…

Machine Learning · Computer Science 2024-10-11 Hongpeng Jin , Yanzhao Wu

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

Interest in reinforcement learning (RL) for large-scale systems, comprising extensive populations of intelligent agents interacting with heterogeneous environments, has surged significantly across diverse scientific domains in recent years.…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Wei Zhang , Jr-Shin Li

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnessed great success over…

Machine Learning · Computer Science 2025-09-01 Yunpeng Qing , Shunyu Liu , Jie Song , Yang Zhou , Kaixuan Chen , Huiqiong Wang , Mingli Song

In this work, we address the problem of determining reliable policies in reinforcement learning (RL), with a focus on optimization under uncertainty and the need for performance guarantees. While classical RL algorithms aim at maximizing…

Machine Learning · Computer Science 2025-10-22 Nadir Farhi

In reinforcement learning (RL), agents continually interact with the environment and use the feedback to refine their behavior. To guide policy optimization, reward models are introduced as proxies of the desired objectives, such that when…

Machine Learning · Computer Science 2025-06-19 Rui Yu , Shenghua Wan , Yucen Wang , Chen-Xiao Gao , Le Gan , Zongzhang Zhang , De-Chuan Zhan

This paper investigates search in model-based reinforcement learning (RL). Conventional wisdom holds that long-term predictions and compounding errors are the primary obstacles for model-based RL. We challenge this view, showing that search…

Machine Learning · Computer Science 2026-05-25 Wei-Di Chang , Mikael Henaff , Brandon Amos , Gregory Dudek , Scott Fujimoto

This study presents a benchmark for evaluating action-constrained reinforcement learning (RL) algorithms. In action-constrained RL, each action taken by the learning system must comply with certain constraints. These constraints are crucial…

Machine Learning · Computer Science 2023-06-30 Kazumi Kasaura , Shuwa Miura , Tadashi Kozuno , Ryo Yonetani , Kenta Hoshino , Yohei Hosoe

In recent years, on-policy reinforcement learning (RL) has been successfully applied to many different continuous control tasks. While RL algorithms are often conceptually simple, their state-of-the-art implementations take numerous low-…

The importance of parameter selection in supervised learning is well known. However, due to the many parameter combinations, an incomplete or an insufficient procedure is often applied. This situation may cause misleading or confusing…

Machine Learning · Computer Science 2021-07-13 Jie-Jyun Liu , Tsung-Han Yang , Si-An Chen , Chih-Jen Lin

With the ever-growing volume of online information, recommender systems have been an effective strategy to overcome such information overload. The utility of recommender systems cannot be overstated, given its widespread adoption in many…

Information Retrieval · Computer Science 2019-07-11 Shuai Zhang , Lina Yao , Aixin Sun , Yi Tay

Deep reinforcement learning (DRL) has gained great success by learning directly from high-dimensional sensory inputs, yet is notorious for the lack of interpretability. Interpretability of the subtasks is critical in hierarchical…

Artificial Intelligence · Computer Science 2019-03-01 Daoming Lyu , Fangkai Yang , Bo Liu , Steven Gustafson

While improvements in deep learning architectures have played a crucial role in improving the state of supervised and unsupervised learning in computer vision and natural language processing, neural network architecture choices for…

Machine Learning · Computer Science 2020-12-01 Samarth Sinha , Homanga Bharadhwaj , Aravind Srinivas , Animesh Garg

Deep Reinforcement learning is a branch of unsupervised learning in which an agent learns to act based on environment state in order to maximize its total reward. Deep reinforcement learning provides good opportunity to model the complexity…

Statistical Finance · Quantitative Finance 2021-08-05 Zhaolu Dong , Shan Huang , Simiao Ma , Yining Qian

Training intelligent agents through reinforcement learning is a notoriously unstable procedure. Massive parallelization on GPUs and distributed systems has been exploited to generate a large amount of training experiences and consequently…

Machine Learning · Computer Science 2019-02-08 Greg Heinrich , Iuri Frosio

Proper hyperparameter tuning is essential for achieving optimal performance of modern machine learning (ML) methods in predictive tasks. While there is an extensive literature on tuning ML learners for prediction, there is only little…

Econometrics · Economics 2024-02-08 Philipp Bach , Oliver Schacht , Victor Chernozhukov , Sven Klaassen , Martin Spindler

The market for domestic robots made to perform household chores is growing as these robots relieve people of everyday responsibilities. Domestic robots are generally welcomed for their role in easing human labor, in contrast to industrial…

Robotics · Computer Science 2024-05-30 Arpita Soni , Sujatha Alla , Suresh Dodda , Hemanth Volikatla

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

Machine Learning · Computer Science 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Deep learning algorithms vary depending on the underlying connection mechanism of nodes of them. They have various hyperparameters that are either set via specific algorithms or randomly chosen. Meanwhile, hyperparameters of deep learning…

Machine Learning · Computer Science 2020-11-20 M. M. Ozturk

Recently, several authors have advocated the use of rule learning algorithms to model multi-label data, as rules are interpretable and can be comprehended, analyzed, or qualitatively evaluated by domain experts. Many rule learning…

Machine Learning · Computer Science 2020-12-09 Michael Rapp , Eneldo Loza Mencía , Johannes Fürnkranz