English
Related papers

Related papers: A gray-box approach for curriculum learning

200 papers

Neural ranking models are traditionally trained on a series of random batches, sampled uniformly from the entire training set. Curriculum learning has recently been shown to improve neural models' effectiveness by sampling batches…

Information Retrieval · Computer Science 2019-12-19 Gustavo Penha , Claudia Hauff

Automatic Curriculum Learning (ACL) has become a cornerstone of recent successes in Deep Reinforcement Learning (DRL).These methods shape the learning trajectories of agents by challenging them with tasks adapted to their capacities. In…

Machine Learning · Computer Science 2020-06-01 Rémy Portelas , Cédric Colas , Lilian Weng , Katja Hofmann , Pierre-Yves Oudeyer

Neural combinatorial optimization (NCO) aims at designing problem-independent and efficient neural network-based strategies for solving combinatorial problems. The field recently experienced growth by successfully adapting architectures…

Machine Learning · Computer Science 2020-11-13 Michal Lisicki , Arash Afkanpour , Graham W. Taylor

Deep reinforcement learning has proven remarkably useful in training agents from unstructured data. However, the opacity of the produced agents makes it difficult to ensure that they adhere to various requirements posed by human engineers.…

Machine Learning · Computer Science 2022-02-10 Raz Yerushalmi , Guy Amir , Achiya Elyasaf , David Harel , Guy Katz , Assaf Marron

Curriculum learning (CL) - ordering training data from easy to hard - has become a popular strategy for improving reasoning in large language models (LLMs). Yet prior work employs disparate difficulty metrics and training setups, leaving…

Machine Learning · Computer Science 2025-10-28 Yaning Jia , Chunhui Zhang , Xingjian Diao , Xiangchi Yuan , Zhongyu Ouyang , Chiyu Ma , Soroush Vosoughi

Curriculum reinforcement learning (CRL) allows solving complex tasks by generating a tailored sequence of learning tasks, starting from easy ones and subsequently increasing their difficulty. Although the potential of curricula in RL has…

Machine Learning · Computer Science 2024-05-07 Pascal Klink , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Deep reinforcement learning (RL) approaches have been broadly applied to a large number of robotics tasks, such as robot manipulation and autonomous driving. However, an open problem in deep RL is learning policies that are robust to…

Robotics · Computer Science 2023-12-19 Rohan Banerjee , Prishita Ray , Mark Campbell

We introduce a control-tutored reinforcement learning (CTRL) algorithm. The idea is to enhance tabular learning algorithms by means of a control strategy with limited knowledge of the system model. By tutoring the learning process, the…

Optimization and Control · Mathematics 2022-04-14 Francesco De Lellis , Giovanni Russo , Mario di Bernardo

Curriculum learning techniques are a viable solution for improving the accuracy of automatic models, by replacing the traditional random training with an easy-to-hard strategy. However, the standard curriculum methodology does not…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Petru Soviany

An important challenge in reinforcement learning is training agents that can solve a wide variety of tasks. If tasks depend on each other (e.g. needing to learn to walk before learning to run), curriculum learning can speed up learning by…

Recent curriculum Reinforcement Learning (RL) has shown notable progress in solving complex tasks by proposing sequences of surrogate tasks. However, the previous approaches often face challenges when they generate curriculum goals in a…

Machine Learning · Computer Science 2023-10-27 Seungjae Lee , Daesol Cho , Jonghae Park , H. Jin Kim

Reinforcement learning and classical planning are typically seen as two distinct problems, with differing formulations necessitating different solutions. Yet, when humans are given a task, regardless of the way it is specified, they can…

Machine Learning · Computer Science 2026-02-10 Gabriel Stella

This paper investigates the impact of using gradient norm reward signals in the context of Automatic Curriculum Learning (ACL) for deep reinforcement learning (DRL). We introduce a framework where the teacher model, utilizing the gradient…

Machine Learning · Computer Science 2023-12-22 Ryan Campbell , Junsang Yoon

Reinforcement learning (RL) -- algorithms that teach artificial agents to interact with environments by maximising reward signals -- has achieved significant success in recent years. These successes have been facilitated by advances in…

Machine Learning · Computer Science 2025-04-03 Llewyn Salt , Marcus Gallagher

The structure of curriculum plays a vital role in our learning process, both as children and adults. Presenting material in ascending order of difficulty that also exploits prior knowledge can have a significant impact on the rate of…

Computation and Language · Computer Science 2017-11-30 Ahmed H. Zaidi , Russell Moore , Ted Briscoe

Real-time control for robotics is a popular research area in the reinforcement learning community. Through the use of techniques such as reward shaping, researchers have managed to train online agents across a multitude of domains. Despite…

Robotics · Computer Science 2023-04-21 Mihai Anca , Jonathan D. Thomas , Dabal Pedamonti , Matthew Studley , Mark Hansen

Curriculum learning has been a quiet, yet crucial component of many high-profile successes of reinforcement learning. Despite this, it is still a niche topic that is not directly supported by any of the major reinforcement learning…

Artificial Intelligence · Computer Science 2025-08-05 Ryan Sullivan , Ryan Pégoud , Ameen Ur Rehman , Xinchen Yang , Junyun Huang , Aayush Verma , Nistha Mitra , John P. Dickerson

Curriculum learning, a training technique where data is presented to the model in order of example difficulty (e.g., from simpler to more complex documents), has shown limited success for pre-training language models. In this work, we…

Computation and Language · Computer Science 2025-09-29 Loris Schoenegger , Lukas Thoma , Terra Blevins , Benjamin Roth

Achieving robust performance is crucial when applying deep reinforcement learning (RL) in safety critical systems. Some of the state of the art approaches try to address the problem with adversarial agents, but these agents often require…

Machine Learning · Computer Science 2022-02-18 Yeeho Song , Jeff Schneider

Curriculum learning (CL) is a training strategy that trains a machine learning model from easier data to harder data, which imitates the meaningful learning order in human curricula. As an easy-to-use plug-in, the CL strategy has…

Machine Learning · Computer Science 2021-03-26 Xin Wang , Yudong Chen , Wenwu Zhu