English
Related papers

Related papers: Evaluating Curriculum Learning Strategies in Neura…

200 papers

Combinatorial Optimization (CO) has been a long-standing challenging research topic featured by its NP-hard nature. Traditionally such problems are approximately solved with heuristic algorithms which are usually fast but may sacrifice the…

Machine Learning · Computer Science 2021-10-26 Runzhong Wang , Zhigang Hua , Gan Liu , Jiayi Zhang , Junchi Yan , Feng Qi , Shuang Yang , Jun Zhou , Xiaokang Yang

While large language models (LLMs) have shown strong performance in math and logic reasoning, their ability to handle combinatorial optimization (CO) -- searching high-dimensional solution spaces under hard constraints -- remains…

Artificial Intelligence · Computer Science 2026-04-13 Xia Jiang , Jing Chen , Cong Zhang , Jie Gao , Chengpeng Hu , Chenhao Zhang , Yaoxin Wu , Yingqian Zhang

Neural combinatorial optimization (NCO) is a promising learning-based approach to solving various vehicle routing problems without much manual algorithm design. However, the current NCO methods mainly focus on the in-distribution…

Machine Learning · Computer Science 2024-05-22 Fei Liu , Xi Lin , Weiduo Liao , Zhenkun Wang , Qingfu Zhang , Xialiang Tong , Mingxuan Yuan

Neural ranking models are traditionally trained on a series of random batches, sampled uniformly from the entire training set. Curriculum learning has recently been shown to improve neural models' effectiveness by sampling batches…

Information Retrieval · Computer Science 2019-12-19 Gustavo Penha , Claudia Hauff

Curriculum learning techniques are a viable solution for improving the accuracy of automatic models, by replacing the traditional random training with an easy-to-hard strategy. However, the standard curriculum methodology does not…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Petru Soviany

Combinatorial optimization problems involving multiple agents are notoriously challenging due to their NP-hard nature and the necessity for effective agent coordination. Despite advancements in learning-based methods, existing approaches…

Multiagent Systems · Computer Science 2025-10-23 Federico Berto , Chuanbo Hua , Laurin Luttmann , Jiwoo Son , Junyoung Park , Kyuree Ahn , Changhyun Kwon , Lin Xie , Jinkyoo Park

Curriculum learning in reinforcement learning is a training methodology that seeks to speed up learning of a difficult target task, by first training on a series of simpler tasks and transferring the knowledge acquired to the target task.…

Machine Learning · Computer Science 2019-09-17 Sanmit Narvekar , Peter Stone

Curriculum learning in reinforcement learning is used to shape exploration by presenting the agent with increasingly complex tasks. The idea of curriculum learning has been largely applied in both animal training and pedagogy. In…

Machine Learning · Computer Science 2019-06-14 Francesco Foglino , Christiano Coletto Christakou , Matteo Leonetti

A curriculum is a planned sequence of learning materials and an effective one can make learning efficient and effective for both humans and machines. Recent studies developed effective data-driven curriculum learning approaches for training…

Machine Learning · Computer Science 2023-07-19 Nidhi Vakil , Hadi Amiri

Using machine learning to solve combinatorial optimization (CO) problems is challenging, especially when the data is unlabeled. This work proposes an unsupervised learning framework for CO problems. Our framework follows a standard…

Machine Learning · Computer Science 2022-10-25 Haoyu Wang , Nan Wu , Hang Yang , Cong Hao , Pan Li

The competitive performance of neural machine translation (NMT) critically relies on large amounts of training data. However, acquiring high-quality translation pairs requires expert knowledge and is costly. Therefore, how to best utilize a…

Computation and Language · Computer Science 2020-04-14 Mingjun Zhao , Haijiang Wu , Di Niu , Xiaoli Wang

Machine translation systems based on deep neural networks are expensive to train. Curriculum learning aims to address this issue by choosing the order in which samples are presented during training to help train better models faster. We…

Computation and Language · Computer Science 2018-11-05 Xuan Zhang , Gaurav Kumar , Huda Khayrallah , Kenton Murray , Jeremy Gwinnup , Marianna J Martindale , Paul McNamee , Kevin Duh , Marine Carpuat

Recently, online Reinforcement Learning with Verifiable Rewards (RLVR) has become a key paradigm for enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing methods typically treat all training samples…

Artificial Intelligence · Computer Science 2025-09-30 Shijie Zhang , Guohao Sun , Kevin Zhang , Xiang Guo , Rujun Guo

Training neural networks is traditionally done by providing a sequence of random mini-batches sampled uniformly from the entire training data. In this work, we analyze the effect of curriculum learning, which involves the non-uniform…

Machine Learning · Computer Science 2020-12-03 Guy Hacohen , Daphna Weinshall

Current methods for end-to-end constructive neural combinatorial optimization usually train a policy using behavior cloning from expert solutions or policy gradient methods from reinforcement learning. While behavior cloning is…

Machine Learning · Computer Science 2024-11-05 Jonathan Pirnay , Dominik G. Grimm

Combinatorial Optimization (CO) encompasses a wide range of problems that arise in many real-world scenarios. While significant progress has been made in developing learning-based methods for specialized CO problems, a unified model with a…

Machine Learning · Computer Science 2025-05-13 Zefang Zong , Xiaochen Wei , Guozhen Zhang , Chen Gao , Huandong Wang , Yong Li

Many traditional algorithms for solving combinatorial optimization problems involve using hand-crafted heuristics that sequentially construct a solution. Such heuristics are designed by domain experts and may often be suboptimal due to the…

Machine Learning · Computer Science 2020-12-25 Nina Mazyavkina , Sergey Sviridov , Sergei Ivanov , Evgeny Burnaev

Research in Curriculum Learning has shown better performance on the task by optimizing the sequence of the training data. Recent works have focused on using complex reinforcement learning techniques to find the optimal data ordering…

Machine Learning · Computer Science 2022-11-10 Dipankar Sarkar , Mukur Gupta

Deep reinforcement learning (DRL)-based combinatorial optimization (CO) methods (i.e., DRL-NCO) have shown significant merit over the conventional CO solvers as DRL-NCO is capable of learning CO solvers less relying on problem-specific…

Machine Learning · Computer Science 2023-01-06 Minsu Kim , Junyoung Park , Jinkyoo Park

Curriculum learning (CL) aims to increase the performance of a learner on a given task by applying a specialized learning strategy. This strategy focuses on either the dataset, the task, or the model. There is little to no work analysing…

Machine Learning · Computer Science 2023-11-08 Luca Scharr , Vanessa Toborek