English
Related papers

Related papers: GALOIS: Boosting Deep Reinforcement Learning via G…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has become a cornerstone for unlocking complex reasoning in Large Language Models (LLMs). Yet, scaling up RL is bottlenecked by limited existing verifiable data, where improvements…

Current Reinforcement Learning (RL) methodologies for Large Language Models (LLMs) often rely on simplistic, outcome-based reward signals (e.g., final answer correctness), which limits the depth of learning from each interaction. This paper…

Artificial Intelligence · Computer Science 2025-06-17 Xiangfan Wu

Training large reasoning models (LRMs) with reinforcement learning in STEM domains is hindered by the scarcity of high-quality, diverse, and verifiable problem sets. Existing synthesis methods, such as Chain-of-Thought prompting, often…

Artificial Intelligence · Computer Science 2025-05-27 Xiong Jun Wu , Zhenduo Zhang , ZuJie Wen , Zhiqiang Zhang , Wang Ren , Lei Shi , Cai Chen , Deng Zhao , Qing Wang , Xudong Han , Chengfu Tang , Dingnan Jin , Qing Cui , Jun Zhou

In this paper, we propose a new data synthesis method called \textbf{LogicPro}, which leverages LeetCode-style algorithm \underline{Pro}blems and their corresponding \underline{Pro}gram solutions to synthesize Complex \underline{Logic}al…

Computation and Language · Computer Science 2025-09-08 Jin Jiang , Yuchen Yan , Yang Liu , Jianing Wang , Shuai Peng , Xunliang Cai , Yixin Cao , Mengdi Zhang , Liangcai Gao

We introduce a deep reinforcement learning (DRL) approach for solving management problems including inventory management, dynamic pricing, and recommendation. This DRL approach has the potential to lead to a large management model based on…

Artificial Intelligence · Computer Science 2024-03-04 Jinyang Jiang , Xiaotian Liu , Tao Ren , Qinghao Wang , Yi Zheng , Yufu Du , Yijie Peng , Cheng Zhang

In syntax-guided synthesis (SyGuS), a synthesizer's goal is to automatically generate a program belonging to a grammar of possible implementations that meets a logical specification. We investigate a common limitation across…

Programming Languages · Computer Science 2019-06-11 Saswat Padhi , Todd Millstein , Aditya Nori , Rahul Sharma

The Abstraction and Reasoning Corpus (ARC) is a general artificial intelligence benchmark that is currently unsolvable by any Machine Learning method, including Large Language Models (LLMs). It demands strong generalization and reasoning…

Machine Learning · Computer Science 2024-05-13 Filipe Marinho Rocha , Inês Dutra , Vítor Santos Costa

While reinforcement learning methods have delivered remarkable results in a number of settings, generalization, i.e., the ability to produce policies that generalize in a reliable and systematic way, has remained a challenge. The problem of…

Artificial Intelligence · Computer Science 2025-12-23 Simon Ståhlberg , Blai Bonet , Hector Geffner

As a form of artificial intelligence (AI) technology based on interactive learning, deep reinforcement learning (DRL) has been widely applied across various fields and has achieved remarkable accomplishments. However, DRL faces certain…

Machine Learning · Computer Science 2025-02-18 Geng Sun , Wenwen Xie , Dusit Niyato , Fang Mei , Jiawen Kang , Hongyang Du , Shiwen Mao

Large language models (LLMs) have shown impressive promise in code generation, yet their progress remains limited by the shortage of large-scale datasets that are both diverse and well-aligned with human reasoning. Most existing resources…

Machine Learning · Computer Science 2025-10-28 Amal Abed , Ivan Lukic , Jörg K. H. Franke , Frank Hutter

In recent years, deep learning techniques have been developed to improve the performance of program synthesis from input-output examples. Albeit its significant progress, the programs that can be synthesized by state-of-the-art approaches…

Machine Learning · Computer Science 2018-03-09 Xinyun Chen , Chang Liu , Dawn Song

Reliable verifiable data has become a key driver of capability gains in modern language models, enabling stable reinforcement learning with verifiable rewards and effective distillation that transfers competence across math, coding, and…

Machine Learning · Computer Science 2025-10-22 He Du , Bowen Li , Aijun Yang , Siyang He , Qipeng Guo , Dacheng Tao

Despite great advances in program synthesis techniques, they remain algorithmic black boxes. Although they guarantee that when synthesis is successful, the implementation satisfies the specification, they provide no additional information…

Programming Languages · Computer Science 2024-03-07 Amirmohammad Nazari , Souti Chattopadhyay , Swabha Swayamdipta , Mukund Raghothaman

The advancement of reasoning capabilities in Large Language Models (LLMs) requires substantial amounts of high-quality reasoning data, particularly in mathematics. Existing data synthesis methods, such as data augmentation from annotated…

Artificial Intelligence · Computer Science 2026-02-17 Jiapeng Wang , Jinhao Jiang , Zhiqiang Zhang , Jun Zhou , Wayne Xin Zhao

The automatic synthesis of a policy through reinforcement learning (RL) from a given set of formal requirements depends on the construction of a reward signal and consists of the iterative application of many policy-improvement steps. The…

Machine Learning · Computer Science 2022-10-21 Luigi Berducci , Radu Grosu

Reinforcement learning (RL) has been applied to improve large language model (LLM) reasoning, yet the systematic study of how training scales with task difficulty has been hampered by the lack of controlled, scalable environments. Observed…

Artificial Intelligence · Computer Science 2026-05-19 Tianle Wang , Zhaoyang Wang , Guangchen Lan , Xinpeng Wei , Sipeng Zhang , Guanwen Qiu , Abulhair Saparov

High-Level Synthesis (HLS) compiles algorithmic C/C++ descriptions into hardware, with Quality of Results (QoR) -- latency and resource utilization -- critically governed by pragma configurations and code structure. Existing LLM-based HLS…

Machine Learning · Computer Science 2026-05-14 Qingyun Zou , Feng Yu , Hongshi Tan , Yao Chen , Bingsheng He , WengFai Wong

Deep Learning has become overly complicated and has enjoyed stellar success in solving several classical problems like image classification, object detection, etc. Several methods for explaining these decisions have been proposed. Black-box…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Siddhant Agarwal , Owais Iqbal , Sree Aditya Buridi , Madda Manjusha , Abir Das

The combination of Large Language Models (LLMs), systematic evaluation, and evolutionary algorithms has enabled breakthroughs in combinatorial optimization and scientific discovery. We propose to extend this powerful combination to the…

Artificial Intelligence · Computer Science 2026-03-12 Carlo Bosio , Mark W. Mueller