English
Related papers

Related papers: Tailored Primitive Initialization is the Secret Ke…

200 papers

The application of reinforcement learning (RL) to enhance the reasoning capabilities of Multimodal Large Language Models (MLLMs) constitutes a rapidly advancing research area. While MLLMs extend Large Language Models (LLMs) to handle…

Artificial Intelligence · Computer Science 2025-05-22 Guanghao Zhou , Panjia Qiu , Cen Chen , Jie Wang , Zheming Yang , Jian Xu , Minghui Qiu

Reranking is fundamental to information retrieval and retrieval-augmented generation, with recent Large Language Models (LLMs) significantly advancing reranking quality. Most current works rely on large-scale LLMs (>7B parameters),…

Information Retrieval · Computer Science 2026-04-17 Xianming Li , Aamir Shakir , Rui Huang , Tsz-fung Andrew Lee , Julius Lipp , Benjamin Clavié , Jing Li

Large Language Models (LLMs) have achieved remarkable success through imitation learning on vast text corpora, but this paradigm creates a training-generation gap and limits robust reasoning. Reinforcement learning (RL) offers a more…

Computation and Language · Computer Science 2026-04-13 Zhepeng Cen , Haolin Chen , Shiyu Wang , Zuxin Liu , Zhiwei Liu , Jielin Qiu , Ding Zhao , Silvio Savarese , Caiming Xiong , Huan Wang , Weiran Yao

Deep Reinforcement Learning (RL) is remarkably effective in addressing sequential resource allocation problems in domains such as healthcare, public policy, and resource management. However, deep RL policies often lack transparency and…

Machine Learning · Computer Science 2025-02-18 Mauricio Tec , Guojun Xiong , Haichuan Wang , Francesca Dominici , Milind Tambe

Compiler auto-tuning optimizes pass sequences to improve performance metrics such as Intermediate Representation (IR) instruction count. Although recent advances leveraging Large Language Models (LLMs) have shown promise in automating…

Machine Learning · Computer Science 2025-06-23 Haolin Pan , Hongyu Lin , Haoran Luo , Yang Liu , Kaichun Yao , Libo Zhang , Mingjie Xing , Yanjun Wu

To take advantage of Large Language Model in theorem formalization and proof, we propose a reinforcement learning framework to iteratively optimize the pretrained LLM by rolling out next tactics and comparing them with the expected ones.…

Artificial Intelligence · Computer Science 2025-02-14 Zhiling Luo

Recent studies have demonstrated the effectiveness of LLM test-time scaling. However, existing approaches to incentivize LLMs' deep thinking abilities generally require large-scale data or significant training efforts. Meanwhile, it remains…

Computation and Language · Computer Science 2025-02-19 Ruotian Ma , Peisong Wang , Cheng Liu , Xingyan Liu , Jiaqi Chen , Bang Zhang , Xin Zhou , Nan Du , Jia Li

Reinforcement learning (RL) has shown impressive results in sequential decision-making tasks. Meanwhile, Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged, exhibiting impressive capabilities in multimodal…

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

Time-series reasoning remains a significant challenge in multimodal large language models (MLLMs) due to the dynamic temporal patterns, ambiguous semantics, and lack of temporal priors. In this work, we introduce TimeMaster, a reinforcement…

Machine Learning · Computer Science 2025-06-17 Junru Zhang , Lang Feng , Xu Guo , Yuhan Wu , Yabo Dong , Duanqing Xu

Reinforcement learning has become the standard for improving reasoning in large language models, yet evidence increasingly suggests that RL does not teach new strategies; it redistributes probability mass over solutions the base model…

Computation and Language · Computer Science 2026-05-12 Ömer Faruk Akgül , Rajgopal Kannan , Willie Neiswanger , Viktor Prasanna

Large language models (LLMs) have recently shown strong reasoning abilities in domains like mathematics, coding, and scientific problem-solving, yet their potential for ranking tasks, where prime examples include retrieval, recommender…

Information Retrieval · Computer Science 2025-10-17 Tao Feng , Zhigang Hua , Zijie Lei , Yan Xie , Shuang Yang , Bo Long , Jiaxuan You

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Reinforcement learning (RL) is an innovative approach to financial decision making, offering specialized solutions to complex investment problems where traditional methods fail. This review analyzes 167 articles from 2017--2025, focusing on…

Computational Finance · Quantitative Finance 2025-12-12 Mohammad Rezoanul Hoque , Md Meftahul Ferdaus , M. Kabir Hassan

In recent years, challenging control problems became solvable with deep reinforcement learning (RL). To be able to use RL for large-scale real-world applications, a certain degree of reliability in their performance is necessary. Reported…

Machine Learning · Computer Science 2020-11-11 Nirnai Rao , Elie Aljalbout , Axel Sauer , Sami Haddadin

Reinforcement Learning (RL) is an important machine learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in this field due to the rapid development of deep neural networks.…

Machine Learning · Computer Science 2026-04-08 Chaofan Pan , Xin Yang , Yanhua Li , Wei Wei , Tianrui Li , Bo An , Jiye Liang

To meet the requirements of real-world applications, it is essential to control generations of large language models (LLMs). Prior research has tried to introduce reinforcement learning (RL) into controllable text generation while most…

Computation and Language · Computer Science 2024-03-19 Wendi Li , Wei Wei , Kaihe Xu , Wenfeng Xie , Dangyang Chen , Yu Cheng

Transformer-based Large Language Models (LLMs) have revolutionized Natural Language Processing by demonstrating exceptional performance across diverse tasks. This study investigates the impact of the parameter initialization scale on the…

Computation and Language · Computer Science 2025-05-22 Junjie Yao , Zhongwang Zhang , Zhi-Qin John Xu

While reinforcement learning (RL) has achieved notable success in various domains, training effective policies for complex tasks remains challenging. Agents often converge to local optima and fail to maximize long-term rewards. Existing…

Artificial Intelligence · Computer Science 2025-05-28 Heng Tan , Hua Yan , Yu Yang

Reinforcement learning (RL) offers a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve. In practice, RL progress often…

Artificial Intelligence · Computer Science 2026-05-05 Caijun Xu , Changyi Xiao , Zhongyuan Peng , Xinrun Wang , Yixin Cao