English
Related papers

Related papers: Mid-Training with Self-Generated Data Improves Rei…

200 papers

While large language models (LLMs) have been pre-trained on multilingual corpora, their performance still lags behind in most languages compared to a few resource-rich languages. One common approach to mitigate this issue is to translate…

Computation and Language · Computer Science 2024-02-20 Yuanchi Zhang , Yile Wang , Zijun Liu , Shuo Wang , Xiaolong Wang , Peng Li , Maosong Sun , Yang Liu

Personalized text generation requires a unique ability of large language models (LLMs) to learn from context that they often do not encounter during their standard training. One way to encourage LLMs to better use personalized context for…

Computation and Language · Computer Science 2025-01-09 Alireza Salemi , Cheng Li , Mingyang Zhang , Qiaozhu Mei , Weize Kong , Tao Chen , Zhuowan Li , Michael Bendersky , Hamed Zamani

The ability of Large Language Models (LLMs) to extract context from natural language problem descriptions naturally raises questions about their suitability in autonomous decision-making settings. This paper studies the behaviour of these…

Artificial Intelligence · Computer Science 2025-07-22 Xiao Yang , Juxi Leitner , Michael Burke

A central goal of cognitive modeling is to develop models that not only predict human behavior but also provide insight into the underlying cognitive mechanisms. While neural network models trained on large-scale behavioral data often…

Artificial Intelligence · Computer Science 2026-02-03 Jian-Qiao Zhu , Hanbo Xie , Dilip Arumugam , Robert C. Wilson , Thomas L. Griffiths

Generating grounded and trustworthy responses remains a key challenge for large language models (LLMs). While retrieval-augmented generation (RAG) with citation-based grounding holds promise, instruction-tuned models frequently fail even in…

Computation and Language · Computer Science 2025-06-19 Shang Hong Sim , Tej Deep Pala , Vernon Toh , Hai Leong Chieu , Amir Zadeh , Chuan Li , Navonil Majumder , Soujanya Poria

Reinforcement learning is now widely adopted as the final stage of large language model training, especially for reasoning-style tasks such as maths problems. Typically, models attempt each question many times during a single training step…

Machine Learning · Computer Science 2026-05-01 Thomas Foster , Anya Sims , Johannes Forkel , Mattie Fellows , Jakob Foerster

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

The reasoning abilities of large language models (LLMs) have improved with chain-of-thought (CoT) prompting, allowing models to solve complex tasks stepwise. However, training CoT capabilities requires detailed reasoning data, which is…

Artificial Intelligence · Computer Science 2025-04-11 Fu-Chieh Chang , Yu-Ting Lee , Hui-Ying Shih , Yi Hsuan Tseng , Pei-Yuan Wu

Personalizing digital applications for health behavior change is a promising route to making them more engaging and effective. This especially holds for approaches that adapt to users and their specific states (e.g., motivation, knowledge,…

Machine Learning · Computer Science 2025-11-25 Nele Albers , Esra Cemre Su de Groot , Loes Keijsers , Manon H. Hillegers , Emiel Krahmer

While scaling laws for large language models (LLMs) during pre-training have been extensively studied, their behavior under reinforcement learning (RL) post-training remains largely unexplored. This paper presents a systematic empirical…

Recent advances in foundation models have highlighted the significant benefits of multi-stage training, with a particular emphasis on the emergence of mid-training as a vital stage that bridges pre-training and post-training. Mid-training…

Computation and Language · Computer Science 2025-11-05 Chengying Tu , Xuemiao Zhang , Rongxiang Weng , Rumei Li , Chen Zhang , Yang Bai , Hongfei Yan , Jingang Wang , Xunliang Cai

Through reinforcement learning (RL) with outcome correctness rewards, large reasoning models (LRMs) with scaled inference computation have demonstrated substantial success on complex reasoning tasks. However, the one-sided reward, focused…

Computation and Language · Computer Science 2025-11-21 Jiashu Yao , Heyan Huang , Shuang Zeng , Chuwei Luo , WangJie You , Jie Tang , Qingsong Liu , Yuhang Guo , Yangyang Kang

Language systems have been of great interest to the research community and have recently reached the mass market through various assistant platforms on the web. Reinforcement Learning methods that optimize dialogue policies have seen…

Machine Learning · Computer Science 2024-02-09 Floris den Hengst , Mark Hoogendoorn , Frank van Harmelen , Joost Bosman

Test-time inference has emerged as a powerful paradigm for enabling language models to ``think'' longer and more carefully about complex challenges, much like skilled human experts. While reinforcement learning (RL) can drive…

Computation and Language · Computer Science 2025-08-18 Kanishk Gandhi , Ayush Chakravarthy , Anikait Singh , Nathan Lile , Noah D. Goodman

The recent advancements of Large Language Models (LLMs) have spurred considerable research interest in extending their linguistic capabilities beyond text to other modalities, which leads to emergence of speech-based LLMs (SpeechLMs) with…

Computation and Language · Computer Science 2026-05-21 Yansong Liu , Jiateng Li , Yuan Liu

Reinforcement learning (RL) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). While RL has demonstrated substantial performance gains, it still faces key challenges, including low…

Machine Learning · Computer Science 2025-11-18 Yihang Yao , Guangtao Zeng , Raina Wu , Yang Zhang , Ding Zhao , Zhang-Wei Hong , Chuang Gan

Large Language Models (LLMs) have achieved remarkable success through imitation learning on vast text corpora, but this paradigm creates a training-generation gap and limits robust reasoning. Reinforcement learning (RL) offers a more…

Computation and Language · Computer Science 2026-04-13 Zhepeng Cen , Haolin Chen , Shiyu Wang , Zuxin Liu , Zhiwei Liu , Jielin Qiu , Ding Zhao , Silvio Savarese , Caiming Xiong , Huan Wang , Weiran Yao

Algorithmic trading requires short-term tactical decisions consistent with long-term financial objectives. Reinforcement Learning (RL) has been applied to such problems, but adoption is limited by myopic behaviour and opaque policies. Large…

Machine Learning · Computer Science 2025-10-28 Adam Darmanin , Vince Vella

We study self-rewarding reasoning large language models (LLMs), which can simultaneously generate step-by-step reasoning and evaluate the correctness of their outputs during the inference time-without external feedback. This integrated…

Artificial Intelligence · Computer Science 2025-02-28 Wei Xiong , Hanning Zhang , Chenlu Ye , Lichang Chen , Nan Jiang , Tong Zhang

Large language models (LLMs) are designed to perform a wide range of tasks. To improve their ability to solve complex problems requiring multi-step reasoning, recent research leverages process reward modeling to provide fine-grained…

Computation and Language · Computer Science 2025-09-29 Weixuan Wang , Minghao Wu , Barry Haddow , Alexandra Birch