English
Related papers

Related papers: Tagging the Thought: Unlocking Personalization Rea…

200 papers

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

Large Language Models (LLMs) have quickly become an invaluable assistant for a variety of tasks. However, their effectiveness is constrained by their ability to tailor responses to human preferences and behaviors via personalization. Prior…

Computation and Language · Computer Science 2024-11-21 Lucie Charlotte Magister , Katherine Metcalf , Yizhe Zhang , Maartje ter Hoeve

Reinforcement learning-based retrieval-augmented generation (RAG) methods enhance the reasoning abilities of large language models (LLMs). However, most rely only on final-answer rewards, overlooking intermediate reasoning quality. This…

Computation and Language · Computer Science 2025-08-07 Jie He , Victor Gutiérrez-Basulto , Jeff Z. Pan

Large language models (LLMs) have shown impressive capabilities, but still struggle with complex reasoning tasks requiring multiple steps. While prompt-based methods like Chain-of-Thought (CoT) can improve LLM reasoning at inference time,…

Artificial Intelligence · Computer Science 2024-11-25 Haolin Chen , Yihao Feng , Zuxin Liu , Weiran Yao , Akshara Prabhakar , Shelby Heinecke , Ricky Ho , Phil Mui , Silvio Savarese , Caiming Xiong , Huan Wang

A safe and trustworthy use of Large Language Models (LLMs) requires an accurate expression of confidence in their answers. We propose a novel Reinforcement Learning approach that allows to directly fine-tune LLMs to express calibrated…

Computation and Language · Computer Science 2026-03-03 David Bani-Harouni , Chantal Pellegrini , Paul Stangel , Ege Özsoy , Kamilia Zaripova , Nassir Navab , Matthias Keicher

While recent success of large reasoning models (LRMs) significantly advanced LLMs' reasoning capability by optimizing the final answer accuracy using reinforcement learning, they may also drastically increase the output length due to…

Artificial Intelligence · Computer Science 2025-05-29 Sohyun An , Ruochen Wang , Tianyi Zhou , Cho-Jui Hsieh

When language models (LMs) are trained via reinforcement learning (RL) to generate natural language "reasoning chains", their performance improves on a variety of difficult question answering tasks. Today, almost all successful applications…

Machine Learning · Computer Science 2026-05-18 Mehul Damani , Isha Puri , Stewart Slocum , Idan Shenfeld , Leshem Choshen , Yoon Kim , Jacob Andreas

Modern large language models (LLMs) are optimized for human-aligned responses using Reinforcement Learning from Human Feedback (RLHF). However, existing RLHF approaches assume a universal preference model and fail to account for individual…

Machine Learning · Computer Science 2025-03-11 Idan Shenfeld , Felix Faltings , Pulkit Agrawal , Aldo Pacchiano

Recently, large language models (LLMs) have shown remarkable reasoning capabilities via large-scale reinforcement learning (RL). However, leveraging the RL algorithm to empower effective multi-tool collaborative reasoning in LLMs remains an…

Computation and Language · Computer Science 2025-05-23 Guanting Dong , Yifei Chen , Xiaoxi Li , Jiajie Jin , Hongjin Qian , Yutao Zhu , Hangyu Mao , Guorui Zhou , Zhicheng Dou , Ji-Rong Wen

Reinforcement learning (RL) has recently emerged as a compelling approach for enhancing the reasoning capabilities of large language models (LLMs), where an LLM generator serves as a policy guided by a verifier (reward model). However,…

Machine Learning · Computer Science 2025-10-24 Kaiwen Zha , Zhengqi Gao , Maohao Shen , Zhang-Wei Hong , Duane S. Boning , Dina Katabi

Designing therapeutic peptides with tailored properties is hindered by the vastness of sequence space, limited experimental data, and poor interpretability of current generative models. To address these challenges, we introduce PepThink-R1,…

Machine Learning · Computer Science 2026-03-30 Ruheng Wang , Hang Zhang , Trieu Nguyen , Shasha Feng , Hao-Wei Pang , Xiang Yu , Li Xiao , Peter Zhiping Zhang

Large language models (LLMs) have become increasingly capable of following instructions and complex reasoning, making prompting a flexible interface for adapting models without parameter updates. Yet prompt design remains labor-intensive…

Computation and Language · Computer Science 2026-05-22 Farima Fatahi Bayat , Moin Aminnaseri , Pouya Pezeshkpour , Estevam Hruschka

Large language models (LLMs) excel in complex tasks through advanced prompting techniques like Chain-of-Thought (CoT) and Tree-of-Thought (ToT), but their reliance on manually crafted, task-specific prompts limits adaptability and…

Computation and Language · Computer Science 2025-07-04 Tao Xiong , Xavier Hu , Wenyan Fan , Shengyu Zhang

Large reasoning models (LRMs) have recently demonstrated impressive capabilities in complex reasoning tasks by leveraging increased test-time computation and exhibiting behaviors reminiscent of human-like self-reflection. While LRMs show a…

Computation and Language · Computer Science 2025-10-21 Qingcheng Zeng , Weihao Xuan , Leyang Cui , Rob Voigt

Generating grounded and trustworthy responses remains a key challenge for large language models (LLMs). While retrieval-augmented generation (RAG) with citation-based grounding holds promise, instruction-tuned models frequently fail even in…

Computation and Language · Computer Science 2025-06-19 Shang Hong Sim , Tej Deep Pala , Vernon Toh , Hai Leong Chieu , Amir Zadeh , Chuan Li , Navonil Majumder , Soujanya Poria

Large Reasoning Models (LRMs) have achieved remarkable performance on complex reasoning tasks by adopting the ``think-then-answer'' paradigm, which enhances both accuracy and interpretability. However, current LRMs exhibit two critical…

Computation and Language · Computer Science 2026-01-09 Xue Zhang , Yunlong Liang , Fandong Meng , Songming Zhang , Kaiyu Huang , Yufeng Chen , Jinan Xu , Jie Zhou

While large language models (LLMs) demonstrate emerging reasoning capabilities, current inference-time expansion methods incur prohibitive computational costs by exhaustive sampling. Through analyzing decoding trajectories, we observe that…

Artificial Intelligence · Computer Science 2026-02-03 Ziheng Li , Hengyi Cai , Xiaochi Wei , Yuchen Li , Shuaiqiang Wang , Zhi-Hong Deng , Dawei Yin

Current large language models (LLMs) have demonstrated emerging capabilities in social intelligence tasks, including implicature resolution and theory-of-mind reasoning, both of which require substantial pragmatic understanding. However,…

Computation and Language · Computer Science 2026-01-13 Kefan Yu , Qingcheng Zeng , Weihao Xuan , Wanxin Li , Jingyi Wu , Rob Voigt

Reinforcement learning (RL) with unit test feedback has enhanced large language models' (LLMs) code generation, but relies on sparse rewards provided only after complete code evaluation, limiting learning efficiency and incremental…

Artificial Intelligence · Computer Science 2025-02-05 Ning Dai , Zheng Wu , Renjie Zheng , Ziyun Wei , Wenlei Shi , Xing Jin , Guanlin Liu , Chen Dun , Liang Huang , Lin Yan

Large Language Models (LLMs) consistently benefit from scaled Chain-of-Thought (CoT) reasoning, but also suffer from heavy computational overhead. To address this issue, efficient reasoning aims to incentivize short yet accurate thinking…

Computation and Language · Computer Science 2026-03-23 Taiqiang Wu , Zenan Xu , Bo Zhou , Ngai Wong