English
Related papers

Related papers: AttriLens-Mol: Attribute Guided Reinforcement Lear…

200 papers

Large language models (LLMs) can already identify patterns and reason effectively, yet their variable accuracy hampers adoption in high-stakes decision-making applications. In this paper, we study this issue from a venture capital…

Artificial Intelligence · Computer Science 2025-10-28 Rick Chen , Joseph Ternasky , Aaron Ontoyin Yin , Xianling Mu , Fuat Alican , Yigit Ihlamur

Protein sequence design, determined by amino acid sequences, are essential to protein engineering problems in drug discovery. Prior approaches have resorted to evolutionary strategies or Monte-Carlo methods for protein design, but often…

Recently, deep reasoning large language models(LLMs) like DeepSeek-R1 have made significant progress in tasks such as mathematics and coding. Inspired by this, several studies have employed reinforcement learning(RL) to enhance models' deep…

Computation and Language · Computer Science 2025-05-28 Zheng Li , Mao Zheng , Mingyang Song , Wenjie Yang

The capabilities of large language models (LLMs) have expanded beyond natural language processing to scientific prediction tasks, including molecular property prediction. However, their effectiveness in in-context learning remains…

Large language models (LLMs) have demonstrated strong capabilities in language understanding and reasoning, yet they remain limited when tackling real-world tasks that require up-to-date knowledge, precise operations, or specialized tool…

Machine Learning · Computer Science 2025-09-17 Yabo Zhang , Yihan Zeng , Qingyun Li , Zhen Hu , Kavin Han , Wangmeng Zuo

A prior-informed large language model (LLM) driven multi-task learning framework is proposed for the unified description of multiple nuclear observables. By fine-tuning the pre-trained DeepSeek-R1-1.5B model with Low-Rank Adaptation (LoRA),…

Nuclear Theory · Physics 2026-05-29 S. J. Guo , S. Y. Wang , E. H. Wang , Z. M. Niu , Y. M. Ding

Reinforcement Learning with Verifiable Rewards (RLVR) has recently demonstrated notable success in enhancing the reasoning performance of large language models (LLMs), particularly on mathematics and programming tasks. Similar to how…

Artificial Intelligence · Computer Science 2025-11-25 Yang Yue , Zhiqi Chen , Rui Lu , Andrew Zhao , Zhaokai Wang , Yang Yue , Shiji Song , Gao Huang

Reinforcement learning with verifiable rewards (RLVR) has been shown to enhance the reasoning capabilities of large language models (LLMs), enabling the development of large reasoning models (LRMs). However, LRMs such as DeepSeek-R1 and…

Artificial Intelligence · Computer Science 2025-11-13 Yuhao Wang , Xiaopeng Li , Cheng Gong , Ziru Liu , Suiyun Zhang , Rui Liu , Xiangyu Zhao

Reward models (RMs) play a critical role in enhancing the reasoning performance of LLMs. For example, they can provide training signals to finetune LLMs during reinforcement learning (RL) and help select the best answer from multiple…

Computation and Language · Computer Science 2025-10-06 Qiyuan Liu , Hao Xu , Xuhong Chen , Wei Chen , Yee Whye Teh , Ning Miao

The emergence of large language model (LLM)-based agents has significantly advanced the development of autonomous machine learning (ML) engineering. However, the dominant prompt-based paradigm exhibits limitations: smaller models lack the…

Computation and Language · Computer Science 2026-05-04 Zexi Liu , Jingyi Chai , Xinyu Zhu , Shuo Tang , Rui Ye , Bo Zhang , Lei Bai , Siheng Chen

Recommender systems are critical for delivering personalized content across digital platforms, and recent advances in Large Language Models (LLMs) offer new opportunities to enhance them with richer world knowledge and explicit reasoning…

Information Retrieval · Computer Science 2026-05-22 Jingtong Gao , Zeyu Song , Chi Lu , Xiaopeng Li , Derong Xu , Maolin Wang , Peng Jiang , Kun Gai , Qingpeng Cai , Xiangyu Zhao

Many capable large language models (LLMs) are developed via self-supervised pre-training followed by a reinforcement-learning fine-tuning phase, often based on human or AI feedback. During this stage, models may be guided by their inductive…

Recent advances in reasoning-centric language models have highlighted reinforcement learning (RL) as a promising method for aligning models with verifiable rewards. However, it remains contentious whether RL truly expands a model's…

Computation and Language · Computer Science 2025-06-02 Mingjie Liu , Shizhe Diao , Ximing Lu , Jian Hu , Xin Dong , Yejin Choi , Jan Kautz , Yi Dong

Large language models (LLMs) with explicit reasoning capabilities excel at mathematical reasoning yet still commit process errors, such as incorrect calculations, brittle logic, and superficially plausible but invalid steps. In this paper,…

Artificial Intelligence · Computer Science 2026-03-26 Qihao Liu , Luoxin Ye , Wufei Ma , Yu-Cheng Chou , Alan Yuille

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

Protein analysis tasks arising in healthcare settings often require accurate reasoning under protein sequence constraints, involving tasks such as functional interpretation of disease-related variants, protein-level analysis for clinical…

Artificial Intelligence · Computer Science 2026-03-03 Congying Liu , Taihao Li , Ming Huang , Xingyuan Wei , Peipei Liu , Yiqing Shen , Yanxu Mao , Tiehan Cui

Recent advances in large language models (LLMs) have increasingly relied on reinforcement learning (RL) to improve their reasoning capabilities. Three types of approaches have been widely adopted: The first relies on a deep neural network…

Machine Learning · Computer Science 2026-05-19 Shijin Gong , Kai Ye , Jin Zhu , Xinyu Zhang , Hongyi Zhou , Chengchun Shi

Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view…

Artificial Intelligence · Computer Science 2026-04-01 Chao Wu , Baoheng Li , Mingchen Gao , Yu Tian , Zhenyi Wang

While large language models have demonstrated impressive reasoning abilities, their extension to the audio modality, particularly within large audio-language models (LALMs), remains underexplored. Addressing this gap requires a systematic…

Computation and Language · Computer Science 2025-09-23 Xingjian Diao , Chunhui Zhang , Keyi Kong , Weiyi Wu , Chiyu Ma , Zhongyu Ouyang , Peijun Qing , Soroush Vosoughi , Jiang Gui

Reinforcement Learning (RL) has traditionally focused on training specialized agents to optimize predefined reward functions within narrowly defined environments. However, the advent of powerful Large Language Models (LLMs) and increasingly…

Artificial Intelligence · Computer Science 2026-05-18 Fangming Cui , Ruixiao Zhu , Cheng Fang , Sunan Li , Jiahong Li