English
Related papers

Related papers: PepThink-R1: LLM for Interpretable Cyclic Peptide …

200 papers

Reinforcement Learning (RL) has become a pivotal approach for enhancing the reasoning capabilities of Large Language Models (LLMs). However, a significant theoretical gap persists, as traditional token-level RL frameworks fail to align with…

Artificial Intelligence · Computer Science 2025-09-26 Zeyu Gan , Hao Yi , Yong Liu

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Tables present unique challenges for language models due to their structured row-column interactions, necessitating specialized approaches for effective comprehension. While large language models (LLMs) have demonstrated potential in table…

Computation and Language · Computer Science 2026-05-14 Zhenhe Wu , Jian Yang , Zhongjiang He , Changzai Pan , Jie Zhang , Jiaheng Liu , Xianjie Wu , Yu Zhao , Shuangyong Song , Yongxiang Li , Zhoujun Li , Xueling Li

Reinforcement Learning (RL) benefits Large Language Models (LLMs) for complex reasoning. Inspired by this, we explore integrating spatio-temporal specific rewards into Multimodal Large Language Models (MLLMs) to address the unique…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Xinhao Li , Ziang Yan , Desen Meng , Lu Dong , Xiangyu Zeng , Yinan He , Yali Wang , Yu Qiao , Yi Wang , Limin Wang

Developing professional, structured reasoning on par with human financial analysts and traders remains a central challenge in AI for finance, where markets demand interpretability and trust. Traditional time-series models lack…

Trading and Market Microstructure · Quantitative Finance 2025-09-16 Yijia Xiao , Edward Sun , Tong Chen , Fang Wu , Di Luo , Wei Wang

Although Large Language Models (LLMs) have demonstrated remarkable progress, their proficiency in graph-related tasks remains notably limited, hindering the development of truly general-purpose models. Previous attempts, including…

Machine Learning · Computer Science 2025-08-20 Xiaojun Guo , Ang Li , Yifei Wang , Stefanie Jegelka , Yisen Wang

Large language models (LLMs) equipped with chain-of-thought (CoT) achieve strong performance and offer a window into LLM behavior. However, recent evidence suggests that improvements in CoT capabilities often come with redundant reasoning…

Computation and Language · Computer Science 2026-02-03 Yanrui Du , Sendong Zhao , Yibo Gao , Danyang Zhao , Qika Lin , Ming Ma , Jiayun Li , Yi Jiang , Kai He , Qianyi Xu , Bing Qin , Mengling Feng

While large language models show promise in medical applications, achieving expert-level clinical reasoning remains challenging due to the need for both accurate answers and transparent reasoning processes. To address this challenge, we…

Machine Learning · Computer Science 2025-09-22 Chi Liu , Derek Li , Yan Shu , Robin Chen , Derek Duan , Teng Fang , Bryan Dai

Reinforcement learning (RL) has emerged as a powerful paradigm for fine-tuning Large Language Models (LLMs) for text generation. In particular, recent LLMs such as ChatGPT and GPT-4 can engage in fluent conversations with users after…

Machine Learning · Computer Science 2023-11-14 Jonathan D. Chang , Kiante Brantley , Rajkumar Ramamurthy , Dipendra Misra , Wen Sun

Distilling reasoning paths from teacher to student models via supervised fine-tuning (SFT) provides a shortcut for improving the reasoning ability of smaller Large Language Models (LLMs). However, the reasoning paths generated by teacher…

Computation and Language · Computer Science 2026-02-03 Shicheng Xu , Liang Pang , Yunchang Zhu , Jia Gu , Zihao Wei , Jingcheng Deng , Feiyang Pan , Huawei Shen , Xueqi Cheng

Recent advancements in large language models (LLMs) have demonstrated their potential in automating the scientific research ideation. Existing approaches primarily focus on prompting techniques, often producing ideas misaligned with expert…

Computation and Language · Computer Science 2025-11-17 Ruochen Li , Liqiang Jing , Chi Han , Jiawei Zhou , Xinya Du

We propose Rec-R1, a general reinforcement learning framework that bridges large language models (LLMs) with recommendation systems through closed-loop optimization. Unlike prompting and supervised fine-tuning (SFT), Rec-R1 directly…

Information Retrieval · Computer Science 2026-01-30 Jiacheng Lin , Tian Wang , Kun Qian

Table reasoning (TR) requires structured reasoning over semi-structured tabular data and remains challenging, particularly for small language models (SLMs, e.g., LLaMA-8B) due to their limited capacity compared to large LMs (LLMs, e.g.,…

Machine Learning · Computer Science 2025-06-09 Rihui Jin , Zheyu Xin , Xing Xie , Zuoyi Li , Guilin Qi , Yongrui Chen , Xinbang Dai , Tongtong Wu , Gholamreza Haffari

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Supervised fine-tuning (SFT) has emerged as one of the most effective ways to improve the performance of large language models (LLMs) in downstream tasks. However, SFT can have difficulty generalizing when the underlying data distribution…

Computation and Language · Computer Science 2025-12-15 Mrinal Rawat , Arkajyoti Chakraborty , Neha Gupta , Roberto Pieraccini

Predicting cancer treatment outcomes requires models that are both accurate and interpretable, particularly in the presence of heterogeneous clinical data. While large language models (LLMs) have shown strong performance in biomedical NLP,…

Computation and Language · Computer Science 2025-10-21 Raghu Vamshi Hemadri , Geetha Krishna Guruju , Kristi Topollai , Anna Ewa Choromanska

Current Large Language Models (LLMs) exhibit significant limitations, notably in structured, interpretable, and verifiable medical reasoning, alongside practical deployment challenges related to computational resources and data privacy.…

Computation and Language · Computer Science 2025-06-06 Boqin Zhuang , Chenxiao Song , Huitong Lu , Jiacheng Qiao , Mingqian Liu , Mingxing Yu , Ping Hong , Rui Li , Xiaoxia Song , Xiangjun Xu , Xu Chen , Yaoyao Ma , Yujie Gao

Long Chain-of-Thought (LCoT), achieved by Reinforcement Learning with Verifiable Rewards (RLVR), has proven effective in enhancing the reasoning capabilities of Large Language Models (LLMs). However, reasoning in current LLMs is primarily…

Contemporary progress in large language models (LLMs) has revealed notable inferential capacities via reinforcement learning (RL) employing verifiable reward, facilitating the development of O1 and R1-like reasoning models. Directly…

Machine Learning · Computer Science 2025-10-21 Zexu Sun , Yongcheng Zeng , Erxue Min , Heyang Gao , Bokai Ji , Xu Chen

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…