English
Related papers

Related papers: MATH-Beyond: A Benchmark for RL to Expand Beyond t…

200 papers

To advance the mathematical proficiency of large language models (LLMs), the DeepMath team has launched an open-source initiative aimed at developing an open mathematical LLM and systematically evaluating its mathematical creativity. This…

Recent advances in large reasoning models (LRMs) show strong performance in structured domains such as mathematics and programming; however, they often lack pedagogical coherence and realistic teaching behaviors. To bridge this gap, we…

Artificial Intelligence · Computer Science 2025-05-27 Unggi Lee , Jaeyong Lee , Jiyeong Bae , Yeil Jeong , Junbo Koh , Gyeonggeon Lee , Gunho Lee , Taekyung Ahn , Hyeoncheol Kim

Recent advances in large language models (LLMs), such as OpenAI-o1 and DeepSeek-R1, have demonstrated the effectiveness of test-time scaling, where extended reasoning processes substantially enhance model performance. Despite this, current…

Computation and Language · Computer Science 2025-03-26 Xiaoyu Tian , Sitong Zhao , Haotian Wang , Shuaiting Chen , Yunjie Ji , Yiping Peng , Han Zhao , Xiangang Li

Theorem proving serves as a major testbed for evaluating complex reasoning abilities in large language models (LLMs). However, traditional automated theorem proving (ATP) approaches rely heavily on formal proof systems that poorly align…

Computation and Language · Computer Science 2025-06-04 Ziyin Zhang , Jiahao Xu , Zhiwei He , Tian Liang , Qiuzhi Liu , Yansi Li , Linfeng Song , Zhenwen Liang , Zhuosheng Zhang , Rui Wang , Zhaopeng Tu , Haitao Mi , Dong Yu

Reinforcement learning (RL) has significantly improved the reasoning ability of large language models. However, current reward models underperform in challenging reasoning scenarios and predominant RL training paradigms rely on rule-based…

Computation and Language · Computer Science 2025-07-30 Meng Zhou , Bei Li , Jiahao Liu , Xiaowen Shi , Yang Bai , Rongxiang Weng , Jingang Wang , Xunliang Cai

In this technical report, we introduce OpenR, an open-source framework designed to integrate key components for enhancing the reasoning capabilities of large language models (LLMs). OpenR unifies data acquisition, reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-15 Jun Wang , Meng Fang , Ziyu Wan , Muning Wen , Jiachen Zhu , Anjie Liu , Ziqin Gong , Yan Song , Lei Chen , Lionel M. Ni , Linyi Yang , Ying Wen , Weinan Zhang

DeepSeek-R1, known for its low training cost and exceptional reasoning capabilities, has achieved state-of-the-art performance on various benchmarks. However, detailed evaluations for DeepSeek Series models from the perspective of…

The rapid progress in the field of natural language processing (NLP) systems and the expansion of large language models (LLMs) have opened up numerous opportunities in the field of education and instructional methods. These advancements…

Computation and Language · Computer Science 2024-04-23 Avinash Anand , Mohit Gupta , Kritarth Prasad , Navya Singla , Sanjana Sanjeev , Jatin Kumar , Adarsh Raj Shivam , Rajiv Ratn Shah

We have witnessed that strong LLMs like Qwen-Math, MiMo, and Phi-4 possess immense reasoning potential inherited from the pre-training stage. With reinforcement learning (RL), these models can improve dramatically on reasoning tasks. Recent…

Computation and Language · Computer Science 2025-06-06 Yubo Wang , Ping Nie , Kai Zou , Lijun Wu , Wenhu Chen

Large language models have demonstrated impressive performance on challenging mathematical reasoning tasks, which has triggered the discussion of whether the performance is achieved by true reasoning capability or memorization. To…

Looped Language Models (LoopLMs) perform multi-step latent reasoning prior to token generation and outperform conventional LLMs on reasoning benchmarks at smaller parameter budgets. However, attempts to further improve LoopLM reasoning with…

Machine Learning · Computer Science 2026-05-29 Jonathan Williams , Esin Tureci

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

Computation and Language · Computer Science 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

Mathematical problem solving remains a challenging test of reasoning for large language and multimodal models, yet existing benchmarks are limited in size, language coverage, and task diversity. We introduce MathNet, a high-quality,…

Artificial Intelligence · Computer Science 2026-04-21 Shaden Alshammari , Kevin Wen , Abrar Zainal , Mark Hamilton , Navid Safaei , Sultan Albarakati , William T. Freeman , Antonio Torralba

Mathematical reasoning has long represented one of the most fundamental and challenging frontiers in artificial intelligence research. In recent years, large language models (LLMs) have achieved significant advances in this area. This…

Artificial Intelligence · Computer Science 2025-06-11 Peng-Yuan Wang , Tian-Shuo Liu , Chenyang Wang , Yi-Di Wang , Shu Yan , Cheng-Xing Jia , Xu-Hui Liu , Xin-Wei Chen , Jia-Cheng Xu , Ziniu Li , Yang Yu

Building a search relevance model that achieves both low latency and high performance is a long-standing challenge in the search industry. To satisfy the millisecond-level response requirements of online systems while retaining the…

Machine Learning · Computer Science 2026-02-11 Shijie Zhang , Xiang Guo , Rujun Guo , Shaoyu Liu , Xiaozhao Wang , Guanjun Jiang , Kevin Zhang

With the rise of LLMs, there is an increasing need for intelligent recommendation assistants that can handle complex queries and provide personalized, reasoning-driven recommendations. LLM-based recommenders show potential but face…

Information Retrieval · Computer Science 2026-04-10 Jiani Huang , Shijie Wang , Liangbo Ning , Wenqi Fan , Qing Li

Recently, deep reasoning LLMs (e.g., OpenAI o1 and DeepSeek-R1) have shown promising performance in various downstream tasks. Free translation is an important and interesting task in the multilingual world, which requires going beyond…

Computation and Language · Computer Science 2025-09-01 Jiaan Wang , Fandong Meng , Jie Zhou

Large Reasoning Models (LRMs) have achieved remarkable success on reasoning-intensive tasks such as mathematics and programming. However, their enhanced reasoning capabilities do not necessarily translate to improved safety performance-and…

Computation and Language · Computer Science 2026-04-21 Zhexin Zhang , Xian Qi Loye , Victor Shea-Jay Huang , Junxiao Yang , Qi Zhu , Shiyao Cui , Fei Mi , Lifeng Shang , Yingkang Wang , Hongning Wang , Minlie Huang

The reasoning ability of large language models (LLMs) can be unleashed with reinforcement learning (RL) (OpenAI, 2024; DeepSeek-AI et al., 2025a; Zeng et al., 2025). The success of existing RL attempts in LLMs usually rely on high-quality…

Machine Learning · Computer Science 2026-04-03 Yiyuan Li , Zhen Huang , Yanan Wu , Weixun Wang , Xuefeng Li , Yijia Luo , Wenbo Su , Bo Zheng , Pengfei Liu

This paper investigates the mathematical reasoning capabilities of large language models (LLMs) using 50 newly constructed high-school-level word problems. Unlike prior studies that focus solely on answer correctness, we rigorously analyze…

Artificial Intelligence · Computer Science 2025-02-24 Johan Boye , Birger Moell