中文
相关论文

相关论文: SynLogic: Synthesizing Verifiable Reasoning Data a…

200 篇论文

In this technical report, we introduce OpenR, an open-source framework designed to integrate key components for enhancing the reasoning capabilities of large language models (LLMs). OpenR unifies data acquisition, reinforcement learning…

How far are Large Language Models (LLMs) in performing deep relational reasoning? In this paper, we evaluate and compare the reasoning capabilities of three cutting-edge LLMs, namely, DeepSeek-R1, DeepSeek-V3 and GPT-4o, through a suite of…

人工智能 · 计算机科学 2025-07-01 Chi Chiu So , Yueyue Sun , Jun-Min Wang , Siu Pang Yung , Anthony Wai Keung Loh , Chun Pong Chau

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

In recent years, training methods centered on Reinforcement Learning (RL) have markedly enhanced the reasoning and alignment performance of Large Language Models (LLMs), particularly in understanding human intents, following user…

计算与语言 · 计算机科学 2025-09-23 Keliang Liu , Dingkang Yang , Ziyun Qian , Weijie Yin , Yuchi Wang , Hongsheng Li , Jun Liu , Peng Zhai , Yang Liu , Lihua Zhang

Logical reasoning is a critical component of Large Language Models (LLMs), and substantial research efforts in recent years have aimed to enhance their deductive reasoning capabilities. However, existing deductive reasoning benchmarks,…

计算与语言 · 计算机科学 2025-05-12 Michael K. Chen , Xikun Zhang , Dacheng Tao

We present that hierarchical LLM reasoning via scaling thought templates can effectively optimize the reasoning search space and outperform the mathematical reasoning capabilities of powerful LLMs like OpenAI o1-preview and DeepSeek V3. We…

计算与语言 · 计算机科学 2025-03-12 Ling Yang , Zhaochen Yu , Bin Cui , Mengdi Wang

In recent years, general-purpose large language models (LLMs) such as GPT, Gemini, Claude, and DeepSeek have advanced at an unprecedented pace. Despite these achievements, their application to finance remains challenging, due to fragmented…

While Large Language Models (LLMs) demonstrate exceptional performance in surface-level text generation, their nature in handling complex multi-step reasoning tasks often remains one of ``statistical fitting'' rather than systematic logical…

机器学习 · 计算机科学 2026-01-27 Lianlei Shan , Han Chen , Yixuan Wang , Zhenjie Liu , Wei Li

Reinforcement learning has been shown to improve the performance of large language models. However, traditional approaches like RLHF or RLAIF treat the problem as single-step. As focus shifts toward more complex reasoning and agentic tasks,…

人工智能 · 计算机科学 2025-04-29 Anna Goldie , Azalia Mirhoseini , Hao Zhou , Irene Cai , Christopher D. Manning

Users increasingly rely on Large Language Models (LLMs) for Deep Research, using them to synthesize diverse sources into structured reports that support understanding and action. In this context, the practical reliability of such reports…

计算与语言 · 计算机科学 2026-02-24 Jujia Zhao , Zhaoxin Huan , Zihan Wang , Xiaolu Zhang , Jun Zhou , Suzan Verberne , Zhaochun Ren

Large language models (LLMs) have demonstrated remarkable progress in understanding long-context inputs. However, benchmarks for evaluating the long-context reasoning abilities of LLMs fall behind the pace. Existing benchmarks often focus…

计算与语言 · 计算机科学 2025-11-19 Zhan Ling , Kang Liu , Kai Yan , Yifan Yang , Weijian Lin , Ting-Han Fan , Lingfeng Shen , Zhengyin Du , Jiecao Chen

Reasoning models (RMs), language models (LMs) trained with reinforcement learning to produce long-form natural language reasoning, have been remarkably successful, but they still require large amounts of computation and data to train, and…

计算与语言 · 计算机科学 2025-10-27 Cedegao E. Zhang , Cédric Colas , Gabriel Poesia , Joshua B. Tenenbaum , Jacob Andreas

The advancement of reasoning capabilities in Large Language Models (LLMs) requires substantial amounts of high-quality reasoning data, particularly in mathematics. Existing data synthesis methods, such as data augmentation from annotated…

人工智能 · 计算机科学 2026-02-17 Jiapeng Wang , Jinhao Jiang , Zhiqiang Zhang , Jun Zhou , Wayne Xin Zhao

This paper studies learning logic rules for reasoning on knowledge graphs. Logic rules provide interpretable explanations when used for prediction as well as being able to generalize to other tasks, and hence are critical to learn. Existing…

人工智能 · 计算机科学 2021-07-19 Meng Qu , Junkun Chen , Louis-Pascal Xhonneux , Yoshua Bengio , Jian Tang

Large Language Model (LLM) based listwise ranking has shown superior performance in many passage ranking tasks. With the development of Large Reasoning Models (LRMs), many studies have demonstrated that step-by-step reasoning during…

信息检索 · 计算机科学 2026-04-23 Wenhan Liu , Xinyu Ma , Weiwei Sun , Yutao Zhu , Yuchen Li , Dawei Yin , Zhicheng Dou

Language has long been conceived as an essential tool for human reasoning. The breakthrough of Large Language Models (LLMs) has sparked significant research interest in leveraging these models to tackle complex reasoning tasks. Researchers…

The reasoning ability of large language models (LLMs) can be unleashed with reinforcement learning (RL) (OpenAI, 2024; DeepSeek-AI et al., 2025a; Zeng et al., 2025). The success of existing RL attempts in LLMs usually rely on high-quality…

机器学习 · 计算机科学 2026-04-03 Yiyuan Li , Zhen Huang , Yanan Wu , Weixun Wang , Xuefeng Li , Yijia Luo , Wenbo Su , Bo Zheng , Pengfei Liu

Recent developments, particularly OpenAI's O1 model, have demonstrated the remarkable potential of Large Language Models (LLMs) for complex reasoning tasks. Through analysis of O1's outputs and provided sample Chain-of-Thought (CoT)…

人工智能 · 计算机科学 2024-12-09 Toby Simonds , Jey Han Lau , Chaithanya Bandi

The recent advent of reasoning models like OpenAI's o1 was met with excited speculation by the AI community about the mechanisms underlying these capabilities in closed models, followed by a rush of replication efforts, particularly from…

计算与语言 · 计算机科学 2025-11-21 Brown Ebouky , Andrea Bartezzaghi , Mattia Rigotti

The success of DeepSeek-R1 demonstrates the immense potential of using reinforcement learning (RL) to enhance LLMs' reasoning capabilities. This paper introduces Retrv-R1, the first R1-style MLLM specifically designed for multimodal…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Lanyun Zhu , Deyi Ji , Tianrun Chen , Haiyang Wu , Shiqi Wang