中文
相关论文

相关论文: DeepSeek-R1 vs. o3-mini: How Well can Reasoning LL…

200 篇论文

Enabling Large Language Models (LLMs) to handle a wider range of complex tasks (e.g., coding, math) has drawn great attention from many researchers. As LLMs continue to evolve, merely increasing the number of model parameters yields…

Recent advancements in large language models (LLMs), such as DeepSeek-R1 and OpenAI-o1, have demonstrated the significant effectiveness of test-time scaling, achieving substantial performance gains across various benchmarks. These advanced…

计算与语言 · 计算机科学 2025-04-15 Haotian Wang , Han Zhao , Shuaiting Chen , Xiaoyu Tian , Sitong Zhao , Yunjie Ji , Yiping Peng , Xiangang Li

Large Language Models (LLMs) have shown significant potential for ontology engineering. However, it is still unclear to what extent they are applicable to the task of domain-specific ontology generation. In this study, we explore the…

Recent Large Language Models (LLMs) such as OpenAI o3-mini and DeepSeek-R1 use enhanced reasoning through Chain-of-Thought (CoT). Their potential in hardware design, which relies on expert-driven iterative optimization, remains unexplored.…

人工智能 · 计算机科学 2025-04-15 Luca Collini , Andrew Hennessee , Ramesh Karri , Siddharth Garg

We present rStar-Math to demonstrate that small language models (SLMs) can rival or even surpass the math reasoning capability of OpenAI o1, without distillation from superior models. rStar-Math achieves this by exercising "deep thinking"…

计算与语言 · 计算机科学 2025-01-09 Xinyu Guan , Li Lyna Zhang , Yifei Liu , Ning Shang , Youran Sun , Yi Zhu , Fan Yang , Mao Yang

Reasoning has long been viewed as an emergent property of large language models (LLMs). However, recent studies challenge this assumption, showing that small language models (SLMs) can also achieve competitive reasoning performance. This…

计算与语言 · 计算机科学 2025-10-01 Gaurav Srivastava , Shuxiang Cao , Xuan Wang

DeepSeek-V3 and DeepSeek-R1 are leading open-source Large Language Models (LLMs) for general-purpose tasks and reasoning, achieving performance comparable to state-of-the-art closed-source models from companies like OpenAI and Anthropic --…

机器学习 · 计算机科学 2025-03-17 Chengen Wang , Murat Kantarcioglu

Large Reasoning Models (LRMs) like DeepSeek-R1 and OpenAI-o1 have demonstrated remarkable reasoning capabilities, raising important questions about their biases in LLM-as-a-judge settings. We present a comprehensive benchmark comparing…

计算机与社会 · 计算机科学 2025-04-21 Qian Wang , Zhanzhi Lou , Zhenheng Tang , Nuo Chen , Xuandong Zhao , Wenxuan Zhang , Dawn Song , Bingsheng He

This paper investigates data selection and model merging methodologies aimed at incorporating advanced reasoning capabilities such as those of DeepSeek R1 into language-specific large language models (LLMs), with a particular focus on the…

计算与语言 · 计算机科学 2025-03-28 Kunat Pipatanakul , Pittawat Taveekitworachai , Potsawee Manakul , Kasima Tharnpipitchai

The advent of large reasoning models, such as OpenAI o1 and DeepSeek R1, has significantly advanced complex reasoning tasks. However, their capabilities in multilingual complex reasoning remain underexplored, with existing efforts largely…

计算与语言 · 计算机科学 2025-05-27 Wenyang Luo , Wayne Xin Zhao , Jing Sha , Shijin Wang , Ji-Rong Wen

Large Language Models (LLMs) have been touted as AI models possessing advanced reasoning abilities. However, recent works have shown that LLMs often bypass true reasoning using shortcuts, sparking skepticism. To study the reasoning…

人工智能 · 计算机科学 2024-10-24 Rishi Hazra , Gabriele Venturato , Pedro Zuidberg Dos Martires , Luc De Raedt

The o1-Like LLMs are transforming AI by simulating human cognitive processes, but their performance in multilingual machine translation (MMT) remains underexplored. This study examines: (1) how o1-Like LLMs perform in MMT tasks and (2) what…

计算与语言 · 计算机科学 2025-02-18 Andong Chen , Yuchen Song , Wenxin Zhu , Kehai Chen , Muyun Yang , Tiejun Zhao , Min zhang

Recent advancements in large reasoning models (LRMs) have introduced an intermediate "thinking" process prior to generating final answers, improving their reasoning capabilities on complex downstream tasks. However, the potential of LRMs as…

计算与语言 · 计算机科学 2025-10-24 Runzhe Zhan , Zhihong Huang , Xinyi Yang , Lidia S. Chao , Min Yang , Derek F. Wong

Large Language Models have shown tremendous performance on a large variety of natural language processing tasks, ranging from text comprehension to common sense reasoning. However, the mechanisms responsible for this success remain opaque,…

计算与语言 · 计算机科学 2024-01-04 Gaël Gendron , Qiming Bao , Michael Witbrock , Gillian Dobbie

Large Language Models (LLMs) have emerged with many intellectual capacities. While numerous benchmarks assess their intelligence, limited attention has been given to their ability to explore--an essential capacity for discovering new…

人工智能 · 计算机科学 2025-05-13 Lan Pan , Hanbo Xie , Robert C. Wilson

As Large Language Models (LLMs) are increasingly adopted as automated judges in benchmarking and reward modeling, ensuring their reliability, efficiency, and robustness has become critical. In this work, we present a systematic comparison…

人工智能 · 计算机科学 2026-05-12 Pratik Jayarao , Himanshu Gupta , Neeraj Varshney , Chaitanya Dwivedi

The emergent few-shot reasoning capabilities of Large Language Models (LLMs) have excited the natural language and machine learning community over recent years. Despite of numerous successful applications, the underlying mechanism of such…

计算与语言 · 计算机科学 2023-06-09 Xiaojuan Tang , Zilong Zheng , Jiaqi Li , Fanxu Meng , Song-Chun Zhu , Yitao Liang , Muhan Zhang

Sorting is a tedious but simple task for human intelligence and can be solved fairly easily algorithmically. However, for Large Language Models (LLMs) this task is surprisingly hard, as some properties of sorting are among known weaknesses…

机器学习 · 计算机科学 2025-04-14 Steffen Herbold

We investigate the effectiveness of large language models (LLMs), including reasoning-based and non-reasoning models, in performing zero-shot financial sentiment analysis. Using the Financial PhraseBank dataset annotated by domain experts,…

计算与语言 · 计算机科学 2025-06-06 Dimitris Vamvourellis , Dhagash Mehta

Mathematical reasoning and optimization are fundamental to artificial intelligence and computational problem-solving. Recent advancements in Large Language Models (LLMs) have significantly improved AI-driven mathematical reasoning, theorem…

人工智能 · 计算机科学 2025-03-25 Ali Forootani