English
Related papers

Related papers: OpenAI-o1 AB Testing: Does the o1 model really do …

200 papers

Recent years have seen a significant progress in the general-purpose problem solving abilities of large vision and language models (LVLMs), such as ChatGPT, Gemini, etc.; some of these breakthroughs even seem to enable AI models to…

Machine Learning · Computer Science 2024-12-09 Anoop Cherian , Kuan-Chuan Peng , Suhas Lohit , Joanna Matthiesen , Kevin Smith , Joshua B. Tenenbaum

Mathematical reasoning is a cornerstone of artificial general intelligence and a primary benchmark for evaluating the capabilities of Large Language Models (LLMs). While state-of-the-art models show promise, they often falter when faced…

Computation and Language · Computer Science 2025-07-29 Yifan Hao , Fangning Chao , Yaqian Hao , Zhaojun Cui , Huan Bai , Haiyu Zhang , Yankai Liu , Chao Deng , Junlan Feng

As artificial intelligence programs have become more powerful, their capacity for problem-solving continues to increase, approaching top-level competitors in many olympiads. Continued development of models and benchmarks is important but…

Software Engineering · Computer Science 2025-03-21 Samuel Ren

Difficult problems, which often result in long reasoning traces, are widely recognized as key factors for enhancing the performance of reasoning models. However, such high-challenge problems are scarce, limiting the size of available…

Computation and Language · Computer Science 2025-03-25 Si Shen , Fei Huang , Zhixiao Zhao , Chang Liu , Tiansheng Zheng , Danhao Zhu

Multi-modal Large Language Models (MLLMs) exhibit impressive problem-solving abilities in various domains, but their visual comprehension and abstract reasoning skills remain under-evaluated. To this end, we present PolyMATH, a challenging…

Artificial Intelligence · Computer Science 2026-05-12 Himanshu Gupta , Shreyas Verma , Ujjwala Anantheswaran , Kevin Scaria , Mihir Parmar , Swaroop Mishra , Chitta Baral

Large Language Models have shown tremendous performance on a large variety of natural language processing tasks, ranging from text comprehension to common sense reasoning. However, the mechanisms responsible for this success remain opaque,…

Computation and Language · Computer Science 2024-01-04 Gaël Gendron , Qiming Bao , Michael Witbrock , Gillian Dobbie

Large language models (LLMs) can achieve strong reasoning performance with sufficient computation, but they do not inherently know how much computation a task requires. We study budgeted inference-time reasoning for multiple tasks under a…

Artificial Intelligence · Computer Science 2026-01-08 Muyang Zhao , Qi Qi , Hao Sun

Leveraging inference-time search in large language models has proven effective in further enhancing a trained model's capability to solve complex mathematical and reasoning problems. However, this approach significantly increases…

Machine Learning · Computer Science 2025-10-29 Tianwei Ni , Allen Nie , Sapana Chaudhary , Yao Liu , Huzefa Rangwala , Rasool Fakoor

We present OpenThaiGPT 1.6 and R1 (OTG-1.6 and OTG-R1), Thai-centric Large Language Models (LLMs) developed through distinct methodologies to enhance generalization and reasoning capabilities. OTG-1.6 employs Task Arithmetic model merging…

Computation and Language · Computer Science 2025-04-03 Sumeth Yuenyong , Thodsaporn Chay-intr , Kobkrit Viriyayudhakorn

The rapid advancement of large reasoning models has saturated existing math benchmarks, underscoring the urgent need for more challenging evaluation frameworks. To address this, we introduce OlymMATH, a rigorously curated, Olympiad-level…

Computation and Language · Computer Science 2026-04-14 Haoxiang Sun , Yingqian Min , Zhipeng Chen , Wayne Xin Zhao , Ji-Rong Wen

Although large language models (LLMs) have been assessed for general medical knowledge using licensing exams, their ability to support clinical decision-making, such as selecting medical calculators, remains uncertain. We assessed nine…

Computation and Language · Computer Science 2025-03-25 Nicholas Wan , Qiao Jin , Joey Chan , Guangzhi Xiong , Serina Applebaum , Aidan Gilson , Reid McMurry , R. Andrew Taylor , Aidong Zhang , Qingyu Chen , Zhiyong Lu

Knowledge representation and reasoning are critical challenges in Artificial Intelligence (AI), particularly in integrating neural and symbolic approaches to achieve explainable and transparent AI systems. Traditional knowledge…

Computation and Language · Computer Science 2025-02-17 Xin Kang , Veronika Shteingardt , Yuhan Wang , Dov Dori

Recent AI systems have achieved gold-medal-level performance on the International Mathematical Olympiad, demonstrating remarkable proficiency at competition-style problem solving. However, competition mathematics represents only a narrow…

Artificial Intelligence · Computer Science 2026-04-09 Suhaas Garre , Erik Knutsen , Sushant Mehta , Edwin Chen

Reward modeling is essential for aligning large language models with human preferences through reinforcement learning. To provide accurate reward signals, a reward model (RM) should stimulate deep thinking and conduct interpretable…

Computation and Language · Computer Science 2026-03-09 Xiusi Chen , Gaotang Li , Ziqi Wang , Bowen Jin , Cheng Qian , Yu Wang , Hongru Wang , Yu Zhang , Denghui Zhang , Tong Zhang , Hanghang Tong , Heng Ji

Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to perform complex reasoning tasks, transitioning from fast and intuitive thinking (System 1) to slow and deep reasoning (System 2). While System…

Computation and Language · Computer Science 2025-04-01 Rui Wang , Hongru Wang , Boyang Xue , Jianhui Pang , Shudong Liu , Yi Chen , Jiahao Qiu , Derek Fai Wong , Heng Ji , Kam-Fai Wong

With the rapid advancement of Artificial Intelligence (AI), Large Language Models (LLMs) have significantly impacted a wide array of domains, including healthcare, engineering, science, education, and mathematical reasoning. Among these,…

Machine Learning · Computer Science 2025-05-20 Afrar Jahin , Arif Hassan Zidan , Wei Zhang , Yu Bao , Tianming Liu

In this article, we tackle the math word problem, namely, automatically answering a mathematical problem according to its textual description. Although recent methods have demonstrated their promising results, most of these methods are…

Computation and Language · Computer Science 2021-09-28 Shifeng Huang , Jiawei Wang , Jiao Xu , Da Cao , Ming Yang

Large language models (LLMs) have shown increasing capability in problem-solving and decision-making, largely based on the step-by-step chain-of-thought reasoning processes. However, evaluating these reasoning abilities has become…

In this short note, we report and analyze a striking event: OpenAI's large language model o3 has outwitted all students in a university exam on thermodynamics. The thermodynamics exam is a difficult hurdle for most students, where they must…

Computational Engineering, Finance, and Science · Computer Science 2025-06-12 Rebecca Loubet , Pascal Zittlau , Marco Hoffmann , Luisa Vollmer , Sophie Fellenz , Heike Leitte , Fabian Jirasek , Johannes Lenhard , Hans Hasse

Large Reasoning Models (LRMs) like DeepSeek-R1 and OpenAI-o1 have demonstrated remarkable reasoning capabilities, raising important questions about their biases in LLM-as-a-judge settings. We present a comprehensive benchmark comparing…

Computers and Society · Computer Science 2025-04-21 Qian Wang , Zhanzhi Lou , Zhenheng Tang , Nuo Chen , Xuandong Zhao , Wenxuan Zhang , Dawn Song , Bingsheng He