English
Related papers

Related papers: DocPuzzle: A Process-Aware Benchmark for Evaluatin…

200 papers

Mathematical reasoning is essential for problem-solving in education, science, and industry, serving as a crucial benchmark for evaluating artificial intelligence systems. As Large Language Models (LLMs) improve their reasoning…

Computation and Language · Computer Science 2026-05-20 Husnain Amjad , Raja Khurram Shahzad , Aamir Shahzad , Mehwish Fatima

Exploring the capabilities of Large Language Models (LLMs) in puzzle solving unveils critical insights into their potential and challenges in AI, marking a significant step towards understanding their applicability in complex reasoning…

Computation and Language · Computer Science 2025-08-04 Panagiotis Giadikiaroglou , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Large Language Models (LLMs) have shown impressive performance in reasoning tasks. However, LLMs tend to generate excessively long reasoning content, leading to significant computational overhead. Our observations indicate that even on…

Computation and Language · Computer Science 2025-05-21 Guochao Jiang , Guofeng Quan , Zepeng Ding , Ziqin Luo , Dixuan Wang , Zheng Hu

Existing multilingual long-context benchmarks, often based on the popular needle-in-a-haystack test, primarily evaluate a model's ability to locate specific information buried within irrelevant texts. However, such a retrieval-centric…

Computation and Language · Computer Science 2025-04-18 Amey Hengle , Prasoon Bajpai , Soham Dan , Tanmoy Chakraborty

Large language models (LLMs) have mastered abundant simple and explicit commonsense knowledge through pre-training, enabling them to achieve human-like performance in simple commonsense reasoning. Nevertheless, LLMs struggle to reason with…

Computation and Language · Computer Science 2025-06-10 Kai Xiong , Xiao Ding , Yixin Cao , Yuxiong Yan , Li Du , Yufei Zhang , Jinglong Gao , Jiaqian Liu , Bing Qin , Ting Liu

Recent advancements in large language models (LLMs) have demonstrated remarkable reasoning capabilities through long chain-of-thought (CoT) reasoning. The R1 distillation scheme has emerged as a promising approach for training…

Artificial Intelligence · Computer Science 2025-03-21 Yijia Luo , Yulin Song , Xingyao Zhang , Jiaheng Liu , Weixun Wang , GengRu Chen , Wenbo Su , Bo Zheng

Daily scenarios are characterized by visual richness, requiring Multimodal Large Language Models (MLLMs) to filter noise and identify decisive visual clues for accurate reasoning. Yet, current benchmarks predominantly aim at evaluating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Xiaomin Li , Tala Wang , Zichen Zhong , Ying Zhang , Zirui Zheng , Takashi Isobe , Dezhuang Li , Huchuan Lu , You He , Xu Jia

DeepSeek-R1 is a cutting-edge open-source large language model (LLM) developed by DeepSeek, showcasing advanced reasoning capabilities through a hybrid architecture that integrates mixture of experts (MoE), chain of thought (CoT) reasoning,…

Computation and Language · Computer Science 2025-06-03 Jiancheng Ye , Sophie Bronstein , Jiarui Hai , Malak Abu Hashish

Recent advances in test-time scaling of large language models (LLMs), exemplified by DeepSeek-R1 and OpenAI's o1, show that extending the chain of thought during inference can significantly improve general reasoning performance. However,…

Computation and Language · Computer Science 2025-11-11 Yinghao Hu , Yaoyao Yu , Leilei Gan , Bin Wei , Kun Kuang , Fei Wu

As the application of Large Language Models (LLMs) expands, the demand for reliable evaluations increases. Existing LLM evaluation benchmarks primarily rely on static datasets, making it challenging to assess model performance in dynamic…

Computation and Language · Computer Science 2024-10-08 Qingchen Yu , Shichao Song , Ke Fang , Yunfeng Shi , Zifan Zheng , Hanyu Wang , Simin Niu , Zhiyu Li

Large Language Models (LLMs) are increasingly utilized in scientific research assessment, particularly in automated paper review. However, existing LLM-based review systems face significant challenges, including limited domain expertise,…

Computation and Language · Computer Science 2025-03-12 Minjun Zhu , Yixuan Weng , Linyi Yang , Yue Zhang

Small Language Models (SLMs) are attractive for cost-sensitive and resource-limited settings due to their efficient, low-latency inference. However, they often struggle with complex, knowledge-intensive tasks that require structured…

Artificial Intelligence · Computer Science 2026-02-03 Shaoxiong Yang , Junting Li , Mengyuan Zhang , Chao Li , Wei Liu , Jian Luan

Evaluating large language models (LLMs) on final-answer correctness is the dominant paradigm. This approach, however, provides a coarse signal for model improvement and overlooks the quality of the underlying reasoning process. We argue…

Artificial Intelligence · Computer Science 2025-10-24 Heejin Do , Jaehui Hwang , Dongyoon Han , Seong Joon Oh , Sangdoo Yun

Large Language Models (LLMs) have demonstrated remarkable potential in advancing scientific knowledge and addressing complex challenges. In this work, we introduce OmniScience, a specialized large reasoning model for general science,…

Artificial Intelligence · Computer Science 2025-04-24 Vignesh Prabhakar , Md Amirul Islam , Adam Atanas , Yao-Ting Wang , Joah Han , Aastha Jhunjhunwala , Rucha Apte , Robert Clark , Kang Xu , Zihan Wang , Kai Liu

Recent advances in Multi-Modal Large Language Models (MLLMs) have enabled unified processing of language, vision, and structured inputs, opening the door to complex tasks such as logical deduction, spatial reasoning, and scientific…

Artificial Intelligence · Computer Science 2025-07-03 Guiyao Tie , Xueyang Zhou , Tianhe Gu , Ruihang Zhang , Chaoran Hu , Sizhe Zhang , Mengqu Sun , Yan Zhang , Pan Zhou , Lichao Sun

Document visual question answering requires models not only to answer questions correctly, but also to precisely localize answers within complex document layouts. While large vision-language models (VLMs) achieve strong spatial grounding,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Pinaki Prasad Guha Neogi , Ahmad Mohammadshirazi , Ser-Nam Lim , Rajiv Ramnath

Large language models (LLMs) are deployed on increasingly complex tasks that require multi-step decision-making. Understanding their algorithmic reasoning abilities is therefore crucial. However, we lack a diagnostic benchmark for…

Machine Learning · Computer Science 2026-02-12 Yu He , Yingxi Li , Colin White , Ellen Vitercik

Recent Large Reasoning Models (LRMs), such as DeepSeek-R1 and OpenAI o1, have demonstrated strong performance gains by scaling up the length of Chain-of-Thought (CoT) reasoning during inference. However, a growing concern lies in their…

Open-domain complex Question Answering (QA) is a difficult task with challenges in evidence retrieval and reasoning. The complexity of such questions could stem from questions being compositional, hybrid evidence, or ambiguity in questions.…

Computation and Language · Computer Science 2024-06-26 Venktesh V. Deepali Prabhu , Avishek Anand

Test-time scaling has significantly improved large language model performance, enabling deeper reasoning to solve complex problems. However, this increased reasoning capability also leads to excessive token generation and unnecessary…