English
Related papers

Related papers: CoDiQ: Test-Time Scaling for Controllable Difficul…

200 papers

We investigate the difficulty levels of questions in reading comprehension datasets such as SQuAD, and propose a new question generation setting, named Difficulty-controllable Question Generation (DQG). Taking as input a sentence in the…

Computation and Language · Computer Science 2019-05-31 Yifan Gao , Lidong Bing , Wang Chen , Michael R. Lyu , Irwin King

Large Reasoning Models (LRMs) have shown impressive capabilities in complex problem-solving, often benefiting from training on difficult mathematical problems that stimulate intricate reasoning. Recent efforts have explored automated…

Machine Learning · Computer Science 2025-09-26 Qizhi Pei , Zhuoshi Pan , Honglin Lin , Xin Gao , Yu Li , Zinan Tang , Conghui He , Rui Yan , Lijun Wu

Recent advancements in reasoning-based Large Language Models (LLMs), particularly their potential through test-time scaling, have created significant opportunities for distillation in code generation and critique. However, progress in both…

Recently, DeepSeek-R1 (671B) (DeepSeek-AIet al., 2025) has demonstrated its excellent reasoning ability in complex tasks and has publiclyshared its methodology. This provides potentially high-quality chain-of-thought (CoT) data for…

Artificial Intelligence · Computer Science 2025-04-17 Qianjin Yu , Keyu Wu , Zihan Chen , Chushu Zhang , Manlin Mei , Lingjun Huang , Fang Tan , Yongsheng Du , Kunlin Liu , Yurui Zhu

This paper explores the task of Difficulty-Controllable Question Generation (DCQG), which aims at generating questions with required difficulty levels. Previous research on this task mainly defines the difficulty of a question as whether it…

Computation and Language · Computer Science 2021-05-26 Yi Cheng , Siyao Li , Bang Liu , Ruihui Zhao , Sujian Li , Chenghua Lin , Yefeng Zheng

Large language models (LLMs) excel in many tasks but struggle to accurately quantify uncertainty in their generated responses. This limitation makes it challenging to detect misinformation and ensure reliable decision-making. Existing…

Computation and Language · Computer Science 2025-06-04 Boxuan Zhang , Ruqi Zhang

Large Language Models (LLMs) have achieved remarkable performance across various reasoning tasks, yet post-training is constrained by inefficient sample utilization and inflexible difficulty samples processing. To address these limitations,…

Large reasoning models (LRMs) tackle complex reasoning problems by following long chain-of-thoughts (Long CoT) that incorporate reflection, backtracking, and self-validation. However, the training techniques and data requirements to elicit…

Logical reasoning is a critical benchmark for evaluating the capabilities of large language models (LLMs), as it reflects their ability to derive valid conclusions from given premises. While the combination of test-time scaling with…

Computation and Language · Computer Science 2025-08-28 Ramya Keerthy Thatikonda , Wray Buntine , Ehsan Shareghi

Large Language Models have achieved strong performance on reasoning tasks, solving competition-level coding and math problems. However, their scalability is limited by human-labeled datasets and the lack of large-scale, challenging coding…

Computation and Language · Computer Science 2025-10-21 Hanxu Hu , Xingxing Zhang , Jannis Vamvas , Rico Sennrich , Furu Wei

Recent advances in large language models (LLMs), such as OpenAI-o1 and DeepSeek-R1, have demonstrated the effectiveness of test-time scaling, where extended reasoning processes substantially enhance model performance. Despite this, current…

Computation and Language · Computer Science 2025-03-26 Xiaoyu Tian , Sitong Zhao , Haotian Wang , Shuaiting Chen , Yunjie Ji , Yiping Peng , Han Zhao , Xiangang Li

Test-Time Training offers a promising way to improve the reasoning ability of large language models (LLMs) by adapting the model using only the test questions. However, existing methods struggle with difficult reasoning problems for two…

Machine Learning · Computer Science 2026-02-02 Chengyi Yang , Zhishang Xiang , Yunbo Tang , Zongpei Teng , Chengsong Huang , Fei Long , Yuhan Liu , Jinsong Su

Large Reasoning Models (LRMs) demonstrate exceptional capability in tackling complex mathematical, logical, and coding tasks by leveraging extended Chain-of-Thought (CoT) reasoning. Test-time scaling methods, such as prolonging CoT with…

Machine Learning · Computer Science 2025-06-03 Weizhe Lin , Xing Li , Zhiyuan Yang , Xiaojin Fu , Hui-Ling Zhen , Yaoyuan Wang , Xianzhi Yu , Wulong Liu , Xiaosong Li , Mingxuan Yuan

Large Reasoning Models (LRMs) leverage transparent reasoning traces, known as Chain-of-Thoughts (CoTs), to break down complex problems into intermediate steps and derive final answers. However, these reasoning traces introduce unique safety…

Computation and Language · Computer Science 2025-10-16 Changyi Li , Jiayi Wang , Xudong Pan , Geng Hong , Min Yang

Distilling conversational skills into Small Language Models (SLMs) with approximately 1 billion parameters presents significant challenges. Firstly, SLMs have limited capacity in their model parameters to learn extensive knowledge compared…

Computation and Language · Computer Science 2024-08-22 Patrick Huber , Arash Einolghozati , Rylan Conway , Kanika Narang , Matt Smith , Waqar Nayyar , Adithya Sagar , Ahmed Aly , Akshat Shrivastava

Large Language Models (LLMs) are increasingly described as possessing strong reasoning capabilities, supported by high performance on mathematical, logical, and planning benchmarks. However, most existing evaluations rely on aggregate…

Computation and Language · Computer Science 2026-04-16 Md. Fahad Ullah Utsho , Mohd. Ruhul Ameen , Akif Islam , Md. Golam Rashed , Dipankar Das

Large language models (LLMs) are evolving from conversational systems into strong reasoners for tasks such as Olympiad mathematics and competitive programming. While scaling parameters and test-time computation has driven progress, a key…

Machine Learning · Computer Science 2025-09-25 Xueliang Zhao , Wei Wu , Jian Guan , Zhuocheng Gong , Lingpeng Kong

Large language models (LLMs) have shown impressive performance in reasoning benchmarks with the emergence of Chain-of-Thought (CoT), particularly in multi-choice question (MCQ). However, current works equally resolve questions regardless of…

Computation and Language · Computer Science 2024-04-04 Zijie Meng , Yan Zhang , Zhaopeng Feng , Zuozhu Liu

Improving the mathematical reasoning capabilities of Large Language Models (LLMs) is critical for advancing artificial intelligence. However, access to extensive, diverse, and high-quality reasoning datasets remains a significant challenge,…

Computation and Language · Computer Science 2025-05-28 Yuyang Ding , Xinyu Shi , Xiaobo Liang , Juntao Li , Zhaopeng Tu , Qiaoming Zhu , Min Zhang

While large language models (LLMs) have exhibited impressive instruction-following capabilities, it is still unclear whether and to what extent they can respond to explicit constraints that might be entailed in various instructions. As a…

Computation and Language · Computer Science 2024-01-02 Yihan Chen , Benfeng Xu , Quan Wang , Yi Liu , Zhendong Mao
‹ Prev 1 2 3 10 Next ›