中文
相关论文

相关论文: CoDiQ: Test-Time Scaling for Controllable Difficul…

200 篇论文

Recent advances in Vision-Language Models (VLMs) and large language models (LLMs) have greatly enhanced visual reasoning, a key capability for embodied AI agents like robots. However, existing visual reasoning benchmarks often suffer from…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Simindokht Jahangard , Mehrzad Mohammadi , Yi Shen , Zhixi Cai , Hamid Rezatofighi

Scaling test-time compute has emerged as a key strategy for enhancing the reasoning capabilities of large language models (LLMs), particularly in tasks like mathematical problem-solving. A traditional approach, Self-Consistency (SC),…

计算与语言 · 计算机科学 2025-10-21 Nishad Singhi , Hritik Bansal , Arian Hosseini , Aditya Grover , Kai-Wei Chang , Marcus Rohrbach , Anna Rohrbach

Question Generation (QG), the task of automatically generating questions from a source input, has seen significant progress in recent years. Difficulty-controllable QG (DCQG) enables control over the difficulty level of generated questions…

计算与语言 · 计算机科学 2025-06-10 Bernardo Leite , Henrique Lopes Cardoso

Despite surpassing human performance across mathematics, coding, and other knowledge-intensive tasks, large language models (LLMs) continue to struggle with causal reasoning. A core obstacle is the target data itself: causal systems are…

人工智能 · 计算机科学 2026-05-12 Nicolás Astorga , Anita Kriz , Mihaela van der Schaar

This paper target in addressing the challenges of underthinking and overthinking in long chain-of-thought (CoT) reasoning for Large Reasoning Models (LRMs) by introducing Reasoning Control Fields (RCF)--a novel test-time approach that…

Table understanding requires structured, multi-step reasoning. Large Language Models (LLMs) struggle with it due to the structural complexity of tabular data. Recently, multi-agent frameworks for SQL generation have shown promise in…

计算与语言 · 计算机科学 2025-12-02 Songyuan Sui , Hongyi Liu , Serena Liu , Li Li , Soo-Hyun Choi , Rui Chen , Xia Hu

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

计算与语言 · 计算机科学 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Large language model (LLM) driven synthetic data generation has emerged as a powerful method for improving model reasoning capabilities. However, most methods either distill large state-of-the-art models into small students or use natural…

机器学习 · 计算机科学 2025-06-18 Alex Havrilla , Edward Hughes , Mikayel Samvelyan , Jacob Abernethy

Large language models (LLMs) trained via reinforcement learning with verifiable reward (RLVR) have achieved breakthroughs on tasks with explicit, automatable verification, such as software programming and mathematical problems. Extending…

Despite significant advancements in the general capability of large language models (LLMs), they continue to struggle with consistent and accurate reasoning, especially in complex tasks such as mathematical and code reasoning. One key…

机器学习 · 计算机科学 2024-10-10 Zhenwen Liang , Ye Liu , Tong Niu , Xiangliang Zhang , Yingbo Zhou , Semih Yavuz

With the significant progress of large reasoning models in complex coding and reasoning tasks, existing benchmarks, like LiveCodeBench and CodeElo, are insufficient to evaluate the coding capabilities of large language models (LLMs) in real…

计算与语言 · 计算机科学 2025-06-06 Shiyi Xu , Yiwen Hu , Yingqian Min , Zhipeng Chen , Wayne Xin Zhao , Ji-Rong Wen

Despite the remarkable success of large language models (LLMs) on traditional natural language processing tasks, their planning ability remains a critical bottleneck in tackling complex multi-step reasoning tasks. Existing approaches mainly…

计算与语言 · 计算机科学 2024-10-07 Jiaxin Wen , Jian Guan , Hongning Wang , Wei Wu , Minlie Huang

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Effective code generation with language models hinges on two critical factors: accurately understanding the intent of the prompt and generating code that applies algorithmic reasoning to produce correct solutions capable of passing diverse…

人工智能 · 计算机科学 2025-10-21 Amir Jalilifard , Anderson de Rezende Rocha , Marcos Medeiros Raimundo

Reasoning Large Language Models (LLMs) with enhanced accuracy and explainability are increasingly being adopted in the medical domain, as the life-critical nature of clinical decision-making demands reliable support. Despite these…

计算与语言 · 计算机科学 2025-11-12 Sung-Min Lee , Siyoon Lee , Juyeon Kim , Kyoungmin Roh

Recently, inference-time reasoning strategies have further improved the accuracy of large language models (LLMs), but their effectiveness on smaller models remains unclear. Based on the observation that conventional approaches often fail to…

计算与语言 · 计算机科学 2025-09-24 Jin Young Kim , Ji Won Yoon

Quantitative reasoning is a critical skill to analyze data, yet the assessment of such ability remains limited. To address this gap, we introduce the Quantitative Reasoning with Data (QRData) benchmark, aiming to evaluate Large Language…

计算与语言 · 计算机科学 2024-06-11 Xiao Liu , Zirui Wu , Xueqing Wu , Pan Lu , Kai-Wei Chang , Yansong Feng

Current large language models (LLMs) often struggle to produce accurate responses on the first attempt for complex reasoning tasks like code generation. Prior research tackles this challenge by generating multiple candidate solutions and…

计算与语言 · 计算机科学 2025-01-03 Zeyao Ma , Xiaokang Zhang , Jing Zhang , Jifan Yu , Sijia Luo , Jie Tang

Large Language Models (LLMs) show strong capabilities in code generation, motivating their use in automated quantum solver development. However, in quantum computing, successful execution of generated code is not sufficient: correctness…

软件工程 · 计算机科学 2026-05-12 Luciano Baresi , Domenico Bianculli , Maryse Ernzer , Livia Lestingi , Fabrizio Pastore , Seung Yeob Shin

Test-time scaling has emerged as a powerful technique for enhancing the reasoning capabilities of large language models. However, its effectiveness in medical reasoning remains uncertain, as the medical domain fundamentally differs from…

计算与语言 · 计算机科学 2026-02-19 Xiaoke Huang , Juncheng Wu , Hui Liu , Xianfeng Tang , Yuyin Zhou