中文
相关论文

相关论文: Systematic Evaluation of Machine-Generated Reasoni…

200 篇论文

Large language models (LLMs) are a promising venue for natural language understanding and generation. However, current LLMs are far from reliable: they are prone to generating non-factual information and, more crucially, to contradicting…

计算与语言 · 计算机科学 2024-09-24 Diego Calanzone , Stefano Teso , Antonio Vergari

Hallucinations in large language models (LLMs) pose significant challenges in tasks requiring complex multi-step reasoning, such as mathematical problem-solving. Existing approaches primarily detect the presence of hallucinations but lack a…

计算与语言 · 计算机科学 2025-09-19 Ruosen Li , Ziming Luo , Xinya Du

Large Reasoning Models (LRMs) have shown impressive capabilities in multi-step reasoning tasks. However, alongside these successes, a more deceptive form of model error has emerged--Reasoning Hallucination--where logically coherent but…

人工智能 · 计算机科学 2025-05-20 Zhongxiang Sun , Qipeng Wang , Haoyu Wang , Xiao Zhang , Jun Xu

The rapid advancement of Large Language Models (LLMs) in the realm of mathematical reasoning necessitates comprehensive evaluations to gauge progress and inspire future directions. Existing assessments predominantly focus on problem-solving…

计算与语言 · 计算机科学 2024-06-05 Xiaoyuan Li , Wenjie Wang , Moxin Li , Junrong Guo , Yang Zhang , Fuli Feng

Large Language Models (LLMs) have been touted as AI models possessing advanced reasoning abilities. In theory, autoregressive LLMs with Chain-of-Thought (CoT) can perform more serial computations to solve complex reasoning tasks. However,…

人工智能 · 计算机科学 2025-04-08 Rishi Hazra , Gabriele Venturato , Pedro Zuidberg Dos Martires , Luc De Raedt

MLLM reasoning has drawn widespread research for its excellent problem-solving capability. Current reasoning methods fall into two types: PRM, which supervises the intermediate reasoning steps, and ORM, which supervises the final results.…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Qihan Huang , Weilong Dai , Jinlong Liu , Wanggui He , Hao Jiang , Mingli Song , Jingyuan Chen , Chang Yao , Jie Song

Standard classification models often map inputs directly to labels without explicit reasoning, potentially limiting their performance, robustness, and interpretability. This paper introduces a novel two-stage approach to enhance text…

计算与语言 · 计算机科学 2025-07-02 Mads Henrichsen , Rasmus Krebs

Detecting deception in an increasingly digital world is both a critical and challenging task. In this study, we present a comprehensive evaluation of the automated deception detection capabilities of Large Language Models (LLMs) and Large…

计算与语言 · 计算机科学 2025-06-12 Md Messal Monem Miah , Adrita Anika , Xi Shi , Ruihong Huang

Large language models (LLMs) have shown impressive capabilities across a wide range of language tasks. However, their reasoning process is primarily guided by statistical patterns in training data, which limits their ability to handle novel…

人工智能 · 计算机科学 2025-08-21 Hong Su

Mental disorders represent a critical global health challenge, and social media is increasingly viewed as a vital resource for real-time digital phenotyping and intervention. To leverage this data, large language models (LLMs) have been…

计算与语言 · 计算机科学 2025-12-23 Zhuohan Ge , Darian Li , Yubo Wang , Nicole Hu , Xinyi Zhu , Haoyang Li , Xin Zhang , Mingtao Zhang , Shihao Qi , Yuming Xu , Han Shi , Chen Jason Zhang , Qing Li

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

计算与语言 · 计算机科学 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars. Notably, chain of thought (CoT) prompting, a…

计算与语言 · 计算机科学 2023-01-31 Takeshi Kojima , Shixiang Shane Gu , Machel Reid , Yutaka Matsuo , Yusuke Iwasawa

The performance of image generation has been significantly improved in recent years. However, the study of image screening is rare and its performance with Multimodal Large Language Models (MLLMs) is unsatisfactory due to the lack of data…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Zhiyuan Hu , Zheng Sun , Yi Wei , Long Yu

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

计算与语言 · 计算机科学 2025-04-16 Thilo Hagendorff , Sarah Fabi

Self-correction has emerged as a promising solution to boost the reasoning performance of large language models (LLMs), where LLMs refine their solutions using self-generated critiques that pinpoint the errors. This work explores whether…

计算与语言 · 计算机科学 2024-06-07 Yunxiang Zhang , Muhammad Khalifa , Lajanugen Logeswaran , Jaekyeom Kim , Moontae Lee , Honglak Lee , Lu Wang

This study investigates explainable machine learning algorithms for identifying depression from speech. Grounded in evidence from speech production that depression affects motor control and vowel generation, pre-trained vowel-based…

机器学习 · 计算机科学 2024-10-25 Kexin Feng , Theodora Chaspari

Chain-of-thought (CoT) reasoning has enabled large language models (LLMs) to utilize additional computation through intermediate tokens to solve complex tasks. However, we posit that typical reasoning traces contain many redundant tokens,…

计算与语言 · 计算机科学 2025-06-11 Tergel Munkhbat , Namgyu Ho , Seo Hyun Kim , Yongjin Yang , Yujin Kim , Se-Young Yun

Large language models (LLMs) have demonstrated remarkable performance across a wide range of tasks. Advances in prompt engineering and fine-tuning techniques have further enhanced their ability to address complex reasoning challenges.…

计算与语言 · 计算机科学 2024-12-16 Jing Bi , Yuting Wu , Weiwei Xing , Zhenjie Wei

Large language models (LLMs) exhibit failures on elementary symbolic tasks such as character counting in a word, despite excelling on complex benchmarks. Although this limitation has been noted, the internal reasons remain unclear. We use…

计算与语言 · 计算机科学 2026-04-02 Ayan Datta , Mounika Marreddy , Alexander Mehler , Zhixue Zhao , Radhika Mamidi

Large Language Models (LLMs) have shown human-like reasoning abilities but still struggle with complex logical problems. This paper introduces a novel framework, Logic-LM, which integrates LLMs with symbolic solvers to improve logical…

计算与语言 · 计算机科学 2023-10-20 Liangming Pan , Alon Albalak , Xinyi Wang , William Yang Wang