中文
相关论文

相关论文: TRACE: Toulmin-based Reasoning Assessment through …

200 篇论文

Large language models (LLMs) are increasingly used as judges to evaluate agent performance, particularly in non-verifiable settings where judgments rely on agent trajectories including chain-of-thought (CoT) reasoning. This paradigm…

The integration of Large Language Models (LLMs) into clinical decision support is critically obstructed by their opaque and often unreliable reasoning. In the high-stakes domain of healthcare, correct answers alone are insufficient;…

人工智能 · 计算机科学 2026-04-21 Chen Zhan , Xiaoyu Tan , Gengchen Ma , Yu-Jie Xiong , Xiaoyan Jiang , Xihe Qiu

Recent advances in Multi-Modal Large Language Models (MLLMs) have enabled unified processing of language, vision, and structured inputs, opening the door to complex tasks such as logical deduction, spatial reasoning, and scientific…

人工智能 · 计算机科学 2025-07-03 Guiyao Tie , Xueyang Zhou , Tianhe Gu , Ruihang Zhang , Chaoran Hu , Sizhe Zhang , Mengqu Sun , Yan Zhang , Pan Zhou , Lichao Sun

Large language models (LLMs) generate not only reasoning text, but also token-level confidence trajectories that record how uncertainty evolves during inference. Whether these trajectories are relevant to reasoning correctness remains…

机器学习 · 计算机科学 2026-05-19 Shuo Liu , Ding Liu , Shi-Ju Ran

Large language models (LLMs) achieve strong performance by generating long chains of thought, but longer traces always introduce redundant or ineffective reasoning steps. One typical behavior is that they often perform unnecessary…

计算与语言 · 计算机科学 2026-01-13 Jinyi Han , Zixiang Di , Zishang Jiang , Ying Liao , Jiaqing Liang , Yongqi Wang , Yanghua Xiao

While Small Language Models (SLMs) have demonstrated promising performance on an increasingly wide array of commonsense reasoning benchmarks, current evaluation practices rely almost exclusively on the accuracy of their final answers,…

计算与语言 · 计算机科学 2026-04-21 Francesco Maria Molfese , Luca Moroni , Ciro Porcaro , Simone Conia , Roberto Navigli

Recent advances in Large Language Models have led to Large Reasoning Models, which produce step-by-step reasoning traces. These traces offer insight into how models think and their goals, improving explainability and helping users follow…

人机交互 · 计算机科学 2025-11-17 Ludwig Felder , Jacob Miller , Markus Wallinger , Stephen Kobourov , Chunyang Chen

Vision-language models (VLMs) have recently demonstrated strong efficacy as visual assistants that can parse natural queries about the visual content and generate human-like outputs. In this work, we explore the ability of these models to…

计算与语言 · 计算机科学 2024-03-21 Yangyi Chen , Karan Sikka , Michael Cogswell , Heng Ji , Ajay Divakaran

Large language models (LLMs) have emerged as a widely-used tool for information seeking, but their generated outputs are prone to hallucination. In this work, our aim is to allow LLMs to generate text with citations, improving their factual…

计算与语言 · 计算机科学 2023-11-01 Tianyu Gao , Howard Yen , Jiatong Yu , Danqi Chen

Test-time scaling has enabled Large Language Models (LLMs) to tackle complex reasoning, yet the limitations of current Chain-of-Thought (CoT) evaluation obscures whether performance gains stem from genuine reasoning or mere verbosity. To…

人工智能 · 计算机科学 2026-01-08 Zhizhang Fu , Yuancheng Gu , Chenkai Hu , Hanmeng Liu , Yue Zhang

Recent advances in Large Language Models (LLMs) have highlighted the challenge of handling long-context tasks, where models need to reason over extensive input contexts to aggregate target information. While Chain-of-Thought (CoT) prompting…

计算与语言 · 计算机科学 2025-03-03 Dawei Zhu , Xiyu Wei , Guangxiang Zhao , Wenhao Wu , Haosheng Zou , Junfeng Ran , Xun Wang , Lin Sun , Xiangzheng Zhang , Sujian Li

Human beings solve complex problems through critical thinking, where reasoning and evaluation are intertwined to converge toward correct solutions. However, most existing large language models (LLMs) treat the reasoning and verification as…

人工智能 · 计算机科学 2026-03-19 Jiaqi Xu , Cuiling Lan , Xuejin Chen , Yan Lu

Code Large Language Models (Code LLMs) have opened a new era in programming with their impressive capabilities. However, recent research has revealed critical limitations in their ability to reason about runtime behavior and understand the…

软件工程 · 计算机科学 2025-09-25 Jian Wang , Xiaofei Xie , Qiang Hu , Shangqing Liu , Yi Li

Chain-of-Thought (CoT) prompting has improved LLM reasoning, but models often generate explanations that appear coherent while containing unfaithful intermediate steps. Existing self-evaluation approaches are prone to inherent biases: the…

人工智能 · 计算机科学 2026-04-21 Yuxi Sun , Aoqi Zuo , Haotian Xie , Wei Gao , Mingming Gong , Jing Ma

Recent advances in long chain-of-thought (CoT) reasoning have largely prioritized answer accuracy and token efficiency, while overlooking aspects critical to trustworthiness. We argue that usable reasoning systems must be trustworthy,…

计算与语言 · 计算机科学 2025-10-13 Chung-En Sun , Ge Yan , Akshay Kulkarni , Tsui-Wei Weng

The extensive world knowledge and powerful reasoning capabilities of large language models (LLMs) have attracted significant attention in recommendation systems (RS). Specifically, The chain of thought (CoT) has been shown to improve the…

信息检索 · 计算机科学 2025-08-22 Yu Xia , Rui Zhong , Zeyu Song , Wei Yang , Junchen Wan , Qingpeng Cai , Chi Lu , Peng Jiang

Post-training alignment of large language models (LLMs) relies on large-scale human annotations guided by policy specifications that change over time. Cultural shifts, value reinterpretations, and regulatory or industrial updates make…

计算与语言 · 计算机科学 2026-05-12 Aakash Sen Sharma , Debdeep Sanyal , Manodeep Ray , Vivek Srivastava , Shirish Karande , Murari Mandal

Large Reasoning Models (LRMs) perform strongly in complex reasoning tasks via Chain-of-Thought (CoT) prompting, but often suffer from verbose outputs, increasing computational overhead. Existing fine-tuning-based compression methods either…

机器学习 · 计算机科学 2025-09-22 Ziqing Qiao , Yongheng Deng , Jiali Zeng , Dong Wang , Lai Wei , Guanbo Wang , Fandong Meng , Jie Zhou , Ju Ren , Yaoxue Zhang

Following how humans communicate, free-text rationales aim to use natural language to explain neural language model (LM) behavior. However, free-text rationales' unconstrained nature makes them prone to hallucination, so it is important to…

计算与语言 · 计算机科学 2022-12-21 Aaron Chan , Shaoliang Nie , Liang Tan , Xiaochang Peng , Hamed Firooz , Maziar Sanjabi , Xiang Ren

Large Reasoning Models (LRMs) introduce new opportunities for safety monitoring through their Chain of Thought (CoT) reasoning. However, CoT is not always faithful to the model's final output, undermining its reliability as a monitoring…

计算与语言 · 计算机科学 2026-05-19 Maciej Chrabąszcz , Aleksander Szymczyk , Marcin Sendera , Tomasz Trzciński , Sebastian Cygert