中文
相关论文

相关论文: Investigating the Shortcomings of LLMs in Step-by-…

200 篇论文

Case-based reasoning is a cornerstone of U.S. legal practice, requiring professionals to argue about a current case by drawing analogies to and distinguishing from past precedents. While Large Language Models (LLMs) have shown remarkable…

计算与语言 · 计算机科学 2026-01-21 Li Zhang , Matthias Grabmair , Morgan Gray , Kevin Ashley

Understanding a program's runtime reasoning behavior, meaning how intermediate states and control flows lead to final execution results, is essential for reliable code generation, debugging, and automated reasoning. Although large language…

软件工程 · 计算机科学 2025-12-02 Mohammad Abdollahi , Khandaker Rifah Tasnia , Soumit Kanti Saha , Jinqiu Yang , Song Wang , Hadi Hemmati

Large language models (LLMs) are being increasingly integrated into legal applications, including judicial decision support, legal practice assistance, and public-facing legal services. While LLMs show strong potential in handling legal…

Thinking Large Language Models (LLMs) generate explicit intermediate reasoning traces before final answers, potentially improving transparency, interpretability, and solution accuracy for code generation. However, the quality of these…

人工智能 · 计算机科学 2025-11-11 Haoran Xue , Gias Uddin , Song Wang

Step-by-step reasoning is widely used to enhance the reasoning ability of large language models (LLMs) in complex problems. Evaluating the quality of reasoning traces is crucial for understanding and improving LLM reasoning. However,…

计算与语言 · 计算机科学 2025-09-23 Jinu Lee , Julia Hockenmaier

Large Language Models (LLMs) are increasingly being used in education, yet their correctness alone does not capture the quality, reliability, or pedagogical validity of their problem-solving behavior, especially in mathematics, where…

计算机与社会 · 计算机科学 2025-10-22 Sagnik Dakshit , Sushmita Sinha Roy

Mathematical reasoning is essential for problem-solving in education, science, and industry, serving as a crucial benchmark for evaluating artificial intelligence systems. As Large Language Models (LLMs) improve their reasoning…

计算与语言 · 计算机科学 2026-05-20 Husnain Amjad , Raja Khurram Shahzad , Aamir Shahzad , Mehwish Fatima

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

人机交互 · 计算机科学 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

With the advancement of large language models (LLMs), diverse time series analysis tasks are reformulated as time series question answering (TSQA) through a unified natural language interface. However, existing LLM-based approaches largely…

计算与语言 · 计算机科学 2025-12-30 Chen Su , Yuanhe Tian , Yan Song

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

计算与语言 · 计算机科学 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin

Large language models (LLMs) have demonstrated outstanding performance across various tasks, yet they still exhibit limitations such as hallucination, unfaithful reasoning, and toxic content. One potential approach to mitigate these issues…

计算与语言 · 计算机科学 2024-07-19 Yuxuan Yao , Han Wu , Zhijiang Guo , Biyan Zhou , Jiahui Gao , Sichun Luo , Hanxu Hou , Xiaojin Fu , Linqi Song

Logical reasoning has been an ongoing pursuit in the field of AI. Despite significant advancements made by large language models (LLMs), they still struggle with complex logical reasoning problems. To enhance reasoning performance, one…

人工智能 · 计算机科学 2024-03-26 Ruixin Hong , Hongming Zhang , Xinyu Pang , Dong Yu , Changshui Zhang

Legal Artificial Intelligence (LegalAI) has achieved notable advances in automating judicial decision-making with the support of Large Language Models (LLMs). However, existing legal LLMs still struggle to generate reliable and…

计算与语言 · 计算机科学 2026-02-10 Xin Dai , Buqiang Xu , Zhenghao Liu , Yukun Yan , Huiyuan Xie , Xiaoyuan Yi , Shuo Wang , Ge Yu

Advances in Large Language Models (LLMs) have significantly improved multi-step reasoning through generating free-text rationales. However, recent studies show that LLMs tend to lose focus over the middle of long contexts. This raises…

计算与语言 · 计算机科学 2025-04-15 Siyuan Wang , Enda Zhao , Zhongyu Wei , Xiang Ren

While self-correction has shown promise in improving LLM outputs in terms of style and quality (e.g. Chen et al., 2023b; Madaan et al., 2023), recent attempts to self-correct logical or reasoning errors often cause correct answers to become…

人工智能 · 计算机科学 2024-06-05 Gladys Tyen , Hassan Mansoor , Victor Cărbune , Peter Chen , Tony Mak

Self-correction of large language models (LLMs) emerges as a critical component for enhancing their reasoning performance. Although various self-correction methods have been proposed, a comprehensive evaluation of these methods remains…

Large language models (LLMs) have demonstrated strong reasoning abilities across specialized domains, motivating research into their application to legal reasoning. However, existing legal benchmarks often conflate factual recall with…

人工智能 · 计算机科学 2025-11-21 Wenhan Yu , Xinbo Lin , Lanxin Ni , Jinhua Cheng , Lei Sha

The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning, a cornerstone of clinical practice.…

计算与语言 · 计算机科学 2025-08-04 Wenxuan Wang , Zizhan Ma , Meidan Ding , Shiyi Zheng , Shengyuan Liu , Jie Liu , Jiaming Ji , Wenting Chen , Xiang Li , Linlin Shen , Yixuan Yuan

Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on…

人工智能 · 计算机科学 2025-11-04 Aske Plaat , Annie Wong , Suzan Verberne , Joost Broekens , Niki van Stein , Thomas Back

We propose a novel framework for comprehending the reasoning capabilities of large language models (LLMs) through the perspective of meta-learning. By conceptualizing reasoning trajectories as pseudo-gradient descent updates to the LLM's…

计算与语言 · 计算机科学 2025-05-27 Junnan Liu , Hongwei Liu , Linchen Xiao , Shudong Liu , Taolin Zhang , Zihan Ma , Songyang Zhang , Kai Chen
‹ 上一页 1 2 3 10 下一页 ›