中文
相关论文

相关论文: Rationality Check! Benchmarking the Rationality of…

200 篇论文

Numerous decision-making tasks require estimating causal effects under interventions on different parts of a system. As practitioners consider using large language models (LLMs) to automate decisions, studying their causal reasoning…

机器学习 · 计算机科学 2024-12-24 Tejas Kasetty , Divyat Mahajan , Gintare Karolina Dziugaite , Alexandre Drouin , Dhanya Sridhar

Large language models (LLMs), such as ChatGPT, have rapidly penetrated into people's work and daily lives over the past few years, due to their extraordinary conversational skills and intelligence. ChatGPT has become the fastest-growing…

计算与语言 · 计算机科学 2024-09-04 Wenxuan Wang

A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates coherent content, including grammatically precise sentences, human-like paragraphs, and syntactically accurate code snippets. LLMs can play…

软件工程 · 计算机科学 2023-12-11 Robson Santos , Italo Santos , Cleyton Magalhaes , Ronnie de Souza Santos

In recent years, large language models (LLMs) have demonstrated significant success in performing varied natural language tasks such as language translation, question-answering, summarizing, fact-checking, etc. Despite LLMs' impressive…

计算与语言 · 计算机科学 2025-03-03 Bishwamittra Ghosh , Sarah Hasan , Naheed Anjum Arafat , Arijit Khan

Large language models (LLMs) are deployed on increasingly complex tasks that require multi-step decision-making. Understanding their algorithmic reasoning abilities is therefore crucial. However, we lack a diagnostic benchmark for…

机器学习 · 计算机科学 2026-02-12 Yu He , Yingxi Li , Colin White , Ellen Vitercik

We study syllogistic reasoning in LLMs from the logical and natural language perspectives. In process, we explore fundamental reasoning capabilities of the LLMs and the direction this research is moving forward. To aid in our studies, we…

计算与语言 · 计算机科学 2025-12-30 Aheli Poddar , Saptarshi Sahoo , Sujata Ghosh

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

计算与语言 · 计算机科学 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

Large Language Models (LLMs) have emerged as highly capable systems and are increasingly being integrated into various uses. However, the rapid pace of their deployment has outpaced a comprehensive understanding of their internal mechanisms…

计算与语言 · 计算机科学 2025-10-27 Gabriele Prato , Jerry Huang , Prasanna Parthasarathi , Shagun Sodhani , Sarath Chandar

Large Language Models (LLMs) have made significant strides in various intelligent tasks but still struggle with complex action reasoning tasks that require systematic search. To address this limitation, we propose a method that bridges the…

计算与语言 · 计算机科学 2025-02-05 Adam Ishay , Joohyung Lee

Mathematical reasoning, a core aspect of human cognition, is vital across many domains, from educational problem-solving to scientific advancements. As artificial general intelligence (AGI) progresses, integrating large language models…

计算与语言 · 计算机科学 2025-05-21 Yibo Yan , Jiamin Su , Jianxiang He , Fangteng Fu , Xu Zheng , Yuanhuiyi Lyu , Kun Wang , Shen Wang , Qingsong Wen , Xuming Hu

Predictive analysis is a cornerstone of modern decision-making, with applications in various domains. Large Language Models (LLMs) have emerged as powerful tools in enabling nuanced, knowledge-intensive conversations, thus aiding in complex…

计算与语言 · 计算机科学 2025-05-26 Qin Chen , Yuanyi Ren , Xiaojun Ma , Yuyang Shi

Large Language Models (LLMs) increasingly show reasoning rationales alongside their answers, turning "reasoning" into a user-interface element. While step-by-step rationales are typically associated with model performance, how they…

人机交互 · 计算机科学 2026-03-10 Xin Sun , Shu Wei , Jos A Bosch , Isao Echizen , Saku Sugawara , Abdallah El Ali

Existing work investigates the reasoning capabilities of large language models (LLMs) to uncover their limitations, human-like biases and underlying processes. Such studies include evaluations of base LLMs (pre-trained on unlabeled corpora…

计算与语言 · 计算机科学 2025-11-14 Jason Chan , Zhixue Zhao , Robert Gaizauskas

Language serves as a vehicle for conveying thought, enabling communication among individuals. The ability to distinguish between diverse concepts, identify fairness and injustice, and comprehend a range of legal notions fundamentally relies…

计算与语言 · 计算机科学 2023-11-23 Ha-Thanh Nguyen , Wachara Fungwacharakorn , Ken Satoh

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

计算与语言 · 计算机科学 2024-12-23 Zhisheng Tang , Mayank Kejriwal

Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works…

计算与语言 · 计算机科学 2024-10-18 Humza Naveed , Asad Ullah Khan , Shi Qiu , Muhammad Saqib , Saeed Anwar , Muhammad Usman , Naveed Akhtar , Nick Barnes , Ajmal Mian

Large Language Models have shown tremendous performance on a large variety of natural language processing tasks, ranging from text comprehension to common sense reasoning. However, the mechanisms responsible for this success remain opaque,…

计算与语言 · 计算机科学 2024-01-04 Gaël Gendron , Qiming Bao , Michael Witbrock , Gillian Dobbie

Honesty is a fundamental principle for aligning large language models (LLMs) with human values, requiring these models to recognize what they know and don't know and be able to faithfully express their knowledge. Despite promising, current…

计算与语言 · 计算机科学 2024-09-30 Siheng Li , Cheng Yang , Taiqiang Wu , Chufan Shi , Yuji Zhang , Xinyu Zhu , Zesen Cheng , Deng Cai , Mo Yu , Lemao Liu , Jie Zhou , Yujiu Yang , Ngai Wong , Xixin Wu , Wai Lam

With powerful large language models (LLMs) demonstrating superhuman reasoning capabilities, a critical question arises: Do LLMs genuinely reason, or do they merely recall answers from their extensive, web-scraped training datasets? Publicly…

计算与语言 · 计算机科学 2025-04-28 Haowei Lin , Xiangyu Wang , Ruilin Yan , Baizhou Huang , Haotian Ye , Jianhua Zhu , Zihao Wang , James Zou , Jianzhu Ma , Yitao Liang