English
Related papers

Related papers: When Not to Answer: Evaluating Prompts on GPT Mode…

200 papers

Recent advances have greatly increased the capabilities of large language models (LLMs), but our understanding of the models and their safety has not progressed as fast. In this paper we aim to understand LLMs deeper by studying their…

Computation and Language · Computer Science 2023-10-12 Justin Lee , Tuomas Oikarinen , Arjun Chatha , Keng-Chi Chang , Yilan Chen , Tsui-Wei Weng

Large language models have achieved impressive performance on various natural language processing tasks. However, so far they have been evaluated primarily on benchmarks where all information in the input context is relevant for solving the…

Computation and Language · Computer Science 2023-06-07 Freda Shi , Xinyun Chen , Kanishka Misra , Nathan Scales , David Dohan , Ed Chi , Nathanael Schärli , Denny Zhou

Large language models (LLMs) can be used as accessible and intelligent chatbots by constructing natural language queries and directly inputting the prompt into the large language model. However, different prompt' constructions often lead to…

Computation and Language · Computer Science 2023-12-14 Jinta Weng , Jiarui Zhang , Yue Hu , Daidong Fa , Xiaofeng Xuand , Heyan Huang

Despite widespread success in language understanding and generation, large language models (LLMs) exhibit unclear and often inconsistent behavior when faced with tasks that require probabilistic reasoning. In this work, we present the first…

Computation and Language · Computer Science 2025-09-29 Mobina Pournemat , Keivan Rezaei , Gaurang Sriramanan , Arman Zarei , Jiaxiang Fu , Yang Wang , Hamid Eghbalzadeh , Soheil Feizi

Background and Context: Over the past year, large language models (LLMs) have taken the world by storm. In computing education, like in other walks of life, many opportunities and threats have emerged as a consequence. Objectives: In this…

Computers and Society · Computer Science 2023-06-12 Arto Hellas , Juho Leinonen , Sami Sarsa , Charles Koutcheme , Lilja Kujanpää , Juha Sorva

Large language models (LLMs) have recently shown strong performance on mathematical benchmarks. At the same time, they are prone to hallucination and sycophancy, often providing convincing but flawed proofs for incorrect mathematical…

Artificial Intelligence · Computer Science 2025-10-07 Ivo Petrov , Jasper Dekoninck , Martin Vechev

Large language models (LLMs) such as ChatGPT and GPT-4 have shown impressive performance in complex reasoning tasks. However, it is difficult to know whether the models are reasoning based on deep understandings of truth and logic, or…

Computation and Language · Computer Science 2023-10-11 Boshi Wang , Xiang Yue , Huan Sun

One of the major barriers to using large language models (LLMs) in medicine is the perception they use uninterpretable methods to make clinical decisions that are inherently different from the cognitive processes of clinicians. In this…

Computation and Language · Computer Science 2023-08-15 Thomas Savage , Ashwin Nayak , Robert Gallo , Ekanath Rangan , Jonathan H Chen

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge. In…

Computation and Language · Computer Science 2024-11-01 Neeladri Bhuiya , Viktor Schlegel , Stefan Winkler

The increasing scale of large language models (LLMs) brings emergent abilities to various complex tasks requiring reasoning, such as arithmetic and commonsense reasoning. It is known that the effective design of task-specific prompts is…

Computation and Language · Computer Science 2024-07-23 Shizhe Diao , Pengcheng Wang , Yong Lin , Rui Pan , Xiang Liu , Tong Zhang

Large language models (LLMs) are increasingly utilized in various complex reasoning tasks due to their excellent instruction following capability. However, the model's performance is highly dependent on the open-ended characteristics of the…

Computation and Language · Computer Science 2026-04-28 Zhenzhen Huang , Chaoning Zhang , Fachrina Dewi Puspitasari , Jiaquan Zhang , Yitian Zhou , Shuxu Chen , Yang Yang

The philosophy of mathematical practice (PMP) looks to evidence from working mathematics to help settle philosophical questions. One prominent program under the PMP banner is the study of explanation in mathematics, which aims to understand…

History and Overview · Mathematics 2025-07-08 William D'Alessandro

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

Despite the remarkable abilities of Large Language Models (LLMs) to answer questions, they often display a considerable level of overconfidence even when the question does not have a definitive answer. To avoid providing hallucinated…

Computation and Language · Computer Science 2024-10-03 Yang Deng , Yong Zhao , Moxin Li , See-Kiong Ng , Tat-Seng Chua

Large Language Models (LLMs) demonstrate potential in complex legal tasks like argument generation, yet their reliability remains a concern. Building upon pilot work assessing LLM generation of 3-ply legal arguments using human evaluation,…

Computation and Language · Computer Science 2025-06-04 Li Zhang , Morgan Gray , Jaromir Savelka , Kevin D. Ashley

Large Language Models (LLMs) have demonstrated remarkable capabilities, revolutionizing the integration of AI in daily life applications. However, they are prone to hallucinations, generating claims that contradict established facts,…

Computation and Language · Computer Science 2024-06-14 A B M Ashikur Rahman , Saeed Anwar , Muhammad Usman , Ajmal Mian

While Large Language Models (LLMs) excel in reasoning, whether they can sustain persistent latent states remains under-explored. The capacity to maintain and manipulate unexpressed, internal representations-analogous to human working…

Computation and Language · Computer Science 2026-01-27 Jen-tse Huang , Kaiser Sun , Wenxuan Wang , Mark Dredze

Large language models (LLMs) achieve impressive results on many benchmarks, yet their capacity for planning and stateful reasoning remains unclear. We study these abilities directly, without code execution or other tools, using the…

Artificial Intelligence · Computer Science 2025-11-27 Charles Schepanowski , Charles Ling

The increased presence of large language models (LLMs) in educational settings has ignited debates concerning negative repercussions, including overreliance and inadequate task reflection. Our work advocates moderated usage of such models,…

Despite efforts to expand the knowledge of large language models (LLMs), knowledge gaps -- missing or outdated information in LLMs -- might always persist given the evolving nature of knowledge. In this work, we study approaches to identify…

Computation and Language · Computer Science 2024-07-02 Shangbin Feng , Weijia Shi , Yike Wang , Wenxuan Ding , Vidhisha Balachandran , Yulia Tsvetkov