English
Related papers

Related papers: When Not to Answer: Evaluating Prompts on GPT Mode…

200 papers

As Large Language Models (LLMs) continue to advance, they are increasingly relied upon as real-time sources of information by non-expert users. To ensure the factuality of the information they provide, much research has focused on…

Computation and Language · Computer Science 2025-04-07 Yining Wang , Yuquan Wang , Xi Li , Mi Zhang , Geng Hong , Min Yang

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

Computation and Language · Computer Science 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

Despite their impressive capabilities, Large Language Models (LLMs) exhibit unwanted uncertainty, a phenomenon where a model changes a previously correct answer into an incorrect one when re-prompted. This behavior undermines trust and…

Computation and Language · Computer Science 2025-10-28 Tiasa Singha Roy , Ayush Rajesh Jhaveri , Ilias Triantafyllopoulos

Large language models (LLMs) rarely admit uncertainty, often producing fluent but misleading answers, rather than abstaining (i.e., refusing to answer). This weakness is even evident in temporal question answering, where models frequently…

Computation and Language · Computer Science 2026-03-05 Xinyu Zhou , Chang Jin , Carsten Eickhoff , Zhijiang Guo , Seyed Ali Bahrainian

Large language models (LLMs) are increasingly trained to abstain on difficult questions by answering unknown. However, we observe that LLMs often misuse this option: they output unknown even when LLMs can actually solve the questions, or…

Computation and Language · Computer Science 2026-01-07 Zipeng Ling , Yuehao Tang , Shuliang Liu , Junqi Yang , Shenghong Fu , Chen Huang , Kejia Huang , Yao Wan , Zhichao Hou , Xuming Hu

Hallucinations in multimodal large language models (MLLMs) hinder their practical applications. To address this, we propose a Magnifier Prompt (MagPrompt), a simple yet effective method to tackle hallucinations in MLLMs via extremely simple…

Computation and Language · Computer Science 2025-02-24 Yuhan Fu , Ruobing Xie , Jiazhen Liu , Bangxiang Lan , Xingwu Sun , Zhanhui Kang , Xirong Li

Although large language models (LLMs) are becoming increasingly capable of solving challenging real-world tasks, accurately quantifying their uncertainty remains a critical open problem--one that limits their applicability in high-stakes…

Hallucinations in large language models (LLMs) are outputs that are syntactically coherent but factually incorrect or contextually inconsistent. They are persistent obstacles in high-stakes industrial settings such as engineering design,…

Software Engineering · Computer Science 2026-04-07 Brian Freeman , Adam Kicklighter , Matt Erdman , Zach Gordon

In recent years, large language models (LLMs) have shown an impressive ability to perform arithmetic and symbolic reasoning tasks. However, we found that LLMs (e.g., ChatGPT) cannot perform well on reasoning that requires multiple rounds of…

Machine Learning · Computer Science 2025-03-25 Kun Li , Xinwei Chen , Tianyou Song , Chengrui Zhou , Zhuoran Liu , Zhenyan Zhang , Jiangjian Guo , Qing Shan

This study critically evaluates the efficacy of prompting methods in enhancing the mathematical reasoning capability of large language models (LLMs). The investigation uses three prescriptive prompting methods - simple, persona, and…

In-context learning has emerged as a groundbreaking ability of Large Language Models (LLMs) and revolutionized various fields by providing a few task-relevant demonstrations in the prompt. However, trustworthy issues with LLM's response,…

Computation and Language · Computer Science 2024-04-01 Chen Ling , Xujiang Zhao , Xuchao Zhang , Wei Cheng , Yanchi Liu , Yiyou Sun , Mika Oishi , Takao Osaki , Katsushi Matsuda , Jie Ji , Guangji Bai , Liang Zhao , Haifeng Chen

Large Language models (LLMs) show extraordinary abilities, but they are still prone to hallucinations, especially when we use them for generating Academic content. We have investigated four popular LLMs, ChatGPT, Grok, Gemini, and Copilot…

Computation and Language · Computer Science 2026-05-07 Humam Khan , Md Tabrez Nafis , Shahab Saquib Sohail , Aqeel Khalique , Rehan Hasan Khan

Quantifying uncertainty in large language models (LLMs) is important for safety-critical applications because it helps spot incorrect answers, known as hallucinations. One major trend of uncertainty quantification methods is based on…

Computation and Language · Computer Science 2025-10-07 Lucie Kunitomo-Jacquin , Edison Marrese-Taylor , Ken Fukuda

Recent advances in language models have demonstrated their capability to solve mathematical reasoning problems, achieving near-perfect accuracy on grade-school level math benchmarks like GSM8K. In this paper, we formally study how language…

Artificial Intelligence · Computer Science 2024-07-31 Tian Ye , Zicheng Xu , Yuanzhi Li , Zeyuan Allen-Zhu

Consistently scaling pre-trained language models (PLMs) imposes substantial burdens on model adaptation, necessitating more efficient alternatives to conventional fine-tuning. Given the advantage of prompting in the zero-shot setting and…

Computation and Language · Computer Science 2023-06-01 Yulin Chen , Ning Ding , Xiaobin Wang , Shengding Hu , Hai-Tao Zheng , Zhiyuan Liu , Pengjun Xie

Written answers to open-ended questions can have a higher long-term effect on learning than multiple-choice questions. However, it is critical that teachers immediately review the answers, and ask to redo those that are incoherent. This can…

Computation and Language · Computer Science 2023-04-25 Felipe Urrutia , Roberto Araya

Large Language Models (LLMs) exhibit impressive performance across various domains but still struggle with arithmetic reasoning tasks. Recent work shows the effectiveness of prompt design methods in enhancing reasoning capabilities.…

Computation and Language · Computer Science 2024-10-11 Wenting Tan , Dongxiao Chen , Jieting Xue , Zihao Wang , Taijie Chen

Large language models (LLMs) have revolutionized numerous domains with their impressive performance but still face their challenges. A predominant issue is the propensity for these models to generate non-existent facts, a concern termed…

Computation and Language · Computer Science 2024-06-10 Hanning Zhang , Shizhe Diao , Yong Lin , Yi R. Fung , Qing Lian , Xingyao Wang , Yangyi Chen , Heng Ji , Tong Zhang

Math Word Problems (MWPs) play a vital role in assessing the capabilities of Large Language Models (LLMs), yet current research primarily focuses on questions with concise contexts. The impact of longer contexts on mathematical reasoning…

Computation and Language · Computer Science 2025-02-27 Xin Xu , Tong Xiao , Zitong Chao , Zhenya Huang , Can Yang , Yang Wang

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah