English
Related papers

Related papers: SelfCheckGPT: Zero-Resource Black-Box Hallucinatio…

200 papers

Large language models (LLMs) are currently being used to answer medical questions across a variety of clinical domains. Recent top-performing commercial LLMs, in particular, are also capable of citing sources to support their responses. In…

Computation and Language · Computer Science 2024-02-06 Kevin Wu , Eric Wu , Ally Cassasola , Angela Zhang , Kevin Wei , Teresa Nguyen , Sith Riantawan , Patricia Shi Riantawan , Daniel E. Ho , James Zou

We investigate the phenomenon of an LLM's untruthful response using a large set of 220 handcrafted linguistic features. We focus on GPT-3 models and find that the linguistic profiles of responses are similar across model sizes. That is, how…

Computation and Language · Computer Science 2023-06-05 Bruce W. Lee , Benedict Florance Arockiaraj , Helen Jin

Large language models (LLMs) have shown remarkable performance on many tasks in different domains. However, their performance in closed-book biomedical machine reading comprehension (MRC) has not been evaluated in depth. In this work, we…

Computation and Language · Computer Science 2024-10-28 Shubham Vatsal , Ayush Singh

Advanced large language models (LLMs) can generate text almost indistinguishable from human-written text, highlighting the importance of LLM-generated text detection. However, current zero-shot techniques face challenges as white-box…

Computation and Language · Computer Science 2025-02-20 Guangsheng Bao , Yanbin Zhao , Juncai He , Yue Zhang

Safe deployment of large language models (LLMs) may benefit from a reliable method for assessing their generated content to determine when to abstain or to selectively generate. While likelihood-based metrics such as perplexity are widely…

Computation and Language · Computer Science 2023-12-18 Jie Ren , Yao Zhao , Tu Vu , Peter J. Liu , Balaji Lakshminarayanan

Large Language Models (LLMs), such as ChatGPT, have demonstrated the capability to generate human like, natural responses across a range of tasks, including task oriented dialogue and question answering. However, their application in real…

Computation and Language · Computer Science 2025-05-01 Naheed Rayhan , Md. Ashrafuzzaman

Object hallucination has been an Achilles' heel which hinders the broader applications of large vision-language models (LVLMs). Object hallucination refers to the phenomenon that the LVLMs claim non-existent objects in the image. To…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Junfei Wu , Qiang Liu , Ding Wang , Jinghao Zhang , Shu Wu , Liang Wang , Tieniu Tan

Large Language Models (LLMs) have shown impressive capability in language generation and understanding, but their tendency to hallucinate and produce factually incorrect information remains a key limitation. To verify LLM-generated contents…

Computation and Language · Computer Science 2025-06-03 Kushan Mitra , Dan Zhang , Sajjadur Rahman , Estevam Hruschka

Academic researchers need efficient and reliable methods for collecting high-quality information from trusted sources, but modern tools for AI-assisted research still suffer from the tendency of Large Language Models (LLMs) to produce…

Computation and Language · Computer Science 2026-05-21 Gábor Recski , Szilveszter Tóth , Nadia Verdha , István Boros , Ádám Kovács

This paper introduces AnalyticsGPT, an intuitive and efficient large language model (LLM)-powered workflow for scientometric question answering. This underrepresented downstream task addresses the subcategory of meta-scientific questions…

Computation and Language · Computer Science 2026-02-11 Khang Ly , Georgios Cheirmpos , Adrian Raudaschl , Christopher James , Seyed Amin Tabatabaei

Large Language Models (LLMs) have demonstrated impressive zero shot performance on a wide range of NLP tasks, demonstrating the ability to reason and apply commonsense. A relevant application is to use them for creating high quality…

Computation and Language · Computer Science 2024-07-11 Vinay Samuel , Houda Aynaou , Arijit Ghosh Chowdhury , Karthik Venkat Ramanan , Aman Chadha

In recent years, large language models (LLMs), such as ChatGPT, have been pivotal in advancing various artificial intelligence applications, including natural language processing and software engineering. A promising yet underexplored area…

Software Engineering · Computer Science 2024-01-26 Hiroyuki Kirinuki , Haruto Tanno

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

While Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to generate contextually grounded responses, contextual faithfulness remains challenging as LLMs may not consistently trust provided context, leading to…

Computation and Language · Computer Science 2026-02-10 Yongchao Long , Xian Wu , Yingying Zhang , Xianbin Wen , Yuxi Zhou , Shenda Hong

While large language models (LLMs), such as GPT-3, appear to be robust and general, their reasoning ability is not at a level to compete with the best models trained for specific natural language reasoning problems. In this study, we…

Computation and Language · Computer Science 2023-07-18 Zhun Yang , Adam Ishay , Joohyung Lee

This paper presents the first few-shot LLM-based chatbot that almost never hallucinates and has high conversationality and low latency. WikiChat is grounded on the English Wikipedia, the largest curated free-text corpus. WikiChat generates…

Computation and Language · Computer Science 2024-05-17 Sina J. Semnani , Violet Z. Yao , Heidi C. Zhang , Monica S. Lam

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

Computation and Language · Computer Science 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

Generative AI models face the challenge of hallucinations that can undermine users' trust in such systems. We approach the problem of conversational information seeking as a two-step process, where relevant passages in a corpus are…

Information Retrieval · Computer Science 2024-01-23 Weronika Łajewska , Krisztian Balog

Recent studies have raised concerns about the potential threats large language models (LLMs) pose to academic integrity and copyright protection. Yet, their investigation is predominantly focused on literal copies of original texts. Also,…

Computation and Language · Computer Science 2025-02-18 Jooyoung Lee , Toshini Agrawal , Adaku Uchendu , Thai Le , Jinghui Chen , Dongwon Lee

The advent of Large Language Models (LLMs) has brought an unprecedented surge in machine-generated text (MGT) across diverse channels. This raises legitimate concerns about its potential misuse and societal implications. The need to…

‹ Prev 1 8 9 10 Next ›