English
Related papers

Related papers: Controlled Hallucinations: Learning to Generate Fa…

200 papers

Hallucination has been a popular topic in natural language generation (NLG). In real-world applications, unfaithful content can result in poor data quality or loss of trust from end users. Thus, it is crucial to fact-check before adopting…

Computation and Language · Computer Science 2025-02-11 Xiaonan Jing , Srinivas Billa , Danny Godbout

The popularity of automated news headline generation has surged with advancements in pre-trained language models. However, these models often suffer from the ``hallucination'' problem, where the generated headline is not fully supported by…

Computation and Language · Computer Science 2024-07-24 Jiaming Shen , Tianqi Liu , Jialu Liu , Zhen Qin , Jay Pavagadhi , Simon Baumgartner , Michael Bendersky

Generative models have shown impressive capabilities in synthesizing high-quality outputs across various domains. However, a persistent challenge is the occurrence of "hallucinations", where the model produces outputs that are plausible but…

Machine Learning · Computer Science 2025-02-10 Changlong Wu , Ananth Grama , Wojciech Szpankowski

Recent advances in deep neural language models combined with the capacity of large scale datasets have accelerated the development of natural language generation systems that produce fluent and coherent texts (to various degrees of success)…

Computation and Language · Computer Science 2025-04-15 Cristina Garbacea , Qiaozhu Mei

Controllable text generation concerns two fundamental tasks of wide applications, namely generating text of given attributes (i.e., attribute-conditional generation), and minimally editing existing text to possess desired attributes (i.e.,…

Computation and Language · Computer Science 2022-01-25 Zhiting Hu , Li Erran Li

Vision-Language Models (VLMs) excel at visual understanding but often suffer from visual hallucinations, where they generate descriptions of nonexistent objects, actions, or concepts, posing significant risks in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Tsung-Han Wu , Heekyung Lee , Jiaxin Ge , Joseph E. Gonzalez , Trevor Darrell , David M. Chan

Text generator systems have become extremely popular with the advent of recent deep learning models such as encoder-decoder. Controlling the information and style of the generated output without supervision is an important and challenging…

Computation and Language · Computer Science 2020-08-24 Zishan Ahmad , Mukuntha N S , Asif Ekbal , Pushpak Bhattacharyya

Hallucinations are a type of output error produced by deep neural networks. While this has been studied in natural language processing, they have not been researched previously in automatic speech recognition. Here, we define hallucinations…

Computation and Language · Computer Science 2024-01-04 Rita Frieske , Bertram E. Shi

Neural Table-to-Text models tend to hallucinate, producing texts that contain factual errors. We investigate whether such errors in the output can be traced back to problems with the input. We manually annotated 1,837 texts generated by…

Computation and Language · Computer Science 2024-04-08 Barkavi Sundararajan , Somayajulu Sripada , Ehud Reiter

In order to extract event information from text, a machine reading model must learn to accurately read and interpret the ways in which that information is expressed. But it must also, as the human reader must, aggregate numerous individual…

Computation and Language · Computer Science 2016-11-01 Jason Naradowsky , Sebastian Riedel

When feedback is absorbed faster than task structure can be evaluated, the learner will favor feedback over truth. A two-timescale model shows this feedback-truth gap is inevitable whenever the two rates differ and vanishes only when they…

Machine Learning · Computer Science 2026-02-20 Elan Schonfeld , Elias Wisnia

Recent neural models for data-to-document generation have achieved remarkable progress in producing fluent and informative texts. However, large proportions of generated texts do not actually conform to the input data. To address this…

Computation and Language · Computer Science 2018-08-21 Feng Nie , Hailin Chen , Jinpeng Wang , Jin-Ge Yao , Chin-Yew Lin , Rong Pan

While large language models have demonstrated exceptional performance across a wide range of tasks, they remain susceptible to hallucinations -- generating plausible yet factually incorrect contents. Existing methods to mitigating such risk…

Computation and Language · Computer Science 2025-09-16 Yurui Chang , Bochuan Cao , Lu Lin

This paper proposes a novel neural model for the understudied task of generating text from keywords. The model takes as input a set of un-ordered keywords, and part-of-speech (POS) based template instructions. This makes it ideal for…

Artificial Intelligence · Computer Science 2020-11-10 Abhijit Mishra , Md Faisal Mahbub Chowdhury , Sagar Manohar , Dan Gutfreund , Karthik Sankaranarayanan

Deploying natural language generation systems in clinical settings remains challenging despite advances in Large Language Models (LLMs), which continue to exhibit hallucinations and factual inconsistencies, necessitating human oversight.…

Computation and Language · Computer Science 2025-02-26 Osman Alperen Koraş , Rabi Bahnan , Jens Kleesiek , Amin Dada

Table-to-text generation aims at automatically generating natural text to help people to conveniently obtain the important information in tables. Although neural models for table-to-text have achieved remarkable progress, some problems…

Computation and Language · Computer Science 2021-03-31 Liang Li , Can Ma , Yinliang Yue , Linjun Shou , Dayong Hu

A major obstacle to the development of Natural Language Processing (NLP) methods in the biomedical domain is data accessibility. This problem can be addressed by generating medical data artificially. Most previous studies have focused on…

Computation and Language · Computer Science 2019-08-09 Zixu Wang , Julia Ive , Sumithra Velupillai , Lucia Specia

Large Language Models (LLMs) have demonstrated a powerful ability for text generation. However, achieving optimal results with a given prompt or instruction can be challenging, especially for billion-sized models. Additionally, undesired…

Computation and Language · Computer Science 2024-10-07 Lifu Tu , Semih Yavuz , Jin Qu , Jiacheng Xu , Rui Meng , Caiming Xiong , Yingbo Zhou

Large language models (LLMs) have demonstrated remarkable performance on various natural language processing tasks. However, they are prone to generating fluent yet untruthful responses, known as "hallucinations". Hallucinations can lead to…

Computation and Language · Computer Science 2024-06-18 Minda Hu , Bowei He , Yufei Wang , Liangyou Li , Chen Ma , Irwin King

Recent advances in large-scale pre-training provide large models with the potential to learn knowledge from the raw text. It is thus natural to ask whether it is possible to leverage these large models as knowledge bases for downstream…

Computation and Language · Computer Science 2022-11-09 Yanyang Li , Jianqiao Zhao , Michael R. Lyu , Liwei Wang