English
Related papers

Related papers: Probing Factually Grounded Content Transfer with F…

200 papers

Language models (LMs) have been shown to memorize a great deal of factual knowledge contained in their training data. But when an LM generates an assertion, it is often difficult to determine where it learned this information and whether it…

Computation and Language · Computer Science 2022-10-26 Ekin Akyürek , Tolga Bolukbasi , Frederick Liu , Binbin Xiong , Ian Tenney , Jacob Andreas , Kelvin Guu

This work addresses the challenge of factual consistency in text generation systems. We unify the tasks of Natural Language Inference, Summarization Evaluation, Factuality Verification and Factual Consistency Evaluation to train models…

Computation and Language · Computer Science 2024-08-09 Raunak Agarwal

In high-stakes domains like legal question-answering, the accuracy and trustworthiness of generative AI systems are of paramount importance. This work presents a comprehensive benchmark of various methods to assess the groundedness of…

Computation and Language · Computer Science 2024-10-14 Dietrich Trautmann , Natalia Ostapuk , Quentin Grail , Adrian Alan Pol , Guglielmo Bonifazi , Shang Gao , Martin Gajek

Text generation from a knowledge base aims to translate knowledge triples to natural language descriptions. Most existing methods ignore the faithfulness between a generated text description and the original table, leading to generated…

Computation and Language · Computer Science 2021-03-03 Zhenyi Wang , Xiaoyang Wang , Bang An , Dong Yu , Changyou Chen

Existing text-to-image (T2I) evaluation metrics mainly assess whether generated images align with information explicitly stated in the prompt, but often fail to capture factual requirements that are implicit, externally grounded, or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Youngsun Lim , Cusuh Ham , Pin-Yu Chen , Deepti Ghadiyaram

Retrieval-Augmented Generation can improve factuality by grounding answers in external evidence, but Agentic GraphRAG complicates what it means for citations to be faithful. In these systems, an agent explores a knowledge graph before…

Artificial Intelligence · Computer Science 2026-05-15 Riccardo Terrenzi , Maximilian von Zastrow , Serkan Ayvaz

Creating high-quality and realistic images is now possible thanks to the impressive advancements in image generation. A description in natural language of your desired output is all you need to obtain breathtaking results. However, as the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Giuseppe Cartella , Vittorio Cuculo , Marcella Cornia , Rita Cucchiara

The past decade has seen a substantial rise in the amount of mis- and disinformation online, from targeted disinformation campaigns to influence politics, to the unintentional spreading of misinformation about public health. This…

Computation and Language · Computer Science 2021-12-09 Isabelle Augenstein

While modern visual generation models excel at creating aesthetically pleasing natural images, they struggle with producing or editing structured visuals like charts, diagrams, and mathematical figures, which demand composition planning,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Le Zhuo , Songhao Han , Yuandong Pu , Boxiang Qiu , Sayak Paul , Yue Liao , Yihao Liu , Jie Shao , Xi Chen , Si Liu , Hongsheng Li

When a language model is fed a wrong answer, what happens inside the network? Current understanding treats truthfulness as a static property of individual-layer representations-a direction to be probed, a feature to be extracted. Less is…

Computation and Language · Computer Science 2026-03-17 Javier Marín

Modern summarization models generate highly fluent but often factually unreliable outputs. This motivated a surge of metrics attempting to measure the factuality of automatically generated summaries. Due to the lack of common benchmarks,…

Computation and Language · Computer Science 2021-07-27 Artidoro Pagnoni , Vidhisha Balachandran , Yulia Tsvetkov

To reduce issues like hallucinations and lack of control in Large Language Models (LLMs), a common method is to generate responses by grounding on external contexts given as input, known as knowledge-augmented models. However, previous…

Computation and Language · Computer Science 2024-07-02 Hyunji Lee , Sejune Joo , Chaeeun Kim , Joel Jang , Doyoung Kim , Kyoung-Woon On , Minjoon Seo

Foundation models for tabular data are rapidly evolving, with increasing interest in extending them to support additional modalities such as free-text features. However, existing benchmarks for tabular data rarely include textual columns,…

Machine Learning · Computer Science 2025-07-11 Martin Mráz , Breenda Das , Anshul Gupta , Lennart Purucker , Frank Hutter

Pretrained language models (LMs) are susceptible to generate text with nonfactual information. In this work, we measure and improve the factual accuracy of large-scale LMs for open-ended text generation. We design the FactualityPrompts test…

Computation and Language · Computer Science 2023-03-03 Nayeon Lee , Wei Ping , Peng Xu , Mostofa Patwary , Pascale Fung , Mohammad Shoeybi , Bryan Catanzaro

Recent pre-trained abstractive summarization systems have started to achieve credible performance, but a major barrier to their use in practice is their propensity to output summaries that are not faithful to the input and that contain…

Computation and Language · Computer Science 2021-04-12 Tanya Goyal , Greg Durrett

Incorporating specific knowledge into large language models via retrieval-augmented generation (RAG) is a widespread technique that fuels many of today's industry AI applications. A fundamental problem is to assess if the context retrieved…

Information Retrieval · Computer Science 2026-05-08 Florian Geissler , Francesco Carella , Laura Fieback , Jakob Spiegelberg

Language models are trained on large volumes of text, and as a result their parameters might contain a significant body of factual knowledge. Any downstream task performed by these models implicitly builds on these facts, and thus it is…

Computation and Language · Computer Science 2023-01-31 Roi Cohen , Mor Geva , Jonathan Berant , Amir Globerson

The assessment of process mining techniques using real-life data is often compromised by the lack of ground truth knowledge, the presence of non-essential outliers in system behavior and recording errors in event logs. Using synthetically…

Databases · Computer Science 2025-01-27 Dominique Sommers , Natalia Sidorova , Boudewijn van Dongen

Counterfactual generation lies at the core of various machine learning tasks, including image translation and controllable text generation. This generation process usually requires the identification of the disentangled latent…

Machine Learning · Computer Science 2024-02-26 Hanqi Yan , Lingjing Kong , Lin Gui , Yuejie Chi , Eric Xing , Yulan He , Kun Zhang

Fighting misinformation is a challenging, yet crucial, task. Despite the growing number of experts being involved in manual fact-checking, this activity is time-consuming and cannot keep up with the ever-increasing amount of Fake News…

Computation and Language · Computer Science 2023-08-30 Daniel Russo , Serra Sinem Tekiroglu , Marco Guerini