English
Related papers

Related papers: FacTool: Factuality Detection in Generative AI -- …

200 papers

As text generated by large language models proliferates, it becomes vital to understand how humans engage with such text, and whether or not they are able to detect when the text they are reading did not originate with a human writer. Prior…

Computation and Language · Computer Science 2022-12-27 Liam Dugan , Daphne Ippolito , Arun Kirubarajan , Sherry Shi , Chris Callison-Burch

Large Language Models (LLMs) like ChatGPT are foundational in various applications due to their extensive knowledge from pre-training and fine-tuning. Despite this, they are prone to generating factual and commonsense errors, raising…

Software Engineering · Computer Science 2026-04-30 Wenxuan Wang , Yuk-Kit Chan , Zixuan Ling , Juluan Shi , Youliang Yuan , Jen-tse Huang , Yifei Zhang , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

The demand for accurate and efficient verification of information in texts generated by large language models (LMs) is at an all-time high, but remains unresolved. Recent efforts have focused on extracting and verifying atomic facts from…

Computation and Language · Computer Science 2024-09-25 Vasileios Katranidis , Gabor Barany

Large Language Models (LLMs) frequently generate hallucinated content, posing significant challenges for applications where factuality is crucial. While existing hallucination detection methods typically operate at the sentence level or…

Machine Learning · Computer Science 2026-02-02 Albert Sawczyn , Jakub Binkowski , Denis Janiak , Bogdan Gabrys , Tomasz Kajdanowicz

Evaluating the factual consistency of automatically generated summaries is essential for the progress and adoption of reliable summarization systems. Despite recent advances, existing factuality evaluation models are not robust, being…

Computation and Language · Computer Science 2023-10-20 Shangbin Feng , Vidhisha Balachandran , Yuyang Bai , Yulia Tsvetkov

Following the universal availability of generative AI systems with the release of ChatGPT, automatic detection of deceptive text created by Large Language Models has focused on domains such as academic plagiarism and "fake news". However,…

Computation and Language · Computer Science 2024-12-23 Andrea Cristina McGlinchey , Peter J Barclay

Amid the proliferation of forged images, notably the tsunami of deepfake content, extensive research has been conducted on using artificial intelligence (AI) to identify forged content in the face of continuing advancements in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Shuhan Cui , Huy H. Nguyen , Trung-Nghia Le , Chun-Shien Lu , Isao Echizen

ChatGPT is a conversational artificial intelligence that is a member of the generative pre-trained transformer of the large language model family. This text generative model was fine-tuned by both supervised learning and reinforcement…

Computation and Language · Computer Science 2023-06-06 Niful Islam , Debopom Sutradhar , Humaira Noor , Jarin Tasnim Raya , Monowara Tabassum Maisha , Dewan Md Farid

With the rise of generative AI, automated fact-checking methods to combat misinformation are becoming more and more important. However, factual claim detection, the first step in a fact-checking pipeline, suffers from two key issues that…

Computation and Language · Computer Science 2024-06-04 Jingwei Ni , Minjing Shi , Dominik Stammbach , Mrinmaya Sachan , Elliott Ash , Markus Leippold

Large Language Models (LLM) have become sophisticated enough that complex computer programs can be created through interpretation of plain English sentences and implemented in a variety of modern languages such as Python, Java Script, C++…

Software Engineering · Computer Science 2023-09-04 Simon Thorne

The growing capability of large language models to produce fluent, contextually coherent text has created mounting pressure on the systems and institutions responsible for ensuring the authenticity of digital content. Advanced generative…

With the advent of fluent generative language models that can produce convincing utterances very similar to those written by humans, distinguishing whether a piece of text is machine-generated or human-written becomes more challenging and…

Computation and Language · Computer Science 2024-02-27 Niloofar Mireshghallah , Justus Mattern , Sicun Gao , Reza Shokri , Taylor Berg-Kirkpatrick

A prominent weakness of modern language models (LMs) is their tendency to generate factually incorrect text, which hinders their usability. A natural question is whether such factual errors can be detected automatically. Inspired by…

Computation and Language · Computer Science 2023-05-23 Roi Cohen , May Hamri , Mor Geva , Amir Globerson

As large language models (LLMs) have become the norm in NLP, demonstrating good performance in generation and reasoning tasks, one of its most fatal disadvantages is the lack of factual correctness. Generating unfactual texts not only leads…

Computation and Language · Computer Science 2023-10-10 Ruochen Zhao , Xingxuan Li , Shafiq Joty , Chengwei Qin , Lidong Bing

The rapid development of generative AI is a double-edged sword, which not only facilitates content creation but also makes image manipulation easier and more difficult to detect. Although current image forgery detection and localization…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Zhipei Xu , Xuanyu Zhang , Runyi Li , Zecheng Tang , Qing Huang , Jian Zhang

Automated fact-checking based on machine learning is a promising approach to identify false information distributed on the web. In order to achieve satisfactory performance, machine learning methods require a large corpus with reliable…

Computation and Language · Computer Science 2019-11-05 Andreas Hanselowski , Christian Stab , Claudia Schulz , Zile Li , Iryna Gurevych

This study investigates the efficacy of six major Generative AI (GenAI) text detectors when confronted with machine-generated content that has been modified using techniques designed to evade detection by these tools (n=805). The results…

Computers and Society · Computer Science 2024-09-10 Mike Perkins , Jasper Roe , Binh H. Vu , Darius Postma , Don Hickerson , James McGaughran , Huy Q. Khuat

Generative AI systems such as ChatGPT have a disruptive effect on learning and assessment. Computer science requires practice to develop skills in problem solving and programming that are traditionally developed using assignments.…

Computers and Society · Computer Science 2023-11-29 Kevin Wang , Seth Akins , Abdallah Mohammed , Ramon Lawrence

This paper presents the Yangtze Sea project, an initiative in the battle against Generative AI (GAI)-generated fake con-tent. Addressing a pressing issue in the digital age, we investigate public reactions to AI-created fabrications through…

Computers and Society · Computer Science 2024-07-02 Yufan Li , Zhan Wang , Theo Papatheodorou

This paper introduces a simple JavaScript-based web application designed to assist educators in detecting AI-generated content in student essays and written assignments. Unlike existing AI detection tools that rely on obfuscated machine…

Human-Computer Interaction · Computer Science 2025-03-24 Andy Buschmann