English
Related papers

Related papers: FactPEGASUS: Factuality-Aware Pre-training and Fin…

200 papers

Currently, there is a significant amount of research being conducted in the field of artificial intelligence to improve the explainability and interpretability of deep learning models. It is found that if end-users understand the reason for…

Information Retrieval · Computer Science 2023-06-02 Niloofar Ranjbar , Saeedeh Momtazi , MohammadMehdi Homayounpour

Automatic fact-checking plays a crucial role in combating the spread of misinformation. Large Language Models (LLMs) and Instruction-Following variants, such as InstructGPT and Alpaca, have shown remarkable performance in various natural…

Computation and Language · Computer Science 2023-09-04 Tsun-Hin Cheung , Kin-Man Lam

Image captioning, which generates natural language descriptions of the visual information in an image, is a crucial task in vision-language research. Previous models have typically addressed this task by aligning the generative capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Qian Cao , Xu Chen , Ruihua Song , Xiting Wang , Xinting Huang , Yuchen Ren

Text summarization is crucial for mitigating information overload across domains like journalism, medicine, and business. This research evaluates summarization performance across 17 large language models (OpenAI, Google, Anthropic,…

Computation and Language · Computer Science 2025-04-08 Anantharaman Janakiraman , Behnaz Ghoraani

Faithfully correcting factual errors is critical for maintaining the integrity of textual knowledge bases and preventing hallucinations in sequence-to-sequence models. Drawing on humans' ability to identify and correct factual errors, we…

Computation and Language · Computer Science 2023-05-30 Kung-Hsiang Huang , Hou Pong Chan , Heng Ji

Despite recent advances in abstractive summarization, current summarization systems still suffer from content hallucinations where models generate text that is either irrelevant or contradictory to the source document. However, prior work…

Computation and Language · Computer Science 2022-05-02 Yue Dong , John Wieting , Pat Verga

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

Computation and Language · Computer Science 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

Conventional dialogue summarization methods directly generate summaries and do not consider user's specific interests. This poses challenges in cases where the users are more focused on particular topics or aspects. With the advancement of…

Computation and Language · Computer Science 2024-08-02 Bin Wang , Zhengyuan Liu , Nancy F. Chen

Automated fact checking systems have been proposed that quickly provide veracity prediction at scale to mitigate the negative influence of fake news on people and on public opinion. However, most studies focus on veracity classifiers of…

Computation and Language · Computer Science 2022-06-15 Shih-Chieh Dai , Yi-Li Hsu , Aiping Xiong , Lun-Wei Ku

We introduce a general framework for abstractive summarization with factual consistency and distinct modeling of the narrative flow in an output summary. Our work addresses current limitations of models for abstractive summarization that…

Computation and Language · Computer Science 2021-04-12 Saadia Gabriel , Antoine Bosselut , Jeff Da , Ari Holtzman , Jan Buys , Kyle Lo , Asli Celikyilmaz , Yejin Choi

Despite recent progress in abstractive summarization, systems still suffer from faithfulness errors. While prior work has proposed models that improve faithfulness, it is unclear whether the improvement comes from an increased level of…

Computation and Language · Computer Science 2022-04-22 Faisal Ladhak , Esin Durmus , He He , Claire Cardie , Kathleen McKeown

Counterfactual Explanations (CFEs) interpret machine learning models by identifying the smallest change to input features needed to change the model's prediction to a desired output. For classification tasks, CFEs determine how close a…

Machine Learning · Computer Science 2025-10-01 Margarita A. Guerrero , Cristian R. Rojas

Clickbaits are surprising social posts or deceptive news headlines that attempt to lure users for more clicks, which have posted at unprecedented rates for more profit or commercial revenue. The spread of clickbait has significant negative…

Computation and Language · Computer Science 2024-04-18 Haoxiang Deng , Yi Zhu , Ye Wang , Jipeng Qiang , Yunhao Yuan , Yun Li , Runmei Zhang

Neural models trained with large amount of parallel data have achieved impressive performance in abstractive summarization tasks. However, large-scale parallel corpora are expensive and challenging to construct. In this work, we introduce a…

Computation and Language · Computer Science 2022-01-17 Mengsay Loem , Sho Takase , Masahiro Kaneko , Naoaki Okazaki

Neural abstractive summarization models are prone to generate content inconsistent with the source document, i.e. unfaithful. Existing automatic metrics do not capture such mistakes effectively. We tackle the problem of evaluating…

Computation and Language · Computer Science 2020-10-13 Esin Durmus , He He , Mona Diab

Through the advent of pre-trained language models, there have been notable advancements in abstractive summarization systems. Simultaneously, a considerable number of novel methods for evaluating factual consistency in abstractive…

Computation and Language · Computer Science 2024-10-03 Joonho Yang , Seunghyun Yoon , Byeongjeong Kim , Hwanhee Lee

Dialogue summarization aims to generate a summary that indicates the key points of a given dialogue. In this work, we propose an end-to-end neural model for dialogue summarization with two novel modules, namely, the \emph{supporting…

Computation and Language · Computer Science 2021-08-04 Wang Chen , Piji Li , Hou Pong Chan , Irwin King

While counterfactual data augmentation offers a promising step towards robust generalization in natural language processing, producing a set of counterfactuals that offer valuable inductive bias for models remains a challenge. Most existing…

Computation and Language · Computer Science 2022-10-25 Phillip Howard , Gadi Singer , Vasudev Lal , Yejin Choi , Swabha Swayamdipta

Large Language Models (LLMs) often struggle to align their responses with objective facts, resulting in the issue of factual hallucinations, which can be difficult to detect and mislead users without relevant knowledge. Although…

Computation and Language · Computer Science 2025-10-14 Siyuan Zhang , Yichi Zhang , Yinpeng Dong , Hang Su

With the widespread consumption of AI-generated content, there has been an increased focus on developing automated tools to verify the factual accuracy of such content. However, prior research and tools developed for fact verification treat…

Computation and Language · Computer Science 2025-03-20 Varich Boonsanong , Vidhisha Balachandran , Xiaochuang Han , Shangbin Feng , Lucy Lu Wang , Yulia Tsvetkov