English
Related papers

Related papers: A Survey on Natural Language Counterfactual Genera…

200 papers

The dissemination of false information on online platforms presents a serious societal challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) offer promising opportunities to support fact-checkers with their…

Computation and Language · Computer Science 2024-10-31 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Marián Šimko

Despite alarm over the reliance of machine learning systems on so-called spurious patterns, the term lacks coherent meaning in standard statistical frameworks. However, the language of causality offers clarity: spurious associations are due…

Computation and Language · Computer Science 2020-02-18 Divyansh Kaushik , Eduard Hovy , Zachary C. Lipton

In the rapidly evolving domain of Natural Language Generation (NLG) evaluation, introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.…

Computation and Language · Computer Science 2024-06-13 Zhen Li , Xiaohan Xu , Tao Shen , Can Xu , Jia-Chen Gu , Yuxuan Lai , Chongyang Tao , Shuai Ma

People can acquire knowledge in an unsupervised manner by reading, and compose the knowledge to make novel combinations. In this paper, we investigate whether pretrained language models can perform compositional generalization in a…

Computation and Language · Computer Science 2022-10-21 Xiao Liu , Yansong Feng , Jizhi Tang , Chengang Hu , Dongyan Zhao

Controllable text generation concerns two fundamental tasks of wide applications, namely generating text of given attributes (i.e., attribute-conditional generation), and minimally editing existing text to possess desired attributes (i.e.,…

Computation and Language · Computer Science 2022-01-25 Zhiting Hu , Li Erran Li

Recent language models, especially those based on recurrent neural networks (RNNs), make it possible to generate natural language from a learned probability. Language generation has wide applications including machine translation,…

Computation and Language · Computer Science 2016-01-05 Lili Mou , Rui Yan , Ge Li , Lu Zhang , Zhi Jin

Large Language Models (LLMs) have shown great potential in Natural Language Processing (NLP) tasks. However, recent literature reveals that LLMs generate nonfactual responses intermittently, which impedes the LLMs' reliability for further…

Computation and Language · Computer Science 2024-03-22 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Chong Meng , Shuaiqiang Wang , Zhicong Cheng , Zhaochun Ren , Dawei Yin

When generating text from probabilistic models, the chosen decoding strategy has a profound effect on the resulting text. Yet the properties elicited by various decoding strategies do not always transfer across natural language generation…

Computation and Language · Computer Science 2022-03-30 Gian Wiher , Clara Meister , Ryan Cotterell

Many natural language inference (NLI) datasets contain biases that allow models to perform well by only using a biased subset of the input, without considering the remainder features. For instance, models are able to make a classification…

Computation and Language · Computer Science 2021-09-01 Dimion Asael , Zachary Ziegler , Yonatan Belinkov

Natural Language Processing and Generation systems have recently shown the potential to complement and streamline the costly and time-consuming job of professional fact-checkers. In this work, we lift several constraints of current…

Computation and Language · Computer Science 2025-10-30 Daniel Russo , Stefano Menini , Jacopo Staiano , Marco Guerini

In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or…

Computation and Language · Computer Science 2024-08-23 Xun Liang , Hanyu Wang , Yezhaohui Wang , Shichao Song , Jiawei Yang , Simin Niu , Jie Hu , Dan Liu , Shunyu Yao , Feiyu Xiong , Zhiyu Li

Advancements in natural language generation (NLG) and large language models (LLMs) have led to proficient text generation in various tasks. However, integrating intricate constraints into neural text generation, due to LLMs' opacity,…

Computation and Language · Computer Science 2024-03-22 Xiang Chen , Xiaojun Wan

Paraphrase generation is an important and challenging natural language processing (NLP) task. In this work, we propose a deep generative model to generate paraphrase with diversity. Our model is based on an encoder-decoder architecture. An…

Computation and Language · Computer Science 2019-10-01 Zhecheng An , Sicong Liu

Predictive process analytics focuses on predicting future states, such as the outcome of running process instances. These techniques often use machine learning models or deep learning models (such as LSTM) to make such predictions. However,…

Machine Learning · Computer Science 2023-03-29 Olusanmi Hundogan , Xixi Lu , Yupei Du , Hajo A. Reijers

This paper investigates the reliability of explanations generated by large language models (LLMs) when prompted to explain their previous output. We evaluate two kinds of such self-explanations - extractive and counterfactual - using three…

Computation and Language · Computer Science 2025-02-03 Korbinian Randl , John Pavlopoulos , Aron Henriksson , Tony Lindgren

This paper seeks to develop a deeper understanding of the fundamental properties of neural text generations models. The study of artifacts that emerge in machine generated text as a result of modeling choices is a nascent research area.…

Computation and Language · Computer Science 2020-04-15 Yi Tay , Dara Bahri , Che Zheng , Clifford Brunk , Donald Metzler , Andrew Tomkins

Counterfactual examples are widely used in natural language processing (NLP) as valuable data to improve models, and in explainable artificial intelligence (XAI) to understand model behavior. The automated generation of counterfactual…

Computation and Language · Computer Science 2025-05-29 Qianli Wang , Nils Feldhus , Simon Ostermann , Luis Felipe Villa-Arenas , Sebastian Möller , Vera Schmitt

Despite the advanced capabilities of large language models (LLMs), their temporal reasoning ability remains underdeveloped. Prior works have highlighted this limitation, particularly in maintaining temporal consistency when understanding…

Computation and Language · Computer Science 2025-06-18 Jongho Kim , Seung-won Hwang

Counterfactual explanations (CFs) provide human-interpretable insights into model's predictions by identifying minimal changes to input features that would alter the model's output. However, existing methods struggle to generate multiple…

Machine Learning · Computer Science 2026-02-20 Oleksii Furman , Patryk Marszałek , Jan Masłowski , Piotr Gaiński , Maciej Zięba , Marek Śmieja

The growing integration of machine learning (ML) and artificial intelligence (AI) models into high-stakes domains such as healthcare and scientific research calls for models that are not only accurate but also interpretable. Among the…

Machine Learning · Computer Science 2025-10-23 Zhuo Cao , Xuan Zhao , Lena Krieger , Hanno Scharr , Ira Assent