English
Related papers

Related papers: CausalAPM: Generalizable Literal Disentanglement f…

200 papers

Natural language understanding (NLU) models often rely on dataset biases rather than intended task-relevant features to achieve high performance on specific datasets. As a result, these models perform poorly on datasets outside the training…

Computation and Language · Computer Science 2023-01-05 Yougang Lyu , Piji Li , Yechang Yang , Maarten de Rijke , Pengjie Ren , Yukun Zhao , Dawei Yin , Zhaochun Ren

Recent successes of deep learning-based recognition rely on maintaining the content related to the main-task label. However, how to explicitly dispel the noisy signals for better generalization in a controllable manner remains an open…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Xiaofeng Liu

When mining large datasets in order to predict new data, limitations of the principles behind statistical machine learning pose a serious challenge not only to the Big Data deluge, but also to the traditional assumptions that data…

Information Theory · Computer Science 2023-04-26 Felipe S. Abrahão , Hector Zenil , Fabio Porto , Michael Winter , Klaus Wehmuth , Itala M. L. D'Ottaviano

Causal disentanglement aims to uncover a representation of data using latent variables that are interrelated through a causal model. Such a representation is identifiable if the latent model that explains the data is unique. In this paper,…

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

Computation and Language · Computer Science 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil

Confounding bias is a key challenge in causal effect estimation from observational data. Double Machine Learning (DML) addresses this issue by estimating treatment and outcome nuisance functions, constructing treatment and outcome…

Machine Learning · Computer Science 2026-05-26 Guodu Xiang , Kui Yu , Yujie Wang , Richang Hong , Fuyuan Cao , Jiye Liang

Data augmentation is an essential technique in natural language processing (NLP) for enriching training datasets by generating diverse samples. This process is crucial for improving the robustness and generalization capabilities of NLP…

Computation and Language · Computer Science 2025-10-16 Zaitian Wang , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu , Pengfei Wang , Yuanchun Zhou

In this paper, we study the partial multi-label (PML) image classification problem, where each image is annotated with a candidate label set consists of multiple relevant labels and other noisy labels. Existing PML methods typically design…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Feng Sun , Ming-Kun Xie , Sheng-Jun Huang

The rapid advancement of Large Language Models (LLMs) has sparked intense debate regarding the prevalence of bias in these models and its mitigation. Yet, as exemplified by both results on debiasing methods in the literature and reports of…

Computation and Language · Computer Science 2024-05-14 David F. Jenny , Yann Billeter , Mrinmaya Sachan , Bernhard Schölkopf , Zhijing Jin

Large Language Models (LLMs) are increasingly deployed in high-stakes contexts where their outputs influence real-world decisions. However, evaluating bias in LLM outputs remains methodologically challenging due to sensitivity to prompt…

Computation and Language · Computer Science 2026-01-13 William Guey , Wei Zhang , Pei-Luen Patrick Rau , Pierrick Bougault , Vitor D. de Moura , Bertan Ucar , Jose O. Gomes

We develop a general theory of omitted variable bias for a wide range of common causal parameters, including (but not limited to) averages of potential outcomes, average treatment effects, average causal derivatives, and policy effects from…

Econometrics · Economics 2024-05-28 Victor Chernozhukov , Carlos Cinelli , Whitney Newey , Amit Sharma , Vasilis Syrgkanis

State-of-the-art natural language processing (NLP) models often learn to model dataset biases and surface form correlations instead of features that target the intended underlying task. Previous work has demonstrated effective methods to…

Computation and Language · Computer Science 2020-12-03 Victor Sanh , Thomas Wolf , Yonatan Belinkov , Alexander M. Rush

Causal reasoning is a cornerstone of human intelligence and a critical capability for artificial systems aiming to achieve advanced understanding and decision-making. This thesis delves into various dimensions of causal reasoning and…

Computation and Language · Computer Science 2025-04-22 Zhijing Jin

Adversarial vulnerability remains a major obstacle to constructing reliable NLP systems. When imperceptible perturbations are added to raw input text, the performance of a deep learning model may drop dramatically under attacks. Recent work…

Computation and Language · Computer Science 2022-10-28 Jiahao Zhao , Wenji Mao

It has been shown that NLI models are usually biased with respect to the word-overlap between premise and hypothesis; they take this feature as a primary cue for predicting the entailment label. In this paper, we focus on an overlooked…

Computation and Language · Computer Science 2022-11-09 Sara Rajaee , Yadollah Yaghoobzadeh , Mohammad Taher Pilehvar

Causal discovery seeks to uncover causal relations from data, typically represented as causal graphs, and is essential for predicting the effects of interventions. While expert knowledge is required to construct principled causal graphs,…

Artificial Intelligence · Computer Science 2026-02-19 Zihao Li , Fabrizio Russo

Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on…

Computation and Language · Computer Science 2024-06-19 Nirmalendu Prakash , Lee Ka Wei Roy

Machine learning (ML) algorithms can often differ in performance across domains. Understanding $\textit{why}$ their performance differs is crucial for determining what types of interventions (e.g., algorithmic or operational) are most…

Machine Learning · Computer Science 2024-02-23 Jean Feng , Harvineet Singh , Fan Xia , Adarsh Subbaswamy , Alexej Gossmann

Although much work in NLP has focused on measuring and mitigating stereotypical bias in semantic spaces, research addressing bias in computational argumentation is still in its infancy. In this paper, we address this research gap and…

Computation and Language · Computer Science 2022-04-11 Carolin Holtermann , Anne Lauscher , Simone Paolo Ponzetto

Link Prediction(LP) is an essential task over Knowledge Graphs(KGs), traditionally focussed on using and predicting the relations between entities. Textual entity descriptions have already been shown to be valuable, but models that…

Machine Learning · Computer Science 2024-07-26 Moritz Blum , Basil Ell , Hannes Ill , Philipp Cimiano