English
Related papers

Related papers: Causal Distillation: Transferring Structured Expla…

200 papers

The increasing use of Machine Learning (ML) models to aid decision-making in high-stakes industries demands explainability to facilitate trust. Counterfactual Explanations (CEs) are ideally suited for this, as they can offer insights into…

Machine Learning · Computer Science 2025-02-20 Junqi Jiang , Luca Marzari , Aaryan Purohit , Francesco Leofante

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

To gain deeper insights into a complex sensor system through the lens of causality, we present common and individual causal mechanism estimation (CICME), a novel three-step approach to inferring causal mechanisms from heterogeneous data…

Machine Learning · Computer Science 2025-08-21 Jingyi Yu , Tim Pychynski , Marco F. Huber

The ability to robustly identify causal relationships is essential for autonomous decision-making and adaptation to novel scenarios. However, accurately inferring causal structure requires integrating both world knowledge and abstract…

Machine Learning · Computer Science 2025-06-17 Khurram Yamin , Shantanu Gupta , Gaurav R. Ghosal , Zachary C. Lipton , Bryan Wilder

Causal explanation analysis (CEA) can assist us to understand the reasons behind daily events, which has been found very helpful for understanding the coherence of messages. In this paper, we focus on Causal Explanation Detection, an…

Computation and Language · Computer Science 2020-09-25 Xinyu Zuo , Yubo Chen , Kang Liu , Jun Zhao

This paper proposes the DistillCSE framework, which performs contrastive learning under the self-training paradigm with knowledge distillation. The potential advantage of DistillCSE is its self-enhancing feature: using a base model to…

Computation and Language · Computer Science 2023-12-25 Jiahao Xu , Wei Shao , Lihui Chen , Lemao Liu

Causality -- referring to temporal, uni-directional cause-effect relationships between components -- underlies many complex generative processes, including videos, language, and robot trajectories. Current causal diffusion models entangle…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Xingjian Bai , Guande He , Zhengqi Li , Eli Shechtman , Xun Huang , Zongze Wu

Owing to their powerful semantic reasoning capabilities, Large Language Models (LLMs) have been effectively utilized as recommenders, achieving impressive performance. However, the high inference latency of LLMs significantly restricts…

Information Retrieval · Computer Science 2024-08-21 Yu Cui , Feng Liu , Pengbo Wang , Bohao Wang , Heng Tang , Yi Wan , Jun Wang , Jiawei Chen

Objective: Causality mining is an active research area, which requires the application of state-of-the-art natural language processing techniques. In the healthcare domain, medical experts create clinical text to overcome the limitation of…

Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for each individual dataset. Such an approach limits the potential of multi-dataset pretraining.…

Causal inference is one of the hallmarks of human intelligence. While the field of CausalNLP has attracted much interest in the recent years, existing causal inference datasets in NLP primarily rely on discovering causality from empirical…

Computation and Language · Computer Science 2024-04-18 Zhijing Jin , Jiarui Liu , Zhiheng Lyu , Spencer Poff , Mrinmaya Sachan , Rada Mihalcea , Mona Diab , Bernhard Schölkopf

Causality understanding between events is a critical natural language processing task that is helpful in many areas, including health care, business risk management and finance. On close examination, one can find a huge amount of textual…

Computation and Language · Computer Science 2021-02-01 Vivek Khetan , Roshni Ramnani , Mayuresh Anand , Shubhashis Sengupta , Andrew E. Fano

Knowledge distillation has proven effective for model compression by transferring knowledge from a larger network called the teacher to a smaller network called the student. Current knowledge distillation in time series is predominantly…

Machine Learning · Computer Science 2026-01-12 Nilushika Udayangani Hewa Dehigahawattage , Kishor Nandakishor , Marimuthu Palaniswami

The scale and scope of scholarly articles today are overwhelming human researchers who seek to timely digest and synthesize knowledge. In this paper, we seek to develop natural language processing (NLP) models to accelerate the speed of…

Computation and Language · Computer Science 2020-06-17 Victor Zitian Chen , Felipe Montano-Campos , Wlodek Zadrozny

The fundamental challenge of drawing causal inference is that counterfactual outcomes are not fully observed for any unit. Furthermore, in observational studies, treatment assignment is likely to be confounded. Many statistical methods have…

Methodology · Statistics 2022-08-01 Harsh Parikh , Carlos Varjao , Louise Xu , Eric Tchetgen Tchetgen

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all machine learning based methods, they are as good as their training data, and can also capture unwanted biases.…

Computation and Language · Computer Science 2022-11-15 Amir Feder , Nadav Oved , Uri Shalit , Roi Reichart

Large language models (LLMs) are increasingly deployed in domains requiring moral understanding, yet their reasoning often remains shallow, and misaligned with human reasoning. Unlike humans, whose moral reasoning integrates contextual…

Human-Computer Interaction · Computer Science 2025-06-19 Mohna Chakraborty , Lu Wang , David Jurgens

This paper describes the development of a causal diagnosis approach for troubleshooting an industrial environment on the basis of the technical language expressed in Return on Experience records. The proposed method leverages the vectorized…

Artificial Intelligence · Computer Science 2024-07-31 Alexandre Trilla , Ossee Yiboe , Nenad Mijatovic , Jordi Vitrià

While state-of-the-art large language models (LLMs) can excel at adapting text from one style to another, current work does not address the explainability of style transfer models. Recent work has explored generating textual explanations…

Computation and Language · Computer Science 2024-06-18 Arkadiy Saakyan , Smaranda Muresan

Numerous benchmarks aim to evaluate the capabilities of Large Language Models (LLMs) for causal inference and reasoning. However, many of them can likely be solved through the retrieval of domain knowledge, questioning whether they achieve…

Machine Learning · Computer Science 2024-07-12 Linying Yang , Vik Shirvaikar , Oscar Clivio , Fabian Falck