English
Related papers

Related papers: CALM: A Causal Analysis Language Model for Tabular…

200 papers

Large language models (LLMs) are increasingly used as automated judges and synthetic labelers, especially in low-label settings. Yet these systems are stochastic and often overconfident, which makes deployment decisions difficult when…

Machine Learning · Computer Science 2026-03-19 Maxim Khomiakov , Jes Frellsen

Estimating causal quantities traditionally relies on bespoke estimators tailored to specific assumptions. Recently proposed Causal Foundation Models (CFMs) promise a more unified approach by amortising causal discovery and inference in a…

Despite the groundbreaking advancements made by large language models (LLMs), hallucination remains a critical bottleneck for their deployment in high-stakes domains. Existing classification-based methods mainly rely on static and passive…

Machine Learning · Computer Science 2026-05-12 Linggang Kong , Lei Wu , Yunlong Zhang , Xiaofeng Zhong , Zhen Wang , Yongjie Wang , Yao Pan

True intelligence hinges on the ability to uncover and leverage hidden causal relations. Despite significant progress in AI and computer vision (CV), there remains a lack of benchmarks for assessing models' abilities to infer latent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Disheng Liu , Yiran Qiao , Wuche Liu , Yiren Lu , Yunlai Zhou , Tuo Liang , Yu Yin , Jing Ma

Causal Structure Learning (CSL), also referred to as causal discovery, amounts to extracting causal relations among variables in data. CSL enables the estimation of causal effects from observational data alone, avoiding the need to perform…

Machine Learning · Computer Science 2025-02-12 Fabrizio Russo , Francesca Toni

Mainstream methods for Legal Judgment Prediction (LJP) based on Pre-trained Language Models (PLMs) heavily rely on the statistical correlation between case facts and judgment results. This paradigm lacks explicit modeling of legal…

Computation and Language · Computer Science 2026-03-13 Yuzhi Liang , Lixiang Ma , Xinrong Zhu

Recent advances in Transformer-based large language models (LLMs) have led to significant performance improvements across many tasks. These gains come with a drastic increase in the models' size, potentially leading to slow and costly use…

Computation and Language · Computer Science 2022-10-26 Tal Schuster , Adam Fisch , Jai Gupta , Mostafa Dehghani , Dara Bahri , Vinh Q. Tran , Yi Tay , Donald Metzler

The validity of medical studies based on real-world clinical data, such as observational studies, depends on critical assumptions necessary for drawing causal conclusions about medical interventions. Many published studies are flawed…

Artificial Intelligence · Computer Science 2024-07-30 Ahmed Alaa , Rachael V. Phillips , Emre Kıcıman , Laura B. Balzer , Mark van der Laan , Maya Petersen

Estimating treatment effects (TE) from observational data is a critical yet complex task in many fields, from healthcare and economics to public policy. While recent advances in machine learning and causal inference have produced powerful…

Machine Learning · Computer Science 2025-08-15 Jeroen Berrevoets , Julianna Piskorz , Robert Davis , Harry Amad , Jim Weatherall , Mihaela van der Schaar

Large Language Models (LLMs) have recently shown great promise in planning and reasoning applications. These tasks demand robust systems, which arguably require a causal understanding of the environment. While LLMs can acquire and reflect…

Artificial Intelligence · Computer Science 2024-10-29 John Gkountouras , Matthias Lindemann , Phillip Lippe , Efstratios Gavves , Ivan Titov

The ability to understand causality significantly impacts the competence of large language models (LLMs) in output explanation and counterfactual reasoning, as causality reveals the underlying data distribution. However, the lack of a…

Machine Learning · Computer Science 2024-09-30 Yu Zhou , Xingyu Wu , Beicheng Huang , Jibin Wu , Liang Feng , Kay Chen Tan

Large language models (LLMs) have shown potential in identifying qualitative causal relations, but their ability to perform quantitative causal reasoning -- estimating effect sizes that parametrize functional relationships -- remains…

Large Language Models (LLMs) have demonstrated remarkable capabilities in various reasoning and generation tasks. However, their proficiency in complex causal reasoning, discovery, and estimation remains an area of active development, often…

Artificial Intelligence · Computer Science 2025-09-03 Adib Bazgir , Amir Habibdoust , Yuwen Zhang , Xing Song

Power system time series analytics is critical in understanding the system operation conditions and predicting the future trends. Despite the wide adoption of Artificial Intelligence (AI) tools, many AI-based time series analytical models…

Signal Processing · Electrical Eng. & Systems 2025-11-12 Zhenghao Zhou , Yiyan Li , Xinjie Yu , Runlong Liu , Zelin Guo , Zheng Yan , Mo-Yuen Chow , Yuqi Yang , Yang Xu

Large language models (LLMs) have shown various ability on natural language processing, including problems about causality. It is not intuitive for LLMs to command causality, since pretrained models usually work on statistical associations,…

Computation and Language · Computer Science 2024-08-27 Chenyang Zhang , Haibo Tong , Bin Zhang , Dongyu Zhang

Causal discovery traditionally relies on statistical methods applied to observational data, often requiring large datasets and assumptions about underlying causal structures. Recent advancements in Large Language Models (LLMs) have…

Machine Learning · Computer Science 2025-04-16 Yuni Susanti , Michael Färber

Training large language representation models has become a standard in the natural language processing community. This allows for fine tuning on any number of specific tasks, however, these large high capacity models can continue to train…

Computation and Language · Computer Science 2020-04-09 Kristjan Arumae , Parminder Bhatia

With the rise of Large Language Models(LLMs), it has become crucial to understand their capabilities and limitations in deciphering and explaining the complex web of causal relationships that language entails. Current methods use either…

Text analysis of tabular data relies on two core operations: \emph{summarization} for corpus-level theme extraction and \emph{tagging} for row-level labeling. A critical limitation of employing large language models (LLMs) for these tasks…

Computation and Language · Computer Science 2026-04-23 Jinxiang Xie , Zihao Li , Wei He , Rui Ding , Shi Han , Dongmei Zhang

Causal discovery (CD) plays a pivotal role in numerous scientific fields by clarifying the causal relationships that underlie phenomena observed in diverse disciplines. Despite significant advancements in CD algorithms that enhance bias and…

Machine Learning · Computer Science 2025-03-25 Khadija Zanna , Akane Sano