English
Related papers

Related papers: Bivariate Causal Discovery Using Rate-Distortion M…

200 papers

Motivation: Algorithms that discover variables which are causally related to a target may inform the design of experiments. With observational gene expression data, many methods discover causal variables by measuring each variable's degree…

Quantitative Methods · Quantitative Biology 2014-07-30 Eric V. Strobl , Shyam Visweswaran

This paper proposes a simple, novel, and fully-Bayesian approach for causal inference in partially linear models with high-dimensional control variables. Off-the-shelf machine learning methods can introduce biases in the causal parameter…

Econometrics · Economics 2025-08-19 Francis J. DiTraglia , Laura Liu

Unsupervised discretization is a crucial step in many knowledge discovery tasks. The state-of-the-art method for one-dimensional data infers locally adaptive histograms using the minimum description length (MDL) principle, but the…

Machine Learning · Computer Science 2022-12-12 Lincen Yang , Mitra Baratchi , Matthijs van Leeuwen

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

This paper addresses the problem of mapping high-dimensional data to a low-dimensional space, in the presence of other known features. This problem is ubiquitous in science and engineering as there are often controllable/measurable features…

Machine Learning · Statistics 2024-01-01 Anh Tuan Bui

We present DMCD (DataMap Causal Discovery), a two-phase causal discovery framework that integrates LLM-based semantic drafting from variable metadata with statistical validation on observational data. In Phase I, a large language model…

Artificial Intelligence · Computer Science 2026-02-25 Samarth KaPatel , Sofia Nikiforova , Giacinto Paolo Saggese , Paul Smith

The mainstream of research in genetics, epigenetics and imaging data analysis focuses on statistical association or exploring statistical dependence between variables. Despite their significant progresses in genetic research, understanding…

Genomics · Quantitative Biology 2018-05-14 Rong Jiao , Nan Lin , Zixin Hu , David A Bennett , Li Jin , Momiao Xiong

Causal discovery, i.e., learning the causal graph from data, is often the first step toward the identification and estimation of causal effects, a key requirement in numerous scientific domains. Causal discovery is hampered by two main…

Machine Learning · Computer Science 2024-03-15 Ehsan Mokhtarian , Sepehr Elahi , Sina Akbari , Negar Kiyavash

Minimum Description Length (MDL) is an important principle for induction and prediction, with strong relations to optimal Bayesian learning. This paper deals with learning non-i.i.d. processes by means of two-part MDL, where the underlying…

Information Theory · Computer Science 2007-07-13 Jan Poland , Marcus Hutter

Causal discovery aims to learn causal relationships between variables from targeted data, making it a fundamental task in machine learning. However, causal discovery algorithms often rely on unverifiable causal assumptions, which are…

Machine Learning · Computer Science 2025-10-15 Huiyang Yi , Yanyan He , Duxin Chen , Mingyu Kang , He Wang , Wenwu Yu

The Minimum Description Length (MDL) principle offers a formal framework for applying Occam's razor in machine learning. However, its application to neural networks such as Transformers is challenging due to the lack of a principled,…

Machine Learning · Computer Science 2026-03-04 Peter Shaw , James Cohan , Jacob Eisenstein , Kristina Toutanova

Symbolic regression, a task discovering the formula best fitting the given data, is typically based on the heuristical search. These methods usually update candidate formulas to obtain new ones with lower prediction errors iteratively.…

Machine Learning · Computer Science 2025-09-11 Zihan Yu , Jingtao Ding , Yong Li , Depeng Jin

We introduce a method to determine if a certain capability helps to achieve an accurate model of given data. We view labels as being generated from the inputs by a program composed of subroutines with different capabilities, and we posit…

Machine Learning · Computer Science 2021-03-08 Ethan Perez , Douwe Kiela , Kyunghyun Cho

This work explores the connections between the Minimum Description Length (MDL) principle as developed by Rissanen, and the a-contrario framework for structure detection proposed by Desolneux, Moisan and Morel. The MDL principle focuses on…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Rafael Grompone von Gioi , Ignacio Ramírez Paulino , Gregory Randall

Causal discovery from observational data is an important tool in many branches of science. Under certain assumptions it allows scientists to explain phenomena, predict, and make decisions. In the large sample limit, sound and complete…

Machine Learning · Statistics 2021-07-13 Shami Nisimov , Yaniv Gurwicz , Raanan Y. Rohekar , Gal Novik

Causal graph recovery is traditionally done using statistical estimation-based methods or based on individual's knowledge about variables of interests. They often suffer from data collection biases and limitations of individuals' knowledge.…

Computation and Language · Computer Science 2024-06-19 Yuzhe Zhang , Yipeng Zhang , Yidong Gan , Lina Yao , Chen Wang

Hawkes processes are a special class of temporal point processes which exhibit a natural notion of causality, as occurrence of events in the past may increase the probability of events in the future. Discovery of the underlying influence…

Machine Learning · Computer Science 2022-06-14 Amirkasra Jalaldoust , Katerina Hlavackova-Schindler , Claudia Plant

Causal representation learning (CRL) has garnered increasing interest from the causal inference and artificial intelligence communities due to its potential to disentangle complex data-generating mechanism into causally interpretable latent…

Machine Learning · Statistics 2026-05-28 Hao Chen , Lin Liu , Yu Guang Wang

Causal discovery is crucial for causal inference in observational studies, as it can enable the identification of valid adjustment sets (VAS) for unbiased effect estimation. However, global causal discovery is notoriously hard in the…

Machine Learning · Statistics 2024-06-04 Jacqueline Maasch , Weishen Pan , Shantanu Gupta , Volodymyr Kuleshov , Kyra Gan , Fei Wang

By adhering to the dictum, "No causation without manipulation (treatment, intervention)", cause and effect data analysis represents changes in observed data in terms of changes in the causal factors. When causal factors are not amenable for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 M. Alex O. Vasilescu , Eric Kim , Xiao S. Zeng