English
Related papers

Related papers: Bivariate Causal Discovery Using Rate-Distortion M…

200 papers

A multiple-descriptions (MD) coding strategy is proposed and an inner bound to the achievable rate-distortion region is derived. The scheme utilizes linear codes. It is shown in two different MD set-ups that the linear coding scheme…

Information Theory · Computer Science 2014-02-11 Farhad Shirani , Sandeep Pradhan

State-of-the-art causal discovery methods usually assume that the observational data is complete. However, the missing data problem is pervasive in many practical scenarios such as clinical trials, economics, and biology. One…

Machine Learning · Computer Science 2023-01-18 Erdun Gao , Ignavier Ng , Mingming Gong , Li Shen , Wei Huang , Tongliang Liu , Kun Zhang , Howard Bondell

We establish the first information-theoretic limits for multimodal retrieval. Casting ranking as lossy source coding, we derive a single-letter rate-distortion function $R(D)$ for reciprocal-rank distortion and prove a converse bound that…

Information Theory · Computer Science 2025-09-16 Thomas Y. Chen

Organizations are collecting increasingly large amounts of data for data driven decision making. These data are often dumped into a centralized repository, e.g., a data lake, consisting of thousands of structured and unstructured datasets.…

Artificial Intelligence · Computer Science 2023-07-18 Mohamed Y. Eltabakh , Mayuresh Kunjir , Ahmed Elmagarmid , Mohammad Shahmeer Ahmad

We consider the problem of causal discovery (a.k.a., causal structure learning) in a multi-domain setting. We assume that the causal functions are invariant across the domains, while the distribution of the exogenous noise may vary. Under…

Machine Learning · Computer Science 2025-05-01 Kasra Jalaldoust , Saber Salehkaleybar , Negar Kiyavash

Causal learning is the key to obtaining stable predictions and answering \textit{what if} problems in decision-makings. In causal learning, it is central to seek methods to estimate the average treatment effect (ATE) from observational…

Machine Learning · Statistics 2022-12-07 Yiyan Huang , Cheuk Hang Leung , Qi Wu , Xing Yan

Disentangling complex causal relationships is important for accurate detection of anomalies. In multivariate time series analysis, dynamic interactions among data variables over time complicate the interpretation of causal relationships.…

Machine Learning · Computer Science 2025-10-14 Wonah Kim , Jeonghyeon Park , Dongsan Jun , Jungkyu Han , Sejin Chun

Causal discovery from time-series data aims to capture both intra-slice (contemporaneous) and inter-slice (time-lagged) causality between variables within the temporal chain, which is crucial for various scientific disciplines. Compared to…

Machine Learning · Computer Science 2026-01-26 Rujia Shen , Boran Wang , Chao Zhao , Yi Guan , Jingchi Jiang

Multivariate time series in domains such as finance, climate science, and healthcare often exhibit long-term trends, seasonal patterns, and short-term fluctuations, complicating causal inference under non-stationarity and autocorrelation.…

Machine Learning · Computer Science 2026-04-29 Muhammad Hasan Ferdous , Md Osman Gani

Recently, differentiable causal discovery has emerged as a promising approach to improve the accuracy and efficiency of existing methods. However, when applied to high-dimensional data or data with latent confounders, these methods, often…

Machine Learning · Computer Science 2026-01-12 Pingchuan Ma , Qixin Zhang , Shuai Wang , Dacheng Tao

We leverage the Minimum Description Length (MDL) principle as a model selection technique for Bernoulli distributions and compare several types of MDL codes. We first present a simplistic crude two-part MDL code and a Normalized Maximum…

Information Theory · Computer Science 2016-10-04 Marc Boullé , Fabrice Clérot , Carine Hue

Deep neural networks trained through end-to-end learning have achieved remarkable success across various domains in the past decade. However, the end-to-end learning strategy, originally designed to minimize predictive loss in a black-box…

Machine Learning · Computer Science 2025-06-11 Canlin Zhang , Xiuwen Liu

Optimizing credit limits, interest rates, and loan terms is crucial for managing borrower risk and lifetime value (LTV) in personal loan platform. However, counterfactual estimation of these continuous, multi-dimensional treatments faces…

Machine Learning · Computer Science 2025-08-12 Kexin Zhao , Bo Wang , Cuiying Zhao , Tongyao Wan

We study the problem of closeness testing for continuous distributions and its implications for causal discovery. Specifically, we analyze the sample complexity of distinguishing whether two multidimensional continuous distributions are…

Machine Learning · Computer Science 2025-03-11 Fateme Jamshidi , Sina Akbari , Negar Kiyavash

This thesis develops methods for causal inference and causal representation learning (CRL) in high-dimensional, time-varying data. The first contribution introduces the Causal Dynamic Variational Autoencoder (CDVAE), a model for estimating…

Machine Learning · Statistics 2025-12-05 Mouad EL Bouchattaoui

High-dimensional datasets often contain multiple meaningful clusterings in different subspaces. For example, objects can be clustered either by color, weight, or size, revealing different interpretations of the given dataset. A variety of…

Machine Learning · Computer Science 2025-04-08 Collin Leiber , Dominik Mautz , Claudia Plant , Christian Böhm

We consider the problem of evaluating representations of data for use in solving a downstream task. We propose to measure the quality of a representation by the complexity of learning a predictor on top of the representation that achieves…

Machine Learning · Computer Science 2021-02-08 William F. Whitney , Min Jae Song , David Brandfonbrener , Jaan Altosaar , Kyunghyun Cho

The relationship between the Bayesian approach and the minimum description length approach is established. We sharpen and clarify the general modeling principles MDL and MML, abstracted as the ideal MDL principle and defined from Bayes's…

Machine Learning · Computer Science 2007-07-16 Paul Vitanyi , Ming Li

The two most commonly used criteria for assessing causal model discovery with artificial data are edit-distance and Kullback-Leibler divergence, measured from the true model to the learned model. Both of these metrics maximally reward the…

Machine Learning · Computer Science 2021-11-12 Rodney T. O'Donnell , Kevin B. Korb , Lloyd Allison

Nonlinear causal discovery from observational data imposes strict identifiability assumptions on the formulation of structural equations utilized in the data generating process. The evaluation of structure learning methods under assumption…

Machine Learning · Statistics 2024-12-17 Georg Velev , Stefan Lessmann