English
Related papers

Related papers: Proof Supplement - Learning Sparse Causal Models i…

200 papers

A main drawback of eXplainable Artificial Intelligence (XAI) approaches is the feature independence assumption, hindering the study of potential variable dependencies. This leads to approximating black box behaviors by analyzing the effects…

Artificial Intelligence · Computer Science 2024-10-16 Martina Cinquini , Riccardo Guidotti

Label noise will degenerate the performance of deep learning algorithms because deep neural networks easily overfit label errors. Let X and Y denote the instance and clean label, respectively. When Y is a cause of X, according to which many…

Machine Learning · Statistics 2022-06-06 Yu Yao , Tongliang Liu , Mingming Gong , Bo Han , Gang Niu , Kun Zhang

The PC and FCI algorithms are popular constraint-based methods for learning the structure of directed acyclic graphs (DAGs) in the absence and presence of latent and selection variables, respectively. These algorithms (and their…

Methodology · Statistics 2022-03-14 Shubhadeep Chakraborty , Ali Shojaie

Structural learning of Bayesian Networks (BNs) is a NP-hard problem, which is further complicated by many theoretical issues, such as the I-equivalence among different structures. In this work, we focus on a specific subclass of BNs, named…

Machine Learning · Computer Science 2018-10-24 Daniele Ramazzotti , Marco S. Nobile , Marco Antoniotti , Alex Graudenzi

We study efficient algorithms for Sparse PCA in standard statistical models (spiked covariance in its Wishart form). Our goal is to achieve optimal recovery guarantees while being resilient to small perturbations. Despite a long history of…

Machine Learning · Computer Science 2020-11-13 Tommaso d'Orsi , Pravesh K. Kothari , Gleb Novikov , David Steurer

We propose a method to detect model misspecifications in nonlinear causal additive and potentially heteroscedastic noise models. We aim to identify predictor variables for which we can infer the causal effect even in cases of such…

Methodology · Statistics 2024-03-28 Christoph Schultheiss , Peter Bühlmann

Bayesian hierarchical models have been demonstrated to provide efficient algorithms for finding sparse solutions to ill-posed inverse problems. The models comprise typically a conditionally Gaussian prior model for the unknown, augmented by…

Numerical Analysis · Mathematics 2023-03-31 Daniela Calvetti , Erkki Somersalo

In recent years a lot of research has been conducted within the area of causal inference and causal learning. Many methods have been developed to identify the cause-effect pairs in models and have been successfully applied to observational…

Machine Learning · Statistics 2021-08-26 Benjamin Kap

Models that learn spurious correlations from training data often fail when deployed in new environments. While many methods aim to learn invariant representations to address this, they often underperform standard empirical risk minimization…

Machine Learning · Computer Science 2025-11-11 Ruqi Bai , Yao Ji , Zeyu Zhou , David I. Inouye

We address the problem of prediction of multivariate data process using an underlying graph model. We develop a method that learns a sparse partial correlation graph in a tuning-free and computationally efficient manner. Specifically, the…

Machine Learning · Statistics 2018-11-19 Arun Venkitaraman , Dave Zachariah

This paper introduces an efficient sparse recovery approach for Polynomial Chaos (PC) expansions, which promotes the sparsity by breaking the dimensionality of the problem. The proposed algorithm incrementally explores sub-dimensional…

Computation · Statistics 2017-04-05 Negin Alemazkoor , Hadi Meidani

Sparse system identification of nonlinear dynamic systems is still challenging, especially for stiff and high-order differential equations for noisy measurement data. The use of highly correlated functions makes distinguishing between true…

Computational Physics · Physics 2025-12-19 Ashish Pal , Sutanu Bhowmick , Satish Nagarajaiah

Causal structure learning is a key problem in many domains. Causal structures can be learnt by performing experiments on the system of interest. We address the largely unexplored problem of designing a batch of experiments that each…

Machine Learning · Computer Science 2021-11-25 Scott Sussex , Andreas Krause , Caroline Uhler

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

We present FLOP (Fast Learning of Order and Parents), a score-based causal discovery algorithm for linear models. It pairs fast parent selection with iterative Cholesky-based score updates, cutting run-times over prior algorithms. This…

Machine Learning · Statistics 2026-03-02 Marcel Wienöbst , Leonard Henckel , Sebastian Weichwald

Progress in probabilistic generative models has accelerated, developing richer models with neural architectures, implicit densities, and with scalable algorithms for their Bayesian inference. However, there has been limited progress in…

Machine Learning · Statistics 2017-10-31 Dustin Tran , David M. Blei

Audio events are quite often overlapping in nature, and more prone to noise than visual signals. There has been increasing evidence for the superior performance of representations learned using sparse dictionaries for applications like…

Machine Learning · Computer Science 2017-12-05 Vaisakh Shaj , Puranjoy Bhattacharya

Convolutional sparse coding (CSC) can learn representative shift-invariant patterns from multiple kinds of data. However, existing CSC methods can only model noises from Gaussian distribution, which is restrictive and unrealistic. In this…

Machine Learning · Computer Science 2020-04-22 Yaqing Wang , James T. Kwok , Lionel M. Ni

We study the problem of detecting a structured, low-rank signal matrix corrupted with additive Gaussian noise. This includes clustering in a Gaussian mixture model, sparse PCA, and submatrix localization. Each of these problems is…

Statistics Theory · Mathematics 2017-01-24 Jess Banks , Cristopher Moore , Nicolas Verzelen , Roman Vershynin , Jiaming Xu

The problem of learning a directed acyclic graph (DAG) up to Markov equivalence is equivalent to the problem of finding a permutation of the variables that induces the sparsest graph. Without additional assumptions, this task is known to be…

Methodology · Statistics 2020-11-10 Chandler Squires , Joshua Amaniampong , Caroline Uhler