English
Related papers

Related papers: Sparse Additive Model Pruning for Order-Based Caus…

200 papers

Directed acyclic graph (DAG) models are widely used to represent causal relationships among random variables in many application domains. This paper studies a special class of non-Gaussian DAG models, where the conditional variance of each…

Machine Learning · Statistics 2021-11-03 Wei Zhou , Xin He , Wei Zhong , Junhui Wang

We propose a joint order-based scoring framework for causal structure learning of directed acyclic graph (DAG) models under heterogeneous data settings. We show that leveraging heterogeneity improves the accuracy of causal ordering…

Methodology · Statistics 2026-05-18 Hyunwoong Chang , Fariha Taskin

We propose a nonparametric method for detecting nonlinear causal relationship within a set of multidimensional discrete time series, by using sparse additive models (SpAMs). We show that, when the input to the SpAM is a $\beta$-mixing time…

Machine Learning · Statistics 2018-04-27 Yingxiang Yang , Adams Wei Yu , Zhaoran Wang , Tuo Zhao

We study the problem of reducing test-time acquisition costs in classification systems. Our goal is to learn decision rules that adaptively select sensors for each example as necessary to make a confident prediction. We model our system as…

Machine Learning · Statistics 2015-10-27 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

In this thesis we discuss machine learning methods performing automated variable selection for learning sparse predictive models. There are multiple reasons for promoting sparsity in the predictive models. By relying on a limited set of…

Machine Learning · Computer Science 2019-03-27 Magda Gregorova

Causal structure learning refers to a process of identifying causal structures from observational data, and it can have multiple applications in biomedicine and health care. This paper provides a practical review and tutorial on scalable…

Machine Learning · Computer Science 2023-01-20 Pulakesh Upadhyaya , Kai Zhang , Can Li , Xiaoqian Jiang , Yejin Kim

Estimating the structure of directed acyclic graphs (DAGs, also known as Bayesian networks) is a challenging problem since the search space of DAGs is combinatorial and scales superexponentially with the number of nodes. Existing approaches…

Machine Learning · Statistics 2018-11-06 Xun Zheng , Bryon Aragam , Pradeep Ravikumar , Eric P. Xing

Causal representation learning algorithms discover lower-dimensional representations of data that admit a decipherable interpretation of cause and effect; as achieving such interpretable representations is challenging, many causal learning…

Machine Learning · Computer Science 2023-11-09 Elise Walker , Jonas A. Actor , Carianne Martinez , Nathaniel Trask

The subject of green AI has been gaining attention within the deep learning community given the recent trend of ever larger and more complex neural network models. Existing solutions for reducing the computational load of training at…

Machine Learning · Computer Science 2025-01-13 Xiaoying Zhi , Varun Babbar , Rundong Liu , Pheobe Sun , Fran Silavong , Ruibo Shi , Sean Moran

We establish a new framework for statistical estimation of directed acyclic graphs (DAGs) when data are generated from a linear, possibly non-Gaussian structural equation model. Our framework consists of two parts: (1) inferring the…

Machine Learning · Statistics 2013-11-15 Po-Ling Loh , Peter Bühlmann

Model pruning is a popular approach to enable the deployment of large deep learning models on edge devices with restricted computational or storage capacities. Although sparse models achieve performance comparable to that of their dense…

Structured additive distributional regression models offer a versatile framework for estimating complete conditional distributions by relating all parameters of a parametric distribution to covariates. Although these models efficiently…

Methodology · Statistics 2023-11-14 Jana Kleinemeier , Nadja Klein

A new causal discovery method, Structural Agnostic Modeling (SAM), is presented in this paper. Leveraging both conditional independencies and distributional asymmetries, SAM aims to find the underlying causal structure from observational…

Machine Learning · Statistics 2022-07-26 Diviyan Kalainathan , Olivier Goudet , Isabelle Guyon , David Lopez-Paz , Michèle Sebag

Decision trees with binary splits are popularly constructed using Classification and Regression Trees (CART) methodology. For regression models, this approach recursively divides the data into two near-homogenous daughter nodes according to…

Machine Learning · Statistics 2020-11-20 Jason M. Klusowski

In observational studies, the true causal model is typically unknown and needs to be estimated from available observational and limited experimental data. In such cases, the learned causal model is commonly represented as a partially…

Artificial Intelligence · Computer Science 2023-03-01 Malte Luttermann , Marcel Wienöbst , Maciej Liśkiewicz

Current methods for pruning neural network weights iteratively apply magnitude-based pruning on the model weights and re-train the resulting model to recover lost accuracy. In this work, we show that such strategies do not allow for the…

Machine Learning · Computer Science 2022-02-04 Suraj Srinivas , Andrey Kuzmin , Markus Nagel , Mart van Baalen , Andrii Skliar , Tijmen Blankevoort

Given data sampled from a number of variables, one is often interested in the underlying causal relationships in the form of a directed acyclic graph. In the general case, without interventions on some of the variables it is only possible…

Machine Learning · Statistics 2017-12-05 Christopher Nowzohour , Peter Bühlmann

Learning directed acyclic graphs (DAGs) to identify causal relations underlying observational data is crucial but also poses significant challenges. Recently, topology-based methods have emerged as a two-step approach to discovering DAGs by…

Machine Learning · Computer Science 2023-08-17 Anpeng Wu , Haoxuan Li , Kun Kuang , Keli Zhang , Fei Wu

We consider the problem of learning the causal MAG of a system from observational data in the presence of latent variables and selection bias. Constraint-based methods are one of the main approaches for solving this problem, but the…

Machine Learning · Computer Science 2021-10-26 Sina Akbari , Ehsan Mokhtarian , AmirEmad Ghassami , Negar Kiyavash

We consider the problem of learning the underlying causal structure among a set of variables, which are assumed to follow a Bayesian network or, more specifically, a linear recursive structural equation model (SEM) with the associated…

Statistics Theory · Mathematics 2025-08-05 Anamitra Chaudhuri , Anirban Bhattacharya , Yang Ni