English
Related papers

Related papers: Kernel-Based Differentiable Learning of Non-Parame…

200 papers

Learning directed acyclic graph (DAG) that describes the causality of observed data is a very challenging but important task. Due to the limited quantity and quality of observed data, and non-identifiability of causal graph, it is almost…

Machine Learning · Computer Science 2022-11-23 Dezhi Yang , Guoxian Yu , Jun Wang , Zhengtian Wu , Maozu Guo

We study the problem of reducing test-time acquisition costs in classification systems. Our goal is to learn decision rules that adaptively select sensors for each example as necessary to make a confident prediction. We model our system as…

Machine Learning · Statistics 2015-10-27 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

Regularization improves generalization of supervised models to out-of-sample data. Prior works have shown that prediction in the causal direction (effect from cause) results in lower testing error than the anti-causal direction. However,…

Machine Learning · Computer Science 2020-09-29 Trent Kyono , Yao Zhang , Mihaela van der Schaar

An acyclic causal structure can be described with directed acyclic graph (DAG), where arrows indicate the possibility of direct causation. The task of learning this structure from data is known as "causal discovery." Diverse populations or…

Machine Learning · Computer Science 2024-10-17 Bijan Mazaheri , Spencer Gordon , Yuval Rabani , Leonard Schulman

Causal structure learning from observational data remains a non-trivial task due to various factors such as finite sampling, unobserved confounding factors, and measurement errors. Constraint-based and score-based methods tend to suffer…

Machine Learning · Computer Science 2022-11-09 Rezaur Rashid , Jawad Chowdhury , Gabriel Terejanu

Consider the problem: given the data pair $(\mathbf{x}, \mathbf{y})$ drawn from a population with $f_*(x) = \mathbf{E}[\mathbf{y} | \mathbf{x} = x]$, specify a neural network model and run gradient flow on the weights over time until…

Machine Learning · Statistics 2020-07-27 Xialiang Dou , Tengyuan Liang

Causal discovery from observational data is an important tool in many branches of science. Under certain assumptions it allows scientists to explain phenomena, predict, and make decisions. In the large sample limit, sound and complete…

Machine Learning · Statistics 2021-07-13 Shami Nisimov , Yaniv Gurwicz , Raanan Y. Rohekar , Gal Novik

The causal dependence in data is often characterized by Directed Acyclic Graphical (DAG) models, widely used in many areas. Causal discovery aims to recover the DAG structure using observational data. This paper focuses on causal discovery…

Machine Learning · Computer Science 2024-06-12 Boxin Zhao , Weishi Wang , Dingyuan Zhu , Ziqi Liu , Dong Wang , Zhiqiang Zhang , Jun Zhou , Mladen Kolar

Conventional methods for causal structure learning from data face significant challenges due to combinatorial search space. Recently, the problem has been formulated into a continuous optimization framework with an acyclicity constraint to…

Machine Learning · Computer Science 2022-06-06 Hristo Petkov , Colin Hanley , Feng Dong

This paper develops a novel mathematical framework for collaborative learning by means of geometrically inspired kernel machines which includes statements on the bounds of generalisation and approximation errors, and sample complexity. For…

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

Numerical Analysis · Mathematics 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…

Machine Learning · Statistics 2019-05-15 Alberto Bietti , Grégoire Mialon , Dexiong Chen , Julien Mairal

Assuming a directed acyclic graph (DAG) that represents prior knowledge of causal relationships between variables is a common starting point for cause-effect estimation. Existing literature typically invokes hypothetical domain expert…

Machine Learning · Statistics 2025-03-11 Kirtan Padh , Zhufeng Li , Cecilia Casolo , Niki Kilbertus

Directed acyclic graphs (DAGs) are commonly used to represent causal relationships among random variables in graphical models. Applications of these models arise in the study of physical, as well as biological systems, where directed edges…

Machine Learning · Statistics 2009-12-01 Ali Shojaie , George Michailidis

Acyclic model, often depicted as a directed acyclic graph (DAG), has been widely employed to represent directional causal relations among collected nodes. In this article, we propose an efficient method to learn linear non-Gaussian DAG in…

Machine Learning · Statistics 2021-11-02 Ruixuan Zhao , Xin He , Junhui Wang

Causal models seek to unravel the cause-effect relationships among variables from observed data, as opposed to mere mappings among them, as traditional regression models do. This paper introduces a novel causal discovery algorithm designed…

Machine Learning · Computer Science 2024-10-03 Saeed Mohseni-Sehdeh , Walid Saad

We establish finite-sample guarantees for a polynomial-time algorithm for learning a nonlinear, nonparametric directed acyclic graphical (DAG) model from data. The analysis is model-free and does not assume linearity, additivity,…

Machine Learning · Statistics 2020-11-12 Ming Gao , Yi Ding , Bryon Aragam

This paper studies causal discovery for a directed acyclic graph under a structural equation model with additive heteroscedastic errors. We first establish new identifiability results for location-scale noise models, showing that…

Methodology · Statistics 2026-05-27 Xintao Xia , Li Chen , Yue Hu , Chunlin Li

We propose a new decentralized robust kernel-based learning algorithm within the framework of reproducing kernel Hilbert spaces (RKHSs) by utilizing a networked system that can be represented as a connected graph. The robust loss function…

Machine Learning · Computer Science 2025-08-18 Zhan Yu , Zhongjie Shi , Ding-Xuan Zhou

Reproducing Kernel Hilbert Space (RKHS) is the common mathematical platform for various kernel methods in machine learning. The purpose of kernel learning is to learn an appropriate RKHS according to different machine learning scenarios and…

Machine Learning · Computer Science 2021-02-19 Xinlong Lu , Zhengming Ma , Yuanping Lin