English
Related papers

Related papers: Robust Learning of Fixed-Structure Bayesian Networ…

200 papers

Learning-based methods for inverse problems, adapting to the data's inherent structure, have become ubiquitous in the last decade. Besides empirical investigations of their often remarkable performance, an increasing number of works…

Numerical Analysis · Mathematics 2023-07-21 Clemens Arndt , Sören Dittmer , Nick Heilenkötter , Meira Iske , Tobias Kluth , Judith Nickel

We give the first polynomial-time algorithm for performing linear or polynomial regression resilient to adversarial corruptions in both examples and labels. Given a sufficiently large (polynomial-size) training set drawn i.i.d. from…

Machine Learning · Computer Science 2020-06-05 Adam Klivans , Pravesh K. Kothari , Raghu Meka

We study the problem of robust linear regression with response variable corruptions. We consider the oblivious adversary model, where the adversary corrupts a fraction of the responses in complete ignorance of the data. We provide a nearly…

Machine Learning · Computer Science 2019-03-21 Arun Sai Suggala , Kush Bhatia , Pradeep Ravikumar , Prateek Jain

The diagnosis of cyber-physical systems aims to detect faulty behaviour, its root cause and a mitigation or even prevention policy. Therefore, diagnosis relies on a representation of the system's functional and faulty behaviour combined…

Machine Learning · Computer Science 2021-10-13 Nicolas Olivain , Philipp Tiefenbacher , Jens Kohl

Learning Bayesian networks is often cast as an optimization problem, where the computational task is to find a structure that maximizes a statistically motivated score. By and large, existing learning tools address this optimization problem…

Machine Learning · Computer Science 2013-01-30 Nir Friedman , Iftach Nachman , Dana Pe'er

Bayesian network structure learning is the notoriously difficult problem of discovering a Bayesian network that optimally represents a given set of training data. In this paper we study the computational worst-case complexity of exact…

Artificial Intelligence · Computer Science 2014-02-05 Sebastian Ordyniak , Stefan Szeider

This work initiates a systematic investigation of testing high-dimensional structured distributions by focusing on testing Bayesian networks -- the prototypical family of directed graphical models. A Bayesian network is defined by a…

Data Structures and Algorithms · Computer Science 2020-01-28 Clement Canonne , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

We consider online similarity prediction problems over networked data. We begin by relating this task to the more standard class prediction problem, showing that, given an arbitrary algorithm for class prediction, we can construct an…

Machine Learning · Computer Science 2013-03-18 Claudio Gentile , Mark Herbster , Stephen Pasteris

The adaptive processing of structured data is a long-standing research topic in machine learning that investigates how to automatically learn a mapping from a structured input to outputs of various nature. Recently, there has been an…

Machine Learning · Computer Science 2022-02-28 Federico Errica

Learning Bayesian networks from raw data can help provide insights into the relationships between variables. While real data often contains a mixture of discrete and continuous-valued variables, many Bayesian network structure learning…

Artificial Intelligence · Computer Science 2018-09-19 Yi-Chun Chen , Tim Allan Wheeler , Mykel John Kochenderfer

We study the Bayesian model averaging approach to learning Bayesian network structures (DAGs) from data. We develop new algorithms including the first algorithm that is able to efficiently sample DAGs according to the exact structure…

Artificial Intelligence · Computer Science 2015-01-20 Ru He , Jin Tian , Huaiqing Wu

We explore why many recently proposed robust estimation problems are efficiently solvable, even though the underlying optimization problems are non-convex. We study the loss landscape of these robust estimation problems, and identify the…

Machine Learning · Statistics 2020-05-29 Banghua Zhu , Jiantao Jiao , Jacob Steinhardt

We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on…

Machine Learning · Computer Science 2021-02-24 Matthew Wicker , Luca Laurenti , Andrea Patane , Zhoutong Chen , Zheng Zhang , Marta Kwiatkowska

This paper extends the work in [Suzuki, 1996] and presents an efficient depth-first branch-and-bound algorithm for learning Bayesian network structures, based on the minimum description length (MDL) principle, for a given (consistent)…

Artificial Intelligence · Computer Science 2013-01-18 Jin Tian

We present a distributed (non-Bayesian) learning algorithm for the problem of parameter estimation with Gaussian noise. The algorithm is expressed as explicit updates on the parameters of the Gaussian beliefs (i.e. means and precision). We…

Optimization and Control · Mathematics 2016-12-08 Angelia Nedić , Alex Olshevsky , César A. Uribe

We study the problem of learning the structure of an optimal Bayesian network when additional constraints are posed on the network or on its moralized graph. More precisely, we consider the constraint that the network or its moralized graph…

Data Structures and Algorithms · Computer Science 2022-07-12 Niels Grüttemeier , Christian Komusiewicz

We study a fundamental problem in Bayesian learning, where the goal is to select a set of data sources with minimum cost while achieving a certain learning performance based on the data streams provided by the selected data sources. First,…

Machine Learning · Computer Science 2021-05-04 Lintao Ye , Aritra Mitra , Shreyas Sundaram

In this paper we extend the work of Smith and Papamichail (1999) and present fast approximate Bayesian algorithms for learning in complex scenarios where at any time frame, the relationships between explanatory state space variables can be…

Machine Learning · Computer Science 2013-01-30 Raffaella Settimi , Jim Q. Smith , A. S. Gargoum

Bayesian structure learning is the NP-hard problem of discovering a Bayesian network that optimally represents a given set of training data. In this paper we study the computational worst-case complexity of exact Bayesian structure learning…

Machine Learning · Computer Science 2012-03-19 Sebastian Ordyniak , Stefan Szeider

One of the most challenging tasks when adopting Bayesian Networks (BNs) is the one of learning their structure from data. This task is complicated by the huge search space of possible solutions, and by the fact that the problem is NP-hard.…

Machine Learning · Computer Science 2018-08-07 Stefano Beretta , Mauro Castelli , Ivo Goncalves , Roberto Henriques , Daniele Ramazzotti