English
Related papers

Related papers: Learning Gaussian Tree Models: Analysis of Error E…

200 papers

Inference is typically intractable in high-treewidth undirected graphical models, making maximum likelihood learning a challenge. One way to overcome this is to restrict parameters to a tractable set, most typically the set of…

Machine Learning · Computer Science 2015-11-02 Justin Domke

The behavior of extreme observations is well-understood for time series or spatial data, but little is known if the data generating process is a structural causal model (SCM). We study the behavior of extremes in this model class, both for…

Methodology · Statistics 2025-03-11 Sebastian Engelke , Nicola Gnecco , Frank Röttger

Several structural learning algorithms for staged tree models, an asymmetric extension of Bayesian networks, have been defined. However, they do not scale efficiently as the number of variables considered increases. Here we introduce the…

Machine Learning · Statistics 2022-06-15 Manuele Leonelli , Gherardo Varando

This paper studies the problem of learning Bayesian networks from continuous observational data, generated according to a linear Gaussian structural equation model. We consider an $\ell_0$-penalized maximum likelihood estimator for this…

Machine Learning · Statistics 2025-10-14 Tong Xu , Simge Küçükyavuz , Ali Shojaie , Armeen Taeb

Generalised linear models for multi-class classification problems are one of the fundamental building blocks of modern machine learning tasks. In this manuscript, we characterise the learning of a mixture of $K$ Gaussians with generic means…

Hidden tree Markov models allow learning distributions for tree structured data while being interpretable as nondeterministic automata. We provide a concise summary of the main approaches in literature, focusing in particular on the…

Machine Learning · Statistics 2018-06-01 Davide Bacciu , Daniele Castellana

Undirected graphical models, or Markov networks, are a popular class of statistical models, used in a wide variety of applications. Popular instances of this class include Gaussian graphical models and Ising models. In many settings,…

Statistics Theory · Mathematics 2015-09-08 Eunho Yang , Pradeep Ravikumar , Genevera I. Allen , Zhandong Liu

Due to the increasing complexity of technical systems, accurate first principle models can often not be obtained. Supervised machine learning can mitigate this issue by inferring models from measurement data. Gaussian process regression is…

Systems and Control · Electrical Eng. & Systems 2023-07-11 Armin Lederer , Jonas Umlauft , Sandra Hirche

We investigate the problem of learning the structure of a Markov network from data. It is shown that the structure of such networks can be described in terms of constraints which enables the use of existing solver technology with…

Artificial Intelligence · Computer Science 2013-10-04 Jukka Corander , Tomi Janhunen , Jussi Rintanen , Henrik Nyman , Johan Pensar

We study the problem of learning a tree Ising model from samples such that subsequent predictions made using the model are accurate. The prediction task considered in this paper is that of predicting the values of a subset of variables…

Statistics Theory · Mathematics 2018-06-15 Guy Bresler , Mina Karzand

Geometric trees are characterized by their tree-structured layout and spatially constrained nodes and edges, which significantly impacts their topological attributes. This inherent hierarchical structure plays a crucial role in domains such…

Machine Learning · Computer Science 2024-08-19 Zheng Zhang , Allen Zhang , Ruth Nelson , Giorgio Ascoli , Liang Zhao

In computational physics, machine learning has now emerged as a powerful complementary tool to explore efficiently candidate designs in engineering studies. Outputs in such supervised problems are signals defined on meshes, and a natural…

Machine Learning · Statistics 2025-03-11 Raphaël Carpintero Perez , Sébastien da Veiga , Josselin Garnier , Brian Staber

We present a numerical study of topological descriptors of initially Gaussian and scale-free density perturbations evolving via gravitational instability in an expanding universe. We carefully evaluate and avoid numerical contamination in…

Astrophysics · Physics 2009-10-31 Stephane Colombi , Dmitry Pogosyan , Tarun Souradeep

Graphical models and factor analysis are well-established tools in multivariate statistics. While these models can be both linked to structures exhibited by covariance and precision matrices, they are generally not jointly leveraged within…

Machine Learning · Statistics 2023-08-02 Alexandre Hippert-Ferrer , Florent Bouchard , Ammar Mian , Titouan Vayer , Arnaud Breloy

Recursive max-linear vectors model causal dependence between its components by expressing each node variable as a max-linear function of its parental nodes in a directed acyclic graph and some exogenous innovation. Motivated by extreme…

Methodology · Statistics 2019-12-10 Claudia Klüppelberg , Mario Krali

While on some natural distributions, neural-networks are trained efficiently using gradient-based algorithms, it is known that learning them is computationally hard in the worst-case. To separate hard from easy to learn distributions, we…

Machine Learning · Computer Science 2020-01-22 Eran Malach , Shai Shalev-Shwartz

The error exponent of the typical random code is defined as the asymptotic normalized expectation of the logarithm of the probability of error, as opposed to the traditional definition of the random coding exponent as the normalized…

Information Theory · Computer Science 2018-12-18 Neri Merhav

High-dimensional data analysis typically focuses on low-dimensional structure, often to aid interpretation and computational efficiency. Graphical models provide a powerful methodology for learning the conditional independence structure in…

Methodology · Statistics 2024-09-13 Maria De Iorio , Willem van den Boom , Alexandros Beskos , Ajay Jasra , Andrea Cremaschi

We consider general Gaussian latent tree models in which the observed variables are not restricted to be leaves of the tree. Extending related recent work, we give a full semi-algebraic description of the set of covariance matrices of any…

Statistics Theory · Mathematics 2018-10-30 Dennis Leung , Mathias Drton

We consider the problem of kernel classification. While worst-case bounds on the decay rate of the prediction error with the number of samples are known for some classifiers, they often fail to accurately describe the learning curves of…

Machine Learning · Statistics 2023-09-07 Hugo Cui , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová