English
Related papers

Related papers: Extremal graphical modeling with latent variables …

200 papers

Training generative models that capture rich semantics of the data and interpreting the latent representations encoded by such models are very important problems in un-/self-supervised learning. In this work, we provide a simple algorithm…

Machine Learning · Computer Science 2024-09-02 Samuel C. Hoffman , Payel Das , Karthikeyan Shanmugam , Kahini Wadhawan , Prasanna Sattigeri

This paper studies the partial estimation of Gaussian graphical models from high-dimensional empirical observations. We derive a convex formulation for this problem using $\ell_1$-regularized maximum-likelihood estimation, which can be…

Machine Learning · Computer Science 2012-10-01 Xiao-Tong Yuan , Tong Zhang

Goal-conditioned planning benefits from learned low-dimensional representations of rich observations. While compact latent representations typically learned from variational autoencoders or inverse dynamics enable goal-conditioned decision…

We aim to analyze the behaviour of a finite-time stochastic system, whose model is not available, in the context of more rare and harmful outcomes. Standard estimators are not effective in making predictions about such outcomes due to their…

Methodology · Statistics 2022-07-29 Evan Arsenault , Yuheng Wang , Margaret P. Chapman

Graph neural networks have emerged as a powerful tool for learning spatiotemporal interactions. However, conventional approaches often rely on predefined graphs, which may obscure the precise relationships being modeled. Additionally,…

Machine Learning · Computer Science 2025-02-21 Jeehong Kim , Minchan Kim , Jaeseong Ju , Youngseok Hwang , Wonhee Lee , Hyunwoo Park

Causal dependence modelling of multivariate extremes is intended to improve our understanding of the relationships amongst variables associated with rare events. Regular variation provides a standard framework in the study of extremes. This…

Methodology · Statistics 2025-02-20 Mario Krali

We propose a novel strategy for multivariate extreme value index estimation. In applications such as finance, volatility and risk present in the components of a multivariate time series are often driven by the same underlying factors, such…

Statistics Theory · Mathematics 2020-03-24 Joni Virta , Niko Lietzén , Lauri Viitasaari , Pauliina Ilmonen

Advances in neural variational inference have facilitated the learning of powerful directed graphical models with continuous latent variables, such as variational autoencoders. The hope is that such models will learn to represent rich,…

Computation and Language · Computer Science 2017-09-26 Iulian V. Serban , Alexander G. Ororbia , Joelle Pineau , Aaron Courville

State-space graphical models and the variational autoencoder framework provide a principled apparatus for learning dynamical systems from data. State-of-the-art probabilistic approaches are often able to scale to large problems at the cost…

Machine Learning · Statistics 2024-11-05 Matthew Dowling , Yuan Zhao , Il Memming Park

We consider structure discovery of undirected graphical models from observational data. Inferring likely structures from few examples is a complex task often requiring the formulation of priors and sophisticated inference procedures.…

Machine Learning · Statistics 2017-08-04 Eugene Belilovsky , Kyle Kastner , Gaël Varoquaux , Matthew Blaschko

Graphical models are an important tool in exploring relationships between variables in complex, multivariate data. Methods for learning such graphical models are well developed in the case where all variables are either continuous or…

Machine Learning · Statistics 2024-02-15 Konstantin Göbler , Anne Miloschewski , Mathias Drton , Sach Mukherjee

This paper studies convex quadratic minimization problems in which each continuous variable is coupled with a binary indicator variable. We focus on the structured setting where the Hessian matrix of the quadratic term is positive definite…

Optimization and Control · Mathematics 2026-03-03 Aaresh Bhathena , Salar Fattahi , Andrés Gómez , Simge Küçükyavuz

We propose an approach for learning the causal structure in stochastic dynamical systems with a $1$-step functional dependency in the presence of latent variables. We propose an information-theoretic approach that allows us to recover the…

Information Theory · Computer Science 2017-01-25 Saber Salehkaleybar , Jalal Etesami , Negar Kiyavash

Extreme weather is one of the main mechanisms through which climate change will directly impact human society. Coping with such change as a global community requires markedly improved understanding of how global warming drives extreme…

Computational Physics · Physics 2019-09-18 Adam Rupe , Karthik Kashinath , Nalini Kumar , Victor Lee , Prabhat , James P. Crutchfield

We study online optimization problems in which the cost function depends on latent, time-varying parameters that are unmeasurable and governed by unknown dynamics. Specifically, we consider a strongly convex cost function whose linear term…

Optimization and Control · Mathematics 2026-05-22 Shivanshu Tripathi , Maziar Raissi

Most causal discovery procedures assume that there are no latent confounders in the system, which is often violated in real-world problems. In this paper, we consider a challenging scenario for causal structure identification, where some…

Machine Learning · Computer Science 2022-10-06 Biwei Huang , Charles Jia Han Low , Feng Xie , Clark Glymour , Kun Zhang

We consider the estimation and inference of graphical models that characterize the dependency structure of high-dimensional tensor-valued data. To facilitate the estimation of the precision matrix corresponding to each way of the tensor, we…

Machine Learning · Statistics 2019-02-27 Xiang Lyu , Will Wei Sun , Zhaoran Wang , Han Liu , Jian Yang , Guang Cheng

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

Recently, parallel text generation has received widespread attention due to its success in generation efficiency. Although many advanced techniques are proposed to improve its generation quality, they still need the help of an…

Computation and Language · Computer Science 2022-04-06 Yu Bao , Hao Zhou , Shujian Huang , Dongqi Wang , Lihua Qian , Xinyu Dai , Jiajun Chen , Lei Li

We consider the problem of learning high-dimensional Gaussian graphical models. The graphical lasso is one of the most popular methods for estimating Gaussian graphical models. However, it does not achieve the oracle rate of convergence. In…

Machine Learning · Statistics 2017-06-06 Qiang Sun , Kean Ming Tan , Han Liu , Tong Zhang