English
Related papers

Related papers: Fast structure learning with modular regularizatio…

200 papers

Vector autoregression (VAR) is a fundamental tool for modeling multivariate time series. However, as the number of component series is increased, the VAR model becomes overparameterized. Several authors have addressed this issue by…

Methodology · Statistics 2020-09-09 William B. Nicholson , Ines Wilms , Jacob Bien , David S. Matteson

Multivariate time-series forecasting is a critical task for many applications, and graph time-series network is widely studied due to its capability to capture the spatial-temporal correlation simultaneously. However, most existing works…

Machine Learning · Computer Science 2022-10-14 Hongyuan Yu , Ting Li , Weichen Yu , Jianguo Li , Yan Huang , Liang Wang , Alex Liu

High-dimensional data sets are often analyzed and explored via the construction of a latent low-dimensional space which enables convenient visualization and efficient predictive modeling or clustering. For complex data structures, linear…

Machine Learning · Computer Science 2022-05-25 Oskar Allerbo , Rebecka Jörnsten

Decoding human brain activities via functional magnetic resonance imaging (fMRI) has gained increasing attention in recent years. While encouraging results have been reported in brain states classification tasks, reconstructing the details…

Artificial Intelligence · Computer Science 2017-07-12 Changde Du , Changying Du , Huiguang He

Most causal discovery procedures assume that there are no latent confounders in the system, which is often violated in real-world problems. In this paper, we consider a challenging scenario for causal structure identification, where some…

Machine Learning · Computer Science 2022-10-06 Biwei Huang , Charles Jia Han Low , Feng Xie , Clark Glymour , Kun Zhang

We study the problem of recovering the structure underlying large Gaussian graphical models or, more generally, partial correlation graphs. In high-dimensional problems it is often too costly to store the entire sample covariance matrix. We…

Statistics Theory · Mathematics 2021-10-13 Gábor Lugosi , Jakub Truszkowski , Vasiliki Velona , Piotr Zwiernik

This paper presents a novel method for structural data recognition using a large number of graph models. In general, prevalent methods for structural data recognition have two shortcomings: 1) Only a single model is used to capture…

Machine Learning · Computer Science 2020-04-15 Tomo Miyazaki , Shinichiro Omachi

Neural models for NLP typically use large numbers of parameters to reach state-of-the-art performance, which can lead to excessive memory usage and increased runtime. We present a structure learning method for learning sparse,…

Computation and Language · Computer Science 2019-09-09 Jesse Dodge , Roy Schwartz , Hao Peng , Noah A. Smith

Deep Neural Networks have achieved remarkable success relying on the developing high computation capability of GPUs and large-scale datasets with increasing network depth and width in image recognition, object detection and many other…

Machine Learning · Computer Science 2020-01-08 E Zhenqian , Gao Weiguo

A multivariate quantile regression model with a factor structure is proposed to study data with many responses of interest. The factor structure is allowed to vary with the quantile levels, which makes our framework more flexible than the…

Methodology · Statistics 2020-01-22 Shih-Kang Chao , Wolfgang Karl Härdle , Ming Yuan

The problem of structure estimation in graphical models with latent variables is considered. We characterize conditions for tractable graph estimation and develop efficient methods with provable guarantees. We consider models where the…

Machine Learning · Statistics 2013-04-23 Animashree Anandkumar , Ragupathyraj Valluvan

This thesis focuses on data that has complex spatio-temporal structure and on probabilistic graphical models that learn the structure in an interpretable and scalable manner. We target two research areas of interest: Gaussian graphical…

Machine Learning · Computer Science 2023-01-18 Yu Wang

Statistical learning in high-dimensional spaces is challenging without a strong underlying data structure. Recent advances with foundational models suggest that text and image data contain such hidden structures, which help mitigate the…

Machine Learning · Statistics 2025-02-04 Charles Arnal , Clement Berenfeld , Simon Rosenberg , Vivien Cabannes

Latent variable models are an elegant framework for capturing rich probabilistic dependencies in many applications. However, current approaches typically parametrize these models using conditional probability tables, and learning relies…

Machine Learning · Computer Science 2012-10-19 Ankur P. Parikh , Le Song , Mariya Ishteva , Gabi Teodoru , Eric P. Xing

In genomic analysis, biomarker discovery, image recognition, and other systems involving machine learning, input variables can often be organized into different groups by their source or semantic category. Eliminating some groups of…

Machine Learning · Computer Science 2019-12-02 Beibin Li , Nicholas Nuechterlein , Erin Barney , Caitlin Hudac , Pamela Ventola , Linda Shapiro , Frederick Shic

Sparse regression and feature extraction are the cornerstones of knowledge discovery from massive data. Their goal is to discover interpretable and predictive models that provide simple relationships among scientific variables. While the…

Machine Learning · Computer Science 2024-01-17 Jeremy A. McCulloch , Skyler R. St. Pierre , Kevin Linka , Ellen Kuhl

Graphical models and factor analysis are well-established tools in multivariate statistics. While these models can be both linked to structures exhibited by covariance and precision matrices, they are generally not jointly leveraged within…

Machine Learning · Statistics 2023-08-02 Alexandre Hippert-Ferrer , Florent Bouchard , Ammar Mian , Titouan Vayer , Arnaud Breloy

We consider the problem of joint estimation of structured covariance matrices. Assuming the structure is unknown, estimation is achieved using heterogeneous training sets. Namely, given groups of measurements coming from centered…

Statistics Theory · Mathematics 2016-04-20 Ilya Soloveychik , Ami Wiesel

Recently there has been substantial interest in spectral methods for learning dynamical systems. These methods are popular since they often offer a good tradeoff between computational and statistical efficiency. Unfortunately, they can be…

Machine Learning · Statistics 2015-11-05 Ahmed Hefny , Carlton Downey , Geoffrey Gordon

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…