English
Related papers

Related papers: Efficient Learning of Discrete Graphical Models

200 papers

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

Machine Learning · Computer Science 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

A new line of research for feature selection based on neural networks has recently emerged. Despite its superiority to classical methods, it requires many training iterations to converge and detect informative features. The computational…

Machine Learning · Computer Science 2022-11-29 Ghada Sokar , Zahra Atashgahi , Mykola Pechenizkiy , Decebal Constantin Mocanu

We consider the problem of learning a conditional Gaussian graphical model in the presence of latent variables. Building on recent advances in this field, we suggest a method that decomposes the parameters of a conditional Markov random…

Methodology · Statistics 2017-03-07 Benjamin Frot , Luke Jostins , Gil McVean

The rapid expansion in the size of new datasets has created a need for fast and efficient parameter-learning techniques. Compressive learning is a framework that enables efficient processing by using random, non-linear features to project…

Machine Learning · Computer Science 2025-08-18 Daniel Mas Montserrat , David Bonet , Maria Perera , Xavier Giró-i-Nieto , Alexander G. Ioannidis

Structure learning of Gaussian graphical models is an extensively studied problem in the classical multivariate setting where the sample size n is larger than the number of random variables p, as well as in the more challenging setting when…

Methodology · Statistics 2012-02-20 Inma Tur , Robert Castelo

Recent interactive segmentation methods iteratively take source image, user guidance and previously predicted mask as the input without considering the invariant nature of the source image. As a result, extracting features from the source…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Huimin Zeng , Weinong Wang , Xin Tao , Zhiwei Xiong , Yu-Wing Tai , Wenjie Pei

Graphical model has been widely used to investigate the complex dependence structure of high-dimensional data, and it is common to assume that observed data follow a homogeneous graphical model. However, observations usually come from…

Methodology · Statistics 2016-01-01 Kevin Lee , Lingzhou Xue

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He

We propose a framework for the joint inference of network topology, multi-type interaction kernels, and latent type assignments in heterogeneous interacting particle systems from multi-trajectory data. This learning task is a challenging…

Machine Learning · Statistics 2026-02-05 Quanjun Lang , Xiong Wang , Fei Lu , Mauro Maggioni

Temporal networks of face-to-face interactions between individuals are useful proxies of the dynamics of social systems on fast time scales. Several empirical statistical properties of these networks have been shown to be robust across a…

Physics and Society · Physics 2023-02-03 Didier Le Bail , Mathieu Génois , Alain Barrat

We outline a representation for discrete multivariate distributions in terms of interventional potential functions that are globally normalized. This representation can be used to model the effects of interventions, and the independence…

Machine Learning · Statistics 2012-05-14 Mark Schmidt , Kevin Murphy

We develop an interpolation-based modeling framework for parameter-dependent partial differential equations arising in control, inverse problems, and uncertainty quantification. The solution is discretized in the physical domain using…

Numerical Analysis · Mathematics 2026-04-20 Erik Burman , Mats G. Larson , Karl Larsson , Jonatan Vallin

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chen Zhang , Riccardo Barbano , Bangti Jin

We present a statistical framework to benchmark the performance of reconstruction algorithms for linear inverse problems, in particular, neural-network-based methods that require large quantities of training data. We generate synthetic…

Signal Processing · Electrical Eng. & Systems 2023-07-05 Pakshal Bohra , Pol del Aguila Pla , Jean-François Giovannelli , Michael Unser

Learning features from data is one of the defining characteristics of deep learning, but our theoretical understanding of the role features play in deep learning is still rudimentary. To address this gap, we introduce a new tool, the…

Machine Learning · Computer Science 2023-06-09 Yiding Jiang , Christina Baek , J. Zico Kolter

We provide a methodology for learning sparse statistical models that use as features all possible multiplicative interactions among an underlying atomic set of features. While the resulting optimization problems are exponentially sized, our…

Machine Learning · Computer Science 2020-02-11 Hristo Paskov , Alex Paskov , Robert West

The graphical lasso is a widely used algorithm for fitting undirected Gaussian graphical models. However, for inference on functionals of edge values in the learned graph, standard tools lack formal statistical guarantees, such as control…

Methodology · Statistics 2025-04-01 Sofia Guglielmini , Gerda Claeskens , Snigdha Panigrahi

Visual place recognition is an important subproblem of mobile robot localization. Since it is a special case of image retrieval, the basic source of information is the pairwise similarity of image descriptors. However, the embedding of the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Stefan Schubert , Peer Neubert , Peter Protzel

Training neural network models with discrete (categorical or structured) latent variables can be computationally challenging, due to the need for marginalization over large or combinatorial sets. To circumvent this issue, one typically…

Machine Learning · Computer Science 2020-12-29 Gonçalo M. Correia , Vlad Niculae , Wilker Aziz , André F. T. Martins

The problem of joint estimation of multiple graphical models from high dimensional data has been studied in the statistics and machine learning literature, due to its importance in diverse fields including molecular biology, neuroscience…

Methodology · Statistics 2019-07-04 Peyman Jalali , Kshitij Khare , George Michailidis