English
Related papers

Related papers: Learning Pairwise Graphical Models with Nonlinear …

200 papers

Inspired by applications in sports where the skill of players or teams competing against each other varies over time, we propose a probabilistic model of pairwise-comparison outcomes that can capture a wide range of time dynamics. We…

Machine Learning · Statistics 2019-05-20 Lucas Maystre , Victor Kristof , Matthias Grossglauser

Gaussian Graphical Models (GGM) are often used to describe the conditional correlations between the components of a random vector. In this article, we compare two families of GGM inference methods: nodewise edge selection and penalised…

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

Computational efficient evaluation of penalized estimators of multivariate exponential family distributions is sought. These distributions encompass among others Markov random fields with variates of mixed type (e.g. binary and continuous)…

Methodology · Statistics 2020-12-29 Diederik S. Laman Trip , Wessel N. van Wieringen

We study maximum likelihood estimation in log-linear models under conditional Poisson sampling schemes. We derive necessary and sufficient conditions for existence of the maximum likelihood estimator (MLE) of the model parameters and…

Statistics Theory · Mathematics 2012-07-24 Stephen E. Fienberg , Alessandro Rinaldo

Graphical models are usually learned without regard to the cost of doing inference with them. As a result, even if a good model is learned, it may perform poorly at prediction, because it requires approximate inference. We propose an…

Artificial Intelligence · Computer Science 2012-06-18 Daniel Lowd , Pedro Domingos

We consider the problem of learning the underlying graph of a sparse Ising model with $p$ nodes from $n$ i.i.d. samples. The most recent and best performing approaches combine an empirical loss (the logistic regression loss or the…

Machine Learning · Statistics 2021-09-17 Antoine Dedieu , Miguel Lázaro-Gredilla , Dileep George

Probabilistic Graphical Models are often used to understand dynamics of a system. They can model relationships between features (nodes) and the underlying distribution. Theoretically these models can represent very complex dependency…

Machine Learning · Computer Science 2023-08-21 Harsh Shrivastava , Urszula Chajewska

Ising models describe the joint probability distribution of a vector of binary feature variables. Typically, not all the variables interact with each other and one is interested in learning the presumably sparse network structure of the…

Machine Learning · Computer Science 2019-07-09 Frank Nussbaum , Joachim Giesen

Deep metric learning (DML) has received much attention in deep learning due to its wide applications in computer vision. Previous studies have focused on designing complicated losses and hard example mining methods, which are mostly…

Machine Learning · Computer Science 2020-06-19 Qi Qi , Yan Yan , Xiaoyu Wang , Tianbao Yang

We discuss the problem of extending data mining approaches to cases in which data points arise in the form of individual graphs. Being able to find the intrinsic low-dimensionality in ensembles of graphs can be useful in a variety of…

Social and Information Networks · Computer Science 2016-12-12 Karthikeyan Rajendran , Assimakis A. Kattis , Alexander Holiday , Risi Kondor , Ioannis G. Kevrekidis

Inference tasks in signal processing are often characterized by the availability of reliable statistical modeling with some missing instance-specific parameters. One conventional approach uses data to estimate these missing parameters and…

Signal Processing · Electrical Eng. & Systems 2023-04-25 Nir Shlezinger , Tirza Routtenberg

Systems of interacting particles or agents have wide applications in many disciplines such as Physics, Chemistry, Biology and Economics. These systems are governed by interaction laws, which are often unknown: estimating them from…

Machine Learning · Statistics 2020-07-16 Fei Lu , Mauro Maggioni , Sui Tang

Classical penalized likelihood regression problems deal with the case that the independent variables data are known exactly. In practice, however, it is common to observe data with incomplete covariate information. We are concerned with a…

Methodology · Statistics 2010-08-04 Xiwen Ma , Bin Dai , Ronald Klein , Barbara E. K. Klein , Kristine E. Lee , Grace Wahba

In this paper we are concerned with the learnability of nonlocal interaction kernels for first order systems modeling certain social interactions, from observations of realizations of their dynamics. This paper is the first of a series on…

Dynamical Systems · Mathematics 2016-02-17 Mattia Bongini , Massimo Fornasier , Markus Hansen , Mauro Maggioni

In undirected graphical models, learning the graph structure and learning the functions that relate the predictive variables (features) to the responses given the structure are two topics that have been widely investigated in machine…

Artificial Intelligence · Computer Science 2015-03-19 Shilin Ding

With the wide-spread availability of complex relational data, semi-supervised node classification in graphs has become a central machine learning problem. Graph neural networks are a recent class of easy-to-train and accurate methods for…

Machine Learning · Computer Science 2021-06-08 Junteng Jia , Cenk Baykal , Vamsi K. Potluru , Austin R. Benson

We introduce a sufficient graphical model by applying the recently developed nonlinear sufficient dimension reduction techniques to the evaluation of conditional independence. The graphical model is nonparametric in nature, as it does not…

Machine Learning · Statistics 2023-07-11 Bing Li , Kyongwon Kim

Motivated by the problem of inferring the graph structure of functional connectivity networks from multi-level functional magnetic resonance imaging data, we develop a valid inference framework for high-dimensional graphical models that…

Methodology · Statistics 2024-03-18 Kun Yue , Eardi Lila , Ali Shojaie

We consider the classical problem of learning, with arbitrary accuracy, the natural parameters of a $k$-parameter truncated \textit{minimal} exponential family from i.i.d. samples in a computationally and statistically efficient manner. We…

Machine Learning · Computer Science 2023-09-13 Abhin Shah , Devavrat Shah , Gregory W. Wornell